[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.690416  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:44877
I20260709 12:08:15.692116  9938 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.693326  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.711234  9945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.711262  9947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.711336  9944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.712618  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:16.918310  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.918655  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.918828  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598896918809 us; error 0 us; skew 500 ppm
I20260709 12:08:16.919697  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.925956  9938 webserver.cc:533] Webserver started at http://127.9.180.190:42351/ using document root <none> and password file <none>
I20260709 12:08:16.927013  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.927248  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.927714  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.934386  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "7bc3b22c56df40819b417dd6b2bfa886"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-lg8f"
I20260709 12:08:16.943787  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:08:16.949975  9953 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.951802  9938 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 12:08:16.952212  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "7bc3b22c56df40819b417dd6b2bfa886"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-lg8f"
I20260709 12:08:16.952565  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.014015  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.015815  9938 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:17.016273  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.099766  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:44877
I20260709 12:08:17.099858 10004 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:44877 every 8 connection(s)
I20260709 12:08:17.108912 10005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.132546 10005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886: Bootstrap starting.
I20260709 12:08:17.139348 10005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.141418 10005 log.cc:826] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:17.147336 10005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886: No bootstrap required, opened a new log
I20260709 12:08:17.168530 10005 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc3b22c56df40819b417dd6b2bfa886" member_type: VOTER }
I20260709 12:08:17.169126 10005 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.169471 10005 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bc3b22c56df40819b417dd6b2bfa886, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.170539 10005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc3b22c56df40819b417dd6b2bfa886" member_type: VOTER }
I20260709 12:08:17.171240 10005 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:17.171598 10005 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:17.171975 10005 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.176211 10005 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc3b22c56df40819b417dd6b2bfa886" member_type: VOTER }
I20260709 12:08:17.176987 10005 leader_election.cc:304] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bc3b22c56df40819b417dd6b2bfa886; no voters: 
I20260709 12:08:17.179095 10005 leader_election.cc:290] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:17.179593 10008 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.182472 10008 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 1 LEADER]: Becoming Leader. State: Replica: 7bc3b22c56df40819b417dd6b2bfa886, State: Running, Role: LEADER
I20260709 12:08:17.183547 10008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc3b22c56df40819b417dd6b2bfa886" member_type: VOTER }
I20260709 12:08:17.184933 10005 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:17.197463 10010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bc3b22c56df40819b417dd6b2bfa886. Latest consensus state: current_term: 1 leader_uuid: "7bc3b22c56df40819b417dd6b2bfa886" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc3b22c56df40819b417dd6b2bfa886" member_type: VOTER } }
I20260709 12:08:17.198573 10010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.198892 10009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bc3b22c56df40819b417dd6b2bfa886" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bc3b22c56df40819b417dd6b2bfa886" member_type: VOTER } }
I20260709 12:08:17.199478 10009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.201823 10018 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:17.216534 10018 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:17.219255  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:17.235219 10018 catalog_manager.cc:1383] Generated new cluster ID: 307cba1ab5b2495d97ff0aa87f8e31a4
I20260709 12:08:17.235564 10018 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:17.252887 10018 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:17.255169 10018 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:17.284935 10018 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886: Generated new TSK 0
I20260709 12:08:17.285953 10018 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:17.350683  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.359396 10027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.361531 10028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.365934 10030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.366760  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:17.367575  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.367856  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.368036  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598897368016 us; error 0 us; skew 500 ppm
I20260709 12:08:17.368698  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.373754  9938 webserver.cc:533] Webserver started at http://127.9.180.129:46755/ using document root <none> and password file <none>
I20260709 12:08:17.374351  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.374604  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.374925  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.376183  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "ec5acd67848b447499287098a35ebb6b"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-lg8f"
I20260709 12:08:17.382481  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:08:17.387620 10035 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.388687  9938 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:08:17.389140  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "ec5acd67848b447499287098a35ebb6b"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-lg8f"
I20260709 12:08:17.389547  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.427747  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.429510  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.432533  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.438046  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.438462  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.438915  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.439155  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.535145  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:38337
I20260709 12:08:17.535247 10097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:38337 every 8 connection(s)
I20260709 12:08:17.543455  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.556995 10102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.561401 10103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.569164 10105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.569761  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:17.570972  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.571254  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.571475  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598897571458 us; error 0 us; skew 500 ppm
I20260709 12:08:17.572253  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.576809  9938 webserver.cc:533] Webserver started at http://127.9.180.130:35247/ using document root <none> and password file <none>
I20260709 12:08:17.576879 10098 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44877
I20260709 12:08:17.577442 10098 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.577525  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.577845  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.578194  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.578765 10098 heartbeater.cc:507] Master 127.9.180.190:44877 requested a full tablet report, sending...
I20260709 12:08:17.579761  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "d32609c695c849399ab492ee45929a18"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-lg8f"
I20260709 12:08:17.582113  9970 ts_manager.cc:194] Registered new tserver with Master: ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337)
I20260709 12:08:17.584611  9970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48328
I20260709 12:08:17.587216  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:17.592760 10110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.594197  9938 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:17.594590  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "d32609c695c849399ab492ee45929a18"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-lg8f"
I20260709 12:08:17.594955  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.614372  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.616024  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.618566  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.622246  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.622517  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.622795  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.623010  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.712509  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:40987
I20260709 12:08:17.712849 10172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:40987 every 8 connection(s)
I20260709 12:08:17.721524  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.732398 10177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.733538 10173 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44877
I20260709 12:08:17.734678 10173 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.735822 10173 heartbeater.cc:507] Master 127.9.180.190:44877 requested a full tablet report, sending...
W20260709 12:08:17.737406 10176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.738865  9970 ts_manager.cc:194] Registered new tserver with Master: d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
W20260709 12:08:17.740666 10179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.741027  9970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48338
I20260709 12:08:17.742247  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:17.743428  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.743721  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.743947  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598897743925 us; error 0 us; skew 500 ppm
I20260709 12:08:17.744658  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.747439  9938 webserver.cc:533] Webserver started at http://127.9.180.131:35759/ using document root <none> and password file <none>
I20260709 12:08:17.747957  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.748199  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.748485  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.749578  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "7c61023420ee4416be7227108fc4997e"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-lg8f"
I20260709 12:08:17.754601  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:08:17.758139 10184 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.759173  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:17.759497  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "7c61023420ee4416be7227108fc4997e"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-lg8f"
I20260709 12:08:17.759821  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.800112  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.801519  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.803261  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.805501  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.805742  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.805996  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.806180  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.911937  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:35757
I20260709 12:08:17.912708 10246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:35757 every 8 connection(s)
I20260709 12:08:17.932886 10247 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44877
I20260709 12:08:17.933370 10247 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.934365 10247 heartbeater.cc:507] Master 127.9.180.190:44877 requested a full tablet report, sending...
I20260709 12:08:17.936725  9970 ts_manager.cc:194] Registered new tserver with Master: 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:17.937494  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019358947s
I20260709 12:08:17.938246  9970 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48340
I20260709 12:08:17.999468  9970 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48346:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:18.004362  9970 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:18.108991 10060 tablet_service.cc:1511] Processing CreateTablet for tablet 7db88b9029294216a2e2e88afe697936 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.110857 10063 tablet_service.cc:1511] Processing CreateTablet for tablet c39450530f534b78bff65b2f726addcb (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.112547 10063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39450530f534b78bff65b2f726addcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.116287 10062 tablet_service.cc:1511] Processing CreateTablet for tablet 19e76e9bb7334422a15a38d27d807b9a (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.117856 10061 tablet_service.cc:1511] Processing CreateTablet for tablet 91adfb3e132f4900bccde1db122dc9e3 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.119145 10062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e76e9bb7334422a15a38d27d807b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.122933 10060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db88b9029294216a2e2e88afe697936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.123859 10061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91adfb3e132f4900bccde1db122dc9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.127385 10212 tablet_service.cc:1511] Processing CreateTablet for tablet c39450530f534b78bff65b2f726addcb (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.128789 10212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39450530f534b78bff65b2f726addcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.131135 10210 tablet_service.cc:1511] Processing CreateTablet for tablet 91adfb3e132f4900bccde1db122dc9e3 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.131611 10211 tablet_service.cc:1511] Processing CreateTablet for tablet 19e76e9bb7334422a15a38d27d807b9a (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.135643 10059 tablet_service.cc:1511] Processing CreateTablet for tablet 691d415d3fa14a05b99784e440c86b93 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.136478 10209 tablet_service.cc:1511] Processing CreateTablet for tablet 7db88b9029294216a2e2e88afe697936 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.146615 10210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91adfb3e132f4900bccde1db122dc9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.147089 10059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d415d3fa14a05b99784e440c86b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.152294 10209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db88b9029294216a2e2e88afe697936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.156049 10211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e76e9bb7334422a15a38d27d807b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.176963 10058 tablet_service.cc:1511] Processing CreateTablet for tablet 72abff819e4f45a188c9134a4df24985 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.177232 10208 tablet_service.cc:1511] Processing CreateTablet for tablet 691d415d3fa14a05b99784e440c86b93 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.179021 10058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72abff819e4f45a188c9134a4df24985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.179368 10208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d415d3fa14a05b99784e440c86b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.196388 10207 tablet_service.cc:1511] Processing CreateTablet for tablet 72abff819e4f45a188c9134a4df24985 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 12:08:18.205103 10017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.206602 10207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72abff819e4f45a188c9134a4df24985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.221099 10057 tablet_service.cc:1511] Processing CreateTablet for tablet 654c53d34f0e4a9f8185ab4f2c22f8e6 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.226835 10057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654c53d34f0e4a9f8185ab4f2c22f8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.231168 10206 tablet_service.cc:1511] Processing CreateTablet for tablet 654c53d34f0e4a9f8185ab4f2c22f8e6 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.243943 10206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654c53d34f0e4a9f8185ab4f2c22f8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.247423 10138 tablet_service.cc:1511] Processing CreateTablet for tablet c39450530f534b78bff65b2f726addcb (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.268144 10056 tablet_service.cc:1511] Processing CreateTablet for tablet d86fd2e180be48b68f2c6f4d426bb4d7 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.265120 10138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39450530f534b78bff65b2f726addcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.273242 10137 tablet_service.cc:1511] Processing CreateTablet for tablet 19e76e9bb7334422a15a38d27d807b9a (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.277897 10056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86fd2e180be48b68f2c6f4d426bb4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.288326 10137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e76e9bb7334422a15a38d27d807b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.288261 10136 tablet_service.cc:1511] Processing CreateTablet for tablet 91adfb3e132f4900bccde1db122dc9e3 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.292433 10136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91adfb3e132f4900bccde1db122dc9e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.296361 10265 tablet_bootstrap.cc:492] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.296380 10055 tablet_service.cc:1511] Processing CreateTablet for tablet ab037a37579a4b29ac83ae3ccf58db9b (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.304358 10135 tablet_service.cc:1511] Processing CreateTablet for tablet 7db88b9029294216a2e2e88afe697936 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.306237 10055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab037a37579a4b29ac83ae3ccf58db9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.322520 10134 tablet_service.cc:1511] Processing CreateTablet for tablet 691d415d3fa14a05b99784e440c86b93 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.326797 10135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db88b9029294216a2e2e88afe697936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.324671 10212 tablet_service.cc:1511] Processing CreateTablet for tablet d86fd2e180be48b68f2c6f4d426bb4d7 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.340979 10134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691d415d3fa14a05b99784e440c86b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.367599 10133 tablet_service.cc:1511] Processing CreateTablet for tablet 72abff819e4f45a188c9134a4df24985 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.370419 10133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72abff819e4f45a188c9134a4df24985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.383517 10212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86fd2e180be48b68f2c6f4d426bb4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.391597 10132 tablet_service.cc:1511] Processing CreateTablet for tablet 654c53d34f0e4a9f8185ab4f2c22f8e6 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.401695 10131 tablet_service.cc:1511] Processing CreateTablet for tablet d86fd2e180be48b68f2c6f4d426bb4d7 (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.404003 10132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654c53d34f0e4a9f8185ab4f2c22f8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.407410 10208 tablet_service.cc:1511] Processing CreateTablet for tablet ab037a37579a4b29ac83ae3ccf58db9b (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.407478 10130 tablet_service.cc:1511] Processing CreateTablet for tablet ab037a37579a4b29ac83ae3ccf58db9b (DEFAULT_TABLE table=test-workload [id=aa48c810fb9143be918617d0d719d69c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.410352 10131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d86fd2e180be48b68f2c6f4d426bb4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.413637 10208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab037a37579a4b29ac83ae3ccf58db9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.416574 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab037a37579a4b29ac83ae3ccf58db9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.416644 10266 tablet_bootstrap.cc:492] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:18.441375 10265 tablet_bootstrap.cc:654] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.488430 10266 tablet_bootstrap.cc:654] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.510684 10267 tablet_bootstrap.cc:492] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.515645 10265 tablet_bootstrap.cc:492] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:18.516172 10265 ts_tablet_manager.cc:1403] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.015s
I20260709 12:08:18.530053 10266 tablet_bootstrap.cc:492] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:18.530635 10266 ts_tablet_manager.cc:1403] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.181s	user 0.022s	sys 0.015s
I20260709 12:08:18.534286 10265 raft_consensus.cc:359] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.535952 10265 raft_consensus.cc:385] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.536278 10265 raft_consensus.cc:740] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.538949 10267 tablet_bootstrap.cc:654] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.538370 10265 consensus_queue.cc:260] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.539114 10266 raft_consensus.cc:359] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.540016 10266 raft_consensus.cc:385] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.540421 10266 raft_consensus.cc:740] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.541402 10266 consensus_queue.cc:260] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.550081 10265 ts_tablet_manager.cc:1434] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.009s
I20260709 12:08:18.551121 10267 tablet_bootstrap.cc:492] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:18.551369 10247 heartbeater.cc:499] Master 127.9.180.190:44877 was elected leader, sending a full tablet report...
I20260709 12:08:18.551654 10267 ts_tablet_manager.cc:1403] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.010s
I20260709 12:08:18.554766 10267 raft_consensus.cc:359] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.555497 10267 raft_consensus.cc:385] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.555789 10267 raft_consensus.cc:740] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.556528 10267 consensus_queue.cc:260] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.565618 10267 ts_tablet_manager.cc:1434] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:08:18.566370 10173 heartbeater.cc:499] Master 127.9.180.190:44877 was elected leader, sending a full tablet report...
I20260709 12:08:18.566735 10267 tablet_bootstrap.cc:492] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.567617 10265 tablet_bootstrap.cc:492] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.573621 10267 tablet_bootstrap.cc:654] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.581408 10098 heartbeater.cc:499] Master 127.9.180.190:44877 was elected leader, sending a full tablet report...
I20260709 12:08:18.585572 10266 ts_tablet_manager.cc:1434] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.055s	user 0.015s	sys 0.027s
I20260709 12:08:18.586285 10265 tablet_bootstrap.cc:654] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.586663 10266 tablet_bootstrap.cc:492] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:18.603385 10266 tablet_bootstrap.cc:654] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.642998 10267 tablet_bootstrap.cc:492] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:18.643558 10267 ts_tablet_manager.cc:1403] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.018s
I20260709 12:08:18.644562 10265 tablet_bootstrap.cc:492] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:18.645015 10265 ts_tablet_manager.cc:1403] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.045s
I20260709 12:08:18.645344 10266 tablet_bootstrap.cc:492] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:18.645875 10266 ts_tablet_manager.cc:1403] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.012s
I20260709 12:08:18.646397 10267 raft_consensus.cc:359] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.647179 10267 raft_consensus.cc:385] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.647493 10267 raft_consensus.cc:740] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.647709 10265 raft_consensus.cc:359] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.648411 10265 raft_consensus.cc:385] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.648257 10267 consensus_queue.cc:260] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.648703 10265 raft_consensus.cc:740] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.649544 10265 consensus_queue.cc:260] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.650782 10267 ts_tablet_manager.cc:1434] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:08:18.651677 10267 tablet_bootstrap.cc:492] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.651959 10265 ts_tablet_manager.cc:1434] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:08:18.652877 10265 tablet_bootstrap.cc:492] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.658211 10267 tablet_bootstrap.cc:654] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.659102 10265 tablet_bootstrap.cc:654] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.668349 10265 tablet_bootstrap.cc:492] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:18.668979 10265 ts_tablet_manager.cc:1403] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
W20260709 12:08:18.670270 10248 tablet.cc:2406] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:18.648936 10266 raft_consensus.cc:359] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.675818 10266 raft_consensus.cc:385] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.676208 10266 raft_consensus.cc:740] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.675450 10265 raft_consensus.cc:359] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.677048 10266 consensus_queue.cc:260] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.677644 10265 raft_consensus.cc:385] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.678416 10265 raft_consensus.cc:740] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.679329 10265 consensus_queue.cc:260] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.697896 10267 tablet_bootstrap.cc:492] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:18.698704 10267 ts_tablet_manager.cc:1403] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.030s
I20260709 12:08:18.699208 10266 ts_tablet_manager.cc:1434] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.003s
I20260709 12:08:18.701099 10265 ts_tablet_manager.cc:1434] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.023s
I20260709 12:08:18.702415 10265 tablet_bootstrap.cc:492] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.701980 10267 raft_consensus.cc:359] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.702809 10267 raft_consensus.cc:385] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.703102 10267 raft_consensus.cc:740] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.703850 10267 consensus_queue.cc:260] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.706343 10267 ts_tablet_manager.cc:1434] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:08:18.707343 10267 tablet_bootstrap.cc:492] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.709095 10265 tablet_bootstrap.cc:654] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.715904 10267 tablet_bootstrap.cc:654] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.723398 10265 tablet_bootstrap.cc:492] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:18.723839 10265 ts_tablet_manager.cc:1403] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:08:18.725903 10265 raft_consensus.cc:359] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.726445 10265 raft_consensus.cc:385] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.726780 10265 raft_consensus.cc:740] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.727272 10266 tablet_bootstrap.cc:492] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:18.727528 10265 consensus_queue.cc:260] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.729749 10265 ts_tablet_manager.cc:1434] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:18.730746 10265 tablet_bootstrap.cc:492] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.732084 10267 tablet_bootstrap.cc:492] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:18.733570 10267 ts_tablet_manager.cc:1403] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 12:08:18.735335 10266 tablet_bootstrap.cc:654] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.737659 10267 raft_consensus.cc:359] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.738416 10265 tablet_bootstrap.cc:654] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.738441 10267 raft_consensus.cc:385] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.739104 10267 raft_consensus.cc:740] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.739995 10267 consensus_queue.cc:260] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.747061 10267 ts_tablet_manager.cc:1434] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:08:18.747910 10266 tablet_bootstrap.cc:492] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:18.748237 10267 tablet_bootstrap.cc:492] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.748716 10266 ts_tablet_manager.cc:1403] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:08:18.752655 10266 raft_consensus.cc:359] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.753808 10266 raft_consensus.cc:385] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.754285 10266 raft_consensus.cc:740] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.755611 10266 consensus_queue.cc:260] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.758951 10266 ts_tablet_manager.cc:1434] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:08:18.760319 10266 tablet_bootstrap.cc:492] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:18.767750 10267 tablet_bootstrap.cc:654] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.768555 10266 tablet_bootstrap.cc:654] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.769310 10265 tablet_bootstrap.cc:492] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:18.769833 10265 ts_tablet_manager.cc:1403] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.024s
I20260709 12:08:18.774062 10265 raft_consensus.cc:359] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.775040 10265 raft_consensus.cc:385] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.775415 10265 raft_consensus.cc:740] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.775857 10266 tablet_bootstrap.cc:492] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:18.776552 10266 ts_tablet_manager.cc:1403] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:08:18.776407 10265 consensus_queue.cc:260] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.779518 10265 ts_tablet_manager.cc:1434] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:08:18.780375 10266 raft_consensus.cc:359] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.781749 10266 raft_consensus.cc:385] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.782079 10266 raft_consensus.cc:740] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.782998 10266 consensus_queue.cc:260] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.785178 10267 tablet_bootstrap.cc:492] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:18.785697 10267 ts_tablet_manager.cc:1403] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.001s
I20260709 12:08:18.789152 10267 raft_consensus.cc:359] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.789885 10267 raft_consensus.cc:385] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.790198 10267 raft_consensus.cc:740] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.791055 10267 consensus_queue.cc:260] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.793322 10267 ts_tablet_manager.cc:1434] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:18.794102 10267 tablet_bootstrap.cc:492] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.780834 10265 tablet_bootstrap.cc:492] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.797883 10272 raft_consensus.cc:493] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.798436 10272 raft_consensus.cc:515] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.800752 10267 tablet_bootstrap.cc:654] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.801838 10272 leader_election.cc:290] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:18.803706 10272 raft_consensus.cc:493] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.804189 10272 raft_consensus.cc:515] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.807219 10272 leader_election.cc:290] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:18.809367 10266 ts_tablet_manager.cc:1434] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:08:18.811128 10265 tablet_bootstrap.cc:654] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.818077 10266 tablet_bootstrap.cc:492] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:18.818863 10270 raft_consensus.cc:493] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.819509 10270 raft_consensus.cc:515] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.823758 10270 leader_election.cc:290] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:18.837586 10266 tablet_bootstrap.cc:654] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.861332 10272 raft_consensus.cc:493] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.862816 10273 raft_consensus.cc:493] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.863373 10273 raft_consensus.cc:515] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.861917 10272 raft_consensus.cc:515] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.879475 10273 leader_election.cc:290] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:18.880430 10272 leader_election.cc:290] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:18.885344 10265 tablet_bootstrap.cc:492] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:18.886005 10265 ts_tablet_manager.cc:1403] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.019s
I20260709 12:08:18.889925 10270 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.889091 10265 raft_consensus.cc:359] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.890553 10270 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.895153 10266 tablet_bootstrap.cc:492] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:18.896564 10265 raft_consensus.cc:385] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.900760 10266 ts_tablet_manager.cc:1403] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.013s
I20260709 12:08:18.905123 10267 tablet_bootstrap.cc:492] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:18.906312 10267 ts_tablet_manager.cc:1403] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.013s
I20260709 12:08:18.905362 10270 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:18.900964 10265 raft_consensus.cc:740] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.909214 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:18.911273 10265 consensus_queue.cc:260] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
W20260709 12:08:18.913820 10187 leader_election.cc:343] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.914615 10265 ts_tablet_manager.cc:1434] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.009s
I20260709 12:08:18.915055 10267 raft_consensus.cc:359] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.915670 10265 tablet_bootstrap.cc:492] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:18.915809 10267 raft_consensus.cc:385] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.916118 10267 raft_consensus.cc:740] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.916882 10267 consensus_queue.cc:260] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.908212 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:18.931219 10265 tablet_bootstrap.cc:654] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.935573 10266 raft_consensus.cc:359] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.936781 10266 raft_consensus.cc:385] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.937225 10266 raft_consensus.cc:740] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.938040 10266 consensus_queue.cc:260] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.943004 10266 ts_tablet_manager.cc:1434] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.005s
I20260709 12:08:18.945780 10267 ts_tablet_manager.cc:1434] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:08:18.946928 10267 tablet_bootstrap.cc:492] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:18.940161 10073 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 0.
I20260709 12:08:18.954725 10187 leader_election.cc:304] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:18.954877 10273 raft_consensus.cc:493] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.955699 10270 raft_consensus.cc:2804] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.955585 10273 raft_consensus.cc:515] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:18.956314 10270 raft_consensus.cc:493] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.956811 10270 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.959759 10273 leader_election.cc:290] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:18.970860 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:18.972311 10266 tablet_bootstrap.cc:492] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:18.969311 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:18.975107 10146 raft_consensus.cc:2468] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 0.
I20260709 12:08:18.970048 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:18.979379 10039 leader_election.cc:304] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
W20260709 12:08:18.980672 10039 leader_election.cc:343] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d32609c695c849399ab492ee45929a18 (127.9.180.130:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.981719 10272 raft_consensus.cc:2804] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.982079 10272 raft_consensus.cc:493] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.983067 10272 raft_consensus.cc:3060] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.987392 10273 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.982470 10148 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 0.
I20260709 12:08:18.991573 10273 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.001514 10270 raft_consensus.cc:515] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.005877 10267 tablet_bootstrap.cc:654] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.014992 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.019315 10221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.021293 10273 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.019635 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.021505 10221 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 0.
I20260709 12:08:19.023270 10073 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.013257 10299 raft_consensus.cc:493] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.028366 10270 leader_election.cc:290] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.019326 10222 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 0.
I20260709 12:08:19.029621 10270 raft_consensus.cc:493] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.028566 10299 raft_consensus.cc:515] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.036095 10270 raft_consensus.cc:515] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.094234 10265 tablet_bootstrap.cc:492] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:19.102802 10265 ts_tablet_manager.cc:1403] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.187s	user 0.021s	sys 0.022s
I20260709 12:08:19.082602 10299 leader_election.cc:290] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.102517 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.097460 10300 raft_consensus.cc:493] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.097963 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab037a37579a4b29ac83ae3ccf58db9b" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.104272 10073 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 1.
I20260709 12:08:19.108830 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.106138 10221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.103983 10272 raft_consensus.cc:515] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.109836 10221 raft_consensus.cc:2468] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 0.
I20260709 12:08:19.055773 10148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.102888 10270 leader_election.cc:290] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.044303 10037 leader_election.cc:304] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: d32609c695c849399ab492ee45929a18
I20260709 12:08:19.114188 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.114308 10272 leader_election.cc:290] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.122638 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.106745 10219 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 0.
I20260709 12:08:19.123065 10272 raft_consensus.cc:2804] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.122711 10187 leader_election.cc:304] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.110805 10265 raft_consensus.cc:359] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.124686 10272 raft_consensus.cc:493] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.124851 10265 raft_consensus.cc:385] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.048225 10039 leader_election.cc:304] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.109558 10147 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 0.
I20260709 12:08:19.125138 10301 raft_consensus.cc:493] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.125280 10220 raft_consensus.cc:2393] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d32609c695c849399ab492ee45929a18 in current term 1: Already voted for candidate 7c61023420ee4416be7227108fc4997e in this term.
W20260709 12:08:19.125666 10039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:40987, user_credentials={real_user=slave}} blocked reactor thread for 77549.1us
I20260709 12:08:19.125138 10272 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.127508 10267 tablet_bootstrap.cc:492] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:19.125295 10265 raft_consensus.cc:740] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.129827 10221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fd2e180be48b68f2c6f4d426bb4d7" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.123697 10148 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 0.
I20260709 12:08:19.125964 10301 raft_consensus.cc:515] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.128957 10270 raft_consensus.cc:2804] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:08:19.133935 10112 leader_election.cc:343] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.134114 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.130247 10267 ts_tablet_manager.cc:1403] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.010s
I20260709 12:08:19.106894 10300 raft_consensus.cc:515] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.132570 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.130604 10265 consensus_queue.cc:260] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.138805 10146 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.138718 10112 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: 
I20260709 12:08:19.140062 10145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
W20260709 12:08:19.140407 10037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:35757, user_credentials={real_user=slave}} blocked reactor thread for 97338.8us
I20260709 12:08:19.139575 10147 raft_consensus.cc:3060] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.148312 10073 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 0.
I20260709 12:08:19.148695 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab037a37579a4b29ac83ae3ccf58db9b" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.143343 10221 raft_consensus.cc:2468] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 0.
I20260709 12:08:19.154256 10270 raft_consensus.cc:697] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:19.157141 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.156968 10270 consensus_queue.cc:237] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.159268 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fd2e180be48b68f2c6f4d426bb4d7" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.160910 10267 raft_consensus.cc:359] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.154392 10299 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.140153 10188 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.166913 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.168812 10187 leader_election.cc:304] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.163964 10267 raft_consensus.cc:385] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:19.172266 10113 leader_election.cc:343] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.169509 10299 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.173364 10267 raft_consensus.cc:740] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.176543 10071 raft_consensus.cc:2393] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d32609c695c849399ab492ee45929a18 in current term 1: Already voted for candidate 7c61023420ee4416be7227108fc4997e in this term.
I20260709 12:08:19.177073 10267 consensus_queue.cc:260] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.177716 10299 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.180855 10265 ts_tablet_manager.cc:1434] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.075s	user 0.018s	sys 0.009s
I20260709 12:08:19.190547 10303 raft_consensus.cc:2804] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.191145 10303 raft_consensus.cc:493] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.178755 10113 leader_election.cc:304] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d32609c695c849399ab492ee45929a18; no voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b
W20260709 12:08:19.195657 10113 leader_election.cc:343] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.196682 10273 raft_consensus.cc:2749] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.196971 10267 ts_tablet_manager.cc:1434] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.010s
I20260709 12:08:19.197456 10299 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.198052 10267 tablet_bootstrap.cc:492] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: Bootstrap starting.
W20260709 12:08:19.197451 10113 leader_election.cc:343] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.198772 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.199406 10113 leader_election.cc:304] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d32609c695c849399ab492ee45929a18; no voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.199658 10071 raft_consensus.cc:2393] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c61023420ee4416be7227108fc4997e in current term 1: Already voted for candidate ec5acd67848b447499287098a35ebb6b in this term.
I20260709 12:08:19.205089 10147 raft_consensus.cc:2468] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:19.192637 10303 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.205483 10301 leader_election.cc:290] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.205435 10146 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 1.
I20260709 12:08:19.218143 10273 raft_consensus.cc:2749] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.203637 10272 raft_consensus.cc:515] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
W20260709 12:08:19.207183 10017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:19.206561 10039 leader_election.cc:304] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
W20260709 12:08:19.206168 10188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:40987, user_credentials={real_user=slave}} blocked reactor thread for 65504.7us
I20260709 12:08:19.206094 10265 tablet_bootstrap.cc:492] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:19.212518 10266 tablet_bootstrap.cc:654] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.231000 10112 leader_election.cc:304] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.234480 10273 raft_consensus.cc:2804] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.234906 10273 raft_consensus.cc:493] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.235266 10273 raft_consensus.cc:3060] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.220074 10299 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.234005 10272 leader_election.cc:290] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.239142 10272 raft_consensus.cc:2804] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.239573 10272 raft_consensus.cc:697] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:19.222345 10305 raft_consensus.cc:2804] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.239987 10305 raft_consensus.cc:493] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.240337 10305 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.220207 10300 leader_election.cc:290] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.244293 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.241998 10306 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.240408 10272 consensus_queue.cc:237] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.248867 10306 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.249373 10306 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.251417 10146 raft_consensus.cc:2393] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c61023420ee4416be7227108fc4997e in current term 1: Already voted for candidate ec5acd67848b447499287098a35ebb6b in this term.
I20260709 12:08:19.256098 10221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:19.256978 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.259449 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:19.260424 10220 raft_consensus.cc:3060] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.260582 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.260632 10267 tablet_bootstrap.cc:654] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.266413 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.266783 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
W20260709 12:08:19.268064 10039 leader_election.cc:343] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d32609c695c849399ab492ee45929a18 (127.9.180.130:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.272116 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
W20260709 12:08:19.274978 10039 leader_election.cc:343] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d32609c695c849399ab492ee45929a18 (127.9.180.130:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.275826 10266 tablet_bootstrap.cc:492] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
W20260709 12:08:19.275954 10113 leader_election.cc:343] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.276638 10266 ts_tablet_manager.cc:1403] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.310s	user 0.022s	sys 0.000s
I20260709 12:08:19.276242 10273 raft_consensus.cc:515] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.277823 10222 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:19.277175 10188 leader_election.cc:343] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d32609c695c849399ab492ee45929a18 (127.9.180.130:40987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.284093 10273 leader_election.cc:290] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.288267 10266 raft_consensus.cc:359] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.289067 10266 raft_consensus.cc:385] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.289402 10266 raft_consensus.cc:740] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.291438 10188 leader_election.cc:304] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c61023420ee4416be7227108fc4997e; no voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.291875 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fd2e180be48b68f2c6f4d426bb4d7" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.290159 10266 consensus_queue.cc:260] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
W20260709 12:08:19.296008 10113 leader_election.cc:343] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.304958 10267 tablet_bootstrap.cc:492] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:19.305716 10267 ts_tablet_manager.cc:1403] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.022s
I20260709 12:08:19.303072 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fd2e180be48b68f2c6f4d426bb4d7" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:19.304800 10220 raft_consensus.cc:2468] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:19.306948 10218 raft_consensus.cc:3060] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.309118 10270 raft_consensus.cc:2749] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.308791 10222 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:19.309731 10273 raft_consensus.cc:493] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.314033 10037 leader_election.cc:304] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: d32609c695c849399ab492ee45929a18
I20260709 12:08:19.314903 10265 tablet_bootstrap.cc:654] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.315586 10272 raft_consensus.cc:2804] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.316445 10272 raft_consensus.cc:697] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:19.312111 10305 raft_consensus.cc:515] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.317061 10267 raft_consensus.cc:359] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.317209 10306 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.317451 10272 consensus_queue.cc:237] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.318269 10219 raft_consensus.cc:2393] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec5acd67848b447499287098a35ebb6b in current term 1: Already voted for candidate 7c61023420ee4416be7227108fc4997e in this term.
I20260709 12:08:19.319725 10221 raft_consensus.cc:2393] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d32609c695c849399ab492ee45929a18 in current term 1: Already voted for candidate 7c61023420ee4416be7227108fc4997e in this term.
I20260709 12:08:19.320564 10306 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.321046 10305 leader_election.cc:290] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.327168 10267 raft_consensus.cc:385] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.327756 10267 raft_consensus.cc:740] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.314230 10273 raft_consensus.cc:515] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.328635 10267 consensus_queue.cc:260] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.321451 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.330858 10273 leader_election.cc:290] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.333386 10073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.334038 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.337673 10267 ts_tablet_manager.cc:1434] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.005s
I20260709 12:08:19.339725 10267 tablet_bootstrap.cc:492] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: Bootstrap starting.
I20260709 12:08:19.342432 10147 raft_consensus.cc:2393] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c61023420ee4416be7227108fc4997e in current term 1: Already voted for candidate d32609c695c849399ab492ee45929a18 in this term.
I20260709 12:08:19.345326 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.352083 10266 ts_tablet_manager.cc:1434] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.005s
W20260709 12:08:19.351789 10187 leader_election.cc:343] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.353102 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.334816 10071 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.357414 10188 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c61023420ee4416be7227108fc4997e; no voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.362579 10218 raft_consensus.cc:2468] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 1.
I20260709 12:08:19.365118 10266 tablet_bootstrap.cc:492] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:19.365227 10305 raft_consensus.cc:2749] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.363631 10072 raft_consensus.cc:2468] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 0.
I20260709 12:08:19.385855 10113 leader_election.cc:304] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.390257 10267 tablet_bootstrap.cc:654] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.390384 10273 raft_consensus.cc:2804] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.391386 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.392961 10273 raft_consensus.cc:493] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:08:19.394181 10112 leader_election.cc:343] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.395360 10146 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.396531 10273 raft_consensus.cc:3060] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.401355 10265 tablet_bootstrap.cc:492] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:19.401851 10265 ts_tablet_manager.cc:1403] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.013s
I20260709 12:08:19.398794 10303 raft_consensus.cc:515] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.403241 10112 leader_election.cc:304] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.408800 10299 raft_consensus.cc:2804] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.410943 10265 raft_consensus.cc:359] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.412714 10265 raft_consensus.cc:385] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.413062 10265 raft_consensus.cc:740] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.413842 10265 consensus_queue.cc:260] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.416990 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.420051 10265 ts_tablet_manager.cc:1434] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:08:19.416494 10303 leader_election.cc:290] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.421819 10265 tablet_bootstrap.cc:492] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e: Bootstrap starting.
I20260709 12:08:19.421476 10147 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.422065 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:19.423669 10299 raft_consensus.cc:697] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:19.425642 10071 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 1.
I20260709 12:08:19.426184 10218 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.432991 10266 tablet_bootstrap.cc:654] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.433568 10187 leader_election.cc:304] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.432977 10146 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 1.
I20260709 12:08:19.436206 10305 raft_consensus.cc:2804] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.438094 10305 raft_consensus.cc:697] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:19.436707 10299 consensus_queue.cc:237] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.450408 10267 tablet_bootstrap.cc:492] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: No bootstrap required, opened a new log
I20260709 12:08:19.451056 10267 ts_tablet_manager.cc:1403] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.004s
I20260709 12:08:19.442682 10305 consensus_queue.cc:237] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.453303 10273 raft_consensus.cc:515] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.455937 10218 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:19.459350 10273 leader_election.cc:290] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.460707 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.461608 10071 raft_consensus.cc:3060] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.462441 10037 leader_election.cc:304] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.463402 10303 raft_consensus.cc:2804] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.464252 10303 raft_consensus.cc:697] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:19.461056 10265 tablet_bootstrap.cc:654] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.464280 10267 raft_consensus.cc:359] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.465113 10303 consensus_queue.cc:237] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.465658 10267 raft_consensus.cc:385] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.465950 10267 raft_consensus.cc:740] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.466656 10267 consensus_queue.cc:260] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.467116 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:19.467973 10222 raft_consensus.cc:3060] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.468739 10267 ts_tablet_manager.cc:1434] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:08:19.471081 10147 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:19.481148 10071 raft_consensus.cc:2468] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 1.
I20260709 12:08:19.480504  9968 catalog_manager.cc:5697] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 0 to 1, leader changed from <none> to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 1 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.482702 10113 leader_election.cc:304] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.497754  9970 catalog_manager.cc:5697] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.500358 10037 leader_election.cc:304] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec5acd67848b447499287098a35ebb6b; no voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18
I20260709 12:08:19.489733 10222 raft_consensus.cc:2468] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 1.
I20260709 12:08:19.489908 10299 raft_consensus.cc:2804] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.503144 10265 tablet_bootstrap.cc:492] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e: No bootstrap required, opened a new log
I20260709 12:08:19.504146 10265 ts_tablet_manager.cc:1403] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.009s
I20260709 12:08:19.503394 10112 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d32609c695c849399ab492ee45929a18; no voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.503836 10303 raft_consensus.cc:2749] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.504985 10299 raft_consensus.cc:697] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:19.508100 10315 raft_consensus.cc:2749] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.514621 10299 consensus_queue.cc:237] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.519100 10266 tablet_bootstrap.cc:492] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:19.521651 10266 ts_tablet_manager.cc:1403] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.020s
I20260709 12:08:19.521451 10265 raft_consensus.cc:359] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.522344 10265 raft_consensus.cc:385] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.522683 10265 raft_consensus.cc:740] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.523383 10265 consensus_queue.cc:260] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.525362 10265 ts_tablet_manager.cc:1434] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:08:19.524152  9969 catalog_manager.cc:5697] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.526846 10266 raft_consensus.cc:359] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.528853 10266 raft_consensus.cc:385] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.529407 10266 raft_consensus.cc:740] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.530387 10266 consensus_queue.cc:260] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.536217 10266 ts_tablet_manager.cc:1434] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:08:19.537293 10266 tablet_bootstrap.cc:492] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:19.550122 10266 tablet_bootstrap.cc:654] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.566468 10266 tablet_bootstrap.cc:492] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:19.567201 10266 ts_tablet_manager.cc:1403] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 12:08:19.570176 10266 raft_consensus.cc:359] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.570941 10266 raft_consensus.cc:385] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.571238 10266 raft_consensus.cc:740] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.571964 10266 consensus_queue.cc:260] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.574393 10266 ts_tablet_manager.cc:1434] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:19.575311 10266 tablet_bootstrap.cc:492] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b: Bootstrap starting.
I20260709 12:08:19.583376 10266 tablet_bootstrap.cc:654] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.589716 10266 tablet_bootstrap.cc:492] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b: No bootstrap required, opened a new log
I20260709 12:08:19.590160 10266 ts_tablet_manager.cc:1403] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:08:19.589305  9970 catalog_manager.cc:5697] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.594187 10266 raft_consensus.cc:359] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.594916 10266 raft_consensus.cc:385] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.595183 10266 raft_consensus.cc:740] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.595983 10266 consensus_queue.cc:260] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.597949 10266 ts_tablet_manager.cc:1434] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:19.600855  9968 catalog_manager.cc:5697] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 0 to 1, leader changed from <none> to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 1 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.603847  9968 catalog_manager.cc:5697] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 0 to 1, leader changed from <none> to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 1 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.609246 10303 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.609790 10303 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.611934 10303 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.612711 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.613492 10147 raft_consensus.cc:2393] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec5acd67848b447499287098a35ebb6b in current term 1: Already voted for candidate d32609c695c849399ab492ee45929a18 in this term.
I20260709 12:08:19.616143 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.616925 10222 raft_consensus.cc:2393] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec5acd67848b447499287098a35ebb6b in current term 1: Already voted for candidate 7c61023420ee4416be7227108fc4997e in this term.
I20260709 12:08:19.616698  9969 catalog_manager.cc:5697] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 0 to 1, leader changed from <none> to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.627215 10037 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec5acd67848b447499287098a35ebb6b; no voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18
I20260709 12:08:19.628111 10303 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.636058 10303 raft_consensus.cc:2749] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.669407 10305 raft_consensus.cc:493] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.669997 10305 raft_consensus.cc:515] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.672170 10305 leader_election.cc:290] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.673239 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab037a37579a4b29ac83ae3ccf58db9b" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.673415 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab037a37579a4b29ac83ae3ccf58db9b" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.673866 10071 raft_consensus.cc:2468] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 0.
I20260709 12:08:19.674155 10147 raft_consensus.cc:2468] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 0.
I20260709 12:08:19.675166 10187 leader_election.cc:304] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.676887 10305 raft_consensus.cc:2804] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.677273 10305 raft_consensus.cc:493] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.677594 10305 raft_consensus.cc:3060] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.682456 10305 raft_consensus.cc:515] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.684969 10305 leader_election.cc:290] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:19.686113 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab037a37579a4b29ac83ae3ccf58db9b" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:19.686178 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab037a37579a4b29ac83ae3ccf58db9b" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:19.686797 10071 raft_consensus.cc:3060] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.686890 10147 raft_consensus.cc:3060] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.692834 10071 raft_consensus.cc:2468] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 1.
I20260709 12:08:19.694003 10187 leader_election.cc:304] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:19.694525 10147 raft_consensus.cc:2468] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 1.
I20260709 12:08:19.694840 10305 raft_consensus.cc:2804] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.695428 10305 raft_consensus.cc:697] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:19.696880 10305 consensus_queue.cc:237] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.707155  9969 catalog_manager.cc:5697] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.721345 10303 consensus_queue.cc:1048] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.747195 10308 consensus_queue.cc:1048] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.765858 10308 raft_consensus.cc:493] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.766398 10308 raft_consensus.cc:515] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.768720 10308 leader_election.cc:290] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.769827 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fd2e180be48b68f2c6f4d426bb4d7" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.769948 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d86fd2e180be48b68f2c6f4d426bb4d7" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:19.770531 10222 raft_consensus.cc:2393] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec5acd67848b447499287098a35ebb6b in current term 1: Already voted for candidate d32609c695c849399ab492ee45929a18 in this term.
I20260709 12:08:19.772344 10039 leader_election.cc:304] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec5acd67848b447499287098a35ebb6b; no voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18
I20260709 12:08:19.773186 10308 raft_consensus.cc:3060] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.779146 10308 raft_consensus.cc:2749] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.796211 10305 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.810809 10299 raft_consensus.cc:493] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.811532 10299 raft_consensus.cc:515] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:19.813949 10299 leader_election.cc:290] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:19.816741 10306 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.816877 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec5acd67848b447499287098a35ebb6b" is_pre_election: true
I20260709 12:08:19.817000 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:19.817935 10222 raft_consensus.cc:2393] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d32609c695c849399ab492ee45929a18 in current term 1: Already voted for candidate ec5acd67848b447499287098a35ebb6b in this term.
I20260709 12:08:19.819451 10112 leader_election.cc:304] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d32609c695c849399ab492ee45929a18; no voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b
I20260709 12:08:19.821049 10299 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.831956 10299 raft_consensus.cc:2749] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.832509 10308 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.851171 10303 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.866279 10306 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.885474 10270 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.994565 10308 consensus_queue.cc:1048] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.008442 10303 consensus_queue.cc:1048] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.017802 10299 consensus_queue.cc:1048] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.034997 10315 consensus_queue.cc:1048] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.049211 10346 consensus_queue.cc:1048] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.065861 10315 consensus_queue.cc:1048] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.131091 10270 consensus_queue.cc:1048] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:20.143839 10305 consensus_queue.cc:1048] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:20.223517 10017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:08:21.228761 10017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:21.560578 10353 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:21.561136 10353 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:21.563174 10353 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:21.564205 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18" is_pre_election: true
I20260709 12:08:21.564419 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e" is_pre_election: true
I20260709 12:08:21.564764 10147 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:21.565292 10222 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 1.
I20260709 12:08:21.566162 10039 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:21.567284 10353 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:08:21.567675 10353 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:21.567930 10353 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.573072 10353 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:21.574904 10353 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:21.575886 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:21.576135 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:21.576519 10147 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.576731 10222 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:21.581341 10222 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 2.
I20260709 12:08:21.581950 10147 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 2.
I20260709 12:08:21.582803 10037 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:21.583539 10353 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:21.584015 10353 raft_consensus.cc:697] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:21.584636 10353 consensus_queue.cc:237] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:21.591706  9969 catalog_manager.cc:5697] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 0 to 2, leader changed from <none> to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 2 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:21.987568 10147 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:08:21.989006 10353 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:22.000681 10222 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:08:22.002208 10353 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:22.363055 10222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c39450530f534b78bff65b2f726addcb"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
mode: GRACEFUL
new_leader_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:60848
I20260709 12:08:22.363795 10222 raft_consensus.cc:606] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Received request to transfer leadership to TS ec5acd67848b447499287098a35ebb6b
I20260709 12:08:22.371498 10222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
mode: GRACEFUL
new_leader_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:60848
I20260709 12:08:22.372056 10222 raft_consensus.cc:606] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Received request to transfer leadership to TS ec5acd67848b447499287098a35ebb6b
I20260709 12:08:22.388414 10071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:08:22.388896 10071 raft_consensus.cc:606] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:22.394567 10071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72abff819e4f45a188c9134a4df24985"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:08:22.395141 10071 raft_consensus.cc:606] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:22.562741 10272 raft_consensus.cc:993] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:22.563315 10353 raft_consensus.cc:1081] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:22.564967 10147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44768
I20260709 12:08:22.565474 10147 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.565804 10147 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.570264 10147 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.571853 10147 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:22.572860 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:22.573103 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:22.573585 10071 raft_consensus.cc:3055] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.573733 10222 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.573935 10071 raft_consensus.cc:740] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:22.575007 10071 consensus_queue.cc:260] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.576360 10071 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.579540 10272 raft_consensus.cc:993] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:22.580044 10353 raft_consensus.cc:1081] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:22.580112 10222 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:22.581385 10112 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: 
I20260709 12:08:22.582222 10315 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.582710 10315 raft_consensus.cc:697] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:22.582818 10147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72abff819e4f45a188c9134a4df24985"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44768
I20260709 12:08:22.583505 10147 raft_consensus.cc:493] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.583539 10071 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:22.583616 10315 consensus_queue.cc:237] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.584223 10147 raft_consensus.cc:3060] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.590786 10147 raft_consensus.cc:515] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.591688 10369 raft_consensus.cc:993] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: : Instructing follower ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:22.592178 10270 raft_consensus.cc:1081] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Signalling peer ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:22.593137 10147 leader_election.cc:290] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 2 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:22.593781 10071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:49494
I20260709 12:08:22.594105 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:22.592097  9970 catalog_manager.cc:5697] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 2 to 3, leader changed from ec5acd67848b447499287098a35ebb6b (127.9.180.129) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:22.594363 10071 raft_consensus.cc:493] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.594682 10072 raft_consensus.cc:3055] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:22.594864 10071 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.595037 10072 raft_consensus.cc:740] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:22.595912 10072 consensus_queue.cc:260] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.596911 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72abff819e4f45a188c9134a4df24985" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:22.597076 10072 raft_consensus.cc:3060] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.597414 10222 raft_consensus.cc:3060] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.602370 10222 raft_consensus.cc:2468] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 2.
I20260709 12:08:22.601902 10071 raft_consensus.cc:515] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.603904 10112 leader_election.cc:304] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: 
I20260709 12:08:22.604773 10315 raft_consensus.cc:2804] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:22.604847 10072 raft_consensus.cc:2468] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 2.
I20260709 12:08:22.605163 10071 leader_election.cc:290] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:22.607132 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:22.607337 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:22.607769 10219 raft_consensus.cc:3055] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:22.605373 10315 raft_consensus.cc:697] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:22.608183 10219 raft_consensus.cc:740] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:22.609004 10315 consensus_queue.cc:237] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.607846 10147 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.609035 10219 consensus_queue.cc:260] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.610844 10219 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.619177 10147 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 2.
I20260709 12:08:22.621716 10039 leader_election.cc:304] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:22.622609 10353 raft_consensus.cc:2804] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:22.623092 10353 raft_consensus.cc:697] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:22.623916 10353 consensus_queue.cc:237] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.626036 10219 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 2.
I20260709 12:08:22.637120  9970 catalog_manager.cc:5697] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 1 to 2, leader changed from ec5acd67848b447499287098a35ebb6b (127.9.180.129) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:22.638379  9969 catalog_manager.cc:5697] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 1 to 2, leader changed from 7c61023420ee4416be7227108fc4997e (127.9.180.131) to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 2 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:22.680689 10369 raft_consensus.cc:993] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: : Instructing follower ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:22.681123 10270 raft_consensus.cc:1081] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Signalling peer ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:22.682603 10071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c39450530f534b78bff65b2f726addcb"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:49494
I20260709 12:08:22.683096 10071 raft_consensus.cc:493] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.683393 10071 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.687845 10071 raft_consensus.cc:515] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.689395 10071 leader_election.cc:290] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:22.690590 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:22.690424 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:22.691208 10219 raft_consensus.cc:3055] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:22.691250 10147 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.691742 10219 raft_consensus.cc:740] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:22.692653 10219 consensus_queue.cc:260] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.693621 10219 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.696332 10147 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 2.
I20260709 12:08:22.697592 10039 leader_election.cc:304] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:22.698330 10353 raft_consensus.cc:2804] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:22.698860 10353 raft_consensus.cc:697] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:22.699357 10219 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 2.
I20260709 12:08:22.699822 10353 consensus_queue.cc:237] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:22.707422  9969 catalog_manager.cc:5697] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 1 to 2, leader changed from 7c61023420ee4416be7227108fc4997e (127.9.180.131) to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 2 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:23.047151 10219 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:08:23.048631 10315 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.060904 10071 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:08:23.063601 10379 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:23.074179 10219 raft_consensus.cc:1275] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.075397 10353 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.085788 10147 raft_consensus.cc:1275] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.087601 10272 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.110764 10071 raft_consensus.cc:1275] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.112075 10379 consensus_queue.cc:1048] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.122615 10219 raft_consensus.cc:1275] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.124400 10315 consensus_queue.cc:1048] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.159647 10147 raft_consensus.cc:1275] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.160880 10353 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.171142 10219 raft_consensus.cc:1275] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.172813 10353 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:25.438450  9938 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:25.439388  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.456951 10147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93"
dest_uuid: "d32609c695c849399ab492ee45929a18"
mode: GRACEFUL
new_leader_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:47478
I20260709 12:08:25.457463 10147 raft_consensus.cc:606] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Received request to transfer leadership to TS 7c61023420ee4416be7227108fc4997e
I20260709 12:08:25.469826 10072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db88b9029294216a2e2e88afe697936"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
mode: GRACEFUL
new_leader_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:56848
I20260709 12:08:25.470438 10072 raft_consensus.cc:606] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Received request to transfer leadership to TS 7c61023420ee4416be7227108fc4997e
I20260709 12:08:25.471661  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:25.472230  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.534703 10379 raft_consensus.cc:993] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: : Instructing follower 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:25.535210 10395 raft_consensus.cc:1081] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Signalling peer 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:25.536799 10219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:60840
I20260709 12:08:25.537344 10219 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:25.537662 10219 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:25.543571 10353 raft_consensus.cc:993] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: : Instructing follower 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:25.544205 10391 raft_consensus.cc:1081] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Signalling peer 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:25.543742 10219 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:25.546078 10222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db88b9029294216a2e2e88afe697936"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:60826
I20260709 12:08:25.546816 10222 raft_consensus.cc:493] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:25.546247 10219 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 4 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:25.547178 10222 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:25.547245 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:25.547609 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:25.548000 10072 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:25.548273 10147 raft_consensus.cc:3055] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:25.548699 10147 raft_consensus.cc:740] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:25.549348 10147 consensus_queue.cc:260] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:25.550508 10147 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:25.554397 10222 raft_consensus.cc:515] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:25.556038 10072 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 4.
I20260709 12:08:25.557070 10147 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 4.
I20260709 12:08:25.557523 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:25.557783 10187 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:25.558240 10072 raft_consensus.cc:3055] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:25.558730 10222 leader_election.cc:290] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 2 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:25.558573 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:25.558929 10072 raft_consensus.cc:740] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:25.558640 10270 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:25.559824 10146 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:25.560432 10072 consensus_queue.cc:260] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:25.561878 10072 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:25.561817 10270 raft_consensus.cc:697] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:25.563505 10270 consensus_queue.cc:237] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:25.569341 10146 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 2.
I20260709 12:08:25.569623 10072 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 2.
I20260709 12:08:25.571609 10188 leader_election.cc:304] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: 
I20260709 12:08:25.572929 10396 raft_consensus.cc:2804] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:25.574536 10396 raft_consensus.cc:697] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:25.575464 10396 consensus_queue.cc:237] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:25.577539  9970 catalog_manager.cc:5697] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 3 to 4, leader changed from d32609c695c849399ab492ee45929a18 (127.9.180.130) to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 4 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:25.597494  9970 catalog_manager.cc:5697] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 1 to 2, leader changed from ec5acd67848b447499287098a35ebb6b (127.9.180.129) to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 2 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:26.027660 10146 raft_consensus.cc:1275] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:26.029364 10396 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:26.039183 10072 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:08:26.041601 10398 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:26.051908 10072 raft_consensus.cc:1275] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:26.055294 10396 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:26.055675 10146 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:08:26.059588 10398 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:26.473497  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.478441  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.478961  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.479987  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.485105  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.485625  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.486647  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.492154  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.492570  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.493643  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.498890  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.499392  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.500366  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.506074  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.506650  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.507787  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.512784  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.513270  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.514308  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:32.519399  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:32.519871  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:33.520813  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:33.525986  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:33.526501  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:34.527456  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:34.537181  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:34.538065  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.568352  9938 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:35.573361 10072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c39450530f534b78bff65b2f726addcb"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:08:35.574064 10072 raft_consensus.cc:606] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:35.579253 10072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:08:35.579772 10072 raft_consensus.cc:606] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:35.585035 10072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:49512
I20260709 12:08:35.585537 10072 raft_consensus.cc:606] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:35.590785 10222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db88b9029294216a2e2e88afe697936"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:60848
I20260709 12:08:35.591398 10222 raft_consensus.cc:606] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:35.596180 10222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
mode: GRACEFUL
new_leader_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:60848
I20260709 12:08:35.596652 10222 raft_consensus.cc:606] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Received request to transfer leadership to TS d32609c695c849399ab492ee45929a18
I20260709 12:08:35.634433 10416 raft_consensus.cc:993] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.635040 10416 raft_consensus.cc:1081] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.636705 10147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:08:35.637202 10147 raft_consensus.cc:493] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.637506 10147 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.638046 10419 raft_consensus.cc:993] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.638790 10413 raft_consensus.cc:1081] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.640453 10146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c39450530f534b78bff65b2f726addcb"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44768
I20260709 12:08:35.640961 10146 raft_consensus.cc:493] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.641276 10146 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.643711 10147 raft_consensus.cc:515] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.646742 10147 leader_election.cc:290] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 5 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:35.647166 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:35.647893 10072 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.648005 10146 raft_consensus.cc:515] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.649854 10146 leader_election.cc:290] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:35.650591 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:35.650861 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691d415d3fa14a05b99784e440c86b93" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:35.651057 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:35.651132 10071 raft_consensus.cc:3055] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.651413 10222 raft_consensus.cc:3055] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:35.651623 10219 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.651840 10222 raft_consensus.cc:740] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:35.651721 10071 raft_consensus.cc:740] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:35.652915 10222 consensus_queue.cc:260] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.652915 10071 consensus_queue.cc:260] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.654193 10222 raft_consensus.cc:3060] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.654289 10071 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.659725 10072 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 5.
I20260709 12:08:35.660354 10071 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:35.660354 10222 raft_consensus.cc:2468] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 5.
I20260709 12:08:35.661204 10113 leader_election.cc:304] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:35.661445 10219 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:35.662144 10415 raft_consensus.cc:2804] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:35.662679 10415 raft_consensus.cc:697] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 5 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:35.662624 10112 leader_election.cc:304] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: 
I20260709 12:08:35.663537 10417 raft_consensus.cc:2804] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.663610 10415 consensus_queue.cc:237] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.664736 10417 raft_consensus.cc:697] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:35.665563 10417 consensus_queue.cc:237] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.670943 10413 raft_consensus.cc:993] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.671391 10413 raft_consensus.cc:1081] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.672253  9969 catalog_manager.cc:5697] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 4 to 5, leader changed from 7c61023420ee4416be7227108fc4997e (127.9.180.131) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 5 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.672835 10146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44768
I20260709 12:08:35.673455 10146 raft_consensus.cc:493] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.674220 10146 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:35.679818 10146 raft_consensus.cc:515] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.682051 10146 leader_election.cc:290] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 2 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:35.682727 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:35.683337 10072 raft_consensus.cc:3055] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:35.683722 10072 raft_consensus.cc:740] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:35.684719 10072 consensus_queue.cc:260] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.686043 10072 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:35.686977 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:35.687541 10219 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:35.692315 10072 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 2.
I20260709 12:08:35.693557 10113 leader_election.cc:304] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:35.693575 10219 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 2.
I20260709 12:08:35.694402 10417 raft_consensus.cc:2804] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:35.693902  9969 catalog_manager.cc:5697] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 2 to 3, leader changed from ec5acd67848b447499287098a35ebb6b (127.9.180.129) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.694926 10417 raft_consensus.cc:697] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:35.695672 10417 consensus_queue.cc:237] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.706898  9969 catalog_manager.cc:5697] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 1 to 2, leader changed from ec5acd67848b447499287098a35ebb6b (127.9.180.129) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.731328 10418 raft_consensus.cc:993] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.731848 10418 raft_consensus.cc:1081] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.733601 10147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db88b9029294216a2e2e88afe697936"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44782
I20260709 12:08:35.734150 10147 raft_consensus.cc:493] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.734331 10413 raft_consensus.cc:993] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: : Instructing follower d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.734601 10147 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.734839 10419 raft_consensus.cc:1081] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Signalling peer d32609c695c849399ab492ee45929a18 to start an election
I20260709 12:08:35.736728 10146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3"
dest_uuid: "d32609c695c849399ab492ee45929a18"
 from {username='slave'} at 127.0.0.1:44768
I20260709 12:08:35.737227 10146 raft_consensus.cc:493] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.737540 10146 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.740720 10147 raft_consensus.cc:515] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.742224 10147 leader_election.cc:290] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:35.743043 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:35.743325 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:35.743687 10072 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.743983 10219 raft_consensus.cc:3055] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.743806 10146 raft_consensus.cc:515] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.744391 10219 raft_consensus.cc:740] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:35.745200 10219 consensus_queue.cc:260] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.746366 10219 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.746644 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:35.746958 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "d32609c695c849399ab492ee45929a18" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:35.747217 10071 raft_consensus.cc:3055] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.747545 10222 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.747587 10071 raft_consensus.cc:740] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:35.748557 10071 consensus_queue.cc:260] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.749588 10071 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.751143 10072 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:35.753649 10222 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:35.754377 10146 leader_election.cc:290] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:35.754809 10112 leader_election.cc:304] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, d32609c695c849399ab492ee45929a18; no voters: 
I20260709 12:08:35.755663 10417 raft_consensus.cc:2804] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.755673 10113 leader_election.cc:304] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d32609c695c849399ab492ee45929a18, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:35.756855 10417 raft_consensus.cc:697] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:35.757154 10420 raft_consensus.cc:2804] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.757717 10420 raft_consensus.cc:697] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Leader. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:35.758104 10417 consensus_queue.cc:237] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.758648 10420 consensus_queue.cc:237] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:35.762813 10071 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:35.755311 10219 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32609c695c849399ab492ee45929a18 in term 3.
I20260709 12:08:35.797559  9969 catalog_manager.cc:5697] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 2 to 3, leader changed from ec5acd67848b447499287098a35ebb6b (127.9.180.129) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.813445  9969 catalog_manager.cc:5697] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 reported cstate change: term changed from 2 to 3, leader changed from 7c61023420ee4416be7227108fc4997e (127.9.180.131) to d32609c695c849399ab492ee45929a18 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "d32609c695c849399ab492ee45929a18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.074039 10071 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 5 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:08:36.075840 10417 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:36.080267 10219 raft_consensus.cc:1275] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.081692 10417 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.094252 10222 raft_consensus.cc:1275] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 5 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:08:36.096015 10417 consensus_queue.cc:1048] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.106597 10071 raft_consensus.cc:1275] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.108784 10431 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.146711 10071 raft_consensus.cc:1275] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.147998 10431 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.158149 10222 raft_consensus.cc:1275] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.159603 10417 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.187594 10222 raft_consensus.cc:1275] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.188844 10417 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.199796 10071 raft_consensus.cc:1275] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.201548 10431 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.219194 10071 raft_consensus.cc:1275] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:36.220430 10431 consensus_queue.cc:1048] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:36.230674 10222 raft_consensus.cc:1275] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Refusing update from remote peer d32609c695c849399ab492ee45929a18: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:36.232232 10431 consensus_queue.cc:1048] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:38.637480  9938 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:38.638360  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.646710 10146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a"
dest_uuid: "d32609c695c849399ab492ee45929a18"
mode: GRACEFUL
new_leader_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:47478
I20260709 12:08:38.647257 10146 raft_consensus.cc:606] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Received request to transfer leadership to TS ec5acd67848b447499287098a35ebb6b
I20260709 12:08:38.649945 10146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6"
dest_uuid: "d32609c695c849399ab492ee45929a18"
mode: GRACEFUL
new_leader_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:47478
I20260709 12:08:38.650388 10146 raft_consensus.cc:606] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Received request to transfer leadership to TS 7c61023420ee4416be7227108fc4997e
I20260709 12:08:38.652593 10146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db88b9029294216a2e2e88afe697936"
dest_uuid: "d32609c695c849399ab492ee45929a18"
mode: GRACEFUL
new_leader_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:47478
I20260709 12:08:38.652959 10146 raft_consensus.cc:606] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Received request to transfer leadership to TS ec5acd67848b447499287098a35ebb6b
I20260709 12:08:38.654983 10146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3"
dest_uuid: "d32609c695c849399ab492ee45929a18"
mode: GRACEFUL
new_leader_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:47478
I20260709 12:08:38.655360 10146 raft_consensus.cc:606] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Received request to transfer leadership to TS ec5acd67848b447499287098a35ebb6b
I20260709 12:08:38.657225 10146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c39450530f534b78bff65b2f726addcb"
dest_uuid: "d32609c695c849399ab492ee45929a18"
mode: GRACEFUL
new_leader_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:47478
I20260709 12:08:38.657593 10146 raft_consensus.cc:606] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Received request to transfer leadership to TS 7c61023420ee4416be7227108fc4997e
I20260709 12:08:38.658653  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:38.659191  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.859450 10446 raft_consensus.cc:993] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: : Instructing follower ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:38.859905 10446 raft_consensus.cc:1081] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Signalling peer ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:38.861697 10072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db88b9029294216a2e2e88afe697936"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:49498
I20260709 12:08:38.862447 10072 raft_consensus.cc:493] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:38.862864 10072 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:38.868858 10072 raft_consensus.cc:515] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:38.871060 10072 leader_election.cc:290] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 4 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:38.872248 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:38.872036 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db88b9029294216a2e2e88afe697936" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:38.872809 10219 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:38.872874 10146 raft_consensus.cc:3055] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:38.873245 10146 raft_consensus.cc:740] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:38.874126 10146 consensus_queue.cc:260] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:38.875512 10146 raft_consensus.cc:3060] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:38.880059 10219 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 4.
I20260709 12:08:38.881466 10037 leader_election.cc:304] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:38.882704 10146 raft_consensus.cc:2468] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 4.
I20260709 12:08:38.883320 10448 raft_consensus.cc:2804] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:38.884598 10448 raft_consensus.cc:697] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 4 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:38.885553 10448 consensus_queue.cc:237] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:38.893172  9968 catalog_manager.cc:5697] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 3 to 4, leader changed from d32609c695c849399ab492ee45929a18 (127.9.180.130) to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 4 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:38.911765 10447 raft_consensus.cc:993] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: : Instructing follower 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:38.912302 10446 raft_consensus.cc:1081] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Signalling peer 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:38.913929 10219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:60840
I20260709 12:08:38.914568 10219 raft_consensus.cc:493] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:38.914881 10219 raft_consensus.cc:3060] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:38.918761 10219 raft_consensus.cc:515] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:38.920516 10219 leader_election.cc:290] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 2 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:38.921662 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:38.921666 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654c53d34f0e4a9f8185ab4f2c22f8e6" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:38.922556 10146 raft_consensus.cc:3055] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:38.922606 10072 raft_consensus.cc:3060] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:38.923064 10146 raft_consensus.cc:740] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:38.923926 10146 consensus_queue.cc:260] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:38.925236 10146 raft_consensus.cc:3060] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:38.930518 10072 raft_consensus.cc:2468] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 2.
I20260709 12:08:38.932111 10187 leader_election.cc:304] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:38.932770 10146 raft_consensus.cc:2468] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 2.
I20260709 12:08:38.933192 10418 raft_consensus.cc:2804] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:38.934655 10418 raft_consensus.cc:697] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:38.935449 10418 consensus_queue.cc:237] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:38.943003  9968 catalog_manager.cc:5697] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 1 to 2, leader changed from d32609c695c849399ab492ee45929a18 (127.9.180.130) to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 2 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:39.019126 10447 raft_consensus.cc:993] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: : Instructing follower 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:39.019687 10446 raft_consensus.cc:1081] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Signalling peer 7c61023420ee4416be7227108fc4997e to start an election
I20260709 12:08:39.021159 10219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c39450530f534b78bff65b2f726addcb"
dest_uuid: "7c61023420ee4416be7227108fc4997e"
 from {username='slave'} at 127.0.0.1:60840
I20260709 12:08:39.021613 10219 raft_consensus.cc:493] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:39.021915 10219 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:39.025756 10219 raft_consensus.cc:515] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.027094 10219 leader_election.cc:290] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 4 election: Requested vote from peers ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337), d32609c695c849399ab492ee45929a18 (127.9.180.130:40987)
I20260709 12:08:39.028002 10072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ec5acd67848b447499287098a35ebb6b"
I20260709 12:08:39.028190 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39450530f534b78bff65b2f726addcb" candidate_uuid: "7c61023420ee4416be7227108fc4997e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:39.028503 10072 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:39.028885 10146 raft_consensus.cc:3055] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:39.029198 10146 raft_consensus.cc:740] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:39.029938 10146 consensus_queue.cc:260] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.031006 10146 raft_consensus.cc:3060] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:39.033386 10072 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 4.
I20260709 12:08:39.034544 10187 leader_election.cc:304] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:39.035369 10418 raft_consensus.cc:2804] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:39.035813 10418 raft_consensus.cc:697] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Becoming Leader. State: Replica: 7c61023420ee4416be7227108fc4997e, State: Running, Role: LEADER
I20260709 12:08:39.036715 10146 raft_consensus.cc:2468] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c61023420ee4416be7227108fc4997e in term 4.
I20260709 12:08:39.036573 10418 consensus_queue.cc:237] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.043097  9968 catalog_manager.cc:5697] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e reported cstate change: term changed from 3 to 4, leader changed from d32609c695c849399ab492ee45929a18 (127.9.180.130) to 7c61023420ee4416be7227108fc4997e (127.9.180.131). New cstate: current_term: 4 leader_uuid: "7c61023420ee4416be7227108fc4997e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:39.155382 10447 raft_consensus.cc:993] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: : Instructing follower ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:39.156935 10447 raft_consensus.cc:1081] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Signalling peer ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:39.157769 10458 raft_consensus.cc:993] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: : Instructing follower ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:39.158278 10447 raft_consensus.cc:1081] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Signalling peer ec5acd67848b447499287098a35ebb6b to start an election
I20260709 12:08:39.158685 10071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:49498
I20260709 12:08:39.159192 10071 raft_consensus.cc:493] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:39.159549 10071 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:39.159732 10072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a"
dest_uuid: "ec5acd67848b447499287098a35ebb6b"
 from {username='slave'} at 127.0.0.1:49498
I20260709 12:08:39.160218 10072 raft_consensus.cc:493] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:39.160544 10072 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:39.166841 10071 raft_consensus.cc:515] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.166880 10072 raft_consensus.cc:515] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.168864 10071 leader_election.cc:290] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 4 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:39.168864 10072 leader_election.cc:290] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 3 election: Requested vote from peers d32609c695c849399ab492ee45929a18 (127.9.180.130:40987), 7c61023420ee4416be7227108fc4997e (127.9.180.131:35757)
I20260709 12:08:39.170038 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:39.170042 10146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:39.170372 10222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91adfb3e132f4900bccde1db122dc9e3" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c61023420ee4416be7227108fc4997e"
I20260709 12:08:39.170753 10219 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:39.170816 10146 raft_consensus.cc:3055] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:39.171046 10222 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:39.171294 10146 raft_consensus.cc:740] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:39.172199 10146 consensus_queue.cc:260] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.172485 10147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e76e9bb7334422a15a38d27d807b9a" candidate_uuid: "ec5acd67848b447499287098a35ebb6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d32609c695c849399ab492ee45929a18"
I20260709 12:08:39.173115 10147 raft_consensus.cc:3055] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:39.173382 10147 raft_consensus.cc:740] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d32609c695c849399ab492ee45929a18, State: Running, Role: LEADER
I20260709 12:08:39.173477 10146 raft_consensus.cc:3060] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:39.174072 10147 consensus_queue.cc:260] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.175467 10147 raft_consensus.cc:3060] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:39.177801 10219 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 3.
I20260709 12:08:39.178131 10222 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 4.
I20260709 12:08:39.178926 10037 leader_election.cc:304] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:39.179807 10448 raft_consensus.cc:2804] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:39.179939 10037 leader_election.cc:304] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c61023420ee4416be7227108fc4997e, ec5acd67848b447499287098a35ebb6b; no voters: 
I20260709 12:08:39.180410 10448 raft_consensus.cc:697] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 3 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:39.181586 10147 raft_consensus.cc:2468] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 3.
I20260709 12:08:39.181867 10449 raft_consensus.cc:2804] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:39.181151 10146 raft_consensus.cc:2468] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec5acd67848b447499287098a35ebb6b in term 4.
I20260709 12:08:39.182262 10449 raft_consensus.cc:697] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 4 LEADER]: Becoming Leader. State: Replica: ec5acd67848b447499287098a35ebb6b, State: Running, Role: LEADER
I20260709 12:08:39.181247 10448 consensus_queue.cc:237] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.183251 10449 consensus_queue.cc:237] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } }
I20260709 12:08:39.190148  9968 catalog_manager.cc:5697] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 2 to 3, leader changed from d32609c695c849399ab492ee45929a18 (127.9.180.130) to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 3 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:39.201957  9968 catalog_manager.cc:5697] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b reported cstate change: term changed from 3 to 4, leader changed from d32609c695c849399ab492ee45929a18 (127.9.180.130) to ec5acd67848b447499287098a35ebb6b (127.9.180.129). New cstate: current_term: 4 leader_uuid: "ec5acd67848b447499287098a35ebb6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:39.283607 10222 raft_consensus.cc:1275] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:39.284982 10449 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:39.294714 10146 raft_consensus.cc:1275] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:39.296703 10449 consensus_queue.cc:1048] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:39.442968 10146 raft_consensus.cc:1275] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:39.444423 10418 consensus_queue.cc:1048] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:39.454958 10072 raft_consensus.cc:1275] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:39.456360 10455 consensus_queue.cc:1048] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:39.500430 10146 raft_consensus.cc:1275] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:39.501981 10455 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:39.511579 10072 raft_consensus.cc:1275] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Refusing update from remote peer 7c61023420ee4416be7227108fc4997e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:39.513437 10418 consensus_queue.cc:1048] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec5acd67848b447499287098a35ebb6b" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 38337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:39.609335 10222 raft_consensus.cc:1275] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:39.610900 10448 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:39.621944 10146 raft_consensus.cc:1275] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:39.623842 10449 consensus_queue.cc:1048] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:39.714848  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.725111  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.725831  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.842336 10146 raft_consensus.cc:1275] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:39.846288 10222 raft_consensus.cc:1275] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Refusing update from remote peer ec5acd67848b447499287098a35ebb6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:39.848352 10449 consensus_queue.cc:1048] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c61023420ee4416be7227108fc4997e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 35757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:39.855573 10460 consensus_queue.cc:1048] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d32609c695c849399ab492ee45929a18" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:40.727102  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.732249  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.732682  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:40.773945 10094 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 9941
W20260709 12:08:40.774801 10094 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 10004
W20260709 12:08:40.775602 10094 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0940 after lost signal to thread 10097
W20260709 12:08:40.776322 10094 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6620 after lost signal to thread 10172
W20260709 12:08:40.777038 10094 debug-util.cc:398] Leaking SignalData structure 0x7b080009e340 after lost signal to thread 10246
I20260709 12:08:41.733991  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.742278  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.742872  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.744258  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.752070  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.752596  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.753720  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.758419  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.758960  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.759958  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.765553  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.765967  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.767120  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:45.772342  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:45.772840  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:46.774224  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:46.779536  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:46.780037  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:47.781427  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:47.787019  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:47.787508  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:48.817807  9938 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:48.818384  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
I20260709 12:08:48.851500  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:48.852288  9938 tablet_replica.cc:333] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.853199  9938 raft_consensus.cc:2243] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:48.853976  9938 raft_consensus.cc:2272] T d86fd2e180be48b68f2c6f4d426bb4d7 P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.856717  9938 tablet_replica.cc:333] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.857290  9938 raft_consensus.cc:2243] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:48.857805  9938 raft_consensus.cc:2272] T 691d415d3fa14a05b99784e440c86b93 P ec5acd67848b447499287098a35ebb6b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.859687  9938 tablet_replica.cc:333] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.860216  9938 raft_consensus.cc:2243] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:48.860659  9938 raft_consensus.cc:2272] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.862365  9938 tablet_replica.cc:333] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.862897  9938 raft_consensus.cc:2243] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:48.863317  9938 raft_consensus.cc:2272] T ab037a37579a4b29ac83ae3ccf58db9b P ec5acd67848b447499287098a35ebb6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.864912  9938 tablet_replica.cc:333] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.865417  9938 raft_consensus.cc:2243] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:48.866204  9938 raft_consensus.cc:2272] T 91adfb3e132f4900bccde1db122dc9e3 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.867846  9938 tablet_replica.cc:333] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.868327  9938 raft_consensus.cc:2243] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:48.868813  9938 raft_consensus.cc:2272] T c39450530f534b78bff65b2f726addcb P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.870479  9938 tablet_replica.cc:333] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.871038  9938 raft_consensus.cc:2243] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:48.871424  9938 raft_consensus.cc:2272] T 72abff819e4f45a188c9134a4df24985 P ec5acd67848b447499287098a35ebb6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.873121  9938 tablet_replica.cc:333] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.873582  9938 raft_consensus.cc:2243] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:48.874368  9938 raft_consensus.cc:2272] T 7db88b9029294216a2e2e88afe697936 P ec5acd67848b447499287098a35ebb6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:48.876178  9938 tablet_replica.cc:333] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b: stopping tablet replica
I20260709 12:08:48.876633  9938 raft_consensus.cc:2243] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:48.877416  9938 raft_consensus.cc:2272] T 19e76e9bb7334422a15a38d27d807b9a P ec5acd67848b447499287098a35ebb6b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:48.992044 10187 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:38337: connect: Connection refused (error 111)
W20260709 12:08:49.013533 10187 consensus_peers.cc:597] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e -> Peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Couldn't send request to peer ec5acd67848b447499287098a35ebb6b. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:38337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:49.016036 10113 consensus_peers.cc:597] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 -> Peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Couldn't send request to peer ec5acd67848b447499287098a35ebb6b. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:38337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:49.031853  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
I20260709 12:08:49.053499  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
I20260709 12:08:49.089845  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:49.090765  9938 tablet_replica.cc:333] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.091681  9938 raft_consensus.cc:2243] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.092312  9938 raft_consensus.cc:2272] T 7db88b9029294216a2e2e88afe697936 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.094905  9938 tablet_replica.cc:333] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.095661  9938 raft_consensus.cc:2243] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.096262  9938 raft_consensus.cc:2272] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.098949  9938 tablet_replica.cc:333] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.099694  9938 raft_consensus.cc:2243] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:08:49.099819 10188 consensus_peers.cc:597] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e -> Peer d32609c695c849399ab492ee45929a18 (127.9.180.130:40987): Couldn't send request to peer d32609c695c849399ab492ee45929a18. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:49.100234  9938 raft_consensus.cc:2272] T 19e76e9bb7334422a15a38d27d807b9a P d32609c695c849399ab492ee45929a18 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.102312  9938 tablet_replica.cc:333] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.103073  9938 raft_consensus.cc:2243] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.103915  9938 raft_consensus.cc:2272] T d86fd2e180be48b68f2c6f4d426bb4d7 P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.105854  9938 tablet_replica.cc:333] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.106360  9938 raft_consensus.cc:2243] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.106817  9938 raft_consensus.cc:2272] T ab037a37579a4b29ac83ae3ccf58db9b P d32609c695c849399ab492ee45929a18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.108645  9938 tablet_replica.cc:333] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.109127  9938 raft_consensus.cc:2243] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.109510  9938 raft_consensus.cc:2272] T 91adfb3e132f4900bccde1db122dc9e3 P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.111475  9938 tablet_replica.cc:333] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.111994  9938 raft_consensus.cc:2243] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.112407  9938 raft_consensus.cc:2272] T c39450530f534b78bff65b2f726addcb P d32609c695c849399ab492ee45929a18 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.114131  9938 tablet_replica.cc:333] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.114840  9938 raft_consensus.cc:2243] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.115797  9938 raft_consensus.cc:2272] T 72abff819e4f45a188c9134a4df24985 P d32609c695c849399ab492ee45929a18 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.118117  9938 tablet_replica.cc:333] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18: stopping tablet replica
I20260709 12:08:49.118825  9938 raft_consensus.cc:2243] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.119717  9938 raft_consensus.cc:2272] T 691d415d3fa14a05b99784e440c86b93 P d32609c695c849399ab492ee45929a18 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.148797  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
I20260709 12:08:49.168347  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
W20260709 12:08:49.177408 10187 consensus_peers.cc:597] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e -> Peer ec5acd67848b447499287098a35ebb6b (127.9.180.129:38337): Couldn't send request to peer ec5acd67848b447499287098a35ebb6b. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:38337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:49.198766  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:49.199512  9938 tablet_replica.cc:333] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.200192  9938 raft_consensus.cc:2243] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.200922  9938 raft_consensus.cc:2272] T 654c53d34f0e4a9f8185ab4f2c22f8e6 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.202848  9938 tablet_replica.cc:333] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.203342  9938 raft_consensus.cc:2243] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.203732  9938 raft_consensus.cc:2272] T d86fd2e180be48b68f2c6f4d426bb4d7 P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.205328  9938 tablet_replica.cc:333] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.205821  9938 raft_consensus.cc:2243] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.206251  9938 raft_consensus.cc:2272] T 7db88b9029294216a2e2e88afe697936 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.207851  9938 tablet_replica.cc:333] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.208319  9938 raft_consensus.cc:2243] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.208703  9938 raft_consensus.cc:2272] T 691d415d3fa14a05b99784e440c86b93 P 7c61023420ee4416be7227108fc4997e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.210223  9938 tablet_replica.cc:333] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.210763  9938 raft_consensus.cc:2243] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.211508  9938 raft_consensus.cc:2272] T c39450530f534b78bff65b2f726addcb P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.213085  9938 tablet_replica.cc:333] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.213532  9938 raft_consensus.cc:2243] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.213908  9938 raft_consensus.cc:2272] T 72abff819e4f45a188c9134a4df24985 P 7c61023420ee4416be7227108fc4997e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.215981  9938 tablet_replica.cc:333] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.216454  9938 raft_consensus.cc:2243] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.217109  9938 raft_consensus.cc:2272] T ab037a37579a4b29ac83ae3ccf58db9b P 7c61023420ee4416be7227108fc4997e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.218866  9938 tablet_replica.cc:333] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.219309  9938 raft_consensus.cc:2243] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.219707  9938 raft_consensus.cc:2272] T 91adfb3e132f4900bccde1db122dc9e3 P 7c61023420ee4416be7227108fc4997e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.221120  9938 tablet_replica.cc:333] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e: stopping tablet replica
I20260709 12:08:49.221539  9938 raft_consensus.cc:2243] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:49.221971  9938 raft_consensus.cc:2272] T 19e76e9bb7334422a15a38d27d807b9a P 7c61023420ee4416be7227108fc4997e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.250806  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:08:49.269297  9938 master.cc:562] Master@127.9.180.190:44877 shutting down...
I20260709 12:08:49.494056  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:49.494730  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:49.495023  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7bc3b22c56df40819b417dd6b2bfa886: stopping tablet replica
I20260709 12:08:49.514937  9938 master.cc:584] Master@127.9.180.190:44877 shutdown complete.
7c61023420ee4416be7227108fc4997e  1
d32609c695c849399ab492ee45929a18  4
ec5acd67848b447499287098a35ebb6b  4
7c61023420ee4416be7227108fc4997e  3
d32609c695c849399ab492ee45929a18  3
ec5acd67848b447499287098a35ebb6b  3
7c61023420ee4416be7227108fc4997e  1
d32609c695c849399ab492ee45929a18  8
ec5acd67848b447499287098a35ebb6b  0
7c61023420ee4416be7227108fc4997e  3
d32609c695c849399ab492ee45929a18  3
ec5acd67848b447499287098a35ebb6b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (33873 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:49.561923  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:37621
I20260709 12:08:49.563288  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:49.570065 10490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:49.570632 10491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:49.571513 10493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:49.573755  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:49.575198  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:49.575415  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:49.575613  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598929575595 us; error 0 us; skew 500 ppm
I20260709 12:08:49.576290  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:49.579362  9938 webserver.cc:533] Webserver started at http://127.9.180.190:41037/ using document root <none> and password file <none>
I20260709 12:08:49.579945  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:49.580163  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:49.580479  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:49.581861  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "0db6e5930070465686520660b90371fb"
format_stamp: "Formatted at 2026-07-09 12:08:49 on dist-test-slave-lg8f"
I20260709 12:08:49.587128  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:08:49.591228 10498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:49.592195  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:08:49.592464  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "0db6e5930070465686520660b90371fb"
format_stamp: "Formatted at 2026-07-09 12:08:49 on dist-test-slave-lg8f"
I20260709 12:08:49.592718  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:49.632282  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:49.633836  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:49.683310  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:37621
I20260709 12:08:49.683404 10549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:37621 every 8 connection(s)
I20260709 12:08:49.687740 10550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:49.697510 10550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb: Bootstrap starting.
I20260709 12:08:49.702170 10550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:49.706730 10550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb: No bootstrap required, opened a new log
I20260709 12:08:49.708791 10550 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db6e5930070465686520660b90371fb" member_type: VOTER }
I20260709 12:08:49.709198 10550 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:49.709434 10550 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db6e5930070465686520660b90371fb, State: Initialized, Role: FOLLOWER
I20260709 12:08:49.709928 10550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db6e5930070465686520660b90371fb" member_type: VOTER }
I20260709 12:08:49.710350 10550 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:49.710559 10550 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:49.710779 10550 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:49.714481 10550 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db6e5930070465686520660b90371fb" member_type: VOTER }
I20260709 12:08:49.714967 10550 leader_election.cc:304] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0db6e5930070465686520660b90371fb; no voters: 
I20260709 12:08:49.716107 10550 leader_election.cc:290] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:49.716689 10553 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:49.718205 10553 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 1 LEADER]: Becoming Leader. State: Replica: 0db6e5930070465686520660b90371fb, State: Running, Role: LEADER
I20260709 12:08:49.719128 10550 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:49.718990 10553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db6e5930070465686520660b90371fb" member_type: VOTER }
I20260709 12:08:49.725760 10554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0db6e5930070465686520660b90371fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db6e5930070465686520660b90371fb" member_type: VOTER } }
I20260709 12:08:49.725883 10555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0db6e5930070465686520660b90371fb. Latest consensus state: current_term: 1 leader_uuid: "0db6e5930070465686520660b90371fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db6e5930070465686520660b90371fb" member_type: VOTER } }
I20260709 12:08:49.726955 10554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:49.727011 10555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:49.742367 10561 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:49.742745  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:49.747301 10561 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:49.756381 10561 catalog_manager.cc:1383] Generated new cluster ID: 0356d093f5cd4c9ca3089ab6695038dd
I20260709 12:08:49.756748 10561 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:49.774928 10561 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:49.776418 10561 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:49.796671 10561 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb: Generated new TSK 0
I20260709 12:08:49.797359 10561 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:49.808811  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:49.814914 10571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:49.816744 10572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:49.818152 10574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:49.818544  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:49.819731  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:49.819943  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:49.820127  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598929820092 us; error 0 us; skew 500 ppm
I20260709 12:08:49.820828  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:49.823442  9938 webserver.cc:533] Webserver started at http://127.9.180.129:33261/ using document root <none> and password file <none>
I20260709 12:08:49.823975  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:49.824172  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:49.824484  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:49.825640  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "5d36eb85f5564a36820405cd675f2a52"
format_stamp: "Formatted at 2026-07-09 12:08:49 on dist-test-slave-lg8f"
I20260709 12:08:49.830544  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:49.834371 10579 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:49.835269  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:49.835601  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "5d36eb85f5564a36820405cd675f2a52"
format_stamp: "Formatted at 2026-07-09 12:08:49 on dist-test-slave-lg8f"
I20260709 12:08:49.835886  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:49.855675  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:49.857148  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:49.858958  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:49.861388  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:49.861631  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:49.861873  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:49.862085  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:49.909976  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:40049
I20260709 12:08:49.910086 10641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:40049 every 8 connection(s)
I20260709 12:08:49.915073  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:49.923522 10646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:49.925197 10647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:49.926867  9938 server_base.cc:1061] running on GCE node
W20260709 12:08:49.927809 10650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:49.928985  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:49.929283  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:49.929502  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598929929483 us; error 0 us; skew 500 ppm
I20260709 12:08:49.930212  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:49.933156  9938 webserver.cc:533] Webserver started at http://127.9.180.130:41707/ using document root <none> and password file <none>
I20260709 12:08:49.933279 10642 heartbeater.cc:344] Connected to a master server at 127.9.180.190:37621
I20260709 12:08:49.933699 10642 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:49.933851  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:49.934103  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:49.934429  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:49.934659 10642 heartbeater.cc:507] Master 127.9.180.190:37621 requested a full tablet report, sending...
I20260709 12:08:49.935920  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "4a5434ea7700440a8c49ae38c831a261"
format_stamp: "Formatted at 2026-07-09 12:08:49 on dist-test-slave-lg8f"
I20260709 12:08:49.937482 10515 ts_manager.cc:194] Registered new tserver with Master: 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049)
I20260709 12:08:49.939690 10515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34802
I20260709 12:08:49.941589  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:08:49.945533 10654 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:49.946547  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:08:49.946926  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "4a5434ea7700440a8c49ae38c831a261"
format_stamp: "Formatted at 2026-07-09 12:08:49 on dist-test-slave-lg8f"
I20260709 12:08:49.947199  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:49.956075  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:49.957221  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:49.958738  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:49.960883  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:49.961090  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:49.961331  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:49.961498  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:50.004470  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:33417
I20260709 12:08:50.004626 10716 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:33417 every 8 connection(s)
I20260709 12:08:50.009172  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:50.016726 10720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:50.021358 10721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:50.021754 10723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:50.021960  9938 server_base.cc:1061] running on GCE node
I20260709 12:08:50.022825 10717 heartbeater.cc:344] Connected to a master server at 127.9.180.190:37621
I20260709 12:08:50.023241 10717 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:50.023437  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:50.023715  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:50.023913  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598930023892 us; error 0 us; skew 500 ppm
I20260709 12:08:50.024106 10717 heartbeater.cc:507] Master 127.9.180.190:37621 requested a full tablet report, sending...
I20260709 12:08:50.024626  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:50.026463 10515 ts_manager.cc:194] Registered new tserver with Master: 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.027496  9938 webserver.cc:533] Webserver started at http://127.9.180.131:45185/ using document root <none> and password file <none>
I20260709 12:08:50.028105  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:50.028352  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:50.028323 10515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34812
I20260709 12:08:50.028779  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:50.030234  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "850fd64d4a4442ce9820ee443cb35156"
format_stamp: "Formatted at 2026-07-09 12:08:50 on dist-test-slave-lg8f"
I20260709 12:08:50.034960  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:08:50.038338 10728 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:50.039207  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:08:50.039441  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "850fd64d4a4442ce9820ee443cb35156"
format_stamp: "Formatted at 2026-07-09 12:08:50 on dist-test-slave-lg8f"
I20260709 12:08:50.039669  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:50.058863  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:50.059966  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:50.061381  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:50.063553  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:50.063727  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:50.064013  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:50.064155  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:50.106546  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:40145
I20260709 12:08:50.106711 10790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:40145 every 8 connection(s)
I20260709 12:08:50.121039 10791 heartbeater.cc:344] Connected to a master server at 127.9.180.190:37621
I20260709 12:08:50.121511 10791 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:50.122314 10791 heartbeater.cc:507] Master 127.9.180.190:37621 requested a full tablet report, sending...
I20260709 12:08:50.124636 10515 ts_manager.cc:194] Registered new tserver with Master: 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:50.125429  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015657393s
I20260709 12:08:50.126297 10515 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34826
I20260709 12:08:50.152395 10515 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34832:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:50.155200 10515 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:50.248912 10755 tablet_service.cc:1511] Processing CreateTablet for tablet 9be5e555ec1944279e18bc9f335ca74f (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:50.251257 10607 tablet_service.cc:1511] Processing CreateTablet for tablet c38bf3517a1442c38dd30d18f337e1e0 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:50.251534 10754 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4af46546694659acdaaa5a90a7ce8e (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:50.252568 10607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bf3517a1442c38dd30d18f337e1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.253604 10753 tablet_service.cc:1511] Processing CreateTablet for tablet f46e54d8a44944538b2e12704c555d3a (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:50.255949 10601 tablet_service.cc:1511] Processing CreateTablet for tablet a8f135afc2b84e36933c5eaa3eee9f1f (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:50.255954 10606 tablet_service.cc:1511] Processing CreateTablet for tablet 9be5e555ec1944279e18bc9f335ca74f (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:50.257859 10601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f135afc2b84e36933c5eaa3eee9f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.259781 10602 tablet_service.cc:1511] Processing CreateTablet for tablet b56e789c2bd84202b9657efbd9b77ceb (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:50.259979 10599 tablet_service.cc:1511] Processing CreateTablet for tablet abf2d66e70474f5aa30a60415813c99b (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:50.263891 10604 tablet_service.cc:1511] Processing CreateTablet for tablet f46e54d8a44944538b2e12704c555d3a (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:50.265283 10752 tablet_service.cc:1511] Processing CreateTablet for tablet bfb02f3c977641f880c37e3061b987e1 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:50.266387 10598 tablet_service.cc:1511] Processing CreateTablet for tablet 334b01d59a784c40987dde98217ddab7 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:50.266714 10605 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4af46546694659acdaaa5a90a7ce8e (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:50.269249 10751 tablet_service.cc:1511] Processing CreateTablet for tablet b56e789c2bd84202b9657efbd9b77ceb (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:50.270392 10600 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec0dd2c873b44e1b8314ba9ae641719 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:50.271596 10756 tablet_service.cc:1511] Processing CreateTablet for tablet c38bf3517a1442c38dd30d18f337e1e0 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:50.272173 10603 tablet_service.cc:1511] Processing CreateTablet for tablet bfb02f3c977641f880c37e3061b987e1 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:50.250396 10755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be5e555ec1944279e18bc9f335ca74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.274410 10754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4af46546694659acdaaa5a90a7ce8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.277742 10599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf2d66e70474f5aa30a60415813c99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.278877 10602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56e789c2bd84202b9657efbd9b77ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.278950 10756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bf3517a1442c38dd30d18f337e1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.279784 10604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46e54d8a44944538b2e12704c555d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.282249 10806 tablet_bootstrap.cc:492] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.282819 10751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56e789c2bd84202b9657efbd9b77ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.283953 10750 tablet_service.cc:1511] Processing CreateTablet for tablet a8f135afc2b84e36933c5eaa3eee9f1f (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:50.285558 10750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f135afc2b84e36933c5eaa3eee9f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.285912 10603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb02f3c977641f880c37e3061b987e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.286966 10606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be5e555ec1944279e18bc9f335ca74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.287294 10753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46e54d8a44944538b2e12704c555d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.288949 10806 tablet_bootstrap.cc:654] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.290818 10600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec0dd2c873b44e1b8314ba9ae641719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.292028 10682 tablet_service.cc:1511] Processing CreateTablet for tablet c38bf3517a1442c38dd30d18f337e1e0 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:50.293684 10682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38bf3517a1442c38dd30d18f337e1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.295861 10681 tablet_service.cc:1511] Processing CreateTablet for tablet 9be5e555ec1944279e18bc9f335ca74f (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:50.297405 10681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be5e555ec1944279e18bc9f335ca74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.299198 10605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4af46546694659acdaaa5a90a7ce8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.299904 10680 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4af46546694659acdaaa5a90a7ce8e (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:50.301492 10680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4af46546694659acdaaa5a90a7ce8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.302975 10752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb02f3c977641f880c37e3061b987e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.303885 10679 tablet_service.cc:1511] Processing CreateTablet for tablet f46e54d8a44944538b2e12704c555d3a (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:50.305333 10679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46e54d8a44944538b2e12704c555d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.306947 10598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334b01d59a784c40987dde98217ddab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.307946 10678 tablet_service.cc:1511] Processing CreateTablet for tablet bfb02f3c977641f880c37e3061b987e1 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:50.309393 10678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb02f3c977641f880c37e3061b987e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.312842 10677 tablet_service.cc:1511] Processing CreateTablet for tablet b56e789c2bd84202b9657efbd9b77ceb (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:50.314253 10677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b56e789c2bd84202b9657efbd9b77ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.316458 10676 tablet_service.cc:1511] Processing CreateTablet for tablet a8f135afc2b84e36933c5eaa3eee9f1f (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:50.319629 10675 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec0dd2c873b44e1b8314ba9ae641719 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:50.323292 10674 tablet_service.cc:1511] Processing CreateTablet for tablet abf2d66e70474f5aa30a60415813c99b (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:50.326386 10673 tablet_service.cc:1511] Processing CreateTablet for tablet 334b01d59a784c40987dde98217ddab7 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:50.334367 10676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f135afc2b84e36933c5eaa3eee9f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.335734 10749 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec0dd2c873b44e1b8314ba9ae641719 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:50.337235 10749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec0dd2c873b44e1b8314ba9ae641719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.338886 10673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334b01d59a784c40987dde98217ddab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.341348 10675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec0dd2c873b44e1b8314ba9ae641719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.345728 10674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf2d66e70474f5aa30a60415813c99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.351394 10748 tablet_service.cc:1511] Processing CreateTablet for tablet abf2d66e70474f5aa30a60415813c99b (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:50.352986 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf2d66e70474f5aa30a60415813c99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.357127 10747 tablet_service.cc:1511] Processing CreateTablet for tablet 334b01d59a784c40987dde98217ddab7 (DEFAULT_TABLE table=test-workload [id=374e3d7737214284855be21b295d319b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:50.358708 10747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334b01d59a784c40987dde98217ddab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:50.460422 10808 tablet_bootstrap.cc:492] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.479368 10808 tablet_bootstrap.cc:654] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.492265 10809 tablet_bootstrap.cc:492] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:50.494226 10806 tablet_bootstrap.cc:492] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.494750 10806 ts_tablet_manager.cc:1403] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.213s	user 0.064s	sys 0.079s
I20260709 12:08:50.497885 10806 raft_consensus.cc:359] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:50.498733 10806 raft_consensus.cc:385] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.499032 10806 raft_consensus.cc:740] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.499842 10806 consensus_queue.cc:260] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:50.500411 10808 tablet_bootstrap.cc:492] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.500924 10808 ts_tablet_manager.cc:1403] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.005s
I20260709 12:08:50.508069 10809 tablet_bootstrap.cc:654] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.503803 10808 raft_consensus.cc:359] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.512295 10808 raft_consensus.cc:385] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.512712 10808 raft_consensus.cc:740] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.515164 10806 ts_tablet_manager.cc:1434] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:08:50.514724 10808 consensus_queue.cc:260] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.517016 10642 heartbeater.cc:499] Master 127.9.180.190:37621 was elected leader, sending a full tablet report...
I20260709 12:08:50.517429 10806 tablet_bootstrap.cc:492] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.519747 10809 tablet_bootstrap.cc:492] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:50.520239 10809 ts_tablet_manager.cc:1403] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 12:08:50.524659 10806 tablet_bootstrap.cc:654] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.527436 10791 heartbeater.cc:499] Master 127.9.180.190:37621 was elected leader, sending a full tablet report...
I20260709 12:08:50.527863 10808 ts_tablet_manager.cc:1434] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 12:08:50.528267 10809 raft_consensus.cc:359] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.528827 10808 tablet_bootstrap.cc:492] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.528960 10809 raft_consensus.cc:385] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.529256 10809 raft_consensus.cc:740] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.530089 10809 consensus_queue.cc:260] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.536775 10808 tablet_bootstrap.cc:654] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.549940 10808 tablet_bootstrap.cc:492] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.550596 10808 ts_tablet_manager.cc:1403] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.011s
I20260709 12:08:50.554522 10808 raft_consensus.cc:359] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.555527 10808 raft_consensus.cc:385] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.555914 10808 raft_consensus.cc:740] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.557053 10808 consensus_queue.cc:260] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.559957 10808 ts_tablet_manager.cc:1434] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:08:50.561712 10808 tablet_bootstrap.cc:492] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.570065 10808 tablet_bootstrap.cc:654] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.584654 10808 tablet_bootstrap.cc:492] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.585268 10808 ts_tablet_manager.cc:1403] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:08:50.588975 10808 raft_consensus.cc:359] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.589828 10808 raft_consensus.cc:385] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.590211 10808 raft_consensus.cc:740] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.591385 10808 consensus_queue.cc:260] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.594687 10808 ts_tablet_manager.cc:1434] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:08:50.595968 10808 tablet_bootstrap.cc:492] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.603132 10808 tablet_bootstrap.cc:654] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:50.610837 10792 tablet.cc:2406] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:50.613116 10717 heartbeater.cc:499] Master 127.9.180.190:37621 was elected leader, sending a full tablet report...
I20260709 12:08:50.615136 10806 tablet_bootstrap.cc:492] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.615630 10806 ts_tablet_manager.cc:1403] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.098s	user 0.044s	sys 0.049s
I20260709 12:08:50.616370 10808 tablet_bootstrap.cc:492] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.616870 10808 ts_tablet_manager.cc:1403] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:08:50.618093 10809 ts_tablet_manager.cc:1434] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.098s	user 0.039s	sys 0.044s
I20260709 12:08:50.618508 10806 raft_consensus.cc:359] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.619074 10809 tablet_bootstrap.cc:492] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:50.619354 10806 raft_consensus.cc:385] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.619689 10806 raft_consensus.cc:740] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.620164 10808 raft_consensus.cc:359] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.620924 10808 raft_consensus.cc:385] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.620703 10806 consensus_queue.cc:260] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.621344 10808 raft_consensus.cc:740] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.622315 10808 consensus_queue.cc:260] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.625952 10809 tablet_bootstrap.cc:654] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.626279 10806 ts_tablet_manager.cc:1434] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:08:50.626575 10808 ts_tablet_manager.cc:1434] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:08:50.627867 10806 tablet_bootstrap.cc:492] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.627954 10808 tablet_bootstrap.cc:492] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.635352 10806 tablet_bootstrap.cc:654] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.637877 10808 tablet_bootstrap.cc:654] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.649483 10806 tablet_bootstrap.cc:492] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.650024 10806 ts_tablet_manager.cc:1403] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:08:50.653053 10808 tablet_bootstrap.cc:492] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.652987 10806 raft_consensus.cc:359] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.653807 10806 raft_consensus.cc:385] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.653887 10808 ts_tablet_manager.cc:1403] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 12:08:50.654224 10806 raft_consensus.cc:740] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.655268 10806 consensus_queue.cc:260] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.658140 10808 raft_consensus.cc:359] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.659371 10808 raft_consensus.cc:385] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.659770 10808 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.660089 10806 ts_tablet_manager.cc:1434] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:08:50.661099 10806 tablet_bootstrap.cc:492] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.661023 10808 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.664884 10808 ts_tablet_manager.cc:1434] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 12:08:50.666287 10808 tablet_bootstrap.cc:492] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.667858 10806 tablet_bootstrap.cc:654] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.675546 10808 tablet_bootstrap.cc:654] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.679103 10806 tablet_bootstrap.cc:492] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.679582 10806 ts_tablet_manager.cc:1403] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:08:50.682341 10806 raft_consensus.cc:359] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.683074 10806 raft_consensus.cc:385] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.685314 10806 raft_consensus.cc:740] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.686182 10806 consensus_queue.cc:260] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.686704 10809 tablet_bootstrap.cc:492] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:50.687341 10809 ts_tablet_manager.cc:1403] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.068s	user 0.032s	sys 0.035s
I20260709 12:08:50.688114 10808 tablet_bootstrap.cc:492] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.688690 10808 ts_tablet_manager.cc:1403] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:08:50.688650 10806 ts_tablet_manager.cc:1434] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:08:50.691043 10806 tablet_bootstrap.cc:492] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.690827 10809 raft_consensus.cc:359] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.691936 10809 raft_consensus.cc:385] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.691993 10808 raft_consensus.cc:359] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:50.692569 10809 raft_consensus.cc:740] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.692888 10808 raft_consensus.cc:385] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.693212 10808 raft_consensus.cc:740] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.693540 10809 consensus_queue.cc:260] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.694037 10808 consensus_queue.cc:260] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:50.698360 10808 ts_tablet_manager.cc:1434] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:08:50.698586 10809 ts_tablet_manager.cc:1434] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:08:50.699394 10809 tablet_bootstrap.cc:492] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:50.699394 10808 tablet_bootstrap.cc:492] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.700999 10806 tablet_bootstrap.cc:654] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.706784 10808 tablet_bootstrap.cc:654] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.706784 10809 tablet_bootstrap.cc:654] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.712373 10813 raft_consensus.cc:493] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.713135 10806 tablet_bootstrap.cc:492] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.712875 10813 raft_consensus.cc:515] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.713680 10806 ts_tablet_manager.cc:1403] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:08:50.715553 10813 leader_election.cc:290] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.716732 10806 raft_consensus.cc:359] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.717536 10806 raft_consensus.cc:385] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.717881 10806 raft_consensus.cc:740] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.718751 10806 consensus_queue.cc:260] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.720603 10809 tablet_bootstrap.cc:492] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:50.721196 10806 ts_tablet_manager.cc:1434] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:50.721272 10809 ts_tablet_manager.cc:1403] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 12:08:50.723728 10806 tablet_bootstrap.cc:492] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.725376 10809 raft_consensus.cc:359] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.726354 10809 raft_consensus.cc:385] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.726747 10809 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.727821 10809 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.731025 10806 tablet_bootstrap.cc:654] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.732478 10809 ts_tablet_manager.cc:1434] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:08:50.733705 10809 tablet_bootstrap.cc:492] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
W20260709 12:08:50.734903 10563 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:50.744921 10809 tablet_bootstrap.cc:654] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.746910 10813 raft_consensus.cc:493] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.747349 10813 raft_consensus.cc:515] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.749461 10806 tablet_bootstrap.cc:492] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.749754 10813 leader_election.cc:290] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.750203 10806 ts_tablet_manager.cc:1403] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 12:08:50.753687 10806 raft_consensus.cc:359] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.755343 10806 raft_consensus.cc:385] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.755868 10806 raft_consensus.cc:740] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.756707 10806 consensus_queue.cc:260] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.755540 10808 tablet_bootstrap.cc:492] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.757903 10808 ts_tablet_manager.cc:1403] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.012s
I20260709 12:08:50.758777 10809 tablet_bootstrap.cc:492] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:50.759284 10809 ts_tablet_manager.cc:1403] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:08:50.759660 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:50.760193 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:50.760516 10616 raft_consensus.cc:2468] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:50.760838 10617 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:50.762305 10732 leader_election.cc:304] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.762403 10809 raft_consensus.cc:359] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.763736 10809 raft_consensus.cc:385] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.763854 10732 leader_election.cc:304] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.764204 10809 raft_consensus.cc:740] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.765003 10813 raft_consensus.cc:2804] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.765154 10811 raft_consensus.cc:493] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.765419 10813 raft_consensus.cc:493] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.765272 10809 consensus_queue.cc:260] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.765720 10811 raft_consensus.cc:515] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.767912 10809 ts_tablet_manager.cc:1434] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:50.768392 10811 leader_election.cc:290] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:50.768823 10815 raft_consensus.cc:493] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.765921 10813 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.769328 10809 tablet_bootstrap.cc:492] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:50.770112 10806 ts_tablet_manager.cc:1434] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:08:50.771090 10806 tablet_bootstrap.cc:492] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:50.771303 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.772047 10692 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:50.773353 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.769346 10815 raft_consensus.cc:515] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.776615 10809 tablet_bootstrap.cc:654] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.778227 10806 tablet_bootstrap.cc:654] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.762256 10808 raft_consensus.cc:359] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.784300 10808 raft_consensus.cc:385] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.786132 10808 raft_consensus.cc:740] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.787055 10808 consensus_queue.cc:260] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.789139 10831 raft_consensus.cc:2804] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.789674 10831 raft_consensus.cc:493] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.790103 10831 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.796659 10815 leader_election.cc:290] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:50.805783 10813 raft_consensus.cc:515] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
W20260709 12:08:50.801961 10729 leader_election.cc:343] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:50.799309 10815 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.807927 10813 leader_election.cc:290] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.807698 10815 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.808516 10813 raft_consensus.cc:493] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.808943 10813 raft_consensus.cc:515] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.809882 10815 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:50.814348 10813 leader_election.cc:290] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.815433 10811 raft_consensus.cc:493] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.815963 10811 raft_consensus.cc:515] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.825278 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:50.819702 10813 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.818581 10811 leader_election.cc:290] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:50.829612 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.830606 10691 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:50.829612 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:50.837532 10617 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.843887 10831 raft_consensus.cc:515] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.849617 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
W20260709 12:08:50.838093 10729 leader_election.cc:343] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:50.852432 10831 leader_election.cc:290] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.852588 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:50.853219 10615 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.835919 10813 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.857306 10808 ts_tablet_manager.cc:1434] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.099s	user 0.015s	sys 0.018s
I20260709 12:08:50.858649 10808 tablet_bootstrap.cc:492] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.858812 10809 tablet_bootstrap.cc:492] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:50.859328 10809 ts_tablet_manager.cc:1403] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.006s
I20260709 12:08:50.851635 10616 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:50.862453 10809 raft_consensus.cc:359] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.868661 10809 raft_consensus.cc:385] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.868785 10813 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.869048 10809 raft_consensus.cc:740] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.870024 10617 raft_consensus.cc:2468] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:50.866144 10808 tablet_bootstrap.cc:654] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.869923 10809 consensus_queue.cc:260] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.874176 10809 ts_tablet_manager.cc:1434] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 12:08:50.875252 10809 tablet_bootstrap.cc:492] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:50.876530 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:50.877287 10766 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:50.878827 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:50.879519 10765 raft_consensus.cc:2468] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:50.881047 10806 tablet_bootstrap.cc:492] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:50.870647 10729 leader_election.cc:304] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.881202 10581 leader_election.cc:304] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.881735 10806 ts_tablet_manager.cc:1403] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.005s
I20260709 12:08:50.882828 10811 raft_consensus.cc:2804] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.883216 10811 raft_consensus.cc:493] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.883540 10811 raft_consensus.cc:3060] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.862751 10615 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:50.883893 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.885142 10691 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:50.885983 10840 raft_consensus.cc:2804] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.886502 10840 raft_consensus.cc:493] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.886869 10840 raft_consensus.cc:3060] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.887521 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.888448 10690 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:50.890750 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.891412 10692 raft_consensus.cc:2468] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:50.882342 10581 leader_election.cc:304] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.893437 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:50.894225 10691 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.901445 10806 raft_consensus.cc:359] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.902880 10729 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.904382 10811 raft_consensus.cc:515] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.905309 10831 raft_consensus.cc:2804] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.905474 10732 leader_election.cc:304] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:50.906512 10837 raft_consensus.cc:493] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.906778 10811 leader_election.cc:290] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:50.907310 10811 raft_consensus.cc:2804] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.907053 10837 raft_consensus.cc:515] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.907655 10811 raft_consensus.cc:493] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.907990 10811 raft_consensus.cc:3060] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.905689 10831 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.911284 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:50.911684 10813 raft_consensus.cc:2804] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:50.913478 10732 leader_election.cc:304] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.902093 10806 raft_consensus.cc:385] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.918391 10808 tablet_bootstrap.cc:492] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:50.918697 10806 raft_consensus.cc:740] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.919127 10808 ts_tablet_manager.cc:1403] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.000s
I20260709 12:08:50.915347 10809 tablet_bootstrap.cc:654] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.919534 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
W20260709 12:08:50.921765 10729 leader_election.cc:343] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:50.915618 10837 leader_election.cc:290] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.922986 10843 raft_consensus.cc:493] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:50.923164 10813 raft_consensus.cc:697] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:50.923668 10843 raft_consensus.cc:515] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:50.922394 10808 raft_consensus.cc:359] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.924065 10813 consensus_queue.cc:237] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.924850 10808 raft_consensus.cc:385] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:50.925354 10808 raft_consensus.cc:740] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:50.926779 10837 raft_consensus.cc:2804] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:50.926318 10808 consensus_queue.cc:260] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.927254 10837 raft_consensus.cc:697] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:50.928933 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:50.929898 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:50.929587 10837 consensus_queue.cc:237] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.917202 10831 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.928030 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:50.930595 10615 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
W20260709 12:08:50.927893 10732 leader_election.cc:343] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:50.932530 10765 raft_consensus.cc:2468] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 0.
I20260709 12:08:50.929124 10840 raft_consensus.cc:515] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.934108 10732 leader_election.cc:304] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:50.934203 10656 leader_election.cc:304] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.934569 10808 ts_tablet_manager.cc:1434] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:08:50.919550 10806 consensus_queue.cc:260] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
W20260709 12:08:50.929555 10581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:40145, user_credentials={real_user=slave}} blocked reactor thread for 47302.7us
I20260709 12:08:50.936395 10808 tablet_bootstrap.cc:492] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:50.937119 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:50.937444 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:50.937820 10692 raft_consensus.cc:3060] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.937445 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:50.916873 10691 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:50.938834 10765 raft_consensus.cc:2393] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d36eb85f5564a36820405cd675f2a52 in current term 1: Already voted for candidate 850fd64d4a4442ce9820ee443cb35156 in this term.
I20260709 12:08:50.935526 10835 raft_consensus.cc:2804] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.939742 10835 raft_consensus.cc:493] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.940088 10835 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.935674 10815 raft_consensus.cc:2804] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.938298 10615 raft_consensus.cc:2393] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 850fd64d4a4442ce9820ee443cb35156 in current term 1: Already voted for candidate 5d36eb85f5564a36820405cd675f2a52 in this term.
I20260709 12:08:50.936102 10840 leader_election.cc:290] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.941126 10815 raft_consensus.cc:493] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:50.942886 10815 raft_consensus.cc:3060] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:50.944609 10808 tablet_bootstrap.cc:654] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:50.946151 10806 ts_tablet_manager.cc:1434] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:08:50.949430 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:50.950057 10765 raft_consensus.cc:2468] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:50.951462 10581 leader_election.cc:304] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:50.947074 10843 leader_election.cc:290] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.955830 10835 raft_consensus.cc:515] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.968669 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:50.973555 10835 leader_election.cc:290] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:50.973846 10691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:50.975803 10692 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:50.976120 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:50.977051 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:50.977303 10815 raft_consensus.cc:515] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:50.967469 10843 raft_consensus.cc:2804] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:50.992110 10729 leader_election.cc:304] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:50.998878 10512 catalog_manager.cc:5697] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.003062 10843 raft_consensus.cc:493] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:51.003554 10615 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.005802 10843 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.010564 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.013051 10815 leader_election.cc:290] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.014362 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.015031 10765 raft_consensus.cc:3060] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.015096 10811 raft_consensus.cc:515] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.015240 10580 leader_election.cc:304] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52; no voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156
W20260709 12:08:51.017447 10580 leader_election.cc:343] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:51.018002 10811 leader_election.cc:290] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.008690 10813 raft_consensus.cc:2804] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.018997 10813 raft_consensus.cc:697] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.020608 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.020696 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.021546 10690 raft_consensus.cc:2393] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d36eb85f5564a36820405cd675f2a52 in current term 1: Already voted for candidate 4a5434ea7700440a8c49ae38c831a261 in this term.
I20260709 12:08:51.022187 10847 raft_consensus.cc:2749] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.023000 10806 tablet_bootstrap.cc:492] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:51.023118 10815 raft_consensus.cc:493] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.023573 10815 raft_consensus.cc:515] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
W20260709 12:08:51.004680 10581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:40145, user_credentials={real_user=slave}} blocked reactor thread for 52927.3us
I20260709 12:08:51.028749 10617 raft_consensus.cc:2393] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a5434ea7700440a8c49ae38c831a261 in current term 1: Already voted for candidate 5d36eb85f5564a36820405cd675f2a52 in this term.
I20260709 12:08:51.029083 10764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:51.027508 10815 leader_election.cc:290] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.031867 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
W20260709 12:08:51.032476 10729 leader_election.cc:343] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:51.032331 10831 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
W20260709 12:08:51.036126 10658 leader_election.cc:343] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:51.036680 10766 raft_consensus.cc:2393] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a5434ea7700440a8c49ae38c831a261 in current term 1: Already voted for candidate 850fd64d4a4442ce9820ee443cb35156 in this term.
I20260709 12:08:51.037002 10616 raft_consensus.cc:2393] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a5434ea7700440a8c49ae38c831a261 in current term 1: Already voted for candidate 5d36eb85f5564a36820405cd675f2a52 in this term.
I20260709 12:08:51.038009 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.038163 10765 raft_consensus.cc:2468] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 1.
I20260709 12:08:51.038793 10617 raft_consensus.cc:2393] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a5434ea7700440a8c49ae38c831a261 in current term 1: Already voted for candidate 850fd64d4a4442ce9820ee443cb35156 in this term.
I20260709 12:08:51.039639 10656 leader_election.cc:304] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:51.040262 10658 leader_election.cc:304] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261; no voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:51.041366 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:51.041147 10813 consensus_queue.cc:237] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
W20260709 12:08:51.043035 10732 leader_election.cc:343] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:51.046742 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.043521 10815 raft_consensus.cc:2804] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.044138 10831 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:51.044045 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.048911 10690 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.045974 10806 tablet_bootstrap.cc:654] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.056327 10808 tablet_bootstrap.cc:492] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:51.056950 10808 ts_tablet_manager.cc:1403] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.018s
I20260709 12:08:51.047605 10656 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261; no voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:51.060139 10765 raft_consensus.cc:2393] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d36eb85f5564a36820405cd675f2a52 in current term 1: Already voted for candidate 4a5434ea7700440a8c49ae38c831a261 in this term.
I20260709 12:08:51.048506 10615 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:51.062531 10815 raft_consensus.cc:697] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 LEADER]: Becoming Leader. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:08:51.064538 10808 raft_consensus.cc:359] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.067179 10808 raft_consensus.cc:385] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.065212 10809 tablet_bootstrap.cc:492] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:51.067612 10808 raft_consensus.cc:740] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.070592 10581 leader_election.cc:304] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52; no voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:51.068219 10732 leader_election.cc:304] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:51.070216 10808 consensus_queue.cc:260] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.070084 10809 ts_tablet_manager.cc:1403] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.195s	user 0.036s	sys 0.026s
I20260709 12:08:51.074671 10831 raft_consensus.cc:2804] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.074981 10847 raft_consensus.cc:2749] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.074898 10843 raft_consensus.cc:515] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:51.076347 10808 ts_tablet_manager.cc:1434] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:08:51.078557 10808 tablet_bootstrap.cc:492] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156: Bootstrap starting.
I20260709 12:08:51.078795 10831 raft_consensus.cc:697] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.072715 10815 consensus_queue.cc:237] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.080981 10831 consensus_queue.cc:237] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.077484 10851 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.089983 10806 tablet_bootstrap.cc:492] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:51.090615 10806 ts_tablet_manager.cc:1403] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.011s
I20260709 12:08:51.092631 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.089085 10843 leader_election.cc:290] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Requested vote from peers 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:51.087109 10690 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
W20260709 12:08:51.095615 10580 leader_election.cc:343] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:51.094522 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.098093 10729 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:51.099004 10852 raft_consensus.cc:2749] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.098338 10765 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.100459 10831 raft_consensus.cc:2804] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.101020 10831 raft_consensus.cc:697] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.101931 10831 consensus_queue.cc:237] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.106889 10809 raft_consensus.cc:359] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.107430 10808 tablet_bootstrap.cc:654] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.107779 10809 raft_consensus.cc:385] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.110213 10809 raft_consensus.cc:740] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.111671 10806 raft_consensus.cc:359] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.115185 10806 raft_consensus.cc:385] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.119573 10806 raft_consensus.cc:740] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.120776 10806 consensus_queue.cc:260] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.123217 10765 raft_consensus.cc:2468] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 1.
I20260709 12:08:51.114836 10809 consensus_queue.cc:260] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.125579 10806 ts_tablet_manager.cc:1434] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:08:51.126603 10806 tablet_bootstrap.cc:492] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:51.126613 10808 tablet_bootstrap.cc:492] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156: No bootstrap required, opened a new log
I20260709 12:08:51.126803 10581 leader_election.cc:304] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:51.127331 10808 ts_tablet_manager.cc:1403] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.016s
I20260709 12:08:51.127835 10843 raft_consensus.cc:2804] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.128360 10843 raft_consensus.cc:697] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:51.126827 10809 ts_tablet_manager.cc:1434] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:08:51.122931 10851 raft_consensus.cc:2749] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.129545 10809 tablet_bootstrap.cc:492] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:51.129225 10843 consensus_queue.cc:237] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:51.130679 10808 raft_consensus.cc:359] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.131353 10808 raft_consensus.cc:385] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.131625 10808 raft_consensus.cc:740] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.133950 10808 consensus_queue.cc:260] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.136054 10808 ts_tablet_manager.cc:1434] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:08:51.137069 10809 tablet_bootstrap.cc:654] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.142954 10806 tablet_bootstrap.cc:654] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.151117 10515 catalog_manager.cc:5697] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4a5434ea7700440a8c49ae38c831a261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.152168 10809 tablet_bootstrap.cc:492] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:51.156056 10809 ts_tablet_manager.cc:1403] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.002s
I20260709 12:08:51.157408 10513 catalog_manager.cc:5697] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.161476 10809 raft_consensus.cc:359] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.162314 10809 raft_consensus.cc:385] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.162732 10806 tablet_bootstrap.cc:492] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:51.162665 10809 raft_consensus.cc:740] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.163502 10806 ts_tablet_manager.cc:1403] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.003s
I20260709 12:08:51.163957 10809 consensus_queue.cc:260] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.166256 10809 ts_tablet_manager.cc:1434] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:08:51.166280 10806 raft_consensus.cc:359] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.167234 10806 raft_consensus.cc:385] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.167465 10809 tablet_bootstrap.cc:492] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:51.167474 10806 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.168510 10806 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.170879 10806 ts_tablet_manager.cc:1434] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:51.171833 10806 tablet_bootstrap.cc:492] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: Bootstrap starting.
I20260709 12:08:51.178294 10806 tablet_bootstrap.cc:654] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.178313 10809 tablet_bootstrap.cc:654] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.178783 10512 catalog_manager.cc:5697] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.180830 10512 catalog_manager.cc:5697] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.183038 10512 catalog_manager.cc:5697] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.186228 10512 catalog_manager.cc:5697] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.189575 10806 tablet_bootstrap.cc:492] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: No bootstrap required, opened a new log
I20260709 12:08:51.190112 10806 ts_tablet_manager.cc:1403] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:08:51.190090 10815 raft_consensus.cc:493] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.191092 10815 raft_consensus.cc:515] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.193159 10806 raft_consensus.cc:359] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.193801 10806 raft_consensus.cc:385] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.194103 10806 raft_consensus.cc:740] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.194957 10815 leader_election.cc:290] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.194811 10806 consensus_queue.cc:260] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.195775 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.196727 10806 ts_tablet_manager.cc:1434] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:51.196882 10615 raft_consensus.cc:2393] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a5434ea7700440a8c49ae38c831a261 in current term 1: Already voted for candidate 850fd64d4a4442ce9820ee443cb35156 in this term.
I20260709 12:08:51.198843 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:51.200435 10656 leader_election.cc:304] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261; no voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:51.201542 10809 tablet_bootstrap.cc:492] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:51.201546 10815 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.202230 10809 ts_tablet_manager.cc:1403] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.010s
I20260709 12:08:51.204897 10809 raft_consensus.cc:359] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.205543 10809 raft_consensus.cc:385] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.205798 10809 raft_consensus.cc:740] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.206527 10809 consensus_queue.cc:260] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.209157 10815 raft_consensus.cc:2749] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.210995 10809 ts_tablet_manager.cc:1434] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:08:51.211995 10809 tablet_bootstrap.cc:492] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:51.218057 10809 tablet_bootstrap.cc:654] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.222770 10809 tablet_bootstrap.cc:492] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:51.223162 10809 ts_tablet_manager.cc:1403] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:08:51.225378 10809 raft_consensus.cc:359] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.225988 10809 raft_consensus.cc:385] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.226203 10809 raft_consensus.cc:740] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.226886 10809 consensus_queue.cc:260] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.228601 10831 raft_consensus.cc:493] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.228727 10809 ts_tablet_manager.cc:1434] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:08:51.229173 10831 raft_consensus.cc:515] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.229808 10809 tablet_bootstrap.cc:492] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261: Bootstrap starting.
I20260709 12:08:51.231350 10831 leader_election.cc:290] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:51.232136 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.232784 10615 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:51.234090 10732 leader_election.cc:304] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.234757 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:51.235450 10690 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:51.236477 10809 tablet_bootstrap.cc:654] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:51.237030 10831 raft_consensus.cc:2804] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:51.237483 10831 raft_consensus.cc:493] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:51.237999 10831 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.242082 10809 tablet_bootstrap.cc:492] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261: No bootstrap required, opened a new log
I20260709 12:08:51.242609 10809 ts_tablet_manager.cc:1403] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:08:51.245378 10809 raft_consensus.cc:359] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:51.245532 10831 raft_consensus.cc:515] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.246121 10809 raft_consensus.cc:385] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:51.246413 10809 raft_consensus.cc:740] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Initialized, Role: FOLLOWER
I20260709 12:08:51.247334 10843 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.247188 10809 consensus_queue.cc:260] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:51.247822 10843 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.248615 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:51.249114 10831 leader_election.cc:290] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:51.249150 10615 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.249498 10809 ts_tablet_manager.cc:1434] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:51.252000 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:51.252779 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:51.252786 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.252794 10690 raft_consensus.cc:2393] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d36eb85f5564a36820405cd675f2a52 in current term 1: Already voted for candidate 850fd64d4a4442ce9820ee443cb35156 in this term.
I20260709 12:08:51.253826 10692 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.256289 10615 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:51.257546 10732 leader_election.cc:304] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.258353 10831 raft_consensus.cc:2804] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.258896 10831 raft_consensus.cc:697] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.258991 10580 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52; no voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:51.260416 10847 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.260411 10831 consensus_queue.cc:237] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.262348 10843 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.264693 10692 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:51.268669 10847 raft_consensus.cc:2749] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.274142 10515 catalog_manager.cc:5697] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.295665 10831 raft_consensus.cc:493] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.296219 10831 raft_consensus.cc:515] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.298048 10831 leader_election.cc:290] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:51.299115 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b01d59a784c40987dde98217ddab7" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.299289 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b01d59a784c40987dde98217ddab7" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:51.299726 10615 raft_consensus.cc:2468] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:51.300088 10692 raft_consensus.cc:2468] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 0.
I20260709 12:08:51.300923 10732 leader_election.cc:304] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.301702 10831 raft_consensus.cc:2804] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:51.302081 10831 raft_consensus.cc:493] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:51.302369 10831 raft_consensus.cc:3060] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.306740 10847 raft_consensus.cc:493] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.307199 10847 raft_consensus.cc:515] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.307891 10831 raft_consensus.cc:515] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.309319 10847 leader_election.cc:290] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.309813 10831 leader_election.cc:290] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:51.310003 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:51.310567 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261" is_pre_election: true
I20260709 12:08:51.310657 10765 raft_consensus.cc:2468] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:51.310904 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b01d59a784c40987dde98217ddab7" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.310864 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334b01d59a784c40987dde98217ddab7" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:51.311262 10692 raft_consensus.cc:2468] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 0.
I20260709 12:08:51.311674 10690 raft_consensus.cc:3060] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.311797 10615 raft_consensus.cc:3060] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.312209 10581 leader_election.cc:304] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.313076 10847 raft_consensus.cc:2804] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:51.313470 10847 raft_consensus.cc:493] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:51.313773 10847 raft_consensus.cc:3060] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.318342 10690 raft_consensus.cc:2468] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:51.319043 10615 raft_consensus.cc:2468] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 1.
I20260709 12:08:51.319603 10729 leader_election.cc:304] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.320480 10813 raft_consensus.cc:2804] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.320230 10847 raft_consensus.cc:515] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.320190 10831 consensus_queue.cc:1048] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:51.321141 10813 raft_consensus.cc:697] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.321985 10813 consensus_queue.cc:237] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.323256 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.323808 10690 raft_consensus.cc:3060] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.323812 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.324584 10765 raft_consensus.cc:3060] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.331580 10690 raft_consensus.cc:2468] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 1.
I20260709 12:08:51.333768 10847 leader_election.cc:290] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.333592 10580 leader_election.cc:304] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:08:51.333894 10515 catalog_manager.cc:5697] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.335076 10847 raft_consensus.cc:2804] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:51.335644 10847 raft_consensus.cc:697] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:51.336515 10847 consensus_queue.cc:237] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.333573 10765 raft_consensus.cc:2468] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 1.
I20260709 12:08:51.350203 10815 raft_consensus.cc:493] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:51.350737 10815 raft_consensus.cc:515] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:51.351972 10837 consensus_queue.cc:1048] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.352707 10815 leader_election.cc:290] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145), 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049)
I20260709 12:08:51.354219 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:08:51.354969 10765 raft_consensus.cc:2393] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a5434ea7700440a8c49ae38c831a261 in current term 1: Already voted for candidate 5d36eb85f5564a36820405cd675f2a52 in this term.
I20260709 12:08:51.355945 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:08:51.355468 10515 catalog_manager.cc:5697] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.358961 10656 leader_election.cc:304] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261; no voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:51.360028 10851 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:51.366600 10851 raft_consensus.cc:2749] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:51.378674 10837 consensus_queue.cc:1048] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.389678 10831 consensus_queue.cc:1048] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.479184 10851 consensus_queue.cc:1048] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.488575 10831 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.492441 10831 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.492689 10854 consensus_queue.cc:1048] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.575623 10837 consensus_queue.cc:1048] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.585196 10843 consensus_queue.cc:1048] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.587510 10831 consensus_queue.cc:1048] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.600950 10886 consensus_queue.cc:1048] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:51.601156 10831 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:51.625387 10837 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.653704 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:08:51.654240 10765 raft_consensus.cc:606] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:51.659945 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:08:51.660411 10765 raft_consensus.cc:606] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:51.665503 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:08:51.665920 10765 raft_consensus.cc:606] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:51.670863 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:08:51.671270 10765 raft_consensus.cc:606] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:08:51.679509 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:08:51.680011 10765 raft_consensus.cc:606] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Received request to transfer leadership to TS 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:51.685056 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:08:51.685559 10765 raft_consensus.cc:606] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Received request to transfer leadership to TS 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:51.700032 10616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:57392
I20260709 12:08:51.700742 10616 raft_consensus.cc:606] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Received request to transfer leadership to TS 4a5434ea7700440a8c49ae38c831a261
I20260709 12:08:51.728228 10837 consensus_queue.cc:1048] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.736109 10813 raft_consensus.cc:993] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:51.736675 10813 raft_consensus.cc:1081] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:51.739668 10615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57380
I20260709 12:08:51.741083 10615 raft_consensus.cc:493] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.741523 10615 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.742906 10813 consensus_queue.cc:1048] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.752313 10615 raft_consensus.cc:515] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.753674 10616 raft_consensus.cc:1240] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Rejecting Update request from peer 850fd64d4a4442ce9820ee443cb35156 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:51.757205 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.757836 10690 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.757879 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.758148 10813 consensus_queue.cc:1059] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:51.758934 10615 leader_election.cc:290] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.759572 10765 raft_consensus.cc:3055] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:51.759960 10765 raft_consensus.cc:740] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.760902 10765 consensus_queue.cc:260] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.762037 10765 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.763643 10690 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:51.765959 10580 leader_election.cc:304] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:08:51.766736 10886 raft_consensus.cc:2804] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:51.767252 10886 raft_consensus.cc:697] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:51.768153 10886 consensus_queue.cc:237] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.769670 10765 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
W20260709 12:08:51.770259 10837 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:08:51.779371 10514 catalog_manager.cc:5697] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 1 to 2, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.801564 10813 consensus_queue.cc:1048] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.805806 10886 consensus_queue.cc:1048] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:51.815411 10837 consensus_queue.cc:1048] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.827606 10886 consensus_queue.cc:1048] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:51.833083 10837 raft_consensus.cc:993] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:08:51.833592 10837 raft_consensus.cc:1081] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Signalling peer 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:08:51.835433 10692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:35908
I20260709 12:08:51.835964 10692 raft_consensus.cc:493] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.836328 10692 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.840157 10843 raft_consensus.cc:993] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:08:51.840950 10843 raft_consensus.cc:1081] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Signalling peer 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:08:51.843573 10690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:35918
I20260709 12:08:51.844182 10690 raft_consensus.cc:493] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.843922 10692 raft_consensus.cc:515] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.844528 10690 raft_consensus.cc:3060] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.847151 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.847711 10765 raft_consensus.cc:3055] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:51.848030 10765 raft_consensus.cc:740] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.848862 10765 consensus_queue.cc:260] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.849944 10765 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.852398 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:51.852985 10615 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.859748 10831 raft_consensus.cc:993] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:51.859833 10692 leader_election.cc:290] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 2 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.860344 10831 raft_consensus.cc:1081] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:51.851469 10690 raft_consensus.cc:515] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.862690 10765 raft_consensus.cc:2468] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 2.
I20260709 12:08:51.863286 10616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57380
I20260709 12:08:51.863241 10690 leader_election.cc:290] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 2 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.864008 10616 raft_consensus.cc:493] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.863902 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.864488 10616 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.864645 10766 raft_consensus.cc:3060] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.859750 10615 raft_consensus.cc:2468] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 2.
I20260709 12:08:51.865255 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf2d66e70474f5aa30a60415813c99b" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:51.865890 10617 raft_consensus.cc:3055] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:51.866250 10617 raft_consensus.cc:740] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:51.866200 10656 leader_election.cc:304] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.867302 10854 raft_consensus.cc:2804] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:51.867810 10854 raft_consensus.cc:697] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Becoming Leader. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:08:51.868635 10854 consensus_queue.cc:237] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.867317 10617 consensus_queue.cc:260] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.870611 10617 raft_consensus.cc:3060] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.872987 10766 raft_consensus.cc:2468] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 2.
I20260709 12:08:51.872682 10616 raft_consensus.cc:515] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.875017 10656 leader_election.cc:304] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:51.876161 10854 raft_consensus.cc:2804] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:51.877017 10854 raft_consensus.cc:697] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Becoming Leader. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:08:51.878332 10617 raft_consensus.cc:2468] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 2.
I20260709 12:08:51.878050 10854 consensus_queue.cc:237] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.881512 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:51.882092 10690 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.878584 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.884614 10766 raft_consensus.cc:3055] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:51.884961 10766 raft_consensus.cc:740] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.877041 10616 leader_election.cc:290] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.885917 10766 consensus_queue.cc:260] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.887097 10766 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.889065 10690 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:51.889139 10514 catalog_manager.cc:5697] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 reported cstate change: term changed from 1 to 2, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4a5434ea7700440a8c49ae38c831a261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.890275 10580 leader_election.cc:304] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:08:51.891228 10886 raft_consensus.cc:2804] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:51.890872 10514 catalog_manager.cc:5697] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 reported cstate change: term changed from 1 to 2, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4a5434ea7700440a8c49ae38c831a261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.891719 10886 raft_consensus.cc:697] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:51.892921 10766 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:51.893079 10886 consensus_queue.cc:237] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.904234 10512 catalog_manager.cc:5697] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 1 to 2, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:51.977660 10896 raft_consensus.cc:993] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:08:51.978168 10896 raft_consensus.cc:1081] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Signalling peer 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:08:51.979976 10690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:35908
I20260709 12:08:51.980485 10690 raft_consensus.cc:493] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.980803 10690 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.987133 10690 raft_consensus.cc:515] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.990082 10690 leader_election.cc:290] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 2 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:51.990825 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:51.991667 10616 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:51.991546 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:51.992357 10766 raft_consensus.cc:3055] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:51.992888 10766 raft_consensus.cc:740] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:51.994290 10766 consensus_queue.cc:260] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:51.996083 10766 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.003212 10616 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 2.
I20260709 12:08:52.004688 10658 leader_election.cc:304] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:08:52.005034 10766 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 2.
I20260709 12:08:52.005899 10854 raft_consensus.cc:2804] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:52.006384 10854 raft_consensus.cc:697] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Becoming Leader. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:08:52.007236 10854 consensus_queue.cc:237] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.014456 10512 catalog_manager.cc:5697] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 reported cstate change: term changed from 1 to 2, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4a5434ea7700440a8c49ae38c831a261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:52.027418 10831 raft_consensus.cc:993] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:52.028007 10831 raft_consensus.cc:1081] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:52.029613 10616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57380
I20260709 12:08:52.030320 10616 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.030769 10616 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.032719 10831 raft_consensus.cc:993] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:52.033150 10837 raft_consensus.cc:1081] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:08:52.034711 10617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57380
I20260709 12:08:52.035284 10617 raft_consensus.cc:493] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.035662 10617 raft_consensus.cc:3060] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.036761 10616 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.038712 10616 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:52.039809 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:52.040057 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:52.040517 10690 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.040628 10766 raft_consensus.cc:3055] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:52.041024 10766 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:52.041807 10766 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.042706 10766 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.045157 10617 raft_consensus.cc:515] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.047724 10617 leader_election.cc:290] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:08:52.047999 10766 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:52.048063 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:52.048655 10692 raft_consensus.cc:3060] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.048708 10690 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:52.049499 10581 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:52.050371 10886 raft_consensus.cc:2804] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:52.050907 10886 raft_consensus.cc:697] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:52.050993 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:08:52.051558 10766 raft_consensus.cc:3055] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:52.051870 10766 raft_consensus.cc:740] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:52.051775 10886 consensus_queue.cc:237] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.052713 10766 consensus_queue.cc:260] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.053807 10766 raft_consensus.cc:3060] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:52.057086 10692 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:52.058959 10580 leader_election.cc:304] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:08:52.060204 10886 raft_consensus.cc:2804] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:52.061085 10886 raft_consensus.cc:697] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:52.062870 10766 raft_consensus.cc:2468] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:08:52.061741 10512 catalog_manager.cc:5697] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 1 to 2, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:52.062829 10886 consensus_queue.cc:237] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:52.076903 10512 catalog_manager.cc:5697] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 1 to 2, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:52.280984 10692 raft_consensus.cc:1275] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.282706 10886 consensus_queue.cc:1048] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.291265 10766 raft_consensus.cc:1275] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.293286 10886 consensus_queue.cc:1048] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:52.324560 10617 raft_consensus.cc:1275] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.326766 10854 consensus_queue.cc:1048] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.338145 10766 raft_consensus.cc:1275] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.339598 10854 consensus_queue.cc:1048] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.358368 10617 raft_consensus.cc:1275] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.359772 10854 consensus_queue.cc:1048] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.369171 10766 raft_consensus.cc:1275] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.370965 10854 consensus_queue.cc:1048] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.376226 10692 raft_consensus.cc:1275] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.377776 10886 consensus_queue.cc:1048] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.391827 10766 raft_consensus.cc:1275] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.393671 10900 consensus_queue.cc:1048] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.396335 10617 raft_consensus.cc:1275] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.398335 10854 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.406801 10766 raft_consensus.cc:1275] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.408311 10852 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.493142 10692 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.494625 10900 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.503589 10766 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.505050 10843 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.521042 10766 raft_consensus.cc:1275] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.522199 10843 consensus_queue.cc:1048] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:52.530866 10692 raft_consensus.cc:1275] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:52.532407 10847 consensus_queue.cc:1048] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:54.738479  9938 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:54.739285  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.757082 10617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:57398
I20260709 12:08:54.757627 10617 raft_consensus.cc:606] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Received request to transfer leadership to TS 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:54.760543 10617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:57398
I20260709 12:08:54.761106 10617 raft_consensus.cc:606] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Received request to transfer leadership to TS 850fd64d4a4442ce9820ee443cb35156
I20260709 12:08:54.762373  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:54.763041  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.892469 10843 raft_consensus.cc:993] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:08:54.893038 10903 raft_consensus.cc:1081] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Signalling peer 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:08:54.894747 10765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:40132
I20260709 12:08:54.895501 10765 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:54.895855 10765 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:54.902065 10765 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:54.903976 10765 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 3 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:54.904897 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:54.905274 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:54.905638 10617 raft_consensus.cc:3055] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:54.905930 10690 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:54.906029 10617 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:54.907020 10617 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:54.908030 10617 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:54.911455 10690 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 3.
I20260709 12:08:54.912691 10729 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:54.913445 10837 raft_consensus.cc:2804] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:54.914669 10617 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 3.
I20260709 12:08:54.916343 10837 raft_consensus.cc:697] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:54.917862 10837 consensus_queue.cc:237] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:08:54.920245 10903 raft_consensus.cc:993] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:08:54.920882 10843 raft_consensus.cc:1081] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Signalling peer 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:08:54.922734 10766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:40132
I20260709 12:08:54.923414 10766 raft_consensus.cc:493] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:54.923830 10766 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.928551 10515 catalog_manager.cc:5697] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 2 to 3, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:54.930213 10766 raft_consensus.cc:515] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:54.932868 10766 leader_election.cc:290] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 2 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:08:54.933059 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:08:54.933459 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:08:54.933784 10617 raft_consensus.cc:3055] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:54.934140 10617 raft_consensus.cc:740] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:08:54.934247 10690 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.935103 10617 consensus_queue.cc:260] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:54.936523 10617 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:54.942155 10690 raft_consensus.cc:2468] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 2.
I20260709 12:08:54.943415 10729 leader_election.cc:304] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:08:54.943598 10617 raft_consensus.cc:2468] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 2.
I20260709 12:08:54.944294 10837 raft_consensus.cc:2804] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:54.944886 10837 raft_consensus.cc:697] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:08:54.945726 10837 consensus_queue.cc:237] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:08:54.953234 10515 catalog_manager.cc:5697] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 1 to 2, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:55.385071 10617 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:55.386412 10837 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:55.396494 10690 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:55.398234 10837 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:55.422935 10617 raft_consensus.cc:1275] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:55.424942 10907 consensus_queue.cc:1048] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:55.434418 10690 raft_consensus.cc:1275] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:55.435906 10837 consensus_queue.cc:1048] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:55.764259  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.769768  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.770161  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.771471  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.778582  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.779121  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.780330  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.785765  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.786290  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.787199  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.793148  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.793546  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.794687  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.799856  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.800287  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.801345  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.808662  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.809165  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.810372  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:01.816268  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:01.816733  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.817781  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:02.824514  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:02.825008  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:03.825991  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:03.831794  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:03.832217  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.864027  9938 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:04.869287 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:09:04.870043 10765 raft_consensus.cc:606] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:09:04.883520 10765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:40156
I20260709 12:09:04.884042 10765 raft_consensus.cc:606] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:09:04.900671 10692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57220
I20260709 12:09:04.901170 10692 raft_consensus.cc:606] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:09:04.906457 10692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57220
I20260709 12:09:04.907148 10692 raft_consensus.cc:606] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:09:04.913038 10692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
mode: GRACEFUL
new_leader_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57220
I20260709 12:09:04.913497 10692 raft_consensus.cc:606] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Received request to transfer leadership to TS 5d36eb85f5564a36820405cd675f2a52
I20260709 12:09:05.069100 10925 raft_consensus.cc:993] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.069723 10937 raft_consensus.cc:1081] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.071745 10616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57380
I20260709 12:09:05.072436 10616 raft_consensus.cc:493] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.072932 10616 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.079008 10616 raft_consensus.cc:515] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:09:05.080927 10616 leader_election.cc:290] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 3 election: Requested vote from peers 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:09:05.082077 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:05.082077 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38bf3517a1442c38dd30d18f337e1e0" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:05.083133 10765 raft_consensus.cc:3055] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.083225 10692 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.083547 10765 raft_consensus.cc:740] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:09:05.084506 10765 consensus_queue.cc:260] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:09:05.085907 10765 raft_consensus.cc:3060] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.091177 10692 raft_consensus.cc:2468] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 3.
I20260709 12:09:05.092635 10580 leader_election.cc:304] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:09:05.092907 10765 raft_consensus.cc:2468] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 3.
I20260709 12:09:05.093677 10923 raft_consensus.cc:2804] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.094892 10923 raft_consensus.cc:697] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:05.095794 10923 consensus_queue.cc:237] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } }
I20260709 12:09:05.103300 10933 raft_consensus.cc:993] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.103780 10933 raft_consensus.cc:1081] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.104423 10515 catalog_manager.cc:5697] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 2 to 3, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.105561 10616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57388
I20260709 12:09:05.106179 10616 raft_consensus.cc:493] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.106763 10616 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.111613 10925 raft_consensus.cc:993] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.112221 10925 raft_consensus.cc:1081] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.113821 10617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57380
I20260709 12:09:05.114259 10617 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.114567 10617 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.114948 10616 raft_consensus.cc:515] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.118994 10616 leader_election.cc:290] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 3 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:05.118944 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:05.119614 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:05.119995 10617 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.119685 10692 raft_consensus.cc:3055] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.120321 10765 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.120746 10692 raft_consensus.cc:740] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:09:05.121680 10692 consensus_queue.cc:260] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.123751 10692 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.125177 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:05.126060 10766 raft_consensus.cc:3055] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:05.126814 10766 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:09:05.127759 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:05.128294 10690 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.127923 10766 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.129562 10766 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.130050 10692 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 3.
I20260709 12:09:05.131126 10580 leader_election.cc:304] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:09:05.131870 10923 raft_consensus.cc:2804] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.132349 10923 raft_consensus.cc:697] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:05.133235 10923 consensus_queue.cc:237] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.134577 10617 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 4 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:05.140228 10690 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 4.
I20260709 12:09:05.141222 10580 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:09:05.141646 10765 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 3.
I20260709 12:09:05.142216 10938 raft_consensus.cc:2804] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:05.147070 10938 raft_consensus.cc:697] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:05.148074 10938 consensus_queue.cc:237] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.148613 10766 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 4.
I20260709 12:09:05.158843 10515 catalog_manager.cc:5697] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 2 to 3, leader changed from 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.159881 10515 catalog_manager.cc:5697] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 3 to 4, leader changed from 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 4 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.287065 10940 raft_consensus.cc:993] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.287585 10933 raft_consensus.cc:1081] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.289026 10617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57388
I20260709 12:09:05.289563 10617 raft_consensus.cc:493] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.289865 10617 raft_consensus.cc:3060] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.294402 10617 raft_consensus.cc:515] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.295964 10617 leader_election.cc:290] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:05.296975 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:05.297109 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b56e789c2bd84202b9657efbd9b77ceb" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:05.297631 10690 raft_consensus.cc:3055] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:05.297698 10766 raft_consensus.cc:3060] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.297956 10690 raft_consensus.cc:740] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:09:05.298799 10690 consensus_queue.cc:260] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.299719 10690 raft_consensus.cc:3060] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.302742 10766 raft_consensus.cc:2468] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:09:05.304363 10690 raft_consensus.cc:2468] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 2.
I20260709 12:09:05.303972 10581 leader_election.cc:304] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:09:05.305593 10938 raft_consensus.cc:2804] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:05.306111 10938 raft_consensus.cc:697] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:05.306852 10938 consensus_queue.cc:237] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.314023 10515 catalog_manager.cc:5697] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 1 to 2, leader changed from 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.376330 10940 raft_consensus.cc:993] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: : Instructing follower 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.376848 10933 raft_consensus.cc:1081] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Signalling peer 5d36eb85f5564a36820405cd675f2a52 to start an election
I20260709 12:09:05.378736 10617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
 from {username='slave'} at 127.0.0.1:57388
I20260709 12:09:05.379232 10617 raft_consensus.cc:493] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.379539 10617 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.384502 10617 raft_consensus.cc:515] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.386263 10617 leader_election.cc:290] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 3 election: Requested vote from peers 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:05.387058 10690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:05.387358 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec0dd2c873b44e1b8314ba9ae641719" candidate_uuid: "5d36eb85f5564a36820405cd675f2a52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:05.387710 10690 raft_consensus.cc:3055] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.387952 10766 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.388072 10690 raft_consensus.cc:740] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:09:05.389005 10690 consensus_queue.cc:260] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.390002 10690 raft_consensus.cc:3060] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.392889 10766 raft_consensus.cc:2468] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 3.
I20260709 12:09:05.393855 10581 leader_election.cc:304] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:09:05.394591 10690 raft_consensus.cc:2468] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d36eb85f5564a36820405cd675f2a52 in term 3.
I20260709 12:09:05.394719 10938 raft_consensus.cc:2804] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.395267 10938 raft_consensus.cc:697] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Becoming Leader. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:05.396230 10938 consensus_queue.cc:237] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:05.406353 10515 catalog_manager.cc:5697] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 reported cstate change: term changed from 2 to 3, leader changed from 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130) to 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "5d36eb85f5564a36820405cd675f2a52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.541404 10690 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.542919 10938 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.547631 10766 raft_consensus.cc:1275] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.549201 10938 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.559391 10766 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.562994 10690 raft_consensus.cc:1275] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.564503 10945 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.564960 10938 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.590099 10765 raft_consensus.cc:1275] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.593500 10938 consensus_queue.cc:1048] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.603960 10690 raft_consensus.cc:1275] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.605216 10923 consensus_queue.cc:1048] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.746541 10690 raft_consensus.cc:1275] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:05.748000 10923 consensus_queue.cc:1048] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:05.757784 10765 raft_consensus.cc:1275] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:05.760807 10945 consensus_queue.cc:1048] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:05.935170 10690 raft_consensus.cc:1275] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.938342 10945 consensus_queue.cc:1048] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.955163 10765 raft_consensus.cc:1275] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Refusing update from remote peer 5d36eb85f5564a36820405cd675f2a52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.956947 10945 consensus_queue.cc:1048] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:07.955886  9938 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:07.956897  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.967199 10617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:57398
I20260709 12:09:07.968003 10617 raft_consensus.cc:606] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Received request to transfer leadership to TS 4a5434ea7700440a8c49ae38c831a261
I20260709 12:09:07.971154 10617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:57398
I20260709 12:09:07.971689 10617 raft_consensus.cc:606] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Received request to transfer leadership to TS 850fd64d4a4442ce9820ee443cb35156
I20260709 12:09:07.974291 10617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:57398
I20260709 12:09:07.974993 10617 raft_consensus.cc:606] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 LEADER]: Received request to transfer leadership to TS 850fd64d4a4442ce9820ee443cb35156
I20260709 12:09:07.977661 10617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a"
dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
mode: GRACEFUL
new_leader_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:57398
I20260709 12:09:07.978174 10617 raft_consensus.cc:606] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Received request to transfer leadership to TS 4a5434ea7700440a8c49ae38c831a261
I20260709 12:09:07.979409  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:07.979945  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.030225 10967 raft_consensus.cc:993] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:09:08.030995 10964 raft_consensus.cc:1081] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 LEADER]: Signalling peer 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:09:08.032521 10765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:08.032933 10765 raft_consensus.cc:493] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:08.033169 10765 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:08.038538 10765 raft_consensus.cc:515] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:08.040361 10765 leader_election.cc:290] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 5 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:09:08.041666 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:08.041677 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb02f3c977641f880c37e3061b987e1" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:09:08.042237 10692 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:08.042382 10617 raft_consensus.cc:3055] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:08.042775 10617 raft_consensus.cc:740] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:08.043578 10617 consensus_queue.cc:260] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:08.044513 10617 raft_consensus.cc:3060] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:08.047214 10692 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 5.
I20260709 12:09:08.048485 10729 leader_election.cc:304] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:09:08.049610 10925 raft_consensus.cc:2804] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:08.050747 10617 raft_consensus.cc:2468] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 5.
I20260709 12:09:08.054301 10925 raft_consensus.cc:697] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 5 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:09:08.060815 10925 consensus_queue.cc:237] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:08.888124 10515 catalog_manager.cc:5697] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 4 to 5, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 5 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:09.112792 10689 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 5 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:09.113987 10933 raft_consensus.cc:493] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d36eb85f5564a36820405cd675f2a52)
I20260709 12:09:09.114581 10933 raft_consensus.cc:515] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.117723 10933 leader_election.cc:290] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:09.119133 10933 raft_consensus.cc:493] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d36eb85f5564a36820405cd675f2a52)
I20260709 12:09:09.119657 10933 raft_consensus.cc:515] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
W20260709 12:09:09.121177 10581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:40145, user_credentials={real_user=slave}} blocked reactor thread for 524704us
I20260709 12:09:09.122413 10933 leader_election.cc:290] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:09.122735 10617 raft_consensus.cc:1275] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 5 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:09.123988 10978 raft_consensus.cc:993] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:09:09.124454 10978 raft_consensus.cc:1081] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Signalling peer 850fd64d4a4442ce9820ee443cb35156 to start an election
I20260709 12:09:09.125070 10977 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:09.131156 10765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:09:09.131384 10766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "850fd64d4a4442ce9820ee443cb35156" is_pre_election: true
I20260709 12:09:09.134585 10976 consensus_queue.cc:1048] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:09.141654 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:09:09.146236 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be5e555ec1944279e18bc9f335ca74f" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d36eb85f5564a36820405cd675f2a52" is_pre_election: true
I20260709 12:09:09.149497 10763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f"
dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
 from {username='slave'} at 127.0.0.1:40132
I20260709 12:09:09.150116 10763 raft_consensus.cc:493] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:09.152067 10763 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:09.159948 10658 leader_election.cc:304] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261; no voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:09:09.161203 10971 raft_consensus.cc:2749] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:09.164327 10763 raft_consensus.cc:515] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.166242 10763 leader_election.cc:290] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 4 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130:33417)
I20260709 12:09:09.167193 10615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:09:09.167857 10615 raft_consensus.cc:3055] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:09.168709 10615 raft_consensus.cc:740] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:09.171905 10692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f135afc2b84e36933c5eaa3eee9f1f" candidate_uuid: "850fd64d4a4442ce9820ee443cb35156" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
I20260709 12:09:09.172499 10692 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:09.169869 10615 consensus_queue.cc:260] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.173629 10615 raft_consensus.cc:3060] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:09.175475 10967 consensus_queue.cc:1175] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4a5434ea7700440a8c49ae38c831a261" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 3 } }
I20260709 12:09:09.178464 10970 raft_consensus.cc:993] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:09:09.178963 10970 raft_consensus.cc:1081] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Signalling peer 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:09:09.180425 10692 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 4.
I20260709 12:09:09.181906 10729 leader_election.cc:304] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:09:09.186290 10692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:35918
I20260709 12:09:09.185946 10982 raft_consensus.cc:993] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: : Instructing follower 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:09:09.186880 10692 raft_consensus.cc:493] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:09.187134 10982 raft_consensus.cc:1081] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Signalling peer 4a5434ea7700440a8c49ae38c831a261 to start an election
I20260709 12:09:09.187258 10692 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:09.187402 10658 leader_election.cc:304] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261; no voters: 5d36eb85f5564a36820405cd675f2a52, 850fd64d4a4442ce9820ee443cb35156
I20260709 12:09:09.190071 10688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a"
dest_uuid: "4a5434ea7700440a8c49ae38c831a261"
 from {username='slave'} at 127.0.0.1:35918
I20260709 12:09:09.190768 10688 raft_consensus.cc:493] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:09.191186 10688 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:09.192307 10971 raft_consensus.cc:2749] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:09.193812 10977 raft_consensus.cc:2804] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:09.194283 10977 raft_consensus.cc:697] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 4 LEADER]: Becoming Leader. State: Replica: 850fd64d4a4442ce9820ee443cb35156, State: Running, Role: LEADER
I20260709 12:09:09.195207 10692 raft_consensus.cc:515] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.195839 10977 consensus_queue.cc:237] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.197356 10615 raft_consensus.cc:2468] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 850fd64d4a4442ce9820ee443cb35156 in term 4.
I20260709 12:09:09.197996 10616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:09:09.198683 10616 raft_consensus.cc:3055] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:09.199038 10616 raft_consensus.cc:740] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:09.200294 10692 leader_election.cc:290] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:09.199908 10616 consensus_queue.cc:260] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.201287 10616 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:09.202293 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4af46546694659acdaaa5a90a7ce8e" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:09.203583 10763 raft_consensus.cc:3060] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:09.211987 10616 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 3.
I20260709 12:09:09.213680 10658 leader_election.cc:304] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 5d36eb85f5564a36820405cd675f2a52; no voters: 
I20260709 12:09:09.215339 10971 raft_consensus.cc:2804] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:09.216112 10971 raft_consensus.cc:697] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 3 LEADER]: Becoming Leader. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:09:09.222910 10763 raft_consensus.cc:2468] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 3.
I20260709 12:09:09.224298 10971 consensus_queue.cc:237] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.235209 10688 raft_consensus.cc:515] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.238752 10765 raft_consensus.cc:1240] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 4 LEADER]: Rejecting Update request from peer 5d36eb85f5564a36820405cd675f2a52 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:09.240228 10688 leader_election.cc:290] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 election: Requested vote from peers 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049), 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131:40145)
I20260709 12:09:09.242930 10617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d36eb85f5564a36820405cd675f2a52"
I20260709 12:09:09.243566 10617 raft_consensus.cc:3055] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:09.243888 10617 raft_consensus.cc:740] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d36eb85f5564a36820405cd675f2a52, State: Running, Role: LEADER
I20260709 12:09:09.244899 10617 consensus_queue.cc:260] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.245904 10617 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:09.246929 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46e54d8a44944538b2e12704c555d3a" candidate_uuid: "4a5434ea7700440a8c49ae38c831a261" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "850fd64d4a4442ce9820ee443cb35156"
I20260709 12:09:09.247577 10763 raft_consensus.cc:3060] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:09.252552 10514 catalog_manager.cc:5697] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 reported cstate change: term changed from 3 to 4, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 850fd64d4a4442ce9820ee443cb35156 (127.9.180.131). New cstate: current_term: 4 leader_uuid: "850fd64d4a4442ce9820ee443cb35156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:09.252882 10515 catalog_manager.cc:5697] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 reported cstate change: term changed from 2 to 3, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "4a5434ea7700440a8c49ae38c831a261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:09.267666 10763 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 3.
I20260709 12:09:09.269459 10656 leader_election.cc:304] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5434ea7700440a8c49ae38c831a261, 850fd64d4a4442ce9820ee443cb35156; no voters: 
I20260709 12:09:09.275134 10617 raft_consensus.cc:2468] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5434ea7700440a8c49ae38c831a261 in term 3.
I20260709 12:09:09.278846 10971 raft_consensus.cc:2804] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:09.279421 10971 raft_consensus.cc:697] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 3 LEADER]: Becoming Leader. State: Replica: 4a5434ea7700440a8c49ae38c831a261, State: Running, Role: LEADER
I20260709 12:09:09.280833 10971 consensus_queue.cc:237] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } }
I20260709 12:09:09.292686 10514 catalog_manager.cc:5697] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 reported cstate change: term changed from 2 to 3, leader changed from 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129) to 4a5434ea7700440a8c49ae38c831a261 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "4a5434ea7700440a8c49ae38c831a261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:09.370005  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.375422  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.375833  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:09.496905 10638 debug-util.cc:398] Leaking SignalData structure 0x7b0800133160 after lost signal to thread 9941
W20260709 12:09:09.497864 10638 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6460 after lost signal to thread 10549
W20260709 12:09:09.498823 10638 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0cc0 after lost signal to thread 10641
W20260709 12:09:09.499661 10638 debug-util.cc:398] Leaking SignalData structure 0x7b08000eace0 after lost signal to thread 10716
W20260709 12:09:09.500702 10638 debug-util.cc:398] Leaking SignalData structure 0x7b08001952e0 after lost signal to thread 10790
I20260709 12:09:09.578477 10617 raft_consensus.cc:1275] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:09.579985 10925 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:09.589907 10688 raft_consensus.cc:1275] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Refusing update from remote peer 850fd64d4a4442ce9820ee443cb35156: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:09.591933 10977 consensus_queue.cc:1048] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5434ea7700440a8c49ae38c831a261" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 33417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:09.655366 10763 raft_consensus.cc:1275] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:09.656847 10971 consensus_queue.cc:1048] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:09.668391 10617 raft_consensus.cc:1275] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:09.670274 10993 consensus_queue.cc:1048] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:09.761348 10617 raft_consensus.cc:1275] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:09.762866 10993 consensus_queue.cc:1048] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d36eb85f5564a36820405cd675f2a52" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:09.774067 10763 raft_consensus.cc:1275] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Refusing update from remote peer 4a5434ea7700440a8c49ae38c831a261: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:09.776227 10993 consensus_queue.cc:1048] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "850fd64d4a4442ce9820ee443cb35156" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 40145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:10.376811  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.383168  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.383746  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.384897  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.391209  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.391746  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.392902  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.398775  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.399281  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.400483  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.406608  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.407115  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.408018  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:14.413317  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:14.413720  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.414870  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:15.420089  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:15.420545  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:16.421957  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:16.429338  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:16.430047  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:17.431524  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:17.436663  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:17.437067  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:18.473453  9938 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:18.474010  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
I20260709 12:09:18.507611  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:18.508545  9938 tablet_replica.cc:333] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.509721  9938 raft_consensus.cc:2243] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.510319  9938 raft_consensus.cc:2272] T 1f4af46546694659acdaaa5a90a7ce8e P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.512746  9938 tablet_replica.cc:333] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.513257  9938 raft_consensus.cc:2243] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.513657  9938 raft_consensus.cc:2272] T 334b01d59a784c40987dde98217ddab7 P 5d36eb85f5564a36820405cd675f2a52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.515686  9938 tablet_replica.cc:333] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.516185  9938 raft_consensus.cc:2243] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.516623  9938 raft_consensus.cc:2272] T abf2d66e70474f5aa30a60415813c99b P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.518416  9938 tablet_replica.cc:333] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.518942  9938 raft_consensus.cc:2243] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.519345  9938 raft_consensus.cc:2272] T f46e54d8a44944538b2e12704c555d3a P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.521173  9938 tablet_replica.cc:333] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.521667  9938 raft_consensus.cc:2243] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.522058  9938 raft_consensus.cc:2272] T a8f135afc2b84e36933c5eaa3eee9f1f P 5d36eb85f5564a36820405cd675f2a52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.523833  9938 tablet_replica.cc:333] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.524300  9938 raft_consensus.cc:2243] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.525194  9938 raft_consensus.cc:2272] T 9be5e555ec1944279e18bc9f335ca74f P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.527045  9938 tablet_replica.cc:333] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.527617  9938 raft_consensus.cc:2243] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.528050  9938 raft_consensus.cc:2272] T bfb02f3c977641f880c37e3061b987e1 P 5d36eb85f5564a36820405cd675f2a52 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.529855  9938 tablet_replica.cc:333] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.530328  9938 raft_consensus.cc:2243] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.531291  9938 raft_consensus.cc:2272] T c38bf3517a1442c38dd30d18f337e1e0 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.533092  9938 tablet_replica.cc:333] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.533543  9938 raft_consensus.cc:2243] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.534322  9938 raft_consensus.cc:2272] T b56e789c2bd84202b9657efbd9b77ceb P 5d36eb85f5564a36820405cd675f2a52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.536176  9938 tablet_replica.cc:333] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52: stopping tablet replica
I20260709 12:09:18.536761  9938 raft_consensus.cc:2243] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.537720  9938 raft_consensus.cc:2272] T 9ec0dd2c873b44e1b8314ba9ae641719 P 5d36eb85f5564a36820405cd675f2a52 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:18.538956 10732 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:09:18.542948 10732 consensus_peers.cc:597] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 -> Peer 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049): Couldn't send request to peer 5d36eb85f5564a36820405cd675f2a52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:18.548586 10658 consensus_peers.cc:597] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 -> Peer 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049): Couldn't send request to peer 5d36eb85f5564a36820405cd675f2a52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.593200  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
I20260709 12:09:18.615253  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
I20260709 12:09:18.650134  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:18.651089  9938 tablet_replica.cc:333] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.652184  9938 raft_consensus.cc:2243] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.653280  9938 raft_consensus.cc:2272] T 1f4af46546694659acdaaa5a90a7ce8e P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.655812  9938 tablet_replica.cc:333] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.656673  9938 raft_consensus.cc:2243] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.657205  9938 raft_consensus.cc:2272] T 334b01d59a784c40987dde98217ddab7 P 4a5434ea7700440a8c49ae38c831a261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.659580  9938 tablet_replica.cc:333] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.660120  9938 raft_consensus.cc:2243] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.660642  9938 raft_consensus.cc:2272] T c38bf3517a1442c38dd30d18f337e1e0 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.662619  9938 tablet_replica.cc:333] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.663244  9938 raft_consensus.cc:2243] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.663738  9938 raft_consensus.cc:2272] T b56e789c2bd84202b9657efbd9b77ceb P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.665571  9938 tablet_replica.cc:333] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.666160  9938 raft_consensus.cc:2243] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.666666  9938 raft_consensus.cc:2272] T bfb02f3c977641f880c37e3061b987e1 P 4a5434ea7700440a8c49ae38c831a261 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.668529  9938 tablet_replica.cc:333] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.669109  9938 raft_consensus.cc:2243] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.669571  9938 raft_consensus.cc:2272] T 9ec0dd2c873b44e1b8314ba9ae641719 P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.671360  9938 tablet_replica.cc:333] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.671880  9938 raft_consensus.cc:2243] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.672286  9938 raft_consensus.cc:2272] T a8f135afc2b84e36933c5eaa3eee9f1f P 4a5434ea7700440a8c49ae38c831a261 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.674031  9938 tablet_replica.cc:333] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.674557  9938 raft_consensus.cc:2243] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.675434  9938 raft_consensus.cc:2272] T abf2d66e70474f5aa30a60415813c99b P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.677129  9938 tablet_replica.cc:333] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.677618  9938 raft_consensus.cc:2243] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.678464  9938 raft_consensus.cc:2272] T f46e54d8a44944538b2e12704c555d3a P 4a5434ea7700440a8c49ae38c831a261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.680508  9938 tablet_replica.cc:333] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261: stopping tablet replica
I20260709 12:09:18.681001  9938 raft_consensus.cc:2243] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.681469  9938 raft_consensus.cc:2272] T 9be5e555ec1944279e18bc9f335ca74f P 4a5434ea7700440a8c49ae38c831a261 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:18.688490 10732 consensus_peers.cc:597] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 -> Peer 5d36eb85f5564a36820405cd675f2a52 (127.9.180.129:40049): Couldn't send request to peer 5d36eb85f5564a36820405cd675f2a52. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:40049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.713507  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
I20260709 12:09:18.734228  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
I20260709 12:09:18.770512  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:18.771371  9938 tablet_replica.cc:333] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.771951  9938 raft_consensus.cc:2243] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.772750  9938 raft_consensus.cc:2272] T 334b01d59a784c40987dde98217ddab7 P 850fd64d4a4442ce9820ee443cb35156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.774581  9938 tablet_replica.cc:333] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.775055  9938 raft_consensus.cc:2243] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.775484  9938 raft_consensus.cc:2272] T 1f4af46546694659acdaaa5a90a7ce8e P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.776995  9938 tablet_replica.cc:333] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.777472  9938 raft_consensus.cc:2243] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.777833  9938 raft_consensus.cc:2272] T b56e789c2bd84202b9657efbd9b77ceb P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.779419  9938 tablet_replica.cc:333] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.779870  9938 raft_consensus.cc:2243] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.780256  9938 raft_consensus.cc:2272] T c38bf3517a1442c38dd30d18f337e1e0 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.781783  9938 tablet_replica.cc:333] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.782222  9938 raft_consensus.cc:2243] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.782999  9938 raft_consensus.cc:2272] T bfb02f3c977641f880c37e3061b987e1 P 850fd64d4a4442ce9820ee443cb35156 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.784458  9938 tablet_replica.cc:333] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.784893  9938 raft_consensus.cc:2243] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.785298  9938 raft_consensus.cc:2272] T abf2d66e70474f5aa30a60415813c99b P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.786810  9938 tablet_replica.cc:333] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.787268  9938 raft_consensus.cc:2243] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.787635  9938 raft_consensus.cc:2272] T 9be5e555ec1944279e18bc9f335ca74f P 850fd64d4a4442ce9820ee443cb35156 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.789146  9938 tablet_replica.cc:333] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.789583  9938 raft_consensus.cc:2243] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.789976  9938 raft_consensus.cc:2272] T f46e54d8a44944538b2e12704c555d3a P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.791579  9938 tablet_replica.cc:333] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.791981  9938 raft_consensus.cc:2243] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.792659  9938 raft_consensus.cc:2272] T a8f135afc2b84e36933c5eaa3eee9f1f P 850fd64d4a4442ce9820ee443cb35156 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.794214  9938 tablet_replica.cc:333] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156: stopping tablet replica
I20260709 12:09:18.794625  9938 raft_consensus.cc:2243] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:18.795024  9938 raft_consensus.cc:2272] T 9ec0dd2c873b44e1b8314ba9ae641719 P 850fd64d4a4442ce9820ee443cb35156 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.825011  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:09:18.844911  9938 master.cc:562] Master@127.9.180.190:37621 shutting down...
I20260709 12:09:18.874212  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:18.874955  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:18.875317  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0db6e5930070465686520660b90371fb: stopping tablet replica
I20260709 12:09:18.896243  9938 master.cc:584] Master@127.9.180.190:37621 shutdown complete.
4a5434ea7700440a8c49ae38c831a261  4
5d36eb85f5564a36820405cd675f2a52  5
850fd64d4a4442ce9820ee443cb35156  1
4a5434ea7700440a8c49ae38c831a261  4
5d36eb85f5564a36820405cd675f2a52  3
850fd64d4a4442ce9820ee443cb35156  3
4a5434ea7700440a8c49ae38c831a261  1
5d36eb85f5564a36820405cd675f2a52  8
850fd64d4a4442ce9820ee443cb35156  1
4a5434ea7700440a8c49ae38c831a261  3
5d36eb85f5564a36820405cd675f2a52  4
850fd64d4a4442ce9820ee443cb35156  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29384 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:18.945648  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:38919
I20260709 12:09:18.946858  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:18.953287 11018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:18.953351 11017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:18.953709 11020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:18.955687  9938 server_base.cc:1061] running on GCE node
I20260709 12:09:18.956818  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:18.957006  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:18.957160  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598958957142 us; error 0 us; skew 500 ppm
I20260709 12:09:18.957681  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:18.960368  9938 webserver.cc:533] Webserver started at http://127.9.180.190:36641/ using document root <none> and password file <none>
I20260709 12:09:18.960863  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:18.961061  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:18.961341  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:18.962458  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "77709ed97aed432192038c6d22f779bc"
format_stamp: "Formatted at 2026-07-09 12:09:18 on dist-test-slave-lg8f"
I20260709 12:09:18.967249  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:09:18.970624 11025 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:18.971401  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:09:18.971686  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "77709ed97aed432192038c6d22f779bc"
format_stamp: "Formatted at 2026-07-09 12:09:18 on dist-test-slave-lg8f"
I20260709 12:09:18.971982  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:18.986707  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:18.988116  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:19.030269  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:38919
I20260709 12:09:19.030413 11076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:38919 every 8 connection(s)
I20260709 12:09:19.034476 11077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.045626 11077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Bootstrap starting.
I20260709 12:09:19.050828 11077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.055732 11077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: No bootstrap required, opened a new log
I20260709 12:09:19.058095 11077 raft_consensus.cc:359] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709ed97aed432192038c6d22f779bc" member_type: VOTER }
I20260709 12:09:19.058560 11077 raft_consensus.cc:385] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.058856 11077 raft_consensus.cc:740] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77709ed97aed432192038c6d22f779bc, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.059468 11077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709ed97aed432192038c6d22f779bc" member_type: VOTER }
I20260709 12:09:19.059980 11077 raft_consensus.cc:399] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:19.060216 11077 raft_consensus.cc:493] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:19.060585 11077 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.065426 11077 raft_consensus.cc:515] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709ed97aed432192038c6d22f779bc" member_type: VOTER }
I20260709 12:09:19.065970 11077 leader_election.cc:304] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77709ed97aed432192038c6d22f779bc; no voters: 
I20260709 12:09:19.067305 11077 leader_election.cc:290] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:19.067718 11080 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.069185 11080 raft_consensus.cc:697] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 1 LEADER]: Becoming Leader. State: Replica: 77709ed97aed432192038c6d22f779bc, State: Running, Role: LEADER
I20260709 12:09:19.069921 11080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709ed97aed432192038c6d22f779bc" member_type: VOTER }
I20260709 12:09:19.070665 11077 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:19.076048 11082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77709ed97aed432192038c6d22f779bc. Latest consensus state: current_term: 1 leader_uuid: "77709ed97aed432192038c6d22f779bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709ed97aed432192038c6d22f779bc" member_type: VOTER } }
I20260709 12:09:19.076898 11082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:19.076987 11081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77709ed97aed432192038c6d22f779bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77709ed97aed432192038c6d22f779bc" member_type: VOTER } }
I20260709 12:09:19.077620 11081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:19.079141 11087 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:19.083972 11087 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:19.088814  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:19.093740 11087 catalog_manager.cc:1383] Generated new cluster ID: a758582e0f264469b3642c9d3a3a4fbe
I20260709 12:09:19.094086 11087 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:19.126040 11087 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:19.127560 11087 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:19.145646 11087 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Generated new TSK 0
I20260709 12:09:19.146381 11087 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:19.155797  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:19.162349 11098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:19.164129 11099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:19.166142 11101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:19.166697  9938 server_base.cc:1061] running on GCE node
I20260709 12:09:19.167747  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:19.167979  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:19.168165  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598959168140 us; error 0 us; skew 500 ppm
I20260709 12:09:19.168712  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:19.171268  9938 webserver.cc:533] Webserver started at http://127.9.180.129:39579/ using document root <none> and password file <none>
I20260709 12:09:19.171844  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:19.172060  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:19.172343  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:19.173538  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "018d40ceb45d4447aa293f4c1d929bb8"
format_stamp: "Formatted at 2026-07-09 12:09:19 on dist-test-slave-lg8f"
I20260709 12:09:19.179095  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:09:19.183034 11106 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.183954  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:09:19.184319  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "018d40ceb45d4447aa293f4c1d929bb8"
format_stamp: "Formatted at 2026-07-09 12:09:19 on dist-test-slave-lg8f"
I20260709 12:09:19.184656  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:19.200307  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:19.201591  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:19.203141  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:19.205470  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:19.205701  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.205937  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:19.206120  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.252187  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:43503
I20260709 12:09:19.252345 11168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:43503 every 8 connection(s)
I20260709 12:09:19.257655  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:19.265759 11173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:19.268287 11174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:19.270606 11176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:19.270751  9938 server_base.cc:1061] running on GCE node
I20260709 12:09:19.273669  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:19.273959  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:19.274197  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598959274174 us; error 0 us; skew 500 ppm
I20260709 12:09:19.274650 11169 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38919
I20260709 12:09:19.274910  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:19.275115 11169 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:19.276124 11169 heartbeater.cc:507] Master 127.9.180.190:38919 requested a full tablet report, sending...
I20260709 12:09:19.277894  9938 webserver.cc:533] Webserver started at http://127.9.180.130:43773/ using document root <none> and password file <none>
I20260709 12:09:19.278450  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:19.278915  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:19.279024 11042 ts_manager.cc:194] Registered new tserver with Master: 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:19.279251  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:19.280612  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
format_stamp: "Formatted at 2026-07-09 12:09:19 on dist-test-slave-lg8f"
I20260709 12:09:19.281246 11042 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50644
I20260709 12:09:19.285945  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:19.289906 11181 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.290879  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:19.291144  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
format_stamp: "Formatted at 2026-07-09 12:09:19 on dist-test-slave-lg8f"
I20260709 12:09:19.291417  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:19.306282  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:19.307749  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:19.309352  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:19.311859  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:19.312060  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.312376  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:19.312544  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.358693  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:41137
I20260709 12:09:19.358810 11243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:41137 every 8 connection(s)
I20260709 12:09:19.364375  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:19.374740 11247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:19.374847 11248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:19.377099 11244 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38919
I20260709 12:09:19.377501 11244 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:19.377894  9938 server_base.cc:1061] running on GCE node
W20260709 12:09:19.377940 11250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:19.378654 11244 heartbeater.cc:507] Master 127.9.180.190:38919 requested a full tablet report, sending...
I20260709 12:09:19.379356  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:19.379643  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:19.379830  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598959379792 us; error 0 us; skew 500 ppm
I20260709 12:09:19.380510  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:19.381258 11042 ts_manager.cc:194] Registered new tserver with Master: 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:19.383139 11042 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50656
I20260709 12:09:19.383558  9938 webserver.cc:533] Webserver started at http://127.9.180.131:34781/ using document root <none> and password file <none>
I20260709 12:09:19.384177  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:19.384395  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:19.384727  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:19.386250  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "ba2779405e8d452e95f42421b2b60928"
format_stamp: "Formatted at 2026-07-09 12:09:19 on dist-test-slave-lg8f"
I20260709 12:09:19.390712  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:09:19.394150 11255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.395040  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:19.395356  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "ba2779405e8d452e95f42421b2b60928"
format_stamp: "Formatted at 2026-07-09 12:09:19 on dist-test-slave-lg8f"
I20260709 12:09:19.395622  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:19.421096  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:19.422360  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:19.424006  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:19.426342  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:19.426538  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.426851  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:19.426997  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:19.470662  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:41465
I20260709 12:09:19.470772 11317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:41465 every 8 connection(s)
I20260709 12:09:19.485749 11318 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38919
I20260709 12:09:19.486166 11318 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:19.487056 11318 heartbeater.cc:507] Master 127.9.180.190:38919 requested a full tablet report, sending...
I20260709 12:09:19.489111 11042 ts_manager.cc:194] Registered new tserver with Master: ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:19.489866  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015914832s
I20260709 12:09:19.490662 11042 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50670
I20260709 12:09:19.519807 11042 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50680:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:19.525736 11042 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:19.732028 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 809626de5a674cba911a83815f1e05ca (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:19.732738 11283 tablet_service.cc:1511] Processing CreateTablet for tablet 809626de5a674cba911a83815f1e05ca (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:19.733579 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809626de5a674cba911a83815f1e05ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.733971 11283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809626de5a674cba911a83815f1e05ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.735639 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 86632bf64d844f6f8f1356ac45447bcc (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:19.737001 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86632bf64d844f6f8f1356ac45447bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.737111 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 4fed3eea68d84fed917f13cdd6cc9820 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:19.738655 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fed3eea68d84fed917f13cdd6cc9820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.739653 11282 tablet_service.cc:1511] Processing CreateTablet for tablet 86632bf64d844f6f8f1356ac45447bcc (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:19.740943 11282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86632bf64d844f6f8f1356ac45447bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.747843 11281 tablet_service.cc:1511] Processing CreateTablet for tablet 4fed3eea68d84fed917f13cdd6cc9820 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:19.749389 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fed3eea68d84fed917f13cdd6cc9820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.751706 11280 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce10840f1d143948ae8836765fb74d1 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:19.753098 11280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce10840f1d143948ae8836765fb74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.754079 11134 tablet_service.cc:1511] Processing CreateTablet for tablet 809626de5a674cba911a83815f1e05ca (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:19.755476 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809626de5a674cba911a83815f1e05ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.755722 11279 tablet_service.cc:1511] Processing CreateTablet for tablet a67ed18056054cad98bdf3dd430e6577 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:19.757045 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67ed18056054cad98bdf3dd430e6577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.759706 11278 tablet_service.cc:1511] Processing CreateTablet for tablet e7c488a2c80e4e21bde9ae92cfae70b3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:19.763227 11277 tablet_service.cc:1511] Processing CreateTablet for tablet 557f4814dd3c4d4bb57340a9834ebd32 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:19.764515 11276 tablet_service.cc:1511] Processing CreateTablet for tablet a5303488c195434ca5cfdb88d6256a0c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:19.765532 11204 tablet_service.cc:1511] Processing CreateTablet for tablet e7c488a2c80e4e21bde9ae92cfae70b3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:19.767620 11275 tablet_service.cc:1511] Processing CreateTablet for tablet f6e27c7f8a6b4e82a1ffee4fc5743515 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:19.767745 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 557f4814dd3c4d4bb57340a9834ebd32 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:19.770809 11274 tablet_service.cc:1511] Processing CreateTablet for tablet 382f5b53b1974dc083d6b840e190fbf9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:19.771760 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce10840f1d143948ae8836765fb74d1 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:19.769937 11205 tablet_service.cc:1511] Processing CreateTablet for tablet a67ed18056054cad98bdf3dd430e6577 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:19.775357 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce10840f1d143948ae8836765fb74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.774991 11202 tablet_service.cc:1511] Processing CreateTablet for tablet a5303488c195434ca5cfdb88d6256a0c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:19.776517 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67ed18056054cad98bdf3dd430e6577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.777181 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c488a2c80e4e21bde9ae92cfae70b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.777976 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557f4814dd3c4d4bb57340a9834ebd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.778296 11201 tablet_service.cc:1511] Processing CreateTablet for tablet f6e27c7f8a6b4e82a1ffee4fc5743515 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:19.778839 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c488a2c80e4e21bde9ae92cfae70b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.779672 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e27c7f8a6b4e82a1ffee4fc5743515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.782816 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5303488c195434ca5cfdb88d6256a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.783658 11200 tablet_service.cc:1511] Processing CreateTablet for tablet 382f5b53b1974dc083d6b840e190fbf9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:19.784360 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557f4814dd3c4d4bb57340a9834ebd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.785012 11200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382f5b53b1974dc083d6b840e190fbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.788393 11274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382f5b53b1974dc083d6b840e190fbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.790712 11276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5303488c195434ca5cfdb88d6256a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.791673 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e27c7f8a6b4e82a1ffee4fc5743515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.804198 11207 tablet_service.cc:1511] Processing CreateTablet for tablet ddd0a7b2bb3645519f8c5c9bf85633d9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:19.805721 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd0a7b2bb3645519f8c5c9bf85633d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.824441 11133 tablet_service.cc:1511] Processing CreateTablet for tablet 86632bf64d844f6f8f1356ac45447bcc (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:19.826197 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86632bf64d844f6f8f1356ac45447bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.826619 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce10840f1d143948ae8836765fb74d1 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:19.824556 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 4fed3eea68d84fed917f13cdd6cc9820 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:19.828848 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce10840f1d143948ae8836765fb74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.831578 11127 tablet_service.cc:1511] Processing CreateTablet for tablet a5303488c195434ca5cfdb88d6256a0c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:19.832973 11127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5303488c195434ca5cfdb88d6256a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.835826 11126 tablet_service.cc:1511] Processing CreateTablet for tablet f6e27c7f8a6b4e82a1ffee4fc5743515 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:19.837260 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e27c7f8a6b4e82a1ffee4fc5743515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.839896 11128 tablet_service.cc:1511] Processing CreateTablet for tablet 557f4814dd3c4d4bb57340a9834ebd32 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:19.843116 11128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557f4814dd3c4d4bb57340a9834ebd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.843065 11130 tablet_service.cc:1511] Processing CreateTablet for tablet a67ed18056054cad98bdf3dd430e6577 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:19.844610 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67ed18056054cad98bdf3dd430e6577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.844841 11125 tablet_service.cc:1511] Processing CreateTablet for tablet 382f5b53b1974dc083d6b840e190fbf9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:19.846280 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382f5b53b1974dc083d6b840e190fbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.847728 11129 tablet_service.cc:1511] Processing CreateTablet for tablet e7c488a2c80e4e21bde9ae92cfae70b3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:19.850229 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c488a2c80e4e21bde9ae92cfae70b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.885090 11282 tablet_service.cc:1511] Processing CreateTablet for tablet 7a24a63c03ef4eb980303acb738b9641 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:19.885286 11278 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5563d41fc84c36a8d7eafa0e6a4968 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:19.881587 11277 tablet_service.cc:1511] Processing CreateTablet for tablet ddd0a7b2bb3645519f8c5c9bf85633d9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:19.893977 11282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24a63c03ef4eb980303acb738b9641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.900609 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 7a24a63c03ef4eb980303acb738b9641 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:19.907132 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24a63c03ef4eb980303acb738b9641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.908149 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fed3eea68d84fed917f13cdd6cc9820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.908190 11283 tablet_service.cc:1511] Processing CreateTablet for tablet e017decd61a34a2cbc717412a4ed64ea (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:19.911278 11333 tablet_bootstrap.cc:492] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:19.904034 11275 tablet_service.cc:1511] Processing CreateTablet for tablet 35f8f77c6e8c4a66b41088646a9c8c90 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:19.915720 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5563d41fc84c36a8d7eafa0e6a4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.916574 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f8f77c6e8c4a66b41088646a9c8c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.918015 11283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e017decd61a34a2cbc717412a4ed64ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.924974 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5563d41fc84c36a8d7eafa0e6a4968 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:19.925055 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 35f8f77c6e8c4a66b41088646a9c8c90 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:19.943710 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5563d41fc84c36a8d7eafa0e6a4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.944561 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f8f77c6e8c4a66b41088646a9c8c90. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:19.972359 11029 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59818.1us
I20260709 12:09:19.977000 11279 tablet_service.cc:1511] Processing CreateTablet for tablet 923b3bc9b7424aa9bdc5a7952136dbba (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:19.980082 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 2864b976ac5946a7b7a41c9a5e2f7f26 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:19.983462 11280 tablet_service.cc:1511] Processing CreateTablet for tablet 2864b976ac5946a7b7a41c9a5e2f7f26 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:19.989017 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2864b976ac5946a7b7a41c9a5e2f7f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.005662 11334 tablet_bootstrap.cc:492] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:20.004321 11281 tablet_service.cc:1511] Processing CreateTablet for tablet 1618626d8c194b9ea8b2ac9f3554b006 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:20.006873 11335 tablet_bootstrap.cc:492] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:19.971176 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd0a7b2bb3645519f8c5c9bf85633d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:19.962812 11205 tablet_service.cc:1511] Processing CreateTablet for tablet e017decd61a34a2cbc717412a4ed64ea (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:20.019665 11133 tablet_service.cc:1511] Processing CreateTablet for tablet ddd0a7b2bb3645519f8c5c9bf85633d9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:20.020993 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd0a7b2bb3645519f8c5c9bf85633d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.021021 11130 tablet_service.cc:1511] Processing CreateTablet for tablet 7a24a63c03ef4eb980303acb738b9641 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:20.024127 11134 tablet_service.cc:1511] Processing CreateTablet for tablet 5b5563d41fc84c36a8d7eafa0e6a4968 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:20.026142 11335 tablet_bootstrap.cc:654] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.026697 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923b3bc9b7424aa9bdc5a7952136dbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.031590 11201 tablet_service.cc:1511] Processing CreateTablet for tablet d969a53adb784388b9e0819cd9786e2f (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:20.033676 11334 tablet_bootstrap.cc:654] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.034268 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24a63c03ef4eb980303acb738b9641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.033763 11333 tablet_bootstrap.cc:654] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.034782 11280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2864b976ac5946a7b7a41c9a5e2f7f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.034315 11274 tablet_service.cc:1511] Processing CreateTablet for tablet d969a53adb784388b9e0819cd9786e2f (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:20.035759 11274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d969a53adb784388b9e0819cd9786e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.038256 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5563d41fc84c36a8d7eafa0e6a4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.040341 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1618626d8c194b9ea8b2ac9f3554b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.047592 11127 tablet_service.cc:1511] Processing CreateTablet for tablet 35f8f77c6e8c4a66b41088646a9c8c90 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:20.048903 11127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f8f77c6e8c4a66b41088646a9c8c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.049186 11276 tablet_service.cc:1511] Processing CreateTablet for tablet aaa499c4330145abb0fb264ec515ea63 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:20.050462 11276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa499c4330145abb0fb264ec515ea63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.073873 11126 tablet_service.cc:1511] Processing CreateTablet for tablet e017decd61a34a2cbc717412a4ed64ea (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:20.076299 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e017decd61a34a2cbc717412a4ed64ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.079107 11202 tablet_service.cc:1511] Processing CreateTablet for tablet 1618626d8c194b9ea8b2ac9f3554b006 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:20.079533 11283 tablet_service.cc:1511] Processing CreateTablet for tablet 6068dd70dc8045fc8ad3d39311dc7428 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:20.080709 11283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6068dd70dc8045fc8ad3d39311dc7428. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:20.084343 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.978375 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 923b3bc9b7424aa9bdc5a7952136dbba (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:20.127629 11335 tablet_bootstrap.cc:492] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:20.128109 11335 ts_tablet_manager.cc:1403] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.014s
I20260709 12:09:20.131027 11335 raft_consensus.cc:359] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.131744 11335 raft_consensus.cc:385] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.136240 11128 tablet_service.cc:1511] Processing CreateTablet for tablet d969a53adb784388b9e0819cd9786e2f (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:20.139950 11128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d969a53adb784388b9e0819cd9786e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.138950 11334 tablet_bootstrap.cc:492] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:20.142948 11334 ts_tablet_manager.cc:1403] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.138s	user 0.021s	sys 0.017s
I20260709 12:09:20.145107 11209 tablet_service.cc:1511] Processing CreateTablet for tablet aaa499c4330145abb0fb264ec515ea63 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:20.146183 11334 raft_consensus.cc:359] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:20.147895 11200 tablet_service.cc:1511] Processing CreateTablet for tablet 6068dd70dc8045fc8ad3d39311dc7428 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:20.149571 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 893ed9b3a6054165a7d66c6d7ae1249c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:20.151274 11335 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.146410 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa499c4330145abb0fb264ec515ea63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.152521 11335 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.154757 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1618626d8c194b9ea8b2ac9f3554b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.156137 11130 tablet_service.cc:1511] Processing CreateTablet for tablet aaa499c4330145abb0fb264ec515ea63 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:20.157537 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa499c4330145abb0fb264ec515ea63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.159006 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923b3bc9b7424aa9bdc5a7952136dbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.164947 11334 raft_consensus.cc:385] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.165407 11334 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.166169 11200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6068dd70dc8045fc8ad3d39311dc7428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.176452 11133 tablet_service.cc:1511] Processing CreateTablet for tablet 1618626d8c194b9ea8b2ac9f3554b006 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:20.177253 11333 tablet_bootstrap.cc:492] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:20.177768 11333 ts_tablet_manager.cc:1403] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.267s	user 0.009s	sys 0.036s
I20260709 12:09:20.177824 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1618626d8c194b9ea8b2ac9f3554b006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.178916 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e017decd61a34a2cbc717412a4ed64ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.179126 11277 tablet_service.cc:1511] Processing CreateTablet for tablet 539267f9f49c4c16b3ec8b1c92be6d29 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:20.180603 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539267f9f49c4c16b3ec8b1c92be6d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.180979 11333 raft_consensus.cc:359] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.181764 11333 raft_consensus.cc:385] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.182070 11333 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.163841 11204 tablet_service.cc:1511] Processing CreateTablet for tablet ca6e44c82eda4c299b22957102352a23 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:20.182828 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d969a53adb784388b9e0819cd9786e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.122135 11125 tablet_service.cc:1511] Processing CreateTablet for tablet 923b3bc9b7424aa9bdc5a7952136dbba (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:20.187079 11333 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.187748 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923b3bc9b7424aa9bdc5a7952136dbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.200438 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6e44c82eda4c299b22957102352a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.210680 11275 tablet_service.cc:1511] Processing CreateTablet for tablet 9948214ce1cd45429598d228699aa5a8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:20.211279 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 6068dd70dc8045fc8ad3d39311dc7428 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:20.212204 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948214ce1cd45429598d228699aa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.212499 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6068dd70dc8045fc8ad3d39311dc7428. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.228669 11278 tablet_service.cc:1511] Processing CreateTablet for tablet 59b9f42c7ee544898eee55760f7287b3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:20.202975 11129 tablet_service.cc:1511] Processing CreateTablet for tablet 2864b976ac5946a7b7a41c9a5e2f7f26 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:20.236306 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b9f42c7ee544898eee55760f7287b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.238833 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893ed9b3a6054165a7d66c6d7ae1249c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.240763 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2864b976ac5946a7b7a41c9a5e2f7f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.241743 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 893ed9b3a6054165a7d66c6d7ae1249c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:20.243773 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893ed9b3a6054165a7d66c6d7ae1249c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.246729 11281 tablet_service.cc:1511] Processing CreateTablet for tablet ca6e44c82eda4c299b22957102352a23 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:20.247187 11282 tablet_service.cc:1511] Processing CreateTablet for tablet 893ed9b3a6054165a7d66c6d7ae1249c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:20.248175 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6e44c82eda4c299b22957102352a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.264549 11282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893ed9b3a6054165a7d66c6d7ae1249c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.284466 11169 heartbeater.cc:499] Master 127.9.180.190:38919 was elected leader, sending a full tablet report...
I20260709 12:09:20.284749 11333 ts_tablet_manager.cc:1434] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.107s	user 0.018s	sys 0.008s
I20260709 12:09:20.296723 11333 tablet_bootstrap.cc:492] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:20.286080 11280 tablet_service.cc:1511] Processing CreateTablet for tablet 92ccd088b1904dd1aae6563124beb655 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:20.299973 11280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ccd088b1904dd1aae6563124beb655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.299896 11133 tablet_service.cc:1511] Processing CreateTablet for tablet 539267f9f49c4c16b3ec8b1c92be6d29 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:20.283622 11334 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:20.301326 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539267f9f49c4c16b3ec8b1c92be6d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.301482 11341 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.287775 11244 heartbeater.cc:499] Master 127.9.180.190:38919 was elected leader, sending a full tablet report...
I20260709 12:09:20.307777 11130 tablet_service.cc:1511] Processing CreateTablet for tablet 59b9f42c7ee544898eee55760f7287b3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:20.309332 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b9f42c7ee544898eee55760f7287b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.289402 11276 tablet_service.cc:1511] Processing CreateTablet for tablet 6250f2432a8a4fbb8c99e0f703ecd269 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:20.313889 11276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6250f2432a8a4fbb8c99e0f703ecd269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.316766 11340 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.312546 11341 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:20.317271 11340 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.321491 11274 tablet_service.cc:1511] Processing CreateTablet for tablet fab38430e77f4f78916480f9b0041989 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:20.322952 11274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab38430e77f4f78916480f9b0041989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.331435 11340 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:20.288395 11127 tablet_service.cc:1511] Processing CreateTablet for tablet ca6e44c82eda4c299b22957102352a23 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:20.340283 11127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6e44c82eda4c299b22957102352a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.341089 11333 tablet_bootstrap.cc:654] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.344340 11277 tablet_service.cc:1511] Processing CreateTablet for tablet 9a38aa6d0e35417db86aadc82bb36b04 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:20.345978 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a38aa6d0e35417db86aadc82bb36b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.352427 11128 tablet_service.cc:1511] Processing CreateTablet for tablet 9948214ce1cd45429598d228699aa5a8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:20.353943 11128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948214ce1cd45429598d228699aa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.358286 11335 ts_tablet_manager.cc:1434] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.230s	user 0.028s	sys 0.030s
I20260709 12:09:20.388473 11335 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:20.407116 11318 heartbeater.cc:499] Master 127.9.180.190:38919 was elected leader, sending a full tablet report...
I20260709 12:09:20.384503 11201 tablet_service.cc:1511] Processing CreateTablet for tablet 539267f9f49c4c16b3ec8b1c92be6d29 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:20.415599 11134 tablet_service.cc:1511] Processing CreateTablet for tablet 92ccd088b1904dd1aae6563124beb655 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:20.416906 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ccd088b1904dd1aae6563124beb655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.423161 11341 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:20.430972 11279 tablet_service.cc:1511] Processing CreateTablet for tablet 7bea72104a4f4494b28f5e58c9ce7e41 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:20.432505 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea72104a4f4494b28f5e58c9ce7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.436059 11200 tablet_service.cc:1511] Processing CreateTablet for tablet 59b9f42c7ee544898eee55760f7287b3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:20.437484 11200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b9f42c7ee544898eee55760f7287b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.468688 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 92ccd088b1904dd1aae6563124beb655 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:20.469934 11335 tablet_bootstrap.cc:654] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.470252 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ccd088b1904dd1aae6563124beb655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.487725 11334 ts_tablet_manager.cc:1434] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.344s	user 0.018s	sys 0.026s
I20260709 12:09:20.488792 11334 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:20.463681 11126 tablet_service.cc:1511] Processing CreateTablet for tablet 6250f2432a8a4fbb8c99e0f703ecd269 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:20.491163 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6250f2432a8a4fbb8c99e0f703ecd269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.493439 11125 tablet_service.cc:1511] Processing CreateTablet for tablet 7bea72104a4f4494b28f5e58c9ce7e41 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:20.489274 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 9a38aa6d0e35417db86aadc82bb36b04 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:20.498195 11278 tablet_service.cc:1511] Processing CreateTablet for tablet 64dc7dbbc231456da11adb2c7a1dada9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:20.500726 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea72104a4f4494b28f5e58c9ce7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.502189 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dc7dbbc231456da11adb2c7a1dada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.503183 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 9948214ce1cd45429598d228699aa5a8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:20.510462 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a38aa6d0e35417db86aadc82bb36b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.513193 11202 tablet_service.cc:1511] Processing CreateTablet for tablet 6250f2432a8a4fbb8c99e0f703ecd269 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:20.472534 11130 tablet_service.cc:1511] Processing CreateTablet for tablet fab38430e77f4f78916480f9b0041989 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:20.514945 11130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab38430e77f4f78916480f9b0041989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.514989 11274 tablet_service.cc:1511] Processing CreateTablet for tablet c4d8b59f386d4565b0103c44f0baa84d (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:20.516562 11274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d8b59f386d4565b0103c44f0baa84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.513830 11281 tablet_service.cc:1511] Processing CreateTablet for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:20.520282 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b238aa9f5b8450ca03fed7b6a294cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.520166 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:20.521445 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b238aa9f5b8450ca03fed7b6a294cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.526232 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539267f9f49c4c16b3ec8b1c92be6d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.531410 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6250f2432a8a4fbb8c99e0f703ecd269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.542586 11339 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.543229 11339 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.544234 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 8857ecbbb0c7485d9d6ff255660d2547 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:20.546401 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857ecbbb0c7485d9d6ff255660d2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.552290 11275 tablet_service.cc:1511] Processing CreateTablet for tablet d9d29c78e55e4b76a84881d4f97aaec8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:20.553694 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d29c78e55e4b76a84881d4f97aaec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.555934 11334 tablet_bootstrap.cc:654] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.546228 11339 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:20.567416 11133 tablet_service.cc:1511] Processing CreateTablet for tablet 64dc7dbbc231456da11adb2c7a1dada9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:20.568933 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dc7dbbc231456da11adb2c7a1dada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.576848 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:20.577666 11144 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:20.577836 11207 tablet_service.cc:1511] Processing CreateTablet for tablet fab38430e77f4f78916480f9b0041989 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:20.579193 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:20.580058 11340 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.580468 11340 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.580797 11340 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.581475 11283 tablet_service.cc:1511] Processing CreateTablet for tablet 14c3c7c84ef94275814f49349db79a72 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:20.565867 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948214ce1cd45429598d228699aa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.602360 11282 tablet_service.cc:1511] Processing CreateTablet for tablet 8857ecbbb0c7485d9d6ff255660d2547 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:20.609925 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab38430e77f4f78916480f9b0041989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.590094 11129 tablet_service.cc:1511] Processing CreateTablet for tablet d9d29c78e55e4b76a84881d4f97aaec8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:20.615686 11283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c3c7c84ef94275814f49349db79a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.646807 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 9a38aa6d0e35417db86aadc82bb36b04 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:20.648594 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a38aa6d0e35417db86aadc82bb36b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.648829 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa9c55aa9ba49cc82db376e55f14ecc (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:20.650187 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa9c55aa9ba49cc82db376e55f14ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.660362 11276 tablet_service.cc:1511] Processing CreateTablet for tablet d3619bd8cdd6482dad222b2265b94b48 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:20.664106 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d29c78e55e4b76a84881d4f97aaec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.666785 11280 tablet_service.cc:1511] Processing CreateTablet for tablet ee56790b88674a68962bb5866affcd4f (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:20.672219 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 7bea72104a4f4494b28f5e58c9ce7e41 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:20.673813 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea72104a4f4494b28f5e58c9ce7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.676380 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 64dc7dbbc231456da11adb2c7a1dada9 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:20.677987 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dc7dbbc231456da11adb2c7a1dada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.680383 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:20.682041 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b238aa9f5b8450ca03fed7b6a294cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.602411 11277 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa9c55aa9ba49cc82db376e55f14ecc (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:20.688721 11282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857ecbbb0c7485d9d6ff255660d2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.663416 11340 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.708118 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 14c3c7c84ef94275814f49349db79a72 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:20.713590 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c3c7c84ef94275814f49349db79a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.727519 11335 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:20.728152 11335 ts_tablet_manager.cc:1403] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.340s	user 0.013s	sys 0.003s
I20260709 12:09:20.728902 11333 tablet_bootstrap.cc:492] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:20.729427 11333 ts_tablet_manager.cc:1403] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.433s	user 0.015s	sys 0.018s
I20260709 12:09:20.733392 11279 tablet_service.cc:1511] Processing CreateTablet for tablet f482641e4e2a4d109ab2f3acbbaebbb2 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:20.734305 11276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3619bd8cdd6482dad222b2265b94b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.740655 11126 tablet_service.cc:1511] Processing CreateTablet for tablet c4d8b59f386d4565b0103c44f0baa84d (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:20.741956 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d8b59f386d4565b0103c44f0baa84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.745103 11280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee56790b88674a68962bb5866affcd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.763368 11333 raft_consensus.cc:359] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.764202 11333 raft_consensus.cc:385] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.764530 11333 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.765302 11333 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.767202 11335 raft_consensus.cc:359] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.767971 11335 raft_consensus.cc:385] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.768283 11335 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.768976 11335 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.772676 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa9c55aa9ba49cc82db376e55f14ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.773401 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f482641e4e2a4d109ab2f3acbbaebbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.782033 11340 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:20.788853 11201 tablet_service.cc:1511] Processing CreateTablet for tablet f482641e4e2a4d109ab2f3acbbaebbb2 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:20.792359 11208 tablet_service.cc:1511] Processing CreateTablet for tablet d9d29c78e55e4b76a84881d4f97aaec8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:20.800925 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 8857ecbbb0c7485d9d6ff255660d2547 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:20.803562 11134 tablet_service.cc:1511] Processing CreateTablet for tablet f482641e4e2a4d109ab2f3acbbaebbb2 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:20.804104 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:20.804512 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:20.806631 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:20.806679 11127 tablet_service.cc:1511] Processing CreateTablet for tablet d3619bd8cdd6482dad222b2265b94b48 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:20.809273 11128 tablet_service.cc:1511] Processing CreateTablet for tablet ee56790b88674a68962bb5866affcd4f (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:09:20.810329 11259 leader_election.cc:343] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.811507 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:20.813498 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:20.814222 11144 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.815126 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:20.820792 11125 tablet_service.cc:1511] Processing CreateTablet for tablet a5275fafd0e7457694ac49b17b3fcfc1 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:20.811503 11275 tablet_service.cc:1511] Processing CreateTablet for tablet a5275fafd0e7457694ac49b17b3fcfc1 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:20.822882 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f482641e4e2a4d109ab2f3acbbaebbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.823519 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5275fafd0e7457694ac49b17b3fcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.824111 11335 ts_tablet_manager.cc:1434] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.000s
I20260709 12:09:20.825301 11335 tablet_bootstrap.cc:492] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:20.825317 11127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3619bd8cdd6482dad222b2265b94b48. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:20.825866 11258 leader_election.cc:343] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.826309 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:20.827117 11341 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.790367 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f482641e4e2a4d109ab2f3acbbaebbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.846122 11334 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:20.846688 11334 ts_tablet_manager.cc:1403] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.358s	user 0.043s	sys 0.037s
I20260709 12:09:20.849516 11334 raft_consensus.cc:359] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.850219 11334 raft_consensus.cc:385] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:20.854904 11185 leader_election.cc:343] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.855525 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d29c78e55e4b76a84881d4f97aaec8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:20.855660 11110 leader_election.cc:343] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.856029 11185 leader_election.cc:343] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.872041 11131 tablet_service.cc:1511] Processing CreateTablet for tablet cbfeda1095314856b34426f3195f5c23 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:20.862428 11128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee56790b88674a68962bb5866affcd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.852347 11334 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.873353 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfeda1095314856b34426f3195f5c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.874039 11334 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:20.876689 11334 ts_tablet_manager.cc:1434] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:09:20.877729 11334 tablet_bootstrap.cc:492] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:20.878090 11333 ts_tablet_manager.cc:1434] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.148s	user 0.007s	sys 0.011s
I20260709 12:09:20.886976 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5275fafd0e7457694ac49b17b3fcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.895699 11280 tablet_service.cc:1511] Processing CreateTablet for tablet cbfeda1095314856b34426f3195f5c23 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:20.903446 11280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfeda1095314856b34426f3195f5c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.899128 11335 tablet_bootstrap.cc:654] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.897248 11129 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:20.896972 11334 tablet_bootstrap.cc:654] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.909301 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:20.909843 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.909665 11278 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:20.910127 11219 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:20.910995 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.911334 11132 tablet_service.cc:1511] Processing CreateTablet for tablet 255c201215d14e89bc735bb8b57682cb (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:20.912626 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255c201215d14e89bc735bb8b57682cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.913941 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:20.914891 11207 tablet_service.cc:1511] Processing CreateTablet for tablet c4d8b59f386d4565b0103c44f0baa84d (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:20.916246 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa9c55aa9ba49cc82db376e55f14ecc (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:20.914876 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857ecbbb0c7485d9d6ff255660d2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.918016 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d8b59f386d4565b0103c44f0baa84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.918711 11200 tablet_service.cc:1511] Processing CreateTablet for tablet 14c3c7c84ef94275814f49349db79a72 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:20.919937 11200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c3c7c84ef94275814f49349db79a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.922765 11333 tablet_bootstrap.cc:492] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:20.923756 11202 tablet_service.cc:1511] Processing CreateTablet for tablet ee56790b88674a68962bb5866affcd4f (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:20.925119 11202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee56790b88674a68962bb5866affcd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.928052 11205 tablet_service.cc:1511] Processing CreateTablet for tablet d3619bd8cdd6482dad222b2265b94b48 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:20.929387 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3619bd8cdd6482dad222b2265b94b48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.930374 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa9c55aa9ba49cc82db376e55f14ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.940312 11201 tablet_service.cc:1511] Processing CreateTablet for tablet a5275fafd0e7457694ac49b17b3fcfc1 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:20.942691 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5275fafd0e7457694ac49b17b3fcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:20.945428 11245 tablet.cc:2406] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:20.954841 11204 tablet_service.cc:1511] Processing CreateTablet for tablet cbfeda1095314856b34426f3195f5c23 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:20.956274 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfeda1095314856b34426f3195f5c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.965116 11281 tablet_service.cc:1511] Processing CreateTablet for tablet 255c201215d14e89bc735bb8b57682cb (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:20.966565 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255c201215d14e89bc735bb8b57682cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.967962 11126 tablet_service.cc:1511] Processing CreateTablet for tablet e8f20890b5ce4b0294cf6746a2a341ff (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:20.969434 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f20890b5ce4b0294cf6746a2a341ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.954892 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 255c201215d14e89bc735bb8b57682cb (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:20.971874 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255c201215d14e89bc735bb8b57682cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.991932 11127 tablet_service.cc:1511] Processing CreateTablet for tablet c0c432ae03684756b937dd1aa2541cbd (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:20.993538 11127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c432ae03684756b937dd1aa2541cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.989984 11207 tablet_service.cc:1511] Processing CreateTablet for tablet e8f20890b5ce4b0294cf6746a2a341ff (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:20.999233 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f20890b5ce4b0294cf6746a2a341ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:20.997634 11281 tablet_service.cc:1511] Processing CreateTablet for tablet e8f20890b5ce4b0294cf6746a2a341ff (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:21.003552 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f20890b5ce4b0294cf6746a2a341ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.005923 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:21.007334 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.015266 11205 tablet_service.cc:1511] Processing CreateTablet for tablet c0c432ae03684756b937dd1aa2541cbd (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:21.016945 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c432ae03684756b937dd1aa2541cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.030220 11279 tablet_service.cc:1511] Processing CreateTablet for tablet c0c432ae03684756b937dd1aa2541cbd (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:21.034720 11129 tablet_service.cc:1511] Processing CreateTablet for tablet c75d2c70008a4d06a2db7185a2b623e2 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:21.035923 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c432ae03684756b937dd1aa2541cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.036139 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d2c70008a4d06a2db7185a2b623e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.036562 11341 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.037091 11341 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.039367 11341 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.039583 11144 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:20.993683 11333 tablet_bootstrap.cc:654] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.043198 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.044457 11339 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:21.044616 11259 leader_election.cc:343] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.044520 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:21.048556 11258 leader_election.cc:343] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.049044 11258 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:21.050092 11341 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.051119 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:21.052525 11356 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.053035 11356 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:21.053886 11356 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.062129 11335 tablet_bootstrap.cc:492] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.062674 11335 ts_tablet_manager.cc:1403] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.238s	user 0.029s	sys 0.017s
I20260709 12:09:21.065912 11335 raft_consensus.cc:359] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:21.067617 11335 raft_consensus.cc:385] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.067974 11335 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.068750 11335 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:21.071044 11335 ts_tablet_manager.cc:1434] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:09:21.076594 11206 tablet_service.cc:1511] Processing CreateTablet for tablet c75d2c70008a4d06a2db7185a2b623e2 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:21.081939 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d2c70008a4d06a2db7185a2b623e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:21.087301 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.091714 11339 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.092221 11339 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:21.099651 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.100435 11293 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:21.100888 11275 tablet_service.cc:1511] Processing CreateTablet for tablet c75d2c70008a4d06a2db7185a2b623e2 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:21.101935 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:21.105434 11335 tablet_bootstrap.cc:492] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.102399 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d2c70008a4d06a2db7185a2b623e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.125763 11333 tablet_bootstrap.cc:492] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.126443 11333 ts_tablet_manager.cc:1403] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.204s	user 0.015s	sys 0.017s
I20260709 12:09:21.127290 11206 tablet_service.cc:1511] Processing CreateTablet for tablet a98f617dcc31482f9ed419423e8b50d5 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:21.128899 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98f617dcc31482f9ed419423e8b50d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.131177 11334 tablet_bootstrap.cc:492] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.131876 11334 ts_tablet_manager.cc:1403] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.254s	user 0.031s	sys 0.019s
I20260709 12:09:21.135814 11334 raft_consensus.cc:359] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.136970 11334 raft_consensus.cc:385] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.137395 11334 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.139521 11340 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.140056 11340 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.123095 11339 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.143153 11339 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.143575 11339 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.143971 11339 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.144075 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.138394 11334 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.147500 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:21.149298 11184 leader_election.cc:343] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.150091 11185 leader_election.cc:343] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.150558 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:21.142328 11340 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.151849 11340 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.158944 11334 ts_tablet_manager.cc:1434] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:09:21.129931 11333 raft_consensus.cc:359] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.166970 11333 raft_consensus.cc:385] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.167385 11333 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.168323 11333 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.170264 11334 tablet_bootstrap.cc:492] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.188687 11334 tablet_bootstrap.cc:654] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.192625 11277 tablet_service.cc:1511] Processing CreateTablet for tablet a98f617dcc31482f9ed419423e8b50d5 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:21.194209 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98f617dcc31482f9ed419423e8b50d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.200678 11333 ts_tablet_manager.cc:1434] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:09:21.201843 11333 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.201210 11040 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:21.215332 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113501us
W20260709 12:09:21.220198 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 70156.9us
I20260709 12:09:21.220994 11132 tablet_service.cc:1511] Processing CreateTablet for tablet a98f617dcc31482f9ed419423e8b50d5 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:21.222455 11132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98f617dcc31482f9ed419423e8b50d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.223337 11333 tablet_bootstrap.cc:654] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.223747 11335 tablet_bootstrap.cc:654] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.231885 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.233136 11281 tablet_service.cc:1511] Processing CreateTablet for tablet 25bbe9f3cd6e42aca82fdba9812b235c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:21.234411 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bbe9f3cd6e42aca82fdba9812b235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.235587 11334 tablet_bootstrap.cc:492] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.236232 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 25bbe9f3cd6e42aca82fdba9812b235c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:21.237675 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bbe9f3cd6e42aca82fdba9812b235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.243637 11339 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:09:21.244822 11110 leader_election.cc:343] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.245939 11339 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.247412 11129 tablet_service.cc:1511] Processing CreateTablet for tablet 25bbe9f3cd6e42aca82fdba9812b235c (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:21.251029 11127 tablet_service.cc:1511] Processing CreateTablet for tablet bc7de5348ade43f196ccf4a393cc5bb8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:21.236210 11334 ts_tablet_manager.cc:1403] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.025s
I20260709 12:09:21.252041 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:21.252899 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:21.253541 11293 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.253579 11110 leader_election.cc:343] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.254734 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bbe9f3cd6e42aca82fdba9812b235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.256678 11206 tablet_service.cc:1511] Processing CreateTablet for tablet bc7de5348ade43f196ccf4a393cc5bb8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:21.264220 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 84d8da0a42f045c0919f6b93b4a3ca15 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:21.265337 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7de5348ade43f196ccf4a393cc5bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.265607 11127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7de5348ade43f196ccf4a393cc5bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.269529 11275 tablet_service.cc:1511] Processing CreateTablet for tablet 84d8da0a42f045c0919f6b93b4a3ca15 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:21.270845 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d8da0a42f045c0919f6b93b4a3ca15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.270957 11275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d8da0a42f045c0919f6b93b4a3ca15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.259555 11333 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.261125 11335 tablet_bootstrap.cc:492] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.272668 11333 ts_tablet_manager.cc:1403] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.000s
I20260709 12:09:21.272809 11335 ts_tablet_manager.cc:1403] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.001s
I20260709 12:09:21.262070 11279 tablet_service.cc:1511] Processing CreateTablet for tablet bc7de5348ade43f196ccf4a393cc5bb8 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:21.275331 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7de5348ade43f196ccf4a393cc5bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.276494 11335 raft_consensus.cc:359] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.276891 11125 tablet_service.cc:1511] Processing CreateTablet for tablet f9943fa4bd634a79a891fa52086a527a (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:21.277339 11335 raft_consensus.cc:385] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.277786 11335 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.278213 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9943fa4bd634a79a891fa52086a527a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.263017 11126 tablet_service.cc:1511] Processing CreateTablet for tablet 84d8da0a42f045c0919f6b93b4a3ca15 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:21.279246 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d8da0a42f045c0919f6b93b4a3ca15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.280086 11205 tablet_service.cc:1511] Processing CreateTablet for tablet f9943fa4bd634a79a891fa52086a527a (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:21.278895 11335 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.281334 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9943fa4bd634a79a891fa52086a527a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.283965 11335 ts_tablet_manager.cc:1434] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:09:21.287300 11361 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.308354 11361 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.310901 11361 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.311300 11333 raft_consensus.cc:359] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.315316 11333 raft_consensus.cc:385] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.312845 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.287003 11281 tablet_service.cc:1511] Processing CreateTablet for tablet f9943fa4bd634a79a891fa52086a527a (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:21.314149 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:21.316577 11110 leader_election.cc:343] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.317413 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9943fa4bd634a79a891fa52086a527a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.317440 11341 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.317616 11110 leader_election.cc:343] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.318192 11110 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:21.318171 11341 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.319767 11361 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.320329 11341 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.320679 11131 tablet_service.cc:1511] Processing CreateTablet for tablet ec444005f2c247b18f21f2d9fcf7749e (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:21.321467 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.322006 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec444005f2c247b18f21f2d9fcf7749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.323778 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.324592 11144 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:21.325752 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:21.327045 11341 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.314932 11335 tablet_bootstrap.cc:492] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.263448 11334 raft_consensus.cc:359] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.334707 11334 raft_consensus.cc:385] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.335100 11334 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.335551 11333 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.336113 11334 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.343448 11128 tablet_service.cc:1511] Processing CreateTablet for tablet f1f091d9f19d495da80e2f33e1044577 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:21.344735 11128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f091d9f19d495da80e2f33e1044577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.345279 11333 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.353295 11201 tablet_service.cc:1511] Processing CreateTablet for tablet f1f091d9f19d495da80e2f33e1044577 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:21.356374 11335 tablet_bootstrap.cc:654] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.356106 11276 tablet_service.cc:1511] Processing CreateTablet for tablet f1f091d9f19d495da80e2f33e1044577 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:21.357641 11276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f091d9f19d495da80e2f33e1044577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.339365 11209 tablet_service.cc:1511] Processing CreateTablet for tablet ec444005f2c247b18f21f2d9fcf7749e (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:21.359532 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec444005f2c247b18f21f2d9fcf7749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.362277 11333 ts_tablet_manager.cc:1434] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.000s
I20260709 12:09:21.369578 11134 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2e22241c745b9aa339da0259546f0 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:21.348251 11293 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:21.364231 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f091d9f19d495da80e2f33e1044577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.371030 11134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2e22241c745b9aa339da0259546f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.346391 11341 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.341917 11277 tablet_service.cc:1511] Processing CreateTablet for tablet ec444005f2c247b18f21f2d9fcf7749e (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:21.379354 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec444005f2c247b18f21f2d9fcf7749e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.387455 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:21.388599 11361 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.389051 11361 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:21.389873 11361 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:21.392935 11369 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.393443 11369 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.400950 11200 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2e22241c745b9aa339da0259546f0 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:21.402444 11200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2e22241c745b9aa339da0259546f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.406292 11333 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.361233 11334 ts_tablet_manager.cc:1434] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.006s
I20260709 12:09:21.408515 11040 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.409828 11278 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2e22241c745b9aa339da0259546f0 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:21.416428 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.417271 11278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2e22241c745b9aa339da0259546f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:21.419207 11258 leader_election.cc:343] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.419003 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5a128ee9974008ab01b0d55cfbb77e (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:21.421345 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.421729 11126 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5a128ee9974008ab01b0d55cfbb77e (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:09:21.422873 11259 leader_election.cc:343] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.423113 11126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5a128ee9974008ab01b0d55cfbb77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.423360 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:21.424259 11341 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.420372 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5a128ee9974008ab01b0d55cfbb77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.426604 11369 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.438189 11334 tablet_bootstrap.cc:492] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.439373 11333 tablet_bootstrap.cc:654] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.447111 11362 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.447826 11362 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.452370 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.453342 11279 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5a128ee9974008ab01b0d55cfbb77e (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:21.455686 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.456167 11362 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:21.457155 11185 leader_election.cc:343] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.457366 11201 tablet_service.cc:1511] Processing CreateTablet for tablet 7e660be03b734102a4ad43c954498a96 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:09:21.458078 11184 leader_election.cc:343] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.455466 11129 tablet_service.cc:1511] Processing CreateTablet for tablet 7e660be03b734102a4ad43c954498a96 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:21.458578 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:21.457398 11281 tablet_service.cc:1511] Processing CreateTablet for tablet 7e660be03b734102a4ad43c954498a96 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:21.469125 11362 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.468808 11277 tablet_service.cc:1511] Processing CreateTablet for tablet 776da81ff0064a87b29c2949e7bc5291 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:21.459403 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e660be03b734102a4ad43c954498a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.458479 11334 tablet_bootstrap.cc:654] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.463250 11131 tablet_service.cc:1511] Processing CreateTablet for tablet 776da81ff0064a87b29c2949e7bc5291 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:21.471887 11131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776da81ff0064a87b29c2949e7bc5291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.465129 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 776da81ff0064a87b29c2949e7bc5291 (DEFAULT_TABLE table=test-workload [id=8a8afda7208d44b0999532d2e7694e6c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:21.459079 11279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5a128ee9974008ab01b0d55cfbb77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.477456 11281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e660be03b734102a4ad43c954498a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.459077 11201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e660be03b734102a4ad43c954498a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.491333 11335 tablet_bootstrap.cc:492] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.491912 11335 ts_tablet_manager.cc:1403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.177s	user 0.009s	sys 0.003s
I20260709 12:09:21.491950 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776da81ff0064a87b29c2949e7bc5291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.495566 11335 raft_consensus.cc:359] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.496395 11335 raft_consensus.cc:385] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.496752 11335 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.497663 11335 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.507845 11335 ts_tablet_manager.cc:1434] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:09:21.509003 11335 tablet_bootstrap.cc:492] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.514645 11277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776da81ff0064a87b29c2949e7bc5291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:21.516752 11333 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.519177 11333 ts_tablet_manager.cc:1403] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.149s	user 0.024s	sys 0.022s
I20260709 12:09:21.522696 11333 raft_consensus.cc:359] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.524219 11333 raft_consensus.cc:385] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.524621 11333 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.525597 11333 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.528777 11334 tablet_bootstrap.cc:492] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.529349 11334 ts_tablet_manager.cc:1403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.003s
I20260709 12:09:21.532501 11334 raft_consensus.cc:359] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.536293 11335 tablet_bootstrap.cc:654] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.537861 11361 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.538340 11333 ts_tablet_manager.cc:1434] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:09:21.538735 11334 raft_consensus.cc:385] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.539149 11334 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.538937 11361 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.539906 11333 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.540096 11334 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.541204 11361 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.546082 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.547207 11333 tablet_bootstrap.cc:654] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.547776 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:21.549495 11110 leader_election.cc:343] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.550685 11110 leader_election.cc:343] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.551220 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:21.553694 11334 ts_tablet_manager.cc:1434] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:09:21.554909 11334 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.556078 11361 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.558779 11333 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.559343 11333 ts_tablet_manager.cc:1403] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 12:09:21.562626 11333 raft_consensus.cc:359] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.563387 11333 raft_consensus.cc:385] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.563706 11333 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.563891 11334 tablet_bootstrap.cc:654] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.564618 11333 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.569872 11335 tablet_bootstrap.cc:492] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.570413 11335 ts_tablet_manager.cc:1403] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.015s
I20260709 12:09:21.570587 11334 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.571178 11334 ts_tablet_manager.cc:1403] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:09:21.573266 11335 raft_consensus.cc:359] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.574071 11335 raft_consensus.cc:385] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.574483 11335 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.574096 11334 raft_consensus.cc:359] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.574849 11333 ts_tablet_manager.cc:1434] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:09:21.575022 11334 raft_consensus.cc:385] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.575352 11334 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.575302 11335 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.576320 11334 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.577834 11335 ts_tablet_manager.cc:1434] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:09:21.578626 11334 ts_tablet_manager.cc:1434] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:21.579362 11335 tablet_bootstrap.cc:492] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.579689 11334 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.583108 11333 tablet_bootstrap.cc:492] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.586522 11334 tablet_bootstrap.cc:654] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.587112 11335 tablet_bootstrap.cc:654] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.591883 11333 tablet_bootstrap.cc:654] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.598274 11362 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.598762 11335 tablet_bootstrap.cc:492] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.601662 11335 ts_tablet_manager.cc:1403] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 12:09:21.605329 11334 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.605981 11334 ts_tablet_manager.cc:1403] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:09:21.606920 11335 raft_consensus.cc:359] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.608067 11335 raft_consensus.cc:385] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.608106 11333 tablet_bootstrap.cc:492] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.608681 11335 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.609040 11333 ts_tablet_manager.cc:1403] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 12:09:21.609483 11334 raft_consensus.cc:359] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.610248 11334 raft_consensus.cc:385] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.609809 11335 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.610605 11334 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.611869 11334 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.612519 11335 ts_tablet_manager.cc:1434] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:09:21.613698 11335 tablet_bootstrap.cc:492] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.613725 11333 raft_consensus.cc:359] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.614933 11333 raft_consensus.cc:385] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.615345 11333 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.619518 11334 ts_tablet_manager.cc:1434] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:09:21.619709 11333 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.622015 11333 ts_tablet_manager.cc:1434] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:09:21.622617 11334 tablet_bootstrap.cc:492] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.622954 11333 tablet_bootstrap.cc:492] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.623092 11335 tablet_bootstrap.cc:654] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.632077 11333 tablet_bootstrap.cc:654] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.632133 11334 tablet_bootstrap.cc:654] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.635962 11335 tablet_bootstrap.cc:492] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.636760 11335 ts_tablet_manager.cc:1403] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 12:09:21.641161 11335 raft_consensus.cc:359] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.642290 11335 raft_consensus.cc:385] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.642771 11335 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.643957 11335 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.647303 11335 ts_tablet_manager.cc:1434] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:21.648663 11335 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.650076 11361 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.650802 11361 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.655138 11339 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.655846 11339 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.660244 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.661164 11219 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:21.665180 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.669775 11340 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.670351 11340 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.666142 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:21.672525 11340 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.673358 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:21.675372 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.676276 11143 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:21.680773 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:21.682003 11340 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.683326 11340 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.683756 11340 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.689105 11388 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.689572 11388 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.689903 11388 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.690601 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.694239 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.695051 11293 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:21.696511 11339 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.697463 11339 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.698179 11339 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.699540 11333 tablet_bootstrap.cc:492] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.700101 11333 ts_tablet_manager.cc:1403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.077s	user 0.039s	sys 0.030s
I20260709 12:09:21.700812 11339 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.702811 11361 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.702564 11333 raft_consensus.cc:359] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.703233 11333 raft_consensus.cc:385] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.703508 11333 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.704706 11388 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.704473 11333 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.705794 11362 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.707195 11388 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.718766 11333 ts_tablet_manager.cc:1434] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:09:21.719969 11333 tablet_bootstrap.cc:492] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.720379 11340 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.728310 11340 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.726011 11335 tablet_bootstrap.cc:654] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.721048 11334 tablet_bootstrap.cc:492] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.735517 11334 ts_tablet_manager.cc:1403] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.114s	user 0.037s	sys 0.048s
I20260709 12:09:21.737275 11333 tablet_bootstrap.cc:654] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.729529 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56302.6us
I20260709 12:09:21.730445 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:21.738428 11334 raft_consensus.cc:359] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.738907 11292 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.739269 11334 raft_consensus.cc:385] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.739573 11334 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.740396 11334 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.742247 11334 ts_tablet_manager.cc:1434] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:21.733278 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:21.742863 11142 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.743192 11334 tablet_bootstrap.cc:492] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.749339 11334 tablet_bootstrap.cc:654] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.762185 11334 tablet_bootstrap.cc:492] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.762766 11334 ts_tablet_manager.cc:1403] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:09:21.762264 11292 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:21.769513 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:21.770697 11340 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.771168 11340 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:21.772038 11340 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.772459 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:09:21.773779 11110 leader_election.cc:343] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.774930 11386 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.774662 11334 raft_consensus.cc:359] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.775296 11386 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.775416 11334 raft_consensus.cc:385] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.775689 11386 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.776269 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.775694 11334 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.767599 11142 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:21.778585 11334 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.781399 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.783980 11334 ts_tablet_manager.cc:1434] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:21.784142 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.786206 11334 tablet_bootstrap.cc:492] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.787544 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:21.788321 11219 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.785226 11386 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.794303 11386 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.799396 11219 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:21.804136 11334 tablet_bootstrap.cc:654] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.802140 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:21.809353 11293 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.801219 11039 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.816555 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:21.817420 11218 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.821695 11334 tablet_bootstrap.cc:492] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.822278 11334 ts_tablet_manager.cc:1403] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.005s
W20260709 12:09:21.823428 11110 leader_election.cc:343] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.824133 11110 leader_election.cc:343] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.825058 11110 leader_election.cc:343] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.825474 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:21.825289 11334 raft_consensus.cc:359] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.826189 11334 raft_consensus.cc:385] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.826586 11334 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.827365 11334 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.807991 11335 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.828212 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:21.828599 11335 ts_tablet_manager.cc:1403] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.180s	user 0.013s	sys 0.003s
I20260709 12:09:21.831722 11333 tablet_bootstrap.cc:492] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.832150 11333 ts_tablet_manager.cc:1403] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.112s	user 0.052s	sys 0.046s
I20260709 12:09:21.832487 11218 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:21.834085 11386 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.834322 11369 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.834625 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:21.834779 11333 raft_consensus.cc:359] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.834880 11369 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.835418 11386 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.835557 11333 raft_consensus.cc:385] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.835582 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:21.835978 11386 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:21.837057 11361 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:21.837123 11110 leader_election.cc:343] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.837625 11361 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:21.837373 11386 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.838404 11361 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.838945 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:21.839495 11340 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.839941 11340 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.840997 11369 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.836054 11333 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.843497 11333 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.845286 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:21.846951 11184 leader_election.cc:343] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.847317 11334 ts_tablet_manager.cc:1434] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 12:09:21.845506 11333 ts_tablet_manager.cc:1434] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:21.848030 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.848433 11334 tablet_bootstrap.cc:492] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:21.848814 11142 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:21.841979 11340 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.852599 11335 raft_consensus.cc:359] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.853272 11335 raft_consensus.cc:385] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.853546 11335 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.854020 11333 tablet_bootstrap.cc:492] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.855243 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.855443 11258 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:21.856003 11218 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:21.856364 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.856987 11293 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:21.855122 11335 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.858189 11185 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:21.859506 11340 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.859910 11369 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.860327 11369 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.860687 11369 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.864167 11333 tablet_bootstrap.cc:654] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.859926 11340 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.866914 11340 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.876748 11369 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.878048 11042 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.879655 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:21.880282 11142 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.881338 11335 ts_tablet_manager.cc:1434] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:09:21.880309 11042 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.882328 11335 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.883623 11334 tablet_bootstrap.cc:654] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.890069 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:21.890348 11142 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:21.890743 11218 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.893146 11258 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:21.893193 11369 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.895272 11369 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.895866 11369 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:21.896060 11356 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.896561 11356 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.888165 11340 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.898787 11356 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.901401 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:21.902148 11293 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:21.903827 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:21.904179 11333 tablet_bootstrap.cc:492] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.904620 11333 ts_tablet_manager.cc:1403] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.018s
I20260709 12:09:21.904613 11356 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.905364 11356 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.905747 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:21.905272 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:21.906358 11144 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.906412 11293 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.906585 11340 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.896978 11369 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.907449 11333 raft_consensus.cc:359] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:21.908077 11333 raft_consensus.cc:385] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.908344 11333 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.905946 11356 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.909111 11333 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:21.911458 11333 ts_tablet_manager.cc:1434] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:21.912883 11218 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:21.917109 11218 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.919387 11144 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:21.920508 11333 tablet_bootstrap.cc:492] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.920806 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:21.921764 11340 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.922403 11340 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:21.923326 11335 tablet_bootstrap.cc:654] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.923254 11340 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.926990 11293 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:21.927806 11333 tablet_bootstrap.cc:654] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.931641 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.931806 11341 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.932344 11341 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.938555 11334 tablet_bootstrap.cc:492] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:21.938619 11341 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.939383 11334 ts_tablet_manager.cc:1403] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.007s
I20260709 12:09:21.941378 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:21.941761 11184 leader_election.cc:343] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.943781 11259 leader_election.cc:343] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.942919 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:21.945356 11144 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:21.946250 11356 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.947155 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:21.948768 11341 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.949198 11341 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.949215 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:21.952778 11333 tablet_bootstrap.cc:492] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:21.951448 11386 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.953279 11333 ts_tablet_manager.cc:1403] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.007s
W20260709 12:09:21.954298 11184 leader_election.cc:343] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.955463 11341 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.956141 11333 raft_consensus.cc:359] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.956820 11333 raft_consensus.cc:385] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.957099 11333 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.957489 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:21.960928 11293 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.961359 11335 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:21.961881 11335 ts_tablet_manager.cc:1403] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.004s
I20260709 12:09:21.957737 11333 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.965508 11335 raft_consensus.cc:359] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.966178 11042 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.949434 11356 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.966214 11335 raft_consensus.cc:385] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.968025 11335 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.968741 11333 ts_tablet_manager.cc:1434] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:09:21.974251 11333 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:21.969019 11335 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.972601 11341 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.975191 11039 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.985630 11335 ts_tablet_manager.cc:1434] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:09:21.986672 11335 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:21.988741 11341 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:21.980705 11293 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:21.989598 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:21.990442 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:21.990873 11386 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.990967 11144 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.991516 11386 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.992022 11361 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.968994 11334 raft_consensus.cc:359] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.993726 11334 raft_consensus.cc:385] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.993822 11386 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:21.994174 11340 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.994659 11334 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.995163 11340 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:21.998055 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:21.999197 11144 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:21.999629 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.001307 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.002811 11369 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.003454 11369 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:22.004606 11369 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:22.006906 11110 leader_election.cc:343] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.996088 11340 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:22.008267 11110 leader_election.cc:343] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.008765 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:22.010046 11386 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.995728 11334 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:21.994513 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:22.011628 11219 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.012666 11333 tablet_bootstrap.cc:654] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.016655 11334 ts_tablet_manager.cc:1434] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.077s	user 0.000s	sys 0.008s
I20260709 12:09:22.030361 11335 tablet_bootstrap.cc:654] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.035955 11219 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:22.043735 11334 tablet_bootstrap.cc:492] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.056145 11042 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.058015 11333 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.058605 11333 ts_tablet_manager.cc:1403] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.006s
I20260709 12:09:22.061725 11333 raft_consensus.cc:359] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.062363 11333 raft_consensus.cc:385] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.062633 11333 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.063354 11333 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.065577 11333 ts_tablet_manager.cc:1434] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:22.066460 11333 tablet_bootstrap.cc:492] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:22.065954 11041 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.071658 11334 tablet_bootstrap.cc:654] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.074062 11333 tablet_bootstrap.cc:654] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.083434 11334 tablet_bootstrap.cc:492] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.083869 11334 ts_tablet_manager.cc:1403] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.010s
I20260709 12:09:22.087141 11333 tablet_bootstrap.cc:492] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.087563 11333 ts_tablet_manager.cc:1403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 12:09:22.089725 11334 raft_consensus.cc:359] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.089715 11333 raft_consensus.cc:359] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.090448 11334 raft_consensus.cc:385] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.090734 11333 raft_consensus.cc:385] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.090821 11334 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.091332 11333 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.091922 11334 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.092000 11333 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.094409 11334 ts_tablet_manager.cc:1434] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:22.094715 11333 ts_tablet_manager.cc:1434] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:09:22.095261 11334 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.095671 11333 tablet_bootstrap.cc:492] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
W20260709 12:09:22.096849 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.102114 11334 tablet_bootstrap.cc:654] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.102114 11333 tablet_bootstrap.cc:654] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.106267 11369 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.106907 11369 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.110461 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.111719 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:22.111881 11258 leader_election.cc:343] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.113333 11259 leader_election.cc:343] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.113888 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:22.114578 11341 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.114598 11369 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.117234 11333 tablet_bootstrap.cc:492] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.117349 11334 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.117851 11333 ts_tablet_manager.cc:1403] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.009s
I20260709 12:09:22.117885 11334 ts_tablet_manager.cc:1403] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:09:22.120508 11333 raft_consensus.cc:359] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.120990 11333 raft_consensus.cc:385] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.121240 11333 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.120869 11334 raft_consensus.cc:359] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.121668 11334 raft_consensus.cc:385] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.121994 11334 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.121831 11333 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.122668 11334 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.124215 11333 ts_tablet_manager.cc:1434] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:22.124611 11335 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:22.125095 11335 ts_tablet_manager.cc:1403] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.139s	user 0.028s	sys 0.043s
I20260709 12:09:22.125445 11334 ts_tablet_manager.cc:1434] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:22.126145 11334 tablet_bootstrap.cc:492] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.128727 11333 tablet_bootstrap.cc:492] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:22.128360 11335 raft_consensus.cc:359] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.129218 11335 raft_consensus.cc:385] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.129570 11335 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.130940 11335 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.132164 11334 tablet_bootstrap.cc:654] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.136492 11333 tablet_bootstrap.cc:654] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.137080 11335 ts_tablet_manager.cc:1434] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:22.138343 11335 tablet_bootstrap.cc:492] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:22.143903 11334 tablet_bootstrap.cc:492] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.144327 11334 ts_tablet_manager.cc:1403] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:09:22.144994 11335 tablet_bootstrap.cc:654] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.147351 11334 raft_consensus.cc:359] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.148006 11334 raft_consensus.cc:385] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.148267 11334 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.149343 11334 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.152297 11334 ts_tablet_manager.cc:1434] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:22.153535 11334 tablet_bootstrap.cc:492] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.165251 11333 tablet_bootstrap.cc:492] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.165797 11333 ts_tablet_manager.cc:1403] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.015s
I20260709 12:09:22.166240 11335 tablet_bootstrap.cc:492] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:22.166656 11334 tablet_bootstrap.cc:654] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.167862 11335 ts_tablet_manager.cc:1403] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.018s
I20260709 12:09:22.168987 11333 raft_consensus.cc:359] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.169716 11333 raft_consensus.cc:385] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.169999 11333 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.170903 11333 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.170568 11335 raft_consensus.cc:359] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.171772 11335 raft_consensus.cc:385] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.174228 11333 ts_tablet_manager.cc:1434] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:09:22.172043 11335 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.175009 11334 tablet_bootstrap.cc:492] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.175467 11334 ts_tablet_manager.cc:1403] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:09:22.175779 11333 tablet_bootstrap.cc:492] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:22.175405 11335 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.178043 11334 raft_consensus.cc:359] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.179131 11334 raft_consensus.cc:385] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.179407 11334 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.180039 11334 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.182447 11334 ts_tablet_manager.cc:1434] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:22.183594 11334 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.184597 11333 tablet_bootstrap.cc:654] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.187081 11356 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.187649 11356 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.189733 11334 tablet_bootstrap.cc:654] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.192039 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.192936 11292 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:22.196070 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.197880 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.199131 11340 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.199498 11369 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.200692 11184 leader_election.cc:343] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.200485 11369 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.203722 11369 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.199615 11340 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.204493 11340 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.205154 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.206059 11144 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:22.207465 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:22.208814 11219 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:22.209728 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.211210 11356 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.212168 11335 ts_tablet_manager.cc:1434] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.044s	user 0.001s	sys 0.006s
I20260709 12:09:22.212445 11369 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.212956 11369 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.213145 11335 tablet_bootstrap.cc:492] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:22.215955 11339 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.216343 11356 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.216596 11339 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.217005 11356 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.223229 11356 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.225015 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:22.225121 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.226130 11292 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:22.226929 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.227993 11293 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:22.219913 11339 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.230433 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.232125 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:22.232820 11340 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.233531 11339 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.234728 11356 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.235241 11356 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.235695 11356 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.239322 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.239979 11144 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:22.213421 11369 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.243755 11362 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.247691 11335 tablet_bootstrap.cc:654] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.289186 11339 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.291270 11333 tablet_bootstrap.cc:492] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.291772 11333 ts_tablet_manager.cc:1403] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.056s
I20260709 12:09:22.293597 11334 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.294399 11334 ts_tablet_manager.cc:1403] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.111s	user 0.033s	sys 0.066s
I20260709 12:09:22.295265 11333 raft_consensus.cc:359] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.296010 11333 raft_consensus.cc:385] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.296291 11333 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.296512 11335 tablet_bootstrap.cc:492] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:22.296921 11333 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.297856 11335 ts_tablet_manager.cc:1403] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.009s
I20260709 12:09:22.297514 11334 raft_consensus.cc:359] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.298388 11334 raft_consensus.cc:385] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.298794 11334 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.299585 11334 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.301352 11334 ts_tablet_manager.cc:1434] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:22.301438 11388 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.302809 11334 tablet_bootstrap.cc:492] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.310361 11334 tablet_bootstrap.cc:654] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.312795 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:22.312585 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:22.312774 11333 ts_tablet_manager.cc:1434] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 12:09:22.313619 11340 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.313638 11292 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.317749 11362 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.321619 11291 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.328085 11356 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.327394 11388 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.300472 11335 raft_consensus.cc:359] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.331827 11335 raft_consensus.cc:385] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.332252 11335 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.333132 11335 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.336329 11144 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.336552 11335 ts_tablet_manager.cc:1434] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 12:09:22.346032 11341 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.346868 11341 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.349151 11292 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:22.349653 11341 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.351511 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.352581 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.353546 11335 tablet_bootstrap.cc:492] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:22.356647 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:22.357324 11290 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.361189 11362 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.361692 11362 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.363893 11362 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.366698 11333 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:22.366369 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.367384 11289 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:22.368045 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:22.369948 11185 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.351819 11356 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:22.372087 11258 leader_election.cc:343] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.375283 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:22.375941 11142 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.376727 11144 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:22.377835 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:22.383315 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.385169 11423 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.385560 11423 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.385895 11423 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.388875 11142 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:22.390158 11362 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.391454 11362 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:09:22.392831 11259 leader_election.cc:343] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.393287 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:22.394824 11341 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.396050 11339 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.397701 11423 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.401018 11362 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.401473 11333 tablet_bootstrap.cc:654] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.354418 11340 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.402933 11356 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.404867 11340 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:22.405040 11423 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.405387 11356 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.405839 11340 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.353916 11369 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.413614 11341 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.419595 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:22.420329 11290 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.413048 11423 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:09:22.461733 11334 tablet_bootstrap.cc:492] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.462177 11334 ts_tablet_manager.cc:1403] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.160s	user 0.036s	sys 0.108s
I20260709 12:09:22.480042 11341 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.484155 11335 tablet_bootstrap.cc:654] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.487326 11420 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:09:22.493697 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.494140 11388 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:22.495923 11185 leader_election.cc:343] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.497263 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.497903 11142 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:22.498883 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:22.500267 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.501300 11143 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.465379 11356 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.511816 11334 raft_consensus.cc:359] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.512825 11334 raft_consensus.cc:385] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.513192 11334 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.514032 11334 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.519775 11422 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.520017 11369 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.520411 11422 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.523175 11422 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.502955 11290 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:22.546835 11334 ts_tablet_manager.cc:1434] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.003s
I20260709 12:09:22.549317 11429 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.553226 11334 tablet_bootstrap.cc:492] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.575502 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.556176 11429 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.592598 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:22.603096 11184 leader_election.cc:343] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.603777 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:22.604743 11362 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.605743 11184 leader_election.cc:343] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.605799 11362 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.594134 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:22.614872 11140 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.610365 11369 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:22.620673 11185 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:09:22.621953 11185 leader_election.cc:343] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.622262 11422 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.622828 11422 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:22.623661 11422 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.631372 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:22.627199 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:22.662010 11217 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.675352 11335 tablet_bootstrap.cc:492] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:22.675734 11362 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.676079 11335 ts_tablet_manager.cc:1403] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.331s	user 0.065s	sys 0.055s
I20260709 12:09:22.679585 11143 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
W20260709 12:09:22.680258 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58367.3us
I20260709 12:09:22.687016 11369 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:22.697526 11333 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.701292 11334 tablet_bootstrap.cc:654] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.702389 11333 ts_tablet_manager.cc:1403] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.336s	user 0.034s	sys 0.042s
I20260709 12:09:22.700765 11356 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.708781 11340 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:09:22.726984 11369 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.730928 11369 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.732949 11369 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.733057 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.734505 11335 raft_consensus.cc:359] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.735301 11335 raft_consensus.cc:385] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.735653 11335 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.736482 11335 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.743121 11335 ts_tablet_manager.cc:1434] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.005s
I20260709 12:09:22.743788 11335 tablet_bootstrap.cc:492] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:22.742226 11429 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:09:22.749890 11258 leader_election.cc:343] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.765777 11339 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.766350 11339 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.755550 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.768512 11339 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:22.771064 11258 leader_election.cc:343] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.771955 11333 raft_consensus.cc:359] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.772866 11333 raft_consensus.cc:385] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.775543 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.776178 11290 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:22.773169 11333 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.784153 11333 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.789032 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:22.785465 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.801510 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:22.802286 11219 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:22.802804 11339 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.803218 11339 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.803560 11339 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.807014 11259 leader_election.cc:343] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.807495 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:22.792194 11140 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:22.811421 11362 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.811869 11444 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.811986 11362 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.813591 11333 ts_tablet_manager.cc:1434] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.002s
I20260709 12:09:22.814575 11333 tablet_bootstrap.cc:492] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:22.819321 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:22.820786 11444 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.821308 11444 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:22.821379 11362 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.820514 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:22.823173 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.825294 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:22.826411 11444 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:22.830237 11184 leader_election.cc:343] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.831216 11185 leader_election.cc:343] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.831632 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:22.829439 11042 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.832998 11428 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.834615 11042 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.836017 11042 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.837357 11259 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:22.838289 11429 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.838682 11429 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.838996 11429 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.842689 11334 tablet_bootstrap.cc:492] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:22.843200 11334 ts_tablet_manager.cc:1403] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.295s	user 0.015s	sys 0.010s
I20260709 12:09:22.832618 11217 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
W20260709 12:09:22.845767 11110 leader_election.cc:343] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.852465 11334 raft_consensus.cc:359] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.853963 11334 raft_consensus.cc:385] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.854314 11334 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.855693 11334 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.858896 11429 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.859905 11334 ts_tablet_manager.cc:1434] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:09:22.861054 11334 tablet_bootstrap.cc:492] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:22.854642 11339 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.873032 11334 tablet_bootstrap.cc:654] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.863703 11335 tablet_bootstrap.cc:654] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.868253 11333 tablet_bootstrap.cc:654] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.864835 11429 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.883852 11339 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:22.878418 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:09:22.887466 11258 leader_election.cc:343] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.890990 11444 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.895044 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:22.890861 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:22.898377 11217 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.898800 11110 leader_election.cc:343] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.900290 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:22.901189 11293 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.901551 11428 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.899510 11444 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.929934 11293 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:22.931798 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:22.933101 11217 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
W20260709 12:09:22.934043 11258 leader_election.cc:343] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.934854 11259 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:22.935802 11429 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.936280 11429 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:22.936825 11333 tablet_bootstrap.cc:492] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:22.937333 11333 ts_tablet_manager.cc:1403] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.007s
I20260709 12:09:22.937121 11429 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.945207 11333 raft_consensus.cc:359] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.946044 11333 raft_consensus.cc:385] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.946386 11333 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.947217 11333 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.954371 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:22.955497 11386 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.956184 11386 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:22.956604 11444 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:22.957245 11386 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:22.958524 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:22.961464 11259 leader_election.cc:343] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.961954 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:22.964468 11444 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.965691 11428 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.971793 11333 ts_tablet_manager.cc:1434] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:09:22.973148 11333 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:22.971751 11428 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:22.983251 11335 tablet_bootstrap.cc:492] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:22.983736 11335 ts_tablet_manager.cc:1403] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.016s
I20260709 12:09:23.058947 11335 raft_consensus.cc:359] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.059746 11335 raft_consensus.cc:385] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.060189 11335 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.061014 11335 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.061350 11334 tablet_bootstrap.cc:492] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.062270 11334 ts_tablet_manager.cc:1403] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.202s	user 0.016s	sys 0.041s
I20260709 12:09:23.063406 11335 ts_tablet_manager.cc:1434] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.079s	user 0.017s	sys 0.057s
I20260709 12:09:23.064375 11335 tablet_bootstrap.cc:492] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.070214 11335 tablet_bootstrap.cc:654] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.069972 11042 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.074353 11422 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.080549 11334 raft_consensus.cc:359] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.081676 11334 raft_consensus.cc:385] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.082098 11334 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.082679 11335 tablet_bootstrap.cc:492] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.083154 11335 ts_tablet_manager.cc:1403] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:09:23.083159 11334 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.086612 11334 ts_tablet_manager.cc:1434] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:09:23.086584 11335 raft_consensus.cc:359] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.087594 11335 raft_consensus.cc:385] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.087857 11335 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.088438 11334 tablet_bootstrap.cc:492] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.088420 11335 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.091415 11335 ts_tablet_manager.cc:1434] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:23.092255 11335 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.093940 11333 tablet_bootstrap.cc:654] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.113617 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.118371 11334 tablet_bootstrap.cc:654] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.133222 11333 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.133896 11333 ts_tablet_manager.cc:1403] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.161s	user 0.030s	sys 0.021s
I20260709 12:09:23.138283 11335 tablet_bootstrap.cc:654] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.143215 11334 tablet_bootstrap.cc:492] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.143713 11334 ts_tablet_manager.cc:1403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.015s
I20260709 12:09:23.144937 11333 raft_consensus.cc:359] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.145972 11333 raft_consensus.cc:385] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.146350 11333 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.146410 11334 raft_consensus.cc:359] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.147331 11334 raft_consensus.cc:385] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.147692 11334 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.148360 11334 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.150885 11334 ts_tablet_manager.cc:1434] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:23.151750 11334 tablet_bootstrap.cc:492] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.147400 11333 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.156711 11422 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.158115 11334 tablet_bootstrap.cc:654] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.162525 11333 ts_tablet_manager.cc:1434] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:09:23.164029 11333 tablet_bootstrap.cc:492] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.169754 11422 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.152434 11041 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.187955 11041 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.189256 11333 tablet_bootstrap.cc:654] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.204088 11335 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.204969 11335 ts_tablet_manager.cc:1403] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.029s
I20260709 12:09:23.212213 11334 tablet_bootstrap.cc:492] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.212781 11334 ts_tablet_manager.cc:1403] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.061s	user 0.033s	sys 0.023s
I20260709 12:09:23.215945 11335 raft_consensus.cc:359] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.217871 11335 raft_consensus.cc:385] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.218246 11335 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.219019 11335 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.227674 11334 raft_consensus.cc:359] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.228425 11334 raft_consensus.cc:385] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.228701 11334 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.230500 11335 ts_tablet_manager.cc:1434] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:09:23.231885 11335 tablet_bootstrap.cc:492] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.229408 11334 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.234583 11334 ts_tablet_manager.cc:1434] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:09:23.235039 11428 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.235919 11334 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.235590 11428 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.238615 11335 tablet_bootstrap.cc:654] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.258116 11333 tablet_bootstrap.cc:492] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.257951 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.258729 11333 ts_tablet_manager.cc:1403] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.008s
I20260709 12:09:23.258785 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.259620 11293 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:23.260390 11428 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.260797 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:23.261562 11333 raft_consensus.cc:359] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.262243 11333 raft_consensus.cc:385] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.262369 11428 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.262595 11333 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.267187 11333 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.268085 11334 tablet_bootstrap.cc:654] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.270068 11333 ts_tablet_manager.cc:1434] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:09:23.271970 11428 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.273257 11333 tablet_bootstrap.cc:492] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.274746 11341 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.277786 11335 tablet_bootstrap.cc:492] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.278288 11335 ts_tablet_manager.cc:1403] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.016s
I20260709 12:09:23.280918 11333 tablet_bootstrap.cc:654] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.281754 11335 raft_consensus.cc:359] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.285264 11335 raft_consensus.cc:385] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.285557 11335 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.286216 11335 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.292157 11335 ts_tablet_manager.cc:1434] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:23.293953 11335 tablet_bootstrap.cc:492] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.305465 11444 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.312029 11335 tablet_bootstrap.cc:654] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.319856 11333 tablet_bootstrap.cc:492] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.320345 11333 ts_tablet_manager.cc:1403] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.007s
I20260709 12:09:23.323848 11333 raft_consensus.cc:359] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.324503 11333 raft_consensus.cc:385] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.324759 11333 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.325464 11333 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.327781 11333 ts_tablet_manager.cc:1434] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:23.328408 11333 tablet_bootstrap.cc:492] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.338779 11333 tablet_bootstrap.cc:654] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.339998 11334 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.340672 11334 ts_tablet_manager.cc:1403] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.105s	user 0.031s	sys 0.029s
I20260709 12:09:23.344053 11334 raft_consensus.cc:359] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.345151 11335 tablet_bootstrap.cc:492] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.345389 11334 raft_consensus.cc:385] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.345767 11335 ts_tablet_manager.cc:1403] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.007s
I20260709 12:09:23.345914 11334 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.346854 11386 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.346946 11334 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.347505 11386 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.348814 11335 raft_consensus.cc:359] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.349542 11335 raft_consensus.cc:385] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.349815 11335 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.350622 11335 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.349774 11386 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.353168 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.354171 11334 ts_tablet_manager.cc:1434] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
W20260709 12:09:23.354954 11110 leader_election.cc:343] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.355093 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.355631 11386 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.355975 11293 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:23.357511 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:23.355152 11334 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.358377 11361 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.358891 11361 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.359249 11361 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.358393 11333 tablet_bootstrap.cc:492] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.359920 11333 ts_tablet_manager.cc:1403] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 12:09:23.364209 11333 raft_consensus.cc:359] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.365427 11333 raft_consensus.cc:385] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.365777 11334 tablet_bootstrap.cc:654] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.365811 11333 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.366887 11333 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.367776 11335 ts_tablet_manager.cc:1434] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:09:23.368652 11335 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.369729 11333 ts_tablet_manager.cc:1434] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:09:23.370666 11333 tablet_bootstrap.cc:492] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.376875 11361 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.381716 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:23.383065 11333 tablet_bootstrap.cc:654] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.392692 11110 leader_election.cc:343] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.388561 11339 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.396070 11339 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.400307 11361 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.400414 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:23.401050 11293 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.401930 11339 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.408067 11293 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:23.409349 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.411170 11335 tablet_bootstrap.cc:654] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.411469 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:23.412504 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.413234 11217 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:23.413483 11339 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.410281 11292 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:23.414536 11339 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:23.420187 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:23.421085 11386 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.420329 11339 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.422587 11386 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.422969 11386 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.423296 11386 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.429944 11334 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.431660 11334 ts_tablet_manager.cc:1403] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.020s
I20260709 12:09:23.435881 11386 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.443735 11386 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.443619 11334 raft_consensus.cc:359] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.444720 11334 raft_consensus.cc:385] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.445075 11334 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.445905 11333 tablet_bootstrap.cc:492] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.446650 11333 ts_tablet_manager.cc:1403] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.076s	user 0.026s	sys 0.010s
I20260709 12:09:23.446558 11334 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.450838 11333 raft_consensus.cc:359] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.451781 11333 raft_consensus.cc:385] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.452131 11333 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.452929 11333 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.456552 11334 ts_tablet_manager.cc:1434] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 12:09:23.458830 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:23.459401 11217 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.460493 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:23.461089 11290 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.461714 11334 tablet_bootstrap.cc:492] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.464186 11333 ts_tablet_manager.cc:1434] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 12:09:23.465097 11333 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.466588 11042 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.480273 11444 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.480821 11444 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.485100 11290 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:23.487023 11429 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.501386 11444 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.502377 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:23.502666 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.503782 11218 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:23.504307 11422 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.504859 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.505633 11142 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:23.507244 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:23.508320 11429 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.508199 11444 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.508845 11444 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.508831 11429 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.509537 11444 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.504876 11422 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.511025 11429 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.512768 11422 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.513011 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.514117 11218 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:23.515481 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.516083 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.516213 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:23.516721 11293 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:23.516979 11429 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.517335 11429 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.517647 11429 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.517555 11184 leader_election.cc:343] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.504117 11339 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.522981 11339 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:23.522724 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:23.525377 11422 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.525954 11422 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.526531 11422 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.526958 11339 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.529695 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.530155 11142 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.539927 11258 leader_election.cc:343] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.519423 11217 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:23.551419 11335 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.551941 11335 ts_tablet_manager.cc:1403] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.004s
I20260709 12:09:23.561823 11428 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.565449 11444 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.563050 11428 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.567822 11335 raft_consensus.cc:359] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.568585 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:23.568749 11444 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.568849 11335 raft_consensus.cc:385] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.569219 11140 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.569229 11335 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.570113 11335 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.556222 11429 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.573115 11335 ts_tablet_manager.cc:1434] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:09:23.572124 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:23.579136 11335 tablet_bootstrap.cc:492] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.579972 11217 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.579522 11428 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.588593 11429 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.588554 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.589525 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:23.591106 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:23.591843 11218 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.592808 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.597543 11292 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:23.599104 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:23.600152 11428 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.592401 11042 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:23.607766 11258 leader_election.cc:343] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.612588 11428 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.615103 11422 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.624454 11334 tablet_bootstrap.cc:654] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.631963 11483 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:09:23.632966 11333 tablet_bootstrap.cc:654] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.633652 11444 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.641776 11428 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.646171 11428 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.647037 11369 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.647482 11369 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.648247 11428 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.649299 11369 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.652631 11217 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:23.637212 11218 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:23.655730 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.656858 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:23.657266 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:23.657756 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:23.657912 11290 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.658370 11140 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:23.660609 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.661207 11144 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:23.661976 11335 tablet_bootstrap.cc:654] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.662062 11341 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.662304 11369 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.661563 11422 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.675892 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:23.676862 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:09:23.681051 11184 leader_election.cc:343] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.681170 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.682616 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.682744 11144 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:23.685184 11429 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.685623 11429 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.685976 11429 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.685175 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:23.667273 11292 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:23.692737 11341 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:23.693863 11356 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.693809 11341 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.694326 11356 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.695221 11356 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.694324 11259 leader_election.cc:343] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.700961 11290 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:23.702315 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:23.703387 11428 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.703850 11428 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:23.703724 11429 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.704944 11428 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.706171 11356 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.714516 11429 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.716311 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:09:23.718402 11259 leader_election.cc:343] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.710815 11369 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:23.722731 11369 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.723609 11333 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.724316 11333 ts_tablet_manager.cc:1403] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.259s	user 0.013s	sys 0.019s
I20260709 12:09:23.712378 11422 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.728499 11422 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.734191 11422 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.735484 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.735940 11333 raft_consensus.cc:359] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.737087 11333 raft_consensus.cc:385] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.737447 11333 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.738142 11333 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.741158 11334 tablet_bootstrap.cc:492] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.742383 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:23.743705 11334 ts_tablet_manager.cc:1403] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.286s	user 0.014s	sys 0.011s
I20260709 12:09:23.744900 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:23.746552 11185 leader_election.cc:343] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.747097 11184 leader_election.cc:343] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.747769 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:23.743718 11142 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.752138 11333 ts_tablet_manager.cc:1434] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 12:09:23.752784 11335 tablet_bootstrap.cc:492] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.753228 11335 ts_tablet_manager.cc:1403] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.024s
I20260709 12:09:23.753377 11333 tablet_bootstrap.cc:492] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.755806 11042 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.756325 11334 raft_consensus.cc:359] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.757331 11334 raft_consensus.cc:385] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.758680 11356 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.757895 11039 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.759728 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:23.760365 11144 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.757910 11334 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.765009 11334 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.765319 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:23.765991 11290 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.752333 11428 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.768567 11142 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:23.773223 11334 ts_tablet_manager.cc:1434] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 12:09:23.774025 11334 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.772822 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:23.774803 11335 raft_consensus.cc:359] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.775473 11335 raft_consensus.cc:385] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.775718 11335 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.776347 11335 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.778213 11335 ts_tablet_manager.cc:1434] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 12:09:23.779047 11335 tablet_bootstrap.cc:492] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.781292 11290 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:23.783190 11444 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.784611 11144 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:23.785769 11444 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:23.786321 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:23.787264 11428 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.786837 11444 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.787876 11428 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:23.790062 11422 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.797509 11422 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.790307 11428 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.799608 11422 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.822829 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.824421 11335 tablet_bootstrap.cc:654] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.826086 11333 tablet_bootstrap.cc:654] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.825618 11184 leader_election.cc:343] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.823843 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:23.836340 11185 leader_election.cc:343] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.836789 11185 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:23.837803 11428 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.839313 11039 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.844050 11042 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.846287 11042 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.849184 11334 tablet_bootstrap.cc:654] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.858916 11335 tablet_bootstrap.cc:492] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.859928 11335 ts_tablet_manager.cc:1403] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.003s
I20260709 12:09:23.866097 11335 raft_consensus.cc:359] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.867691 11386 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.869460 11335 raft_consensus.cc:385] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.869863 11335 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.870445 11335 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.872658 11335 ts_tablet_manager.cc:1434] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:23.869472 11333 tablet_bootstrap.cc:492] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.873309 11333 ts_tablet_manager.cc:1403] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.006s
I20260709 12:09:23.874059 11335 tablet_bootstrap.cc:492] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.876827 11334 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.877336 11334 ts_tablet_manager.cc:1403] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.007s
I20260709 12:09:23.877290 11333 raft_consensus.cc:359] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.878135 11333 raft_consensus.cc:385] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.881313 11334 raft_consensus.cc:359] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.878445 11333 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.882241 11334 raft_consensus.cc:385] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.883121 11334 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.896760 11334 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.897782 11335 tablet_bootstrap.cc:654] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.904979 11333 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.905651 11334 ts_tablet_manager.cc:1434] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 12:09:23.907217 11333 ts_tablet_manager.cc:1434] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:09:23.908836 11333 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.908011 11334 tablet_bootstrap.cc:492] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.918545 11333 tablet_bootstrap.cc:654] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.922457 11361 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.928231 11334 tablet_bootstrap.cc:654] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.929183 11361 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.929682 11361 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.930637 11335 tablet_bootstrap.cc:492] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.931169 11335 ts_tablet_manager.cc:1403] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.026s
I20260709 12:09:23.931753 11361 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:23.934746 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.935298 11218 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:23.935178 11335 raft_consensus.cc:359] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.935949 11335 raft_consensus.cc:385] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.936103 11334 tablet_bootstrap.cc:492] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:23.936570 11334 ts_tablet_manager.cc:1403] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 12:09:23.937266 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:23.936241 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:23.938012 11361 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.936262 11335 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.938412 11361 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.938813 11361 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.939033 11110 leader_election.cc:343] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.939144 11335 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.939484 11334 raft_consensus.cc:359] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.940954 11334 raft_consensus.cc:385] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.941229 11335 ts_tablet_manager.cc:1434] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:23.941224 11334 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.942255 11334 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.944516 11334 ts_tablet_manager.cc:1434] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:23.945463 11334 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:23.945644 11333 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:23.946043 11333 ts_tablet_manager.cc:1403] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.004s
I20260709 12:09:23.948055 11335 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.948819 11333 raft_consensus.cc:359] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.949534 11333 raft_consensus.cc:385] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.949808 11333 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.950460 11333 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.951489 11334 tablet_bootstrap.cc:654] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.954012 11444 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.954871 11335 tablet_bootstrap.cc:654] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.954705 11444 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.957597 11444 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:23.960650 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:23.960933 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:23.961562 11218 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
W20260709 12:09:23.963033 11258 leader_election.cc:343] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.967506 11335 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:23.967458 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:23.968266 11335 ts_tablet_manager.cc:1403] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.015s
I20260709 12:09:23.969085 11444 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.969497 11444 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.969846 11444 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.971772 11335 raft_consensus.cc:359] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.972596 11335 raft_consensus.cc:385] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.972872 11335 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.973533 11335 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.975571 11335 ts_tablet_manager.cc:1434] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:09:23.976711 11335 tablet_bootstrap.cc:492] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:23.977252 11333 ts_tablet_manager.cc:1434] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:09:23.983637 11386 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.983978 11333 tablet_bootstrap.cc:492] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:23.982266 11335 tablet_bootstrap.cc:654] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.981894 11444 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:23.997260 11339 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.999862 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:24.000056 11444 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:09:24.001279 11258 leader_election.cc:343] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.004972 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:24.005570 11218 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.006171 11335 tablet_bootstrap.cc:492] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:24.006788 11335 ts_tablet_manager.cc:1403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.002s
I20260709 12:09:24.002916 11361 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.013778 11218 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:24.015228 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:24.016088 11216 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.016796 11335 raft_consensus.cc:359] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.017464 11335 raft_consensus.cc:385] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.017720 11335 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.018311 11335 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.020308 11335 ts_tablet_manager.cc:1434] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:24.021145 11335 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:24.024003 11444 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.025986 11444 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.028992 11444 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.030788 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:24.031579 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:24.035259 11339 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:24.037169 11258 leader_election.cc:343] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.036798 11339 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.037381 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:24.038774 11259 leader_election.cc:343] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.039230 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:24.039680 11339 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.043035 11361 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.043455 11369 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.041473 11444 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.044880 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.045599 11444 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:24.045770 11217 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:24.045867 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:24.046651 11290 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:24.046452 11444 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.047358 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:24.048187 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:24.048833 11290 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.050918 11386 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.053884 11386 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.054189 11216 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:24.054289 11386 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.051399 11361 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.062708 11361 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.064339 11335 tablet_bootstrap.cc:654] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.062258 11386 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.060189 11334 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:24.066908 11334 ts_tablet_manager.cc:1403] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.122s	user 0.031s	sys 0.042s
I20260709 12:09:24.055269 11333 tablet_bootstrap.cc:654] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.068364 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:24.069041 11218 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.070297 11334 raft_consensus.cc:359] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.071189 11334 raft_consensus.cc:385] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.071545 11334 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.072806 11361 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.066190 11386 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.072348 11334 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.080045 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:24.080602 11292 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.080717 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:24.081333 11334 ts_tablet_manager.cc:1434] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:24.082368 11334 tablet_bootstrap.cc:492] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:24.082731 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:09:24.088075 11110 leader_election.cc:343] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.089170 11386 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.089756 11386 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:24.096163 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.097050 11217 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:24.107770 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.108865 11361 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.109221 11361 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.110025 11361 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.109895 11039 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.102756 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:24.097610 11218 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:24.119660 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:24.122375 11339 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.124286 11361 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.134155 11290 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:24.098380 11386 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.137984 11335 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:24.139539 11335 ts_tablet_manager.cc:1403] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.119s	user 0.030s	sys 0.013s
I20260709 12:09:24.146328 11333 tablet_bootstrap.cc:492] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:24.146922 11333 ts_tablet_manager.cc:1403] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.016s
I20260709 12:09:24.148746 11361 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.142822 11339 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:24.150416 11335 raft_consensus.cc:359] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.151587 11335 raft_consensus.cc:385] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.151335 11333 raft_consensus.cc:359] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.149397 11334 tablet_bootstrap.cc:654] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.150183 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:24.151937 11335 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.152356 11218 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.152750 11335 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.151751 11339 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.154945 11333 raft_consensus.cc:385] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.155022 11335 ts_tablet_manager.cc:1434] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:09:24.155326 11333 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.156121 11335 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:24.156175 11333 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.159786 11333 ts_tablet_manager.cc:1434] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:09:24.165001 11333 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:24.163256 11335 tablet_bootstrap.cc:654] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.150403 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:09:24.173187 11110 leader_election.cc:343] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.174772 11218 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:24.177416 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.178905 11335 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:24.179425 11335 ts_tablet_manager.cc:1403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.002s
I20260709 12:09:24.180214 11361 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.181797 11361 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:24.182698 11361 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.183175 11335 raft_consensus.cc:359] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.185913 11335 raft_consensus.cc:385] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.186223 11335 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.187052 11335 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.189553 11335 ts_tablet_manager.cc:1434] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:09:24.191243 11335 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:24.190699 11039 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.193370 11444 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.196230 11428 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.198012 11334 tablet_bootstrap.cc:492] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:24.198526 11334 ts_tablet_manager.cc:1403] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.011s
I20260709 12:09:24.205420 11334 raft_consensus.cc:359] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.206009 11334 raft_consensus.cc:385] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.206226 11334 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.209198 11334 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.209585 11444 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.210454 11335 tablet_bootstrap.cc:654] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.213192 11333 tablet_bootstrap.cc:654] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.214241 11334 ts_tablet_manager.cc:1434] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 12:09:24.214957 11369 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.215334 11334 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:24.215399 11369 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.217835 11369 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.219866 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:24.220714 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.220870 11144 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:24.227085 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.232548 11258 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:24.236277 11444 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.236724 11444 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.237079 11444 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.262728 11142 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.279135 11334 tablet_bootstrap.cc:654] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.282219 11184 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.283305 11422 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.283746 11259 leader_election.cc:343] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.287598 11335 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:24.289127 11039 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.288625 11335 ts_tablet_manager.cc:1403] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.025s
I20260709 12:09:24.291070 11039 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.294432 11429 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.313330 11333 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:24.313828 11333 ts_tablet_manager.cc:1403] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.149s	user 0.033s	sys 0.010s
I20260709 12:09:24.335500 11444 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.338025 11444 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.349946 11339 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.350688 11339 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.356462 11333 raft_consensus.cc:359] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.357290 11333 raft_consensus.cc:385] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.357579 11333 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.357874 11339 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.361909 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.362838 11335 raft_consensus.cc:359] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.363549 11335 raft_consensus.cc:385] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.363994 11335 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.364768 11335 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.377749 11524 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.378262 11524 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:24.379978 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58587.5us
I20260709 12:09:24.381361 11428 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.383139 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 59614.7us
I20260709 12:09:24.386147 11429 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.358345 11333 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.387811 11333 ts_tablet_manager.cc:1434] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 12:09:24.387970 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:24.388643 11333 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:24.391137 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.404958 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:09:24.408344 11259 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:24.409029 11259 leader_election.cc:343] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.411478 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:24.412940 11143 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.451123 11524 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.456557 11339 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:24.456650 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65580.7us
I20260709 12:09:24.457231 11335 ts_tablet_manager.cc:1434] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.000s
I20260709 12:09:24.458196 11335 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:24.460181 11429 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.462949 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:24.465629 11334 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:24.467016 11334 ts_tablet_manager.cc:1403] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.252s	user 0.040s	sys 0.044s
I20260709 12:09:24.469515 11334 raft_consensus.cc:359] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.470170 11334 raft_consensus.cc:385] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.472960 11333 tablet_bootstrap.cc:654] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.474558 11143 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:24.481211 11362 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.484820 11362 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.486855 11362 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:24.473698 11258 consensus_peers.cc:597] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.483273 11335 tablet_bootstrap.cc:654] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.489660 11258 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:24.490515 11429 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.470439 11334 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.490967 11429 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:24.491779 11334 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.494546 11429 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:24.499121 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45554.9us
I20260709 12:09:24.500320 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.506111 11219 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:24.510203 11334 ts_tablet_manager.cc:1434] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 12:09:24.511686 11334 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:24.507149 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:24.517356 11526 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.522205 11523 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.522871 11523 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.529299 11523 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.529845 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:24.532138 11258 leader_election.cc:343] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.534425 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.535646 11339 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.535964 11526 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.536206 11339 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:24.538275 11259 leader_election.cc:343] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.538803 11259 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:24.540424 11369 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.540522 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.540274 11339 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.543138 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:24.545607 11110 leader_election.cc:343] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.548408 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:24.554847 11110 leader_election.cc:343] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.555271 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.572777 11335 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:24.573287 11335 ts_tablet_manager.cc:1403] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.115s	user 0.020s	sys 0.004s
I20260709 12:09:24.575434 11335 raft_consensus.cc:359] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.575942 11335 raft_consensus.cc:385] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.576220 11335 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.564397 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:24.562902 11512 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.580456 11335 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.582511 11335 ts_tablet_manager.cc:1434] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:09:24.585788 11339 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:24.587499 11184 leader_election.cc:343] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.588383 11334 tablet_bootstrap.cc:654] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.591470 11185 leader_election.cc:343] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.589164 11335 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:24.589265 11333 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:24.590212 11523 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.593233 11361 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.593777 11361 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.594794 11333 ts_tablet_manager.cc:1403] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.206s	user 0.013s	sys 0.032s
I20260709 12:09:24.596565 11361 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.598002 11333 raft_consensus.cc:359] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.598845 11333 raft_consensus.cc:385] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.599229 11333 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.600041 11333 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.601191 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:24.601738 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.602941 11529 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.604146 11333 ts_tablet_manager.cc:1434] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:09:24.605293 11333 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:24.607620 11512 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.617417 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.617120 11361 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:24.619629 11533 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.616266 11512 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:24.620164 11533 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.620754 11335 tablet_bootstrap.cc:654] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.621567 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.623374 11512 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.623003 11361 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.623903 11512 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.634408 11333 tablet_bootstrap.cc:654] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.669508 11334 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:24.670010 11334 ts_tablet_manager.cc:1403] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.006s
I20260709 12:09:24.673341 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.676512 11533 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.676649 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:24.677907 11110 leader_election.cc:343] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.677060 11512 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.678165 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:24.678617 11110 leader_election.cc:343] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.678854 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:24.679041 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.679468 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:24.680056 11512 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.680166 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:09:24.680879 11184 leader_election.cc:343] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.682049 11428 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.682442 11428 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.682837 11428 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.682744 11039 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.686571 11334 raft_consensus.cc:359] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.687229 11334 raft_consensus.cc:385] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.687685 11334 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.688489 11334 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.690579 11334 ts_tablet_manager.cc:1434] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:09:24.691473 11334 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
W20260709 12:09:24.695274 11538 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.059s	user 0.001s	sys 0.002s
I20260709 12:09:24.708103 11334 tablet_bootstrap.cc:654] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.727957 11339 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.731051 11523 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.731814 11523 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.737713 11428 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.739547 11523 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.741514 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.742210 11217 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:24.743577 11259 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:24.744367 11333 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:24.744884 11333 ts_tablet_manager.cc:1403] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.004s
I20260709 12:09:24.744766 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:24.747134 11523 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.747532 11523 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.747888 11523 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.751605 11258 leader_election.cc:343] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.755707 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:09:24.757203 11184 leader_election.cc:343] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.756969 11333 raft_consensus.cc:359] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.757769 11333 raft_consensus.cc:385] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.758118 11333 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.758251 11428 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.764266 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:24.764930 11290 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.758441 11386 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:24.795806 11141 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.796742 11333 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.800734 11386 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.835812 11386 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.862591 11333 ts_tablet_manager.cc:1434] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.003s
I20260709 12:09:24.863708 11333 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:24.882818 11533 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.883488 11533 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.887305 11334 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:24.892304 11334 ts_tablet_manager.cc:1403] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.040s
I20260709 12:09:24.900033 11386 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.903301 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:24.904939 11110 leader_election.cc:343] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.906045 11533 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.906275 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:24.906952 11216 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:24.908391 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.909660 11339 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.910070 11339 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.900619 11334 raft_consensus.cc:359] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.910468 11339 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.910749 11334 raft_consensus.cc:385] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.911047 11334 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.911877 11334 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.915248 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:24.916610 11334 ts_tablet_manager.cc:1434] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:09:24.916834 11290 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:24.917654 11334 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
W20260709 12:09:24.918417 11185 leader_election.cc:343] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.924283 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:24.925264 11533 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.925823 11533 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:24.926796 11533 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.933182 11334 tablet_bootstrap.cc:654] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.935113 11335 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:24.935772 11335 ts_tablet_manager.cc:1403] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.347s	user 0.024s	sys 0.032s
I20260709 12:09:24.917589 11339 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.939687 11335 raft_consensus.cc:359] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.940595 11335 raft_consensus.cc:385] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.940923 11335 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.940965 11217 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.941628 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:24.941792 11335 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.942817 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:24.943399 11216 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.944419 11335 ts_tablet_manager.cc:1434] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 12:09:24.945537 11110 leader_election.cc:343] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.952419 11339 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:24.951954 11523 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.950254 11216 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:24.956585 11429 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.957108 11333 tablet_bootstrap.cc:654] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.961614 11523 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:24.960984 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:24.964656 11144 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:24.966763 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:24.967773 11216 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.969460 11184 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.970067 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:24.970678 11428 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.972371 11512 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.973248 11512 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:24.974129 11512 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:24.981935 11216 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:24.984269 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:24.985745 11140 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.970953 11335 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.001622 11334 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:25.001802 11259 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:25.002144 11334 ts_tablet_manager.cc:1403] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.009s
I20260709 12:09:25.026434 11041 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:25.041654 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53419.2us
I20260709 12:09:25.042089 11140 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:25.046191 11526 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:25.046350 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44664.7us
I20260709 12:09:25.047256 11526 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:25.048355 11526 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.050357 11335 tablet_bootstrap.cc:654] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.061863 11333 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:25.062398 11333 ts_tablet_manager.cc:1403] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.199s	user 0.017s	sys 0.018s
I20260709 12:09:25.069020 11334 raft_consensus.cc:359] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.069798 11334 raft_consensus.cc:385] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.070063 11334 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.065941 11333 raft_consensus.cc:359] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.073024 11333 raft_consensus.cc:385] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.072803 11334 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.073571 11333 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.074229 11040 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.080935 11333 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.082383 11334 ts_tablet_manager.cc:1434] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 12:09:25.083386 11334 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:25.092687 11335 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:25.093355 11335 ts_tablet_manager.cc:1403] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.123s	user 0.006s	sys 0.010s
I20260709 12:09:25.097288 11333 ts_tablet_manager.cc:1434] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:09:25.098436 11333 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
W20260709 12:09:25.098832 11259 consensus_peers.cc:597] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.099654 11335 raft_consensus.cc:359] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.100378 11335 raft_consensus.cc:385] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.100666 11335 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.101369 11335 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.103605 11335 ts_tablet_manager.cc:1434] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:25.104497 11335 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.104871 11334 tablet_bootstrap.cc:654] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.108596 11039 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.111562 11335 tablet_bootstrap.cc:654] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.117165 11334 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:25.117470 11333 tablet_bootstrap.cc:654] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.117810 11334 ts_tablet_manager.cc:1403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.007s
I20260709 12:09:25.129192 11333 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:25.129760 11333 ts_tablet_manager.cc:1403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.000s
I20260709 12:09:25.133975 11333 raft_consensus.cc:359] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.131201 11334 raft_consensus.cc:359] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.134995 11333 raft_consensus.cc:385] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.136158 11335 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:25.136488 11333 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.136797 11335 ts_tablet_manager.cc:1403] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 12:09:25.137374 11333 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.136471 11334 raft_consensus.cc:385] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.138844 11334 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.139887 11334 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.140106 11335 raft_consensus.cc:359] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.140714 11335 raft_consensus.cc:385] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.140973 11335 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.141654 11335 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.142095 11334 ts_tablet_manager.cc:1434] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:09:25.143576 11335 ts_tablet_manager.cc:1434] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:25.144312 11335 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.146427 11333 ts_tablet_manager.cc:1434] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:09:25.147430 11333 tablet_bootstrap.cc:492] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:25.150210 11335 tablet_bootstrap.cc:654] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.154300 11333 tablet_bootstrap.cc:654] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.160528 11334 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:25.166086 11512 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.166823 11512 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.171245 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.180243 11333 tablet_bootstrap.cc:492] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:25.180761 11333 ts_tablet_manager.cc:1403] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.015s
I20260709 12:09:25.182303 11335 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:25.182750 11335 ts_tablet_manager.cc:1403] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.021s
I20260709 12:09:25.180809 11334 tablet_bootstrap.cc:654] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.183609 11512 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:25.183521 11333 raft_consensus.cc:359] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.184258 11333 raft_consensus.cc:385] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.184564 11333 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.184682 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:25.186252 11110 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:25.187708 11512 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.185657 11333 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.188694 11335 raft_consensus.cc:359] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.189459 11335 raft_consensus.cc:385] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.189726 11335 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.190311 11333 ts_tablet_manager.cc:1434] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:09:25.190371 11335 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.191911 11333 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:25.192039 11334 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:25.192485 11334 ts_tablet_manager.cc:1403] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
I20260709 12:09:25.192691 11335 ts_tablet_manager.cc:1434] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:25.195256 11334 raft_consensus.cc:359] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.196359 11334 raft_consensus.cc:385] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.196825 11334 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.199194 11333 tablet_bootstrap.cc:654] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.198024 11334 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.207984 11334 ts_tablet_manager.cc:1434] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:25.208319 11335 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.209004 11334 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:25.216782 11334 tablet_bootstrap.cc:654] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.217345 11333 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:25.217854 11333 ts_tablet_manager.cc:1403] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.010s
I20260709 12:09:25.218025 11335 tablet_bootstrap.cc:654] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.221253 11333 raft_consensus.cc:359] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.221961 11333 raft_consensus.cc:385] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.222214 11333 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.222859 11333 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.224901 11333 ts_tablet_manager.cc:1434] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:09:25.225643 11333 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:25.229789 11335 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:25.230304 11335 ts_tablet_manager.cc:1403] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 12:09:25.232579 11534 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.233222 11333 tablet_bootstrap.cc:654] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.233057 11534 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.233566 11335 raft_consensus.cc:359] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.234229 11335 raft_consensus.cc:385] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.234522 11335 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.235320 11534 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:25.235188 11335 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.237363 11335 ts_tablet_manager.cc:1434] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:09:25.238955 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:25.243271 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:25.245128 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:25.248631 11534 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.257634 11335 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.265923 11335 tablet_bootstrap.cc:654] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.267980 11526 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.269251 11526 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.273403 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:25.274256 11144 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:25.276216 11258 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:25.277105 11429 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.277776 11429 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.278270 11335 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:25.278213 11429 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.278895 11335 ts_tablet_manager.cc:1403] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:09:25.281771 11335 raft_consensus.cc:359] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.282706 11335 raft_consensus.cc:385] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.283000 11335 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.283658 11335 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.285750 11335 ts_tablet_manager.cc:1434] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:25.288524 11429 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.289757 11526 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:25.291030 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.292104 11219 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:25.293063 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:25.293685 11144 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.294423 11429 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:25.306839 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:25.307596 11219 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.308486 11335 tablet_bootstrap.cc:492] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.315876 11335 tablet_bootstrap.cc:654] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.349328 11361 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.350176 11339 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.350091 11361 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.350852 11339 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.353282 11339 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:25.354183 11361 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:25.354453 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:25.356078 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.355993 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.359184 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:25.361132 11110 leader_election.cc:343] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.362015 11110 leader_election.cc:343] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.362843 11110 leader_election.cc:343] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.363327 11110 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:25.364161 11361 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.370347 11110 leader_election.cc:343] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.370901 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:25.371733 11361 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.383682 11428 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.384418 11428 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.390941 11526 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.391805 11526 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.393460 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:25.395787 11184 leader_election.cc:343] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.399096 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:25.395258 11428 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:25.403712 11185 leader_election.cc:343] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.404150 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:25.406141 11526 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:25.408771 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:25.409740 11140 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:25.411489 11362 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.412238 11258 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:25.414952 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.415587 11217 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:25.416831 11526 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.417198 11526 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.417636 11526 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.430899 11428 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.431578 11428 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.433553 11523 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.434201 11523 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.435635 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:25.436511 11140 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:25.436841 11523 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:25.437773 11526 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.438544 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:25.439802 11526 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:25.439925 11362 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.440486 11362 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.440486 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:25.441115 11362 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.441494 11141 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.447719 11219 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:25.439086 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:25.449448 11428 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:25.449954 11258 leader_election.cc:343] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.452138 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:25.454820 11526 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.464478 11526 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:09:25.464641 11184 consensus_peers.cc:597] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.430548 11144 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:25.469980 11141 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:25.476464 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:25.478089 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:25.479022 11216 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.480593 11526 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:25.479001 11185 leader_election.cc:343] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.491397 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.494123 11258 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:25.495412 11523 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.491462 11362 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.498127 11534 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.498849 11429 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.497522 11523 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:25.502259 11429 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.502924 11523 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.505360 11429 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:25.506742 11333 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:25.507690 11333 ts_tablet_manager.cc:1403] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.282s	user 0.054s	sys 0.094s
I20260709 12:09:25.508859 11334 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:25.509387 11334 ts_tablet_manager.cc:1403] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.301s	user 0.065s	sys 0.123s
W20260709 12:09:25.511137 11259 leader_election.cc:343] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.511791 11362 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:25.509261 11290 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.512367 11333 raft_consensus.cc:359] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.513038 11333 raft_consensus.cc:385] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.513305 11333 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.511709 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:25.513921 11333 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.518762 11333 ts_tablet_manager.cc:1434] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:09:25.519631 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:25.522419 11333 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:25.520247 11144 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.526258 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:25.527057 11335 tablet_bootstrap.cc:492] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:25.527519 11335 ts_tablet_manager.cc:1403] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.219s	user 0.065s	sys 0.074s
I20260709 12:09:25.534561 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:25.535415 11217 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:25.537038 11333 tablet_bootstrap.cc:654] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.524029 11526 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.543121 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:25.543802 11429 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.544842 11335 raft_consensus.cc:359] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.545528 11335 raft_consensus.cc:385] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.545780 11335 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.546409 11335 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.554068 11335 ts_tablet_manager.cc:1434] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:09:25.555032 11335 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:25.551587 11216 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:25.558923 11334 raft_consensus.cc:359] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.560086 11334 raft_consensus.cc:385] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.560446 11334 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.561239 11334 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.567695 11219 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.571921 11292 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.662918 11334 ts_tablet_manager.cc:1434] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.153s	user 0.002s	sys 0.009s
I20260709 12:09:25.664299 11334 tablet_bootstrap.cc:492] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
W20260709 12:09:25.672344 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 129652us
W20260709 12:09:25.682695 11572 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:09:25.695484 11141 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.688901 11144 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:25.724587 11334 tablet_bootstrap.cc:654] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.737344 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.738952 11292 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:25.741629 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:25.743821 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:25.749398 11534 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.751343 11042 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.755084 11429 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.757673 11335 tablet_bootstrap.cc:654] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.764307 11333 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:25.774360 11333 ts_tablet_manager.cc:1403] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.252s	user 0.017s	sys 0.016s
I20260709 12:09:25.765699 11534 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:09:25.771790 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68550.9us
I20260709 12:09:25.786855 11577 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.787757 11573 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.787787 11333 raft_consensus.cc:359] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.795835 11333 raft_consensus.cc:385] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.796216 11333 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.797055 11333 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.798275 11334 tablet_bootstrap.cc:492] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:25.798817 11334 ts_tablet_manager.cc:1403] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.135s	user 0.019s	sys 0.008s
I20260709 12:09:25.799672 11333 ts_tablet_manager.cc:1434] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:09:25.800609 11333 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:25.788607 11339 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.809007 11534 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.850139 11334 raft_consensus.cc:359] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.855185 11334 raft_consensus.cc:385] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.855600 11334 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.856477 11334 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:25.879788 11579 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.930356 11579 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:25.934922 11550 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.123s	user 0.027s	sys 0.020s
I20260709 12:09:25.946694 11334 ts_tablet_manager.cc:1434] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.148s	user 0.018s	sys 0.022s
I20260709 12:09:25.947892 11334 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:25.977523 11333 tablet_bootstrap.cc:654] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.994055 11589 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.998744 11589 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.072779 11334 tablet_bootstrap.cc:654] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.081012 11335 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.094297 11335 ts_tablet_manager.cc:1403] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.539s	user 0.043s	sys 0.026s
I20260709 12:09:26.098287 11335 raft_consensus.cc:359] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.106559 11335 raft_consensus.cc:385] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.107266 11335 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.108453 11335 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.156209 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.171006 11144 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.175901 11334 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:26.182250 11141 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:26.183398 11334 ts_tablet_manager.cc:1403] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.005s
I20260709 12:09:26.196918 11184 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:26.198987 11590 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.199568 11590 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.200059 11590 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.212050 11589 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.225502 11333 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.228818 11333 ts_tablet_manager.cc:1403] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.428s	user 0.020s	sys 0.007s
I20260709 12:09:26.236760 11334 raft_consensus.cc:359] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.239135 11579 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.243595 11590 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.248214 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:26.249297 11290 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:26.249675 11333 raft_consensus.cc:359] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.250891 11333 raft_consensus.cc:385] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.251272 11333 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.256521 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:26.257823 11141 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.262154 11588 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.239392 11334 raft_consensus.cc:385] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.264810 11334 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.262836 11588 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.276160 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.278909 11590 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.279788 11335 ts_tablet_manager.cc:1434] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.185s	user 0.030s	sys 0.007s
W20260709 12:09:26.280975 11184 leader_election.cc:343] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.285279 11588 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.252156 11333 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.297433 11429 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.300088 11429 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.297578 11334 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.294127 11141 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:26.314042 11335 tablet_bootstrap.cc:492] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.314569 11334 ts_tablet_manager.cc:1434] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.006s
I20260709 12:09:26.328007 11333 ts_tablet_manager.cc:1434] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 12:09:26.329895 11333 tablet_bootstrap.cc:492] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:26.331298 11042 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.336920 11334 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:26.337952 11184 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:26.353070 11579 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.353619 11579 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:26.354888 11579 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.343742 11429 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:26.348409 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:26.363256 11333 tablet_bootstrap.cc:654] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.366669 11334 tablet_bootstrap.cc:654] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.371330 11588 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.372032 11588 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.375211 11588 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.377583 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.378676 11140 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:26.380225 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:26.381376 11588 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.381976 11588 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.382442 11588 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.381428 11334 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:26.386014 11334 ts_tablet_manager.cc:1403] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 12:09:26.387773 11526 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.388496 11526 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.389611 11334 raft_consensus.cc:359] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.390511 11334 raft_consensus.cc:385] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.390957 11526 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:26.392957 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.401464 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.401999 11335 tablet_bootstrap.cc:654] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.404299 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.403630 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:26.405992 11334 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.411649 11579 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.418545 11334 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.424962 11334 ts_tablet_manager.cc:1434] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:09:26.425757 11429 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.426354 11334 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:26.427968 11429 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.429587 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:26.430294 11292 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
W20260709 12:09:26.430954 11258 leader_election.cc:343] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:26.431711 11258 leader_election.cc:343] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.433683 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:26.434607 11293 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.436237 11526 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.438982 11526 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.444437 11293 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:26.444386 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:26.453037 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:26.453797 11216 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:26.458191 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:26.459095 11217 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:26.473223 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:26.473908 11333 tablet_bootstrap.cc:492] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.474388 11333 ts_tablet_manager.cc:1403] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.145s	user 0.034s	sys 0.018s
I20260709 12:09:26.475466 11429 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.475864 11429 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.476203 11429 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.477330 11333 raft_consensus.cc:359] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.478097 11333 raft_consensus.cc:385] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.478387 11333 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.479329 11333 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.481856 11333 ts_tablet_manager.cc:1434] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:26.482120 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:26.483227 11333 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:26.484313 11607 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.492944 11335 tablet_bootstrap.cc:492] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.493491 11335 ts_tablet_manager.cc:1403] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.006s
I20260709 12:09:26.494863 11588 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.497265 11588 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.497905 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:26.498517 11140 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.499895 11259 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:26.501046 11526 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.501434 11526 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.501847 11526 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.504516 11335 raft_consensus.cc:359] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.505514 11335 raft_consensus.cc:385] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.505872 11335 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.506735 11335 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.506140 11041 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.509246 11526 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.511214 11333 tablet_bootstrap.cc:654] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.484839 11429 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.523306 11185 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:09:26.525841 11185 leader_election.cc:343] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.510325 11140 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:26.525902 11600 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.538954 11600 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.539371 11600 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.540094 11335 ts_tablet_manager.cc:1434] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:09:26.541267 11335 tablet_bootstrap.cc:492] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.542845 11573 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.543447 11579 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.543329 11573 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.545589 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:26.545600 11573 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:26.537364 11526 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:26.537771 11429 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:26.511766 11334 tablet_bootstrap.cc:654] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.556159 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:26.556246 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:26.557420 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:26.558800 11588 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.559867 11588 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:26.561015 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:26.562690 11216 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.560942 11588 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:26.570294 11185 leader_election.cc:343] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:26.571506 11259 leader_election.cc:343] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.569674 11600 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.572980 11215 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:26.578881 11334 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:26.578598 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:26.580956 11140 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.581265 11334 ts_tablet_manager.cc:1403] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.001s
I20260709 12:09:26.585223 11600 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.586326 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:26.591086 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:09:26.592509 11184 leader_election.cc:343] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.592428 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.592989 11216 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:26.595860 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:26.598097 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:09:26.598296 11258 leader_election.cc:343] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.598773 11258 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:26.598966 11291 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:26.598999 11526 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.599653 11526 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:09:26.599923 11258 leader_election.cc:343] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.600405 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:26.600546 11526 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.603569 11335 tablet_bootstrap.cc:654] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.603971 11333 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.604715 11333 ts_tablet_manager.cc:1403] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.006s
I20260709 12:09:26.605707 11574 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.607790 11429 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.610350 11334 raft_consensus.cc:359] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.612524 11334 raft_consensus.cc:385] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.612778 11334 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.613379 11334 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.611899 11429 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.614655 11429 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.616717 11429 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:26.620301 11185 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:26.621250 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:26.624039 11334 ts_tablet_manager.cc:1434] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 12:09:26.624246 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:26.629714 11259 leader_election.cc:343] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.632068 11334 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
W20260709 12:09:26.638692 11258 leader_election.cc:343] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.639299 11258 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:26.640152 11429 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.642145 11140 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:26.630191 11588 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.651783 11333 raft_consensus.cc:359] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.652571 11333 raft_consensus.cc:385] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.652863 11333 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.660315 11041 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.664390 11333 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.667577 11333 ts_tablet_manager.cc:1434] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 12:09:26.668992 11333 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:26.673635 11334 tablet_bootstrap.cc:654] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.674939 11335 tablet_bootstrap.cc:492] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.675441 11335 ts_tablet_manager.cc:1403] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.134s	user 0.022s	sys 0.008s
I20260709 12:09:26.676445 11039 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.680514 11335 raft_consensus.cc:359] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.681290 11335 raft_consensus.cc:385] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.681560 11335 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.683422 11333 tablet_bootstrap.cc:654] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.683092 11335 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.686530 11335 ts_tablet_manager.cc:1434] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:09:26.689703 11334 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:26.690027 11335 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.690340 11334 ts_tablet_manager.cc:1403] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.010s
I20260709 12:09:26.693162 11334 raft_consensus.cc:359] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.693799 11334 raft_consensus.cc:385] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.694074 11334 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.694900 11334 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.696166 11335 tablet_bootstrap.cc:654] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.697469 11334 ts_tablet_manager.cc:1434] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:09:26.699771 11334 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:26.706218 11333 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.706887 11333 ts_tablet_manager.cc:1403] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.002s
I20260709 12:09:26.710474 11333 raft_consensus.cc:359] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.711249 11333 raft_consensus.cc:385] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.713965 11335 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.714550 11335 ts_tablet_manager.cc:1403] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 12:09:26.716218 11334 tablet_bootstrap.cc:654] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.717571 11335 raft_consensus.cc:359] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.718338 11335 raft_consensus.cc:385] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.711551 11333 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.718644 11335 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.719277 11333 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.719548 11335 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.721760 11335 ts_tablet_manager.cc:1434] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:26.723527 11335 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.724087 11333 ts_tablet_manager.cc:1434] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:09:26.725342 11333 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:26.730046 11335 tablet_bootstrap.cc:654] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.732358 11333 tablet_bootstrap.cc:654] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.742465 11335 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.743021 11335 ts_tablet_manager.cc:1403] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:09:26.746541 11333 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.747056 11333 ts_tablet_manager.cc:1403] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:09:26.747201 11335 raft_consensus.cc:359] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.747961 11335 raft_consensus.cc:385] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.748248 11335 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.749040 11335 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.749759 11333 raft_consensus.cc:359] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.750558 11333 raft_consensus.cc:385] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.750862 11333 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.751710 11333 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.756042 11333 ts_tablet_manager.cc:1434] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:26.756698 11335 ts_tablet_manager.cc:1434] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:26.757108 11333 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:26.757936 11335 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.759600 11334 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:26.760102 11334 ts_tablet_manager.cc:1403] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 12:09:26.765213 11335 tablet_bootstrap.cc:654] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.767544 11333 tablet_bootstrap.cc:654] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.769248 11334 raft_consensus.cc:359] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.770025 11334 raft_consensus.cc:385] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.770329 11334 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.780548 11334 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.789103 11334 ts_tablet_manager.cc:1434] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:09:26.789934 11588 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.790531 11588 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.792754 11588 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.794703 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.794728 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:26.796344 11185 leader_election.cc:343] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:26.798316 11184 leader_election.cc:343] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.800978 11334 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:26.801544 11184 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:26.818208 11334 tablet_bootstrap.cc:654] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.819785 11588 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.823695 11335 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.824213 11335 ts_tablet_manager.cc:1403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.035s
I20260709 12:09:26.825937 11588 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.827055 11335 raft_consensus.cc:359] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.827932 11335 raft_consensus.cc:385] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.828244 11335 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.829058 11335 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.831295 11335 ts_tablet_manager.cc:1434] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:26.832441 11335 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.839277 11333 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.839990 11333 ts_tablet_manager.cc:1403] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.013s
I20260709 12:09:26.840497 11335 tablet_bootstrap.cc:654] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.844398 11333 raft_consensus.cc:359] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.845109 11333 raft_consensus.cc:385] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.845356 11333 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.846190 11333 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.857756 11333 ts_tablet_manager.cc:1434] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:09:26.859536 11335 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:26.860055 11335 ts_tablet_manager.cc:1403] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 12:09:26.862993 11335 raft_consensus.cc:359] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.863701 11335 raft_consensus.cc:385] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.863977 11335 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.864677 11335 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.865955 11333 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:26.866896 11335 ts_tablet_manager.cc:1434] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:26.868057 11335 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:26.874675 11335 tablet_bootstrap.cc:654] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:26.876787 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:26.879510 11333 tablet_bootstrap.cc:654] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.882030 11600 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.893483 11588 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.894201 11588 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.898304 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:26.899011 11143 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:26.898473 11588 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.900151 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:26.901883 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:26.903002 11292 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:26.909575 11600 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.910027 11600 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.910404 11600 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.920691 11600 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.928942 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:26.929247 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:26.930156 11141 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.930444 11600 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.929555 11292 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.956585 11292 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:26.960435 11577 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.961056 11577 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.961925 11141 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:26.979004 11334 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:26.979782 11334 ts_tablet_manager.cc:1403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.179s	user 0.048s	sys 0.051s
I20260709 12:09:26.983456 11607 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.984112 11607 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.986374 11333 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:26.985445 11185 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:26.986032 11334 raft_consensus.cc:359] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.986441 11607 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.987910 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:26.988566 11590 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.988706 11293 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:26.989089 11590 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:26.987089 11333 ts_tablet_manager.cc:1403] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.122s	user 0.029s	sys 0.045s
I20260709 12:09:26.989965 11590 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:26.990590 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:26.991750 11607 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.992202 11607 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.988350 11334 raft_consensus.cc:385] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.993393 11607 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.995683 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:26.999344 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:27.001418 11577 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:26.999857 11335 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:27.002121 11594 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.006762 11335 ts_tablet_manager.cc:1403] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.139s	user 0.029s	sys 0.037s
I20260709 12:09:26.993940 11334 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.008661 11577 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.009473 11577 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.009876 11333 raft_consensus.cc:359] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.012223 11333 raft_consensus.cc:385] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.012499 11333 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.013124 11333 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.006843 11594 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.013526 11577 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.014562 11334 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.006356 11607 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.016018 11594 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.017467 11607 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.017933 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.018635 11140 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:27.019713 11333 ts_tablet_manager.cc:1434] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:09:27.019765 11334 ts_tablet_manager.cc:1434] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:09:27.021256 11334 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:27.020967 11335 raft_consensus.cc:359] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.021890 11335 raft_consensus.cc:385] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.022243 11335 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.023072 11335 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.025445 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:27.026196 11335 ts_tablet_manager.cc:1434] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:27.027658 11335 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:27.027827 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.029561 11429 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:27.030673 11185 leader_election.cc:343] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.035732 11335 tablet_bootstrap.cc:654] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.036311 11588 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.036726 11588 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.037164 11588 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.036816 11334 tablet_bootstrap.cc:654] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.020942 11333 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
W20260709 12:09:27.050309 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58866.5us
I20260709 12:09:27.051414 11333 tablet_bootstrap.cc:654] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.057928 11335 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:27.058741 11335 ts_tablet_manager.cc:1403] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 12:09:27.058004 11038 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.061622 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.062362 11292 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:27.061671 11335 raft_consensus.cc:359] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.063483 11335 raft_consensus.cc:385] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.057928 11334 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:27.063851 11335 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.064405 11334 ts_tablet_manager.cc:1403] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.018s
I20260709 12:09:27.064841 11335 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.067165 11334 raft_consensus.cc:359] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.067848 11334 raft_consensus.cc:385] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.068140 11334 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.069409 11335 ts_tablet_manager.cc:1434] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:27.070860 11334 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.071215 11291 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.073298 11334 ts_tablet_manager.cc:1434] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:09:27.079849 11334 tablet_bootstrap.cc:492] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:27.080575 11333 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:27.081111 11333 ts_tablet_manager.cc:1403] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.002s
I20260709 12:09:27.084023 11333 raft_consensus.cc:359] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.085386 11590 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.087387 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:27.086840 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:27.088009 11215 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.089366 11334 tablet_bootstrap.cc:654] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.089895 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:27.090559 11292 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.094430 11593 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.095110 11593 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.097874 11215 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:27.103456 11593 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:27.107052 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.084651 11333 raft_consensus.cc:385] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.108985 11333 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.109800 11333 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.112323 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:27.112936 11335 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
W20260709 12:09:27.113729 11259 leader_election.cc:343] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.119247 11333 ts_tablet_manager.cc:1434] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:09:27.121982 11333 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:27.124137 11335 tablet_bootstrap.cc:654] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.124081 11526 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.125046 11526 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.127414 11526 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:27.127264 11594 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.130172 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.130348 11292 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:27.130928 11143 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:27.133119 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:27.133657 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.133873 11218 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:27.134310 11138 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
W20260709 12:09:27.135259 11110 leader_election.cc:343] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.135906 11110 leader_election.cc:343] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.137024 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:27.137770 11647 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.138309 11647 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:27.139180 11647 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.139927 11588 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.141461 11216 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:27.147302 11259 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:27.148283 11429 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.148699 11429 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.149015 11429 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.154950 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:27.155674 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:27.156271 11138 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.156523 11185 leader_election.cc:343] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.163609 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:27.169935 11526 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.142236 11588 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.184911 11429 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.205050 11429 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:27.186975 11594 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.203408 11588 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.208902 11512 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.209367 11512 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.208981 11588 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.209688 11512 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.211200 11588 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.212491 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:27.214190 11185 leader_election.cc:343] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.221213 11333 tablet_bootstrap.cc:654] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.195704 11607 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.224144 11607 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.227522 11594 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.221267 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:27.232024 11216 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.234227 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.235137 11607 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:27.236258 11185 leader_election.cc:343] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.236820 11607 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.237380 11607 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.240589 11607 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.230258 11594 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.244309 11138 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
W20260709 12:09:27.264568 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95905.3us
I20260709 12:09:27.264735 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.298511 11258 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:27.302630 11429 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.303112 11429 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.303495 11429 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.361811 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 176144us
I20260709 12:09:27.385965 11335 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:27.355548 11216 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:27.390967 11335 ts_tablet_manager.cc:1403] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.278s	user 0.039s	sys 0.027s
I20260709 12:09:27.392215 11259 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:09:27.393191 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 86345.2us
I20260709 12:09:27.395924 11657 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.399222 11429 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.401194 11429 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:27.401703 11657 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:27.401911 11333 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:27.402422 11333 ts_tablet_manager.cc:1403] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.281s	user 0.023s	sys 0.019s
I20260709 12:09:27.402922 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:27.402701 11657 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:27.404991 11259 leader_election.cc:343] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.407778 11333 raft_consensus.cc:359] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.408449 11333 raft_consensus.cc:385] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.408708 11333 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.411443 11335 raft_consensus.cc:359] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.412186 11335 raft_consensus.cc:385] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.412472 11335 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.412598 11334 tablet_bootstrap.cc:492] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:27.413367 11334 ts_tablet_manager.cc:1403] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.339s	user 0.051s	sys 0.046s
I20260709 12:09:27.413158 11335 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.418460 11647 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.419052 11647 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.419764 11334 raft_consensus.cc:359] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.420939 11334 raft_consensus.cc:385] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.421279 11334 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.422439 11334 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.415935 11333 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.427832 11335 ts_tablet_manager.cc:1434] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 12:09:27.428416 11333 ts_tablet_manager.cc:1434] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:27.421232 11647 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.429450 11335 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:27.429450 11333 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:27.431335 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.407213 11512 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.435148 11594 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.435688 11594 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:09:27.432814 11184 leader_election.cc:343] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.437441 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.441314 11334 ts_tablet_manager.cc:1434] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 12:09:27.436653 11512 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.442991 11588 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.443605 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.436714 11594 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.464818 11142 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:27.466463 11335 tablet_bootstrap.cc:654] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.468103 11334 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
W20260709 12:09:27.495374 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55083.1us
W20260709 12:09:27.524101 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 150819us
I20260709 12:09:27.534258 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:27.535153 11110 leader_election.cc:343] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.535213 11288 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:27.535732 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.537432 11647 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.545965 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:27.537616 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.546657 11289 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.547492 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.557300 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:27.565097 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:27.567798 11585 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.568192 11219 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:27.575567 11039 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:27.576246 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:27.588685 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46465.3us
W20260709 12:09:27.594702 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47569.7us
I20260709 12:09:27.586016 11215 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
W20260709 12:09:27.598562 11110 leader_election.cc:343] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.599368 11110 leader_election.cc:343] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.611461 11184 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.613703 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.611443 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:27.615981 11585 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.620682 11664 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.624255 11334 tablet_bootstrap.cc:654] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.631161 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:27.631723 11218 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:27.622972 11585 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.634994 11585 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.620177 11138 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.643419 11333 tablet_bootstrap.cc:654] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:27.643689 11110 leader_election.cc:343] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.645368 11110 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.647889 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:27.648129 11607 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.654923 11607 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.654306 11040 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.655325 11607 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.664121 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:27.664793 11140 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.658420 11579 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.667694 11579 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.650911 11577 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.679126 11577 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.679666 11577 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.674355 11289 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:27.677809 11140 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:27.695132 11038 catalog_manager.cc:5697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.699790 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:27.701663 11660 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.698036 11138 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:27.702185 11660 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:27.705543 11258 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:27.714596 11607 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.718109 11335 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:27.718660 11335 ts_tablet_manager.cc:1403] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.289s	user 0.020s	sys 0.005s
I20260709 12:09:27.723146 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.723879 11289 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:27.717391 11661 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.715063 11585 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.723378 11660 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.721732 11579 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.732424 11662 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:27.729372 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.752365 11333 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:27.753407 11333 ts_tablet_manager.cc:1403] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.324s	user 0.021s	sys 0.008s
I20260709 12:09:27.738405 11669 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 12:09:27.765993 11335 raft_consensus.cc:359] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.772400 11335 raft_consensus.cc:385] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.772720 11335 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.773415 11335 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.774155 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:27.787382 11335 ts_tablet_manager.cc:1434] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:09:27.771858 11664 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.794950 11333 raft_consensus.cc:359] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.796197 11335 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:27.777552 11647 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:09:27.797382 11333 raft_consensus.cc:385] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.801992 11334 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:27.868041 11334 ts_tablet_manager.cc:1403] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.400s	user 0.026s	sys 0.013s
I20260709 12:09:27.867370 11333 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.853789 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:27.869354 11333 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.782948 11669 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.826503 11585 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.789376 11661 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:27.877918 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:27.878865 11212 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:27.796096 11139 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:27.872296 11664 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.886554 11333 ts_tablet_manager.cc:1434] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.133s	user 0.020s	sys 0.017s
I20260709 12:09:27.872357 11607 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.874181 11669 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.887826 11664 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.891680 11669 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.897277 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:27.900774 11136 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:27.902418 11333 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:27.903748 11664 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.899097 11577 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.908427 11577 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:27.909020 11661 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.909889 11334 raft_consensus.cc:359] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.914750 11334 raft_consensus.cc:385] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.915059 11334 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.934207 11334 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.936455 11678 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.937040 11678 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:27.945281 11335 tablet_bootstrap.cc:654] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.945322 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:27.947407 11138 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:27.955528 11334 ts_tablet_manager.cc:1434] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:09:27.944576 11678 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:27.958845 11333 tablet_bootstrap.cc:654] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.959924 11334 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:27.971817 11286 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.989367 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:27.989602 11657 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.990937 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:27.993548 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:27.998054 11579 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.998615 11579 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.000757 11579 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:28.008860 11110 leader_election.cc:343] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.011008 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:28.011202 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:28.011266 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.011696 11219 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.011721 11141 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:28.012049 11213 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
W20260709 12:09:28.017077 11110 leader_election.cc:343] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.015712 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:28.018807 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.024230 11110 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.022228 11579 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.028213 11579 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.028658 11579 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.030413 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:28.031608 11286 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:28.034677 11429 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.061100 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:28.032104 11669 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.033350 11647 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:09:28.063650 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:28.064303 11429 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.071604 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.075601 11664 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.079567 11664 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.079937 11664 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.080768 11335 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:28.081300 11335 ts_tablet_manager.cc:1403] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.285s	user 0.018s	sys 0.025s
I20260709 12:09:28.068713 11588 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.087610 11588 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:28.090435 11588 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.073937 11526 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:28.093729 11669 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.101238 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:28.101910 11135 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.104485 11219 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:28.113276 11335 raft_consensus.cc:359] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.114193 11335 raft_consensus.cc:385] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.119558 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.127279 11664 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.119781 11335 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.129606 11335 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.132529 11666 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.142789 11666 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:28.138346 11335 ts_tablet_manager.cc:1434] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:09:28.143445 11040 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.137012 11579 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.157501 11135 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:28.161149 11664 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.162767 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:28.168643 11335 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:28.170460 11334 tablet_bootstrap.cc:654] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.172034 11333 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:28.172573 11333 ts_tablet_manager.cc:1403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.276s	user 0.011s	sys 0.011s
I20260709 12:09:28.181206 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:09:28.190627 11110 leader_election.cc:343] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.192087 11333 raft_consensus.cc:359] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.193223 11333 raft_consensus.cc:385] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.193634 11333 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.165921 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:28.195559 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:28.195611 11210 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:28.198282 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.200851 11647 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.209461 11585 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.209982 11585 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:28.234790 11690 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:09:28.145385 11666 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.229509 11696 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.175077 11669 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260709 12:09:28.247594 11333 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.251755 11670 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.252323 11670 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.267113 11333 ts_tablet_manager.cc:1434] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.094s	user 0.025s	sys 0.006s
I20260709 12:09:28.268460 11333 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:28.270443 11038 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.274025 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:28.274869 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:28.275238 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:28.275544 11292 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.275928 11290 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:28.255627 11696 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:28.284282 11333 tablet_bootstrap.cc:654] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.284682 11594 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.289928 11696 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.294869 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:28.295002 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:28.295578 11141 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:28.295897 11138 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:28.296097 11292 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:28.277727 11585 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.304016 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:28.306947 11334 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:28.307535 11334 ts_tablet_manager.cc:1403] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.350s	user 0.013s	sys 0.003s
W20260709 12:09:28.308899 11110 leader_election.cc:343] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.313994 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:28.301776 11670 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.326553 11585 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:28.326951 11585 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.328542 11585 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:28.332800 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50070.8us
I20260709 12:09:28.330165 11334 raft_consensus.cc:359] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:28.333714 11185 leader_election.cc:343] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.333961 11334 raft_consensus.cc:385] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.334311 11334 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.345541 11334 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:28.345500 11185 leader_election.cc:343] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.346999 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.347941 11700 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.352358 11334 ts_tablet_manager.cc:1434] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:09:28.354961 11333 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:28.355786 11333 ts_tablet_manager.cc:1403] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.088s	user 0.024s	sys 0.010s
I20260709 12:09:28.362373 11333 raft_consensus.cc:359] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.363044 11333 raft_consensus.cc:385] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.363348 11333 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.363965 11333 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.369580 11335 tablet_bootstrap.cc:654] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.377470 11333 ts_tablet_manager.cc:1434] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:28.382208 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.382956 11219 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:28.384632 11214 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.387418 11219 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.387282 11647 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.385243 11040 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.393194 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.393661 11334 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:28.393884 11333 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:28.376435 11579 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.398563 11607 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.402618 11607 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.406195 11607 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.406322 11585 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.412955 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:28.413632 11135 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:28.436836 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:28.443356 11285 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:28.447813 11607 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.451896 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:28.453933 11213 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.457055 11042 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.463085 11607 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.464123 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:09:28.466313 11110 leader_election.cc:343] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.477934 11042 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.474998 11585 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.493674 11600 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.494254 11600 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.495563 11647 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.502593 11135 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:28.502830 11285 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:28.503871 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:28.506832 11579 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:28.507368 11579 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:28.508227 11579 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.510576 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:28.510991 11600 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.516965 11213 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:28.518818 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:28.521997 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.527415 11185 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.530956 11692 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:28.531462 11670 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.533483 11670 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:28.534400 11670 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.542062 11594 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.548233 11594 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.554253 11333 tablet_bootstrap.cc:654] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.556761 11334 tablet_bootstrap.cc:654] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.561511 11526 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:28.571425 11705 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:09:28.573851 11594 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.576021 11335 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:28.576709 11335 ts_tablet_manager.cc:1403] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.410s	user 0.016s	sys 0.028s
I20260709 12:09:28.589584 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:28.586190 11600 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:28.595916 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:28.606513 11335 raft_consensus.cc:359] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.607995 11335 raft_consensus.cc:385] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.608294 11335 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.608902 11335 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.619968 11335 ts_tablet_manager.cc:1434] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.003s
I20260709 12:09:28.626729 11184 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.627583 11600 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:28.627373 11042 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.632791 11335 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:28.645579 11594 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:28.660305 11040 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 2, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.669801 11607 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.670575 11607 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.683173 11607 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.685410 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.692233 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:28.693852 11110 leader_election.cc:343] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.694736 11594 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:28.696835 11110 leader_election.cc:343] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.697224 11110 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.698668 11512 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.702979 11333 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:28.703543 11333 ts_tablet_manager.cc:1403] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.310s	user 0.026s	sys 0.015s
I20260709 12:09:28.706970 11334 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:28.707475 11334 ts_tablet_manager.cc:1403] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.331s	user 0.031s	sys 0.022s
I20260709 12:09:28.710189 11333 raft_consensus.cc:359] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.711040 11333 raft_consensus.cc:385] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.711323 11333 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.712261 11333 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.714874 11333 ts_tablet_manager.cc:1434] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:09:28.716029 11333 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:28.717908 11334 raft_consensus.cc:359] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.718546 11334 raft_consensus.cc:385] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.718788 11334 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.721832 11335 tablet_bootstrap.cc:654] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.722772 11334 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.724386 11334 ts_tablet_manager.cc:1434] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:28.725401 11334 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:28.733345 11334 tablet_bootstrap.cc:654] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.766558 11579 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.776971 11333 tablet_bootstrap.cc:654] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.777956 11335 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:28.779989 11335 ts_tablet_manager.cc:1403] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.010s
I20260709 12:09:28.780486 11334 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:28.780956 11334 ts_tablet_manager.cc:1403] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.009s
I20260709 12:09:28.782382 11335 raft_consensus.cc:359] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.783365 11335 raft_consensus.cc:385] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.783721 11335 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.784936 11335 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.787127 11334 raft_consensus.cc:359] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.787870 11334 raft_consensus.cc:385] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.788177 11334 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.788892 11334 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.787669 11335 ts_tablet_manager.cc:1434] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:28.791174 11334 ts_tablet_manager.cc:1434] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:28.792001 11334 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:28.795466 11594 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.798905 11334 tablet_bootstrap.cc:654] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.808981 11512 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.818753 11335 tablet_bootstrap.cc:492] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:28.823066 11661 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.823575 11661 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.830873 11292 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.843088 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.843325 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:28.844117 11661 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:28.852615 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:28.853876 11607 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.854770 11661 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.863637 11607 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.866010 11607 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.868502 11335 tablet_bootstrap.cc:654] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.871762 11333 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:28.872301 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.872320 11333 ts_tablet_manager.cc:1403] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.001s
W20260709 12:09:28.875418 11110 leader_election.cc:343] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.876993 11607 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:28.887669 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:28.888911 11110 leader_election.cc:343] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:28.889398 11110 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:28.890077 11666 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.891314 11333 raft_consensus.cc:359] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.892117 11333 raft_consensus.cc:385] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.892409 11333 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.893704 11333 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.900223 11333 ts_tablet_manager.cc:1434] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:28.903455 11333 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:28.913908 11334 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:28.914435 11334 ts_tablet_manager.cc:1403] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.123s	user 0.028s	sys 0.013s
I20260709 12:09:28.917692 11334 raft_consensus.cc:359] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.918372 11334 raft_consensus.cc:385] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.918741 11334 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.919672 11333 tablet_bootstrap.cc:654] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.919715 11334 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.926479 11666 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.931972 11334 ts_tablet_manager.cc:1434] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:09:28.932614 11335 tablet_bootstrap.cc:492] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:28.933076 11334 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:28.933141 11335 ts_tablet_manager.cc:1403] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.008s
I20260709 12:09:28.941838 11335 raft_consensus.cc:359] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.942834 11335 raft_consensus.cc:385] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.943084 11335 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.943722 11335 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.950275 11333 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:28.951000 11333 ts_tablet_manager.cc:1403] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.014s
I20260709 12:09:28.955310 11333 raft_consensus.cc:359] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.956081 11333 raft_consensus.cc:385] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.956405 11333 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.957209 11333 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.959802 11333 ts_tablet_manager.cc:1434] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:09:28.960819 11334 tablet_bootstrap.cc:654] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.960945 11333 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:28.966254 11290 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.960582 11335 ts_tablet_manager.cc:1434] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:09:28.976645 11335 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:28.982061 11678 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.982995 11678 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:28.988893 11333 tablet_bootstrap.cc:654] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.990068 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:28.991874 11213 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:28.992270 11678 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:28.993580 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:28.994578 11678 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:28.995078 11678 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:28.995685 11678 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.001775 11696 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.002480 11696 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.006894 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.007542 11144 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:29.008247 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.008844 11184 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:29.009829 11579 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.010253 11579 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.010605 11579 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.006908 11696 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.018087 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:29.018867 11185 leader_election.cc:343] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.019296 11144 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:29.019654 11678 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.020089 11512 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:29.029558 11579 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.036852 11678 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:29.038206 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.038374 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.039155 11144 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.039273 11136 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.048450 11136 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:29.050653 11258 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:29.051371 11692 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.051831 11692 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:29.052626 11692 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.057286 11144 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:29.058951 11184 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:29.060141 11696 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.060781 11696 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:29.062013 11696 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.070845 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:29.071511 11214 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.073113 11579 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.074237 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:09:29.075793 11185 leader_election.cc:343] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.077903 11594 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.078050 11334 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:29.078394 11594 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.078859 11334 ts_tablet_manager.cc:1403] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.010s
I20260709 12:09:29.080570 11594 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.085829 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.088929 11136 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:29.090113 11285 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:29.090427 11667 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.091898 11214 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:29.091112 11334 raft_consensus.cc:359] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.093063 11334 raft_consensus.cc:385] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.093391 11334 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.090900 11335 tablet_bootstrap.cc:654] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.094669 11333 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:29.095783 11333 ts_tablet_manager.cc:1403] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.135s	user 0.042s	sys 0.049s
I20260709 12:09:29.093762 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:29.097635 11184 leader_election.cc:343] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.098299 11334 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.099277 11292 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:29.101487 11667 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.106921 11333 raft_consensus.cc:359] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.107591 11333 raft_consensus.cc:385] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.107931 11334 ts_tablet_manager.cc:1434] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:09:29.109253 11334 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:29.107865 11333 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.110525 11333 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.112776 11333 ts_tablet_manager.cc:1434] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:29.113530 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:29.115389 11696 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.115839 11696 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.116482 11696 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.118147 11335 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:29.118682 11335 ts_tablet_manager.cc:1403] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.002s
I20260709 12:09:29.121260 11335 raft_consensus.cc:359] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.121937 11335 raft_consensus.cc:385] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.122189 11335 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.124843 11040 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.126996 11334 tablet_bootstrap.cc:654] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.130735 11335 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.130079 11042 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.136368 11335 ts_tablet_manager.cc:1434] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:09:29.125285 11696 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.142657 11692 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.152494 11335 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:29.152328 11692 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.156468 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.157500 11696 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:29.158766 11184 leader_election.cc:343] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.159363 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:29.159921 11285 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.168553 11335 tablet_bootstrap.cc:654] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.169962 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.170894 11214 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:29.172164 11692 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:29.176172 11285 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:29.177378 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:29.178388 11696 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.179415 11696 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:29.192739 11696 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.196241 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.197469 11135 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:29.202260 11333 tablet_bootstrap.cc:492] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:29.207818 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:29.210537 11678 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.220021 11334 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:29.220507 11334 ts_tablet_manager.cc:1403] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.009s
I20260709 12:09:29.228000 11334 raft_consensus.cc:359] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.228725 11334 raft_consensus.cc:385] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.228999 11334 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
W20260709 12:09:29.229916 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:29.229589 11334 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.232509 11334 ts_tablet_manager.cc:1434] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:29.234058 11334 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:29.234417 11335 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:29.234972 11335 ts_tablet_manager.cc:1403] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.024s
I20260709 12:09:29.239105 11333 tablet_bootstrap.cc:654] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.239742 11335 raft_consensus.cc:359] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.240679 11335 raft_consensus.cc:385] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.241014 11335 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.241899 11335 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.244107 11038 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.250722 11334 tablet_bootstrap.cc:654] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.257452 11335 ts_tablet_manager.cc:1434] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 12:09:29.258940 11335 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:29.261363 11666 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.262333 11666 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.267395 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.271023 11678 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:29.275211 11110 leader_election.cc:343] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.284534 11594 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.290810 11692 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.310254 11692 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.319762 11692 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:29.306296 11594 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.322265 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.327380 11137 raft_consensus.cc:2393] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:29.324856 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.323871 11594 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.327030 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.328202 11136 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
W20260709 12:09:29.329463 11110 leader_election.cc:343] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.329900 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:29.329770 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:29.331223 11594 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.331785 11594 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.333393 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.335410 11594 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.336194 11607 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.342538 11666 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.326182 11333 tablet_bootstrap.cc:492] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
W20260709 12:09:29.350967 11185 leader_election.cc:343] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.351660 11333 ts_tablet_manager.cc:1403] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.165s	user 0.030s	sys 0.033s
I20260709 12:09:29.355055 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.358636 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:29.361635 11658 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.370397 11334 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:29.370961 11334 ts_tablet_manager.cc:1403] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.137s	user 0.025s	sys 0.050s
I20260709 12:09:29.374538 11334 raft_consensus.cc:359] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.375183 11334 raft_consensus.cc:385] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.375519 11334 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.376286 11334 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.378923 11334 ts_tablet_manager.cc:1434] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:29.381613 11335 tablet_bootstrap.cc:654] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.383028 11334 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:29.388845 11333 raft_consensus.cc:359] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.388820 11666 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.389773 11333 raft_consensus.cc:385] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.390137 11333 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.391062 11333 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.399497 11658 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.402298 11333 ts_tablet_manager.cc:1434] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260709 12:09:29.403515 11333 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:29.390196 11666 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.411434 11334 tablet_bootstrap.cc:654] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.419802 11579 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.420491 11579 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.421393 11335 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:29.421965 11335 ts_tablet_manager.cc:1403] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.163s	user 0.003s	sys 0.015s
I20260709 12:09:29.414700 11594 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.425995 11666 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.433429 11333 tablet_bootstrap.cc:654] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.440145 11335 raft_consensus.cc:359] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.440876 11335 raft_consensus.cc:385] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.441154 11335 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.443617 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.448976 11335 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.462718 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.463691 11137 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:29.449957 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.461316 11594 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.465952 11579 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.470330 11335 ts_tablet_manager.cc:1434] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.006s
I20260709 12:09:29.471830 11335 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:29.450219 11658 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.473341 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:29.475641 11579 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.475526 11658 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.476257 11579 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.476809 11579 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.477226 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.477885 11136 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.486727 11285 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:29.491906 11658 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:29.492403 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:29.497596 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.499742 11136 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:29.501494 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:29.503497 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.505280 11594 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.506168 11594 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:29.507635 11594 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.510010 11334 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:29.510601 11334 ts_tablet_manager.cc:1403] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.128s	user 0.023s	sys 0.024s
W20260709 12:09:29.520107 11110 leader_election.cc:343] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:29.523470 11185 leader_election.cc:343] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.522464 11579 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.534094 11579 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.535498 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.541807 11136 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.548480 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:09:29.530967 11185 leader_election.cc:343] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.549553 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.550510 11135 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:29.551229 11670 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.551731 11670 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.552203 11670 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.559669 11594 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:29.566401 11259 leader_election.cc:343] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.567288 11258 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:29.568787 11692 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.569164 11692 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.569497 11692 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.572875 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:29.578260 11333 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:29.580503 11678 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.583559 11333 ts_tablet_manager.cc:1403] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.180s	user 0.019s	sys 0.020s
I20260709 12:09:29.587028 11670 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.588439 11692 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.592175 11670 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.595304 11658 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.598477 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:29.586253 11333 raft_consensus.cc:359] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.599262 11333 raft_consensus.cc:385] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.599351 11285 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:29.599586 11333 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.538944 11335 tablet_bootstrap.cc:654] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.523080 11334 raft_consensus.cc:359] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.600528 11334 raft_consensus.cc:385] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.600834 11334 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.601567 11334 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.603230 11334 ts_tablet_manager.cc:1434] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.092s	user 0.003s	sys 0.005s
I20260709 12:09:29.603467 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.604264 11135 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:29.604341 11334 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:29.616982 11040 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.594225 11692 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:09:29.580533 11185 leader_election.cc:343] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:29.624367 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43883.4us
I20260709 12:09:29.627734 11742 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.628271 11742 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.625310 11333 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.630357 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:29.630779 11333 ts_tablet_manager.cc:1434] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:09:29.631091 11210 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.631723 11333 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:29.630273 11742 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.634763 11136 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:29.636241 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:29.638098 11696 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.638198 11210 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:29.638473 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.638880 11696 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:29.639424 11285 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:29.640388 11696 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.648407 11335 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:29.648484 11334 tablet_bootstrap.cc:654] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.649026 11335 ts_tablet_manager.cc:1403] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.177s	user 0.010s	sys 0.004s
I20260709 12:09:29.652532 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.653576 11333 tablet_bootstrap.cc:654] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.652534 11335 raft_consensus.cc:359] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.656713 11335 raft_consensus.cc:385] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.656967 11335 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.657581 11335 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.660199 11335 ts_tablet_manager.cc:1434] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:09:29.661496 11335 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:29.665023 11696 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.667172 11334 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:29.667771 11334 ts_tablet_manager.cc:1403] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.000s
I20260709 12:09:29.667789 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:29.668721 11742 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.669252 11742 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:29.667598 11594 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.670120 11742 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.673345 11333 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:29.673795 11333 ts_tablet_manager.cc:1403] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:09:29.673904 11334 raft_consensus.cc:359] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.674842 11334 raft_consensus.cc:385] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.675201 11334 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.676491 11334 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.671933 11335 tablet_bootstrap.cc:654] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.679188 11334 ts_tablet_manager.cc:1434] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:29.676553 11333 raft_consensus.cc:359] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.680300 11333 raft_consensus.cc:385] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.680648 11333 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.682060 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:29.671921 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:29.683718 11210 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:29.685357 11333 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.687043 11040 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.689383 11512 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.694037 11333 ts_tablet_manager.cc:1434] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:09:29.695374 11334 tablet_bootstrap.cc:492] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
W20260709 12:09:29.736858 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 49897.7us
I20260709 12:09:29.740309 11259 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:29.744810 11333 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:29.754168 11757 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.783165 11335 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:29.783828 11335 ts_tablet_manager.cc:1403] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.022s
I20260709 12:09:29.788077 11334 tablet_bootstrap.cc:654] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.794935 11335 raft_consensus.cc:359] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.795732 11335 raft_consensus.cc:385] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.796044 11335 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.796736 11335 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.809527 11335 ts_tablet_manager.cc:1434] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:09:29.805342 11742 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.810437 11742 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.822039 11335 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:29.833927 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.838837 11512 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.840179 11742 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:29.842690 11110 leader_election.cc:343] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.846479 11333 tablet_bootstrap.cc:654] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.853436 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.856501 11594 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:29.863999 11040 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:29.876331 11110 leader_election.cc:343] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:29.877039 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:29.879910 11335 tablet_bootstrap.cc:654] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:29.883903 11658 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.884634 11658 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.897580 11594 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.900363 11647 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.910446 11594 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.914057 11658 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:29.918016 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.919576 11135 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:29.920789 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:29.920883 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:29.921406 11742 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.921957 11742 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.922363 11678 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.922816 11678 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.923147 11678 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.924427 11334 tablet_bootstrap.cc:492] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:29.921442 11136 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:29.925348 11334 ts_tablet_manager.cc:1403] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.001s
I20260709 12:09:29.930075 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:29.930912 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.931210 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.923944 11742 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.931980 11212 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:29.937479 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:29.938725 11696 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:29.939109 11696 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.939443 11696 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.942085 11678 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.938174 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:29.944232 11678 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:29.945906 11292 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:29.925961 11594 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.951246 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:29.952194 11742 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:29.952569 11742 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.952901 11742 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.954198 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.954769 11144 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:29.956414 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:29.957121 11216 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:29.958981 11334 raft_consensus.cc:359] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.959676 11334 raft_consensus.cc:385] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.959942 11334 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.967547 11696 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.969529 11144 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:29.969743 11696 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:29.973438 11334 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.974742 11333 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:29.975206 11334 ts_tablet_manager.cc:1434] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:09:29.976379 11334 tablet_bootstrap.cc:492] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:29.977461 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:29.978305 11760 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:29.978797 11760 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:29.979605 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:29.979628 11760 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.980634 11212 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:29.983405 11335 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:29.983897 11335 ts_tablet_manager.cc:1403] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.004s
I20260709 12:09:29.985184 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:29.988147 11335 raft_consensus.cc:359] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.989681 11335 raft_consensus.cc:385] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:29.989960 11335 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:29.990402 11742 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.990676 11335 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:29.991302 11144 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:29.993448 11335 ts_tablet_manager.cc:1434] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:29.996855 11335 tablet_bootstrap.cc:492] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:29.998050 11742 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.002074 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:29.975256 11333 ts_tablet_manager.cc:1403] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.250s	user 0.015s	sys 0.003s
I20260709 12:09:30.002771 11292 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:30.002336 11334 tablet_bootstrap.cc:654] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.011766 11292 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:30.012799 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:30.013046 11333 raft_consensus.cc:359] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.014739 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.013773 11333 raft_consensus.cc:385] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.015599 11512 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:30.015815 11333 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.016209 11512 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:30.017102 11512 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.017735 11292 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.016669 11333 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.020673 11594 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.026578 11333 ts_tablet_manager.cc:1434] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:09:30.027730 11333 tablet_bootstrap.cc:492] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:30.035513 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:30.036171 11212 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:30.038887 11334 tablet_bootstrap.cc:492] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:30.039425 11334 ts_tablet_manager.cc:1403] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.002s
I20260709 12:09:30.042603 11334 raft_consensus.cc:359] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.043666 11334 raft_consensus.cc:385] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.043700 11212 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:30.044036 11334 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.050041 11334 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.052018 11290 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.052572 11334 ts_tablet_manager.cc:1434] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:30.053597 11334 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:30.059685 11334 tablet_bootstrap.cc:654] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.062429 11333 tablet_bootstrap.cc:654] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.065363 11335 tablet_bootstrap.cc:654] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.069959 11040 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.072703 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:30.073601 11696 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:30.074100 11760 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.074769 11760 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.075603 11334 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:30.076097 11334 ts_tablet_manager.cc:1403] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:09:30.079044 11334 raft_consensus.cc:359] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.079726 11334 raft_consensus.cc:385] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.079854 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:30.080727 11760 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.081662 11333 tablet_bootstrap.cc:492] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:30.082125 11333 ts_tablet_manager.cc:1403] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.005s
I20260709 12:09:30.079995 11334 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.085028 11333 raft_consensus.cc:359] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.085932 11333 raft_consensus.cc:385] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.086257 11333 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.085041 11334 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.091069 11334 ts_tablet_manager.cc:1434] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:09:30.087093 11333 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.093065 11335 tablet_bootstrap.cc:492] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:30.093597 11335 ts_tablet_manager.cc:1403] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.000s
I20260709 12:09:30.097180 11335 raft_consensus.cc:359] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.097844 11335 raft_consensus.cc:385] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.098115 11335 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.098809 11335 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.097518 11333 ts_tablet_manager.cc:1434] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:30.093642 11334 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:30.101194 11333 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:30.101240 11335 ts_tablet_manager.cc:1434] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:30.102380 11335 tablet_bootstrap.cc:492] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Bootstrap starting.
I20260709 12:09:30.107745 11334 tablet_bootstrap.cc:654] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.108282 11335 tablet_bootstrap.cc:654] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.108589 11594 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.109982 11594 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.108285 11333 tablet_bootstrap.cc:654] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.124342 11678 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.125111 11678 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.127064 11039 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.134995 11678 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.137573 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:30.142896 11136 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:30.144079 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.145076 11678 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:30.145437 11678 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.145761 11678 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:30.155469 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.157665 11678 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.158448 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.167186 11292 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:30.168494 11678 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.170027 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:30.170847 11144 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:30.171837 11335 tablet_bootstrap.cc:492] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: No bootstrap required, opened a new log
I20260709 12:09:30.172389 11335 ts_tablet_manager.cc:1403] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.025s
I20260709 12:09:30.173262 11334 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:30.171837 11333 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:30.173905 11334 ts_tablet_manager.cc:1403] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.081s	user 0.027s	sys 0.020s
I20260709 12:09:30.174623 11333 ts_tablet_manager.cc:1403] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.013s
I20260709 12:09:30.177547 11512 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.184228 11144 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:09:30.184324 11335 raft_consensus.cc:359] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.186036 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.186131 11333 raft_consensus.cc:359] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.187124 11678 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.187477 11334 raft_consensus.cc:359] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.188182 11335 raft_consensus.cc:385] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.188697 11760 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:30.188877 11678 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.189270 11334 raft_consensus.cc:385] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.189220 11335 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.190793 11334 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.190240 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:30.191234 11335 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.191308 11678 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.192622 11678 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:30.189486 11760 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:30.194465 11600 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.194419 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:30.194913 11760 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.195418 11144 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:30.195214 11600 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.196569 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.197430 11600 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.197595 11759 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.198069 11759 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.198223 11335 ts_tablet_manager.cc:1434] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:09:30.198508 11759 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.193817 11334 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.201476 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.203138 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:30.204159 11334 ts_tablet_manager.cc:1434] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:09:30.188616 11333 raft_consensus.cc:385] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.204490 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:30.204797 11333 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.205161 11136 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:30.209868 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:30.210163 11334 tablet_bootstrap.cc:492] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Bootstrap starting.
I20260709 12:09:30.243444 11696 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.081s
I20260709 12:09:30.285513 11666 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.290984 11333 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:30.282940 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44705.4us
I20260709 12:09:30.325671 11216 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:30.294795 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:30.327610 11696 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:30.329967 11696 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:30.333262 11579 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.337358 11579 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.329618 11333 ts_tablet_manager.cc:1434] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.154s	user 0.042s	sys 0.070s
I20260709 12:09:30.337849 11579 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.341491 11334 tablet_bootstrap.cc:654] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.210464 11290 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 0.
I20260709 12:09:30.234264 11512 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.325415 11666 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.342589 11333 tablet_bootstrap.cc:492] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Bootstrap starting.
I20260709 12:09:30.337908 11696 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:30.346046 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54713.6us
I20260709 12:09:30.351310 11696 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:30.353291 11579 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.354406 11139 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:30.355432 11579 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.359509 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:30.360152 11137 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.366099 11647 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.374608 11512 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.298617 11759 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.396960 11759 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.405684 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:30.406282 11144 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.416706 11039 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.424198 11333 tablet_bootstrap.cc:654] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:30.433781 11144 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:30.435391 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:30.436003 11285 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.439141 11692 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.440017 11692 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.446784 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.449613 11512 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.451133 11137 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:30.451351 11760 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.451946 11760 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:30.452922 11760 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.478085 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:30.459530 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:30.452922 11666 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.487475 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:30.494076 11292 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:30.503089 11600 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:30.518319 11600 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:30.519291 11600 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.522590 11692 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.525818 11285 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:30.544852 11334 tablet_bootstrap.cc:492] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: No bootstrap required, opened a new log
I20260709 12:09:30.545526 11334 ts_tablet_manager.cc:1403] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent bootstrapping tablet: real 0.336s	user 0.011s	sys 0.032s
I20260709 12:09:30.582041 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:09:30.583841 11110 leader_election.cc:343] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:30.587035 11607 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.592077 11607 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.592489 11607 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.593811 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:30.594703 11215 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.598130 11333 tablet_bootstrap.cc:492] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: No bootstrap required, opened a new log
I20260709 12:09:30.598867 11333 ts_tablet_manager.cc:1403] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent bootstrapping tablet: real 0.257s	user 0.092s	sys 0.039s
I20260709 12:09:30.603538 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.604365 11216 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:30.604616 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.605304 11212 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:30.605317 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.612289 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.613524 11764 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.613958 11764 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.614394 11764 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.620504 11692 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.620922 11212 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:09:30.627811 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59562.7us
W20260709 12:09:30.637751 11090 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:30.646950 11219 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:09:30.647859 11219 pending_rounds.cc:85] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 0
I20260709 12:09:30.648155 11219 pending_rounds.cc:107] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:09:30.648483 11219 raft_consensus.cc:2889] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:30.683597 11334 raft_consensus.cc:359] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.686249 11334 raft_consensus.cc:385] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.686563 11334 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.691824 11334 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.735144 11334 ts_tablet_manager.cc:1434] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent starting tablet: real 0.189s	user 0.003s	sys 0.007s
I20260709 12:09:30.687885 11678 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 12:09:30.707412 11607 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.752579 11333 raft_consensus.cc:359] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.754011 11333 raft_consensus.cc:385] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:30.754359 11333 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Initialized, Role: FOLLOWER
I20260709 12:09:30.755205 11333 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.753516 11658 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:30.756225 11658 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.756995 11333 ts_tablet_manager.cc:1434] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent starting tablet: real 0.158s	user 0.006s	sys 0.000s
I20260709 12:09:30.758119 11658 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.763363 11607 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.774197 11764 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.781021 11215 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:30.788282 11764 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.791263 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:30.792088 11138 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:30.793920 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:30.795024 11138 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:30.800546 11216 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 0.
I20260709 12:09:30.810412 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:30.811373 11137 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:30.814697 11040 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.829447 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:30.829845 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:30.830520 11211 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.830196 11214 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 0.
I20260709 12:09:30.843942 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:30.848440 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:30.858893 11692 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:30.838464 11670 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:09:30.863255 11666 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.886881 11666 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.887403 11666 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.891203 11144 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:09:30.893537 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67889.4us
W20260709 12:09:30.895579 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49129.9us
I20260709 12:09:30.921588 11211 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:30.932740 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:30.933993 11658 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:30.934371 11658 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:30.934758 11658 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.948647 11760 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.949218 11291 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:30.954977 11790 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.959267 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:30.958865 11039 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.960280 11285 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:30.927366 11666 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.941931 11658 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:30.974675 11658 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:30.981490 11666 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:30.984036 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:30.984819 11210 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:30.990103 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:30.991079 11286 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 1: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:09:30.994055 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:30.994912 11135 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:31.001150 11210 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:31.003064 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:31.003896 11666 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:31.004873 11666 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:31.006038 11666 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:31.009955 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:31.010933 11678 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:31.011422 11678 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:31.016667 11678 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:31.032712 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:31.023053 11607 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:31.033562 11215 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 1: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:09:31.036795 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:31.059235 11790 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.074544 11647 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.066663 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:31.075703 11796 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:31.076581 11040 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:31.102752 11796 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.142438 11794 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.152679 11039 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.399992 11661 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.419235 11661 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.494885 11666 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.512049 11670 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.994868  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:32.024827 11817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:32.025316 11815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:32.025972 11814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:32.030200  9938 server_base.cc:1061] running on GCE node
I20260709 12:09:32.032450  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:32.032665  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:32.032814  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783598972032797 us; error 0 us; skew 500 ppm
I20260709 12:09:32.033375  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:32.036383  9938 webserver.cc:533] Webserver started at http://127.9.180.132:40245/ using document root <none> and password file <none>
I20260709 12:09:32.036871  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:32.037048  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:32.037433  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:32.039392  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-3-root/instance:
uuid: "2b4f4725b82b481ab53f0717a429e94a"
format_stamp: "Formatted at 2026-07-09 12:09:32 on dist-test-slave-lg8f"
I20260709 12:09:32.048746  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:32.052522 11822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:32.053454  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:09:32.053917  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-3-root
uuid: "2b4f4725b82b481ab53f0717a429e94a"
format_stamp: "Formatted at 2026-07-09 12:09:32 on dist-test-slave-lg8f"
I20260709 12:09:32.054260  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:32.073148  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:32.074622  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:32.076057  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:32.078377  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:32.078680  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:32.078944  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:32.079135  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:32.166206  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.132:46563
I20260709 12:09:32.167009 11885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.132:46563 every 8 connection(s)
I20260709 12:09:32.172454  9938 auto_leader_rebalancer-test.cc:439] add a tserver: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:32.191071 11886 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38919
I20260709 12:09:32.191538 11886 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:32.192457 11886 heartbeater.cc:507] Master 127.9.180.190:38919 requested a full tablet report, sending...
I20260709 12:09:32.194865 11042 ts_manager.cc:194] Registered new tserver with Master: 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:32.196237 11042 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48006
I20260709 12:09:32.776664 11219 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:32.782874 11291 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.783914 11136 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.785233 11890 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:32.786303 11778 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:32.802141 11890 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.804160 11141 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:32.807523 11182 consensus_peers.cc:597] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64dc7dbbc231456da11adb2c7a1dada9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.811553 11291 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.820966 11042 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.844936 11285 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:32.859148 11219 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.860201 11141 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.860746 11661 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:32.861757 11794 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:32.884531 11256 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92ccd088b1904dd1aae6563124beb655. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.883481 11813 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.886766 11141 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.893299 11215 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.905112 11039 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.906724 11285 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:32.918757 11215 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.920763 11661 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:32.930665 11256 consensus_peers.cc:597] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9948214ce1cd45429598d228699aa5a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.933234 11794 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.935091 11141 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.936813 11910 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:32.944710 11141 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.948531 11219 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:32.963201 11285 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:32.964071 11042 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.977927 11141 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.978273 11215 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.979542 11661 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:32.980464 11256 consensus_peers.cc:597] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a67ed18056054cad98bdf3dd430e6577. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.982160 11661 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.000911 11794 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:33.001904 11136 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:33.006140 11215 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:33.024055 11042 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:33.199355 11886 heartbeater.cc:499] Master 127.9.180.190:38919 was elected leader, sending a full tablet report...
I20260709 12:09:33.353899 11916 ts_tablet_manager.cc:933] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:33.374579 11916 tablet_copy_client.cc:323] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:33.398442 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 64dc7dbbc231456da11adb2c7a1dada9 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:33.399138 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 64dc7dbbc231456da11adb2c7a1dada9 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-64dc7dbbc231456da11adb2c7a1dada9
I20260709 12:09:33.409332 11921 ts_tablet_manager.cc:933] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:33.409340 11229 tablet_copy_source_session.cc:215] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.411636 11921 tablet_copy_client.cc:323] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:33.414268 11916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64dc7dbbc231456da11adb2c7a1dada9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.436197 11916 tablet_copy_client.cc:806] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.437053 11916 tablet_copy_client.cc:670] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.444355 11916 tablet_copy_client.cc:538] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.446560 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 92ccd088b1904dd1aae6563124beb655 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:33.447157 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 92ccd088b1904dd1aae6563124beb655 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-92ccd088b1904dd1aae6563124beb655
I20260709 12:09:33.454681 11916 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:33.456017 11303 tablet_copy_source_session.cc:215] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.460675 11921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ccd088b1904dd1aae6563124beb655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.474972 11921 tablet_copy_client.cc:806] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.482210 11921 tablet_copy_client.cc:670] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.486639 11921 tablet_copy_client.cc:538] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.503634 11924 ts_tablet_manager.cc:933] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:33.506737 11921 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:33.531723 11926 ts_tablet_manager.cc:933] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:33.533950 11924 tablet_copy_client.cc:323] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:33.571283 11916 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.574229 11916 tablet_bootstrap.cc:492] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:33.575032 11916 ts_tablet_manager.cc:1403] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.121s	user 0.035s	sys 0.045s
I20260709 12:09:33.579452 11926 tablet_copy_client.cc:323] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:33.584627 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 9948214ce1cd45429598d228699aa5a8 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:33.585246 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 9948214ce1cd45429598d228699aa5a8 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-9948214ce1cd45429598d228699aa5a8
I20260709 12:09:33.585309 11916 raft_consensus.cc:359] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:33.615253 11916 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:33.597249 11302 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet a67ed18056054cad98bdf3dd430e6577 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:33.616113 11916 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:33.617213 11302 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet a67ed18056054cad98bdf3dd430e6577 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-a67ed18056054cad98bdf3dd430e6577
I20260709 12:09:33.594002 11303 tablet_copy_source_session.cc:215] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.630921 11302 tablet_copy_source_session.cc:215] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:33.633718 11924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9948214ce1cd45429598d228699aa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.639043 11921 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:33.639963 11921 tablet_bootstrap.cc:492] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:33.640651 11921 ts_tablet_manager.cc:1403] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.134s	user 0.017s	sys 0.007s
I20260709 12:09:33.643517 11921 raft_consensus.cc:359] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:33.644284 11921 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:33.644920 11921 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:33.655285 11916 ts_tablet_manager.cc:1434] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.008s
I20260709 12:09:33.655891 11926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67ed18056054cad98bdf3dd430e6577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:33.657114 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-64dc7dbbc231456da11adb2c7a1dada9 received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:33.657668 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-64dc7dbbc231456da11adb2c7a1dada9 on tablet 64dc7dbbc231456da11adb2c7a1dada9 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:33.661583 11921 ts_tablet_manager.cc:1434] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:09:33.662694 11924 tablet_copy_client.cc:806] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:33.663250 11924 tablet_copy_client.cc:670] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:33.663298 11302 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-92ccd088b1904dd1aae6563124beb655 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:33.663794 11302 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-92ccd088b1904dd1aae6563124beb655 on tablet 92ccd088b1904dd1aae6563124beb655 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:33.668731 11924 tablet_copy_client.cc:538] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:33.776667 11860 raft_consensus.cc:1217] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.868314 11860 raft_consensus.cc:1217] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.067852 11924 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:34.077692 11926 tablet_copy_client.cc:806] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.078425 11926 tablet_copy_client.cc:670] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.113914 11924 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.115265 11924 tablet_bootstrap.cc:492] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:34.116021 11924 ts_tablet_manager.cc:1403] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.003s
I20260709 12:09:34.123507 11924 raft_consensus.cc:359] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:34.124888 11924 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:34.125732 11924 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:34.129539 11924 ts_tablet_manager.cc:1434] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.008s
I20260709 12:09:34.367594 11938 raft_consensus.cc:1064] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:34.370645 11938 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:09:34.432298 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:34.447722 11939 raft_consensus.cc:1064] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:34.453173 11860 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.453186 11939 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:34.460088 11929 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.475163 11861 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.480235 11898 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.481966 11216 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.483577 11144 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.487092 11920 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.488885 11292 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.494259 11861 raft_consensus.cc:1217] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.504413 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-9948214ce1cd45429598d228699aa5a8 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:34.504864 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-9948214ce1cd45429598d228699aa5a8 on tablet 9948214ce1cd45429598d228699aa5a8 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:34.510596 11926 tablet_copy_client.cc:538] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.510715 11898 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.513903 11942 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:34.553540 11926 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:34.557578 11910 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.565577 11215 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.572557 11141 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:34.586896 11292 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.591624 11860 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.587116 11898 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.596844 11861 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.618957 11040 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.617413 11039 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:34.627535 11941 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:34.653971 11141 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.704605 11141 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.712323 11926 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.713321 11926 tablet_bootstrap.cc:492] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:34.713967 11926 ts_tablet_manager.cc:1403] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.010s
I20260709 12:09:34.721607 11926 raft_consensus.cc:359] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:34.722733 11926 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:34.723399 11926 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:34.725775 11926 ts_tablet_manager.cc:1434] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:09:34.747432 11215 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:34.749953 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-a67ed18056054cad98bdf3dd430e6577 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:34.750514 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-a67ed18056054cad98bdf3dd430e6577 on tablet a67ed18056054cad98bdf3dd430e6577 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:34.786638 11860 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.790907 11141 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:34.793252 11939 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.799067 11939 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:34.815495 11778 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.816063 11860 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.854620 11141 raft_consensus.cc:2955] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.856745 11039 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:34.862426 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64dc7dbbc231456da11adb2c7a1dada9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:34.887846 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 64dc7dbbc231456da11adb2c7a1dada9 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:34.932896 11860 raft_consensus.cc:1217] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:34.956935 11956 tablet_replica.cc:333] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:34.958024 11956 raft_consensus.cc:2243] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:34.958968 11956 raft_consensus.cc:2272] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:34.965762 11956 ts_tablet_manager.cc:1916] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.007364 11956 ts_tablet_manager.cc:1929] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.008149 11956 log.cc:1199] T 64dc7dbbc231456da11adb2c7a1dada9 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/64dc7dbbc231456da11adb2c7a1dada9
I20260709 12:09:35.013342 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 64dc7dbbc231456da11adb2c7a1dada9 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:35.045943 11285 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:35.051594 11860 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.053049 11929 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.056952 11135 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.059013 11933 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.062378 11929 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.067926 11135 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.071324 11860 raft_consensus.cc:2955] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.095362 11794 raft_consensus.cc:1064] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:35.095337 11040 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.098249 11794 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:35.104676 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 92ccd088b1904dd1aae6563124beb655 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.121073 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ccd088b1904dd1aae6563124beb655 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:35.125525 11860 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.128211 11135 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.128664 11661 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.130151 11794 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.133149 11211 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.140684 11661 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.141836 11958 tablet_replica.cc:333] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:35.149674 11958 raft_consensus.cc:2243] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.151046 11958 raft_consensus.cc:2272] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.153574 11661 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.156402 11135 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.158921 11211 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.154626 11958 ts_tablet_manager.cc:1916] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.167459 11860 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.181761 11042 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:35.199925 11285 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:35.205632 11958 ts_tablet_manager.cc:1929] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.206254 11958 log.cc:1199] T 92ccd088b1904dd1aae6563124beb655 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/92ccd088b1904dd1aae6563124beb655
I20260709 12:09:35.210727 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 92ccd088b1904dd1aae6563124beb655 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:35.212186 11860 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.212636 11211 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.214268 11661 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.215970 11933 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.224532 11794 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.228942 11211 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.235356 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9948214ce1cd45429598d228699aa5a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.236084 11860 raft_consensus.cc:2955] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.252128 11039 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.269392 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 9948214ce1cd45429598d228699aa5a8 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:35.271929 11962 tablet_replica.cc:333] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:35.272993 11962 raft_consensus.cc:2243] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.273851 11962 raft_consensus.cc:2272] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.277040 11962 ts_tablet_manager.cc:1916] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.296497 11962 ts_tablet_manager.cc:1929] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.297019 11962 log.cc:1199] T 9948214ce1cd45429598d228699aa5a8 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/9948214ce1cd45429598d228699aa5a8
I20260709 12:09:35.300419 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 9948214ce1cd45429598d228699aa5a8 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
W20260709 12:09:35.328039 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8060 after lost signal to thread 9941
W20260709 12:09:35.328969 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8740 after lost signal to thread 11076
W20260709 12:09:35.329849 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2fe0 after lost signal to thread 11168
W20260709 12:09:35.330796 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002fcc60 after lost signal to thread 11243
W20260709 12:09:35.331782 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080030cf60 after lost signal to thread 11317
W20260709 12:09:35.333251 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080030d8c0 after lost signal to thread 11885
I20260709 12:09:35.528774 11661 raft_consensus.cc:1064] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:35.532115 11661 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:35.561527 11860 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.563251 11910 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.566730 11135 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.575037 11211 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.578286 11910 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.619201 11941 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.622032 11861 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:09:35.619151 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62477.1us
I20260709 12:09:35.639885 11038 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.643769 11910 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.649753 11211 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.662757 11144 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.668020 11285 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:35.682089 11216 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.683044 11861 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:35.684026 11910 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:09:35.688076 11661 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:35.695019 11910 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.700529 11216 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.702036 11861 raft_consensus.cc:2955] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.709210 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a67ed18056054cad98bdf3dd430e6577 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:35.724985 11039 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:35.735502 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet a67ed18056054cad98bdf3dd430e6577 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:35.736577 11962 tablet_replica.cc:333] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:35.737670 11962 raft_consensus.cc:2243] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.738386 11962 raft_consensus.cc:2272] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.742043 11962 ts_tablet_manager.cc:1916] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.763954 11962 ts_tablet_manager.cc:1929] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:35.765689 11962 log.cc:1199] T a67ed18056054cad98bdf3dd430e6577 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/a67ed18056054cad98bdf3dd430e6577
I20260709 12:09:35.767529 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet a67ed18056054cad98bdf3dd430e6577 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:36.861465 11291 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:36.869702 11216 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:36.870283 11256 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59b9f42c7ee544898eee55760f7287b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.872568 11661 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.874382 11141 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:36.878136 11661 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:36.887485 11974 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:36.895206 11216 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:36.900813 11144 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:36.912667 11215 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:36.921497 11038 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:36.949654 11182 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4d8b59f386d4565b0103c44f0baa84d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:36.952308 11144 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.966547 11291 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:36.966536 11898 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:36.971284 11973 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:36.983134 11981 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:36.987324 11144 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.039733 11292 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.068454 11040 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.068933 11291 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:37.084585 11256 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a98f617dcc31482f9ed419423e8b50d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.087811 11144 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.088867 11215 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.091661 11661 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.093297 11661 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.118724 11794 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.123073 11215 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.127316 11144 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.144531 11039 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.161532 11291 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:09:37.175719 11256 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e660be03b734102a4ad43c954498a96. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.175756 11215 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.177842 11144 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.177688 11661 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.179527 11661 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.200103 11661 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.204461 11141 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.223902 11215 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.233714 11040 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:37.368018 11994 ts_tablet_manager.cc:933] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:37.374840 11994 tablet_copy_client.cc:323] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:37.377388 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet c4d8b59f386d4565b0103c44f0baa84d from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:37.378050 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet c4d8b59f386d4565b0103c44f0baa84d from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-c4d8b59f386d4565b0103c44f0baa84d
I20260709 12:09:37.395833 11229 tablet_copy_source_session.cc:215] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.400717 11994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d8b59f386d4565b0103c44f0baa84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.400887 11996 ts_tablet_manager.cc:933] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:37.420840 11996 tablet_copy_client.cc:323] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:37.424697 11994 tablet_copy_client.cc:806] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.424952 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 59b9f42c7ee544898eee55760f7287b3 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:37.425590 11994 tablet_copy_client.cc:670] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.425541 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 59b9f42c7ee544898eee55760f7287b3 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-59b9f42c7ee544898eee55760f7287b3
I20260709 12:09:37.434988 11303 tablet_copy_source_session.cc:215] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.439436 11994 tablet_copy_client.cc:538] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.449566 11996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b9f42c7ee544898eee55760f7287b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.466442 11994 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:37.469607 11996 tablet_copy_client.cc:806] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.470396 11996 tablet_copy_client.cc:670] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.477180 11996 tablet_copy_client.cc:538] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.488292 11996 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:37.517637 11994 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.518644 11994 tablet_bootstrap.cc:492] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:37.519337 11994 ts_tablet_manager.cc:1403] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.021s
I20260709 12:09:37.523116 11994 raft_consensus.cc:359] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.523974 11994 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:37.524644 11994 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.535938 11994 ts_tablet_manager.cc:1434] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 12:09:37.537613 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-c4d8b59f386d4565b0103c44f0baa84d received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:37.538129 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-c4d8b59f386d4565b0103c44f0baa84d on tablet c4d8b59f386d4565b0103c44f0baa84d with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:37.548801 11996 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.549724 11996 tablet_bootstrap.cc:492] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:37.550387 11996 ts_tablet_manager.cc:1403] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.062s	user 0.028s	sys 0.007s
I20260709 12:09:37.553643 11996 raft_consensus.cc:359] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.554518 11996 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:37.555542 11996 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.559952 11996 ts_tablet_manager.cc:1434] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:37.561769 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-59b9f42c7ee544898eee55760f7287b3 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:37.562165 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-59b9f42c7ee544898eee55760f7287b3 on tablet 59b9f42c7ee544898eee55760f7287b3 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:37.594921 11996 ts_tablet_manager.cc:933] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:37.599983 11996 tablet_copy_client.cc:323] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:37.602137 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet a98f617dcc31482f9ed419423e8b50d5 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:37.602850 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet a98f617dcc31482f9ed419423e8b50d5 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-a98f617dcc31482f9ed419423e8b50d5
I20260709 12:09:37.612175 11303 tablet_copy_source_session.cc:215] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.616143 11996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a98f617dcc31482f9ed419423e8b50d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.697168 11996 tablet_copy_client.cc:806] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.697762 11996 tablet_copy_client.cc:670] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.702164 11996 tablet_copy_client.cc:538] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.712778 11996 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:37.732139 11994 ts_tablet_manager.cc:933] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:37.776432 11994 tablet_copy_client.cc:323] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:37.784641 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 7e660be03b734102a4ad43c954498a96 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:37.785290 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 7e660be03b734102a4ad43c954498a96 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-7e660be03b734102a4ad43c954498a96
I20260709 12:09:37.798477 11303 tablet_copy_source_session.cc:215] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:37.804553 11994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e660be03b734102a4ad43c954498a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:37.823900 11994 tablet_copy_client.cc:806] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:37.815541 11996 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.828037 11996 tablet_bootstrap.cc:492] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:37.829046 11996 ts_tablet_manager.cc:1403] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.117s	user 0.028s	sys 0.003s
I20260709 12:09:37.824738 11994 tablet_copy_client.cc:670] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:37.833909 11994 tablet_copy_client.cc:538] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:37.835089 11996 raft_consensus.cc:359] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.836585 11996 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:37.848958 11996 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.857950 11994 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:37.864634 11996 ts_tablet_manager.cc:1434] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:09:37.876096 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-a98f617dcc31482f9ed419423e8b50d5 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:37.876727 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-a98f617dcc31482f9ed419423e8b50d5 on tablet a98f617dcc31482f9ed419423e8b50d5 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:37.881615 11860 raft_consensus.cc:1217] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.897938 11860 raft_consensus.cc:1217] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:37.922434 11994 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:37.923480 11994 tablet_bootstrap.cc:492] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:37.924219 11994 ts_tablet_manager.cc:1403] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.009s
I20260709 12:09:37.927125 11994 raft_consensus.cc:359] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.927977 11994 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:37.928660 11994 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:37.931367 11994 ts_tablet_manager.cc:1434] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:37.933748 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-7e660be03b734102a4ad43c954498a96 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:37.934144 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-7e660be03b734102a4ad43c954498a96 on tablet 7e660be03b734102a4ad43c954498a96 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:38.213618 11860 raft_consensus.cc:1217] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.230997 11860 raft_consensus.cc:1217] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.282564 11794 raft_consensus.cc:1064] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:38.286998 11794 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:38.350411 11210 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.351038 11860 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.357234 11794 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.358953 11974 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.361702 11141 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.369141 12007 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.405027 11861 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.416172 11898 raft_consensus.cc:1064] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:38.419839 11898 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:38.401997 12006 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.481570 11860 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:38.481609 11291 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:38.484061 11136 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:38.485668 11981 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.485549 11040 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.487674 11981 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.488618 11973 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.500203 11136 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.504567 11216 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.539211 11973 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.554328 11141 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.564224 11860 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.606047 11038 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.623986 11291 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.689925 11216 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:38.690943 11292 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:38.696486 11860 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:38.698436 11898 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.701138 11141 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:38.706080 11898 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.713678 11136 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.716339 12006 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.716464 11973 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.720367 11974 raft_consensus.cc:1064] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:38.721174 11861 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.724157 11860 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.737047 12007 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.746093 12007 raft_consensus.cc:1064] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:38.726120 11974 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:38.730408 11141 raft_consensus.cc:2955] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.749550 11794 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.783191 11860 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.778543 11135 raft_consensus.cc:2955] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.770107 12007 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:38.814399 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 59b9f42c7ee544898eee55760f7287b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.843559 11038 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.863534 11858 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.897190 11216 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.900444 11794 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.921366 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4d8b59f386d4565b0103c44f0baa84d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.926331 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 59b9f42c7ee544898eee55760f7287b3 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:38.932126 11135 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.941193 12031 tablet_replica.cc:333] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:38.921142 12026 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:09:38.948628 12024 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.959432 11042 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:38.964699 11215 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.964754 11135 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.975466 11861 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:38.975490 11974 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:38.978449 11794 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:38.980500 12029 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:38.989058 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet c4d8b59f386d4565b0103c44f0baa84d with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:38.999408 12031 raft_consensus.cc:2243] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.000331 12031 raft_consensus.cc:2272] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.005200 12031 ts_tablet_manager.cc:1916] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.061002 12035 tablet_replica.cc:333] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:39.063884 12035 raft_consensus.cc:2243] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.064276 12031 ts_tablet_manager.cc:1929] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.064793 12031 log.cc:1199] T 59b9f42c7ee544898eee55760f7287b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/59b9f42c7ee544898eee55760f7287b3
I20260709 12:09:39.064811 12035 raft_consensus.cc:2272] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.077530 11974 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.081151 12035 ts_tablet_manager.cc:1916] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.080129 11135 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.092581 12024 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.101524 11038 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.113482 11141 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.116617 11039 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.119407 11859 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:09:39.126459 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74829.8us
I20260709 12:09:39.132253 11291 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:39.134107 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 59b9f42c7ee544898eee55760f7287b3 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:39.143971 11860 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.149986 12035 ts_tablet_manager.cc:1929] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:39.150610 12035 log.cc:1199] T c4d8b59f386d4565b0103c44f0baa84d P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/c4d8b59f386d4565b0103c44f0baa84d
I20260709 12:09:39.157699 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet c4d8b59f386d4565b0103c44f0baa84d (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:39.166244 11210 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.185860 11135 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.211061 11861 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.221197 11285 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:39.231349 12007 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.239040 11861 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.241216 12024 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:39.247939 11974 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.250463 12007 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.259958 11860 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.265672 11216 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.272781 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a98f617dcc31482f9ed419423e8b50d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.279202 11038 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.286311 12025 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:39.300997 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet a98f617dcc31482f9ed419423e8b50d5 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:39.312676 11860 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.313248 11974 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.325314 11135 raft_consensus.cc:2955] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.328862 11038 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.333797 12039 tablet_replica.cc:333] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:39.336073 11215 raft_consensus.cc:2955] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:39.355396 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e660be03b734102a4ad43c954498a96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.359074 12039 raft_consensus.cc:2243] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.359992 12039 raft_consensus.cc:2272] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.361887 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e660be03b734102a4ad43c954498a96 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:39.365294 12031 tablet_replica.cc:333] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:39.366119 12039 ts_tablet_manager.cc:1916] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.366451 12031 raft_consensus.cc:2243] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.367094 12031 pending_rounds.cc:70] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Trying to abort 1 pending ops.
I20260709 12:09:39.367364 12031 pending_rounds.cc:77] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621416983625728 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7e660be03b734102a4ad43c954498a96" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } } }
I20260709 12:09:39.369571 12031 raft_consensus.cc:2917] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:39.370072 12031 raft_consensus.cc:2889] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:39.370455 12031 raft_consensus.cc:2272] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.376910 12031 ts_tablet_manager.cc:1916] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.386009 12039 ts_tablet_manager.cc:1929] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.386418 12039 log.cc:1199] T a98f617dcc31482f9ed419423e8b50d5 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/a98f617dcc31482f9ed419423e8b50d5
I20260709 12:09:39.388506 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet a98f617dcc31482f9ed419423e8b50d5 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:39.397320 12031 ts_tablet_manager.cc:1929] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.398007 12031 log.cc:1199] T 7e660be03b734102a4ad43c954498a96 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/7e660be03b734102a4ad43c954498a96
I20260709 12:09:39.399966 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 7e660be03b734102a4ad43c954498a96 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:40.460672 11141 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:40.475754 11285 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.479269 11215 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.480307 12032 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.488090 11971 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.503635 11971 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.509513 11291 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:40.520398 11107 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14c3c7c84ef94275814f49349db79a72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.524128 11210 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:40.541639 11038 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.506366 11215 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:40.559670 11182 consensus_peers.cc:597] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee56790b88674a68962bb5866affcd4f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.561020 11285 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.564028 11980 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.574189 11135 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.576074 11980 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.595256 11898 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.600178 11135 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.628942 11291 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:40.640196 11292 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:40.659339 11256 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b5563d41fc84c36a8d7eafa0e6a4968. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.665637 11216 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.672001 11974 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.646229 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.697656 12048 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.705284 11216 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.766758 11135 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.768260 12061 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.776358 11216 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:40.787794 11039 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:40.799657 11182 consensus_peers.cc:597] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9943fa4bd634a79a891fa52086a527a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.802057 11291 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.804726 11141 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.804998 11898 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.806285 11980 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.802858 11135 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.834739 11898 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.843699 11292 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.844961 11141 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.874073 11042 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:40.964452 12067 ts_tablet_manager.cc:933] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:40.972671 12067 tablet_copy_client.cc:323] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.129:43503
I20260709 12:09:41.013805 11154 tablet_copy_service.cc:140] P 018d40ceb45d4447aa293f4c1d929bb8: Received BeginTabletCopySession request for tablet 14c3c7c84ef94275814f49349db79a72 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:40324)
I20260709 12:09:41.014380 11154 tablet_copy_service.cc:161] P 018d40ceb45d4447aa293f4c1d929bb8: Beginning new tablet copy session on tablet 14c3c7c84ef94275814f49349db79a72 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:40324: session id = 2b4f4725b82b481ab53f0717a429e94a-14c3c7c84ef94275814f49349db79a72
I20260709 12:09:41.020530 11154 tablet_copy_source_session.cc:215] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.024668 12067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c3c7c84ef94275814f49349db79a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.050882 12067 tablet_copy_client.cc:806] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.051795 12067 tablet_copy_client.cc:670] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.055799 12067 tablet_copy_client.cc:538] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.065049 12067 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:41.083621 12071 ts_tablet_manager.cc:933] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:41.089171 12071 tablet_copy_client.cc:323] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:41.091143 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 5b5563d41fc84c36a8d7eafa0e6a4968 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:41.091764 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 5b5563d41fc84c36a8d7eafa0e6a4968 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-5b5563d41fc84c36a8d7eafa0e6a4968
I20260709 12:09:41.112263 12067 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.113313 12067 tablet_bootstrap.cc:492] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:41.114020 12067 ts_tablet_manager.cc:1403] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.049s	user 0.029s	sys 0.000s
I20260709 12:09:41.117287 12067 raft_consensus.cc:359] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.118134 12067 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:41.119184 12067 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.151688 11303 tablet_copy_source_session.cc:215] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.157949 12071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b5563d41fc84c36a8d7eafa0e6a4968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.159044 12067 ts_tablet_manager.cc:1434] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.045s	user 0.027s	sys 0.010s
I20260709 12:09:41.161936 11154 tablet_copy_service.cc:342] P 018d40ceb45d4447aa293f4c1d929bb8: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-14c3c7c84ef94275814f49349db79a72 received from {username='slave'} at 127.0.0.1:40324
I20260709 12:09:41.162421 11154 tablet_copy_service.cc:434] P 018d40ceb45d4447aa293f4c1d929bb8: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-14c3c7c84ef94275814f49349db79a72 on tablet 14c3c7c84ef94275814f49349db79a72 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:41.178323 12067 ts_tablet_manager.cc:933] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:41.185379 12067 tablet_copy_client.cc:323] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:41.187098 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet ee56790b88674a68962bb5866affcd4f from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:41.187667 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet ee56790b88674a68962bb5866affcd4f from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-ee56790b88674a68962bb5866affcd4f
I20260709 12:09:41.199244 12071 tablet_copy_client.cc:806] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.200116 12071 tablet_copy_client.cc:670] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.202800 11229 tablet_copy_source_session.cc:215] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.204471 12071 tablet_copy_client.cc:538] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.207811 12067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee56790b88674a68962bb5866affcd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.213819 12071 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:41.228055 12067 tablet_copy_client.cc:806] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.228912 12067 tablet_copy_client.cc:670] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.232995 12067 tablet_copy_client.cc:538] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.263650 12077 ts_tablet_manager.cc:933] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:41.265220 12071 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.267333 12071 tablet_bootstrap.cc:492] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:41.268163 12071 ts_tablet_manager.cc:1403] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.016s
I20260709 12:09:41.272598 12071 raft_consensus.cc:359] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.277233 12071 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:41.279868 12071 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.279100 12077 tablet_copy_client.cc:323] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:41.282757 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet f9943fa4bd634a79a891fa52086a527a from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:41.283344 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet f9943fa4bd634a79a891fa52086a527a from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-f9943fa4bd634a79a891fa52086a527a
I20260709 12:09:41.284277 12071 ts_tablet_manager.cc:1434] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.002s
I20260709 12:09:41.286785 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-5b5563d41fc84c36a8d7eafa0e6a4968 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:41.287202 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-5b5563d41fc84c36a8d7eafa0e6a4968 on tablet 5b5563d41fc84c36a8d7eafa0e6a4968 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:41.297780 11229 tablet_copy_source_session.cc:215] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.300093 12067 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:41.311468 12077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9943fa4bd634a79a891fa52086a527a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.362545 12077 tablet_copy_client.cc:806] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.363195 12077 tablet_copy_client.cc:670] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.368280 12067 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.370654 12077 tablet_copy_client.cc:538] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.374441 12067 tablet_bootstrap.cc:492] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:41.375243 12067 ts_tablet_manager.cc:1403] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.015s
I20260709 12:09:41.379144 12067 raft_consensus.cc:359] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.380165 12067 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:41.380853 12067 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.383708 12067 ts_tablet_manager.cc:1434] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:41.388173 11860 raft_consensus.cc:1217] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.391821 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-ee56790b88674a68962bb5866affcd4f received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:41.392275 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-ee56790b88674a68962bb5866affcd4f on tablet ee56790b88674a68962bb5866affcd4f with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:41.424995 12077 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:41.452666 11860 raft_consensus.cc:1217] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.470235 12077 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.471424 12077 tablet_bootstrap.cc:492] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:41.472360 12077 ts_tablet_manager.cc:1403] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.009s
I20260709 12:09:41.478996 12077 raft_consensus.cc:359] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.480182 12077 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:41.481048 12077 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:41.486825 12077 ts_tablet_manager.cc:1434] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:09:41.490617 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-f9943fa4bd634a79a891fa52086a527a received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:41.491068 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-f9943fa4bd634a79a891fa52086a527a on tablet f9943fa4bd634a79a891fa52086a527a with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:41.647611 11860 raft_consensus.cc:1217] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.799666 11860 raft_consensus.cc:1217] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.863765 12081 raft_consensus.cc:1064] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:41.872202 12081 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:41.973326 11292 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.973964 11860 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.975935 12032 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.978331 12032 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.985793 11216 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.996781 12032 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.000311 12079 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.018313 11860 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.051637 11974 raft_consensus.cc:1064] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:42.061256 11039 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:42.063931 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:42.064481 11291 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.081657 11974 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:42.090241 11216 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:09:42.095463 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 70505.1us
I20260709 12:09:42.122278 11859 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.125161 12007 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.135147 11135 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.139570 11974 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.146757 11898 raft_consensus.cc:1064] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:42.148660 11212 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.153792 12007 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.167351 12090 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.160907 11898 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:42.169097 11859 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.180588 11215 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.198618 11042 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.201138 11859 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.202986 12083 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.218428 11135 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.237377 11292 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:42.243602 11291 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.245213 12083 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.254141 11860 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.257716 12088 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.269925 12088 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.271806 11860 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:09:42.302907 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62154.3us
I20260709 12:09:42.309672 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b5563d41fc84c36a8d7eafa0e6a4968 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.318903 11038 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.330339 11141 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.345638 11135 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.348045 12088 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.350363 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b5563d41fc84c36a8d7eafa0e6a4968 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:42.353294 12083 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.355290 11980 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.356058 11859 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.363445 11135 raft_consensus.cc:2955] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.386250 11038 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.388278 11141 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.419330 12058 raft_consensus.cc:1064] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:42.427135 11290 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.496239 12103 tablet_replica.cc:333] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:42.506400 12103 raft_consensus.cc:2243] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.507285 12103 raft_consensus.cc:2272] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.507890 12058 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:09:42.502163 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 89600.4us
I20260709 12:09:42.543816 12103 ts_tablet_manager.cc:1916] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.551513 11859 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.552611 11290 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.555946 12105 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.561441 11135 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:42.564576 11141 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.576375 11860 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.579581 12081 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.588421 12032 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.590698 11860 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.580407 12105 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.580839 12103 ts_tablet_manager.cc:1929] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.594928 12103 log.cc:1199] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/5b5563d41fc84c36a8d7eafa0e6a4968
I20260709 12:09:42.607679 11028 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14c3c7c84ef94275814f49349db79a72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.610651 12105 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.613857 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 5b5563d41fc84c36a8d7eafa0e6a4968 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:42.617959 11038 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.631206 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 14c3c7c84ef94275814f49349db79a72 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:42.632695 11219 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.637609 12032 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.656199 11219 raft_consensus.cc:2955] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.659088 12110 tablet_replica.cc:333] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:42.660219 12110 raft_consensus.cc:2243] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.660971 12110 raft_consensus.cc:2272] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.673740 12110 ts_tablet_manager.cc:1916] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.707628 12107 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.707662 12110 ts_tablet_manager.cc:1929] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:42.722412 12110 log.cc:1199] T 14c3c7c84ef94275814f49349db79a72 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/14c3c7c84ef94275814f49349db79a72
I20260709 12:09:42.722070 11859 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.725364 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 14c3c7c84ef94275814f49349db79a72 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:42.708352 11141 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.731019 11291 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.740695 11042 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.765982 11216 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:42.776189 11290 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.777767 11898 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.782644 11859 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.784607 12105 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.786731 12083 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.812965 11212 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:42.825404 11861 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.826877 11898 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.833911 12058 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.840855 11860 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.856091 11141 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.857622 11898 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:42.845340 11290 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.865954 11141 raft_consensus.cc:2955] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.871387 11859 raft_consensus.cc:2955] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.873767 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9943fa4bd634a79a891fa52086a527a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.882834 11039 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:42.890244 11040 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:42.910286 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee56790b88674a68962bb5866affcd4f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.931910 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet f9943fa4bd634a79a891fa52086a527a with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:42.944391 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet ee56790b88674a68962bb5866affcd4f with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:42.945693 12110 tablet_replica.cc:333] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:42.946755 12110 raft_consensus.cc:2243] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:42.947520 12110 raft_consensus.cc:2272] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:42.960095 12110 ts_tablet_manager.cc:1916] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:42.991734 12113 tablet_replica.cc:333] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:42.999145 12110 ts_tablet_manager.cc:1929] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.001129 12110 log.cc:1199] T ee56790b88674a68962bb5866affcd4f P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/ee56790b88674a68962bb5866affcd4f
I20260709 12:09:43.002746 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet ee56790b88674a68962bb5866affcd4f (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:43.000352 12113 raft_consensus.cc:2243] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.006477 12113 raft_consensus.cc:2272] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.013805 12113 ts_tablet_manager.cc:1916] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.034374 12113 ts_tablet_manager.cc:1929] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.034871 12113 log.cc:1199] T f9943fa4bd634a79a891fa52086a527a P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/f9943fa4bd634a79a891fa52086a527a
I20260709 12:09:43.036628 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet f9943fa4bd634a79a891fa52086a527a (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:44.023321 11212 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.031622 11291 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.031757 11182 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a24a63c03ef4eb980303acb738b9641. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.033970 12115 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:44.034621 11144 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.037159 12105 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.045796 12105 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.047488 11144 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.052481 11290 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.064404 11291 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.066376 11039 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.076927 11256 consensus_peers.cc:597] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a38aa6d0e35417db86aadc82bb36b04. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.078567 11144 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.079267 11219 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.080470 12088 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.081759 11974 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.117985 12088 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.120462 11219 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.123010 11141 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.136392 11144 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.140080 11040 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.157220 11291 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.158182 11107 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b1a0c01c80c45d5a5e2a78cec27d0b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.159840 12114 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.160487 11219 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.162653 12032 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.172516 12032 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.174469 11291 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.176519 11219 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.184671 11290 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.189548 11040 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.209221 11256 consensus_peers.cc:597] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bea72104a4f4494b28f5e58c9ce7e41. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.214145 11144 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.215525 12088 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:44.223528 11219 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.225548 12088 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.230934 12128 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.236433 11219 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.238703 11141 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.258136 11038 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:44.532096 12137 ts_tablet_manager.cc:933] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:44.536885 12137 tablet_copy_client.cc:323] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:44.538641 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 7a24a63c03ef4eb980303acb738b9641 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:44.539315 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 7a24a63c03ef4eb980303acb738b9641 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-7a24a63c03ef4eb980303acb738b9641
I20260709 12:09:44.548916 11229 tablet_copy_source_session.cc:215] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.551622 12139 ts_tablet_manager.cc:933] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:44.552776 12137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a24a63c03ef4eb980303acb738b9641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.556514 12139 tablet_copy_client.cc:323] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:44.558550 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 9a38aa6d0e35417db86aadc82bb36b04 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:44.559135 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 9a38aa6d0e35417db86aadc82bb36b04 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-9a38aa6d0e35417db86aadc82bb36b04
I20260709 12:09:44.566517 11303 tablet_copy_source_session.cc:215] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.569989 12139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a38aa6d0e35417db86aadc82bb36b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.570562 12137 tablet_copy_client.cc:806] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.571491 12137 tablet_copy_client.cc:670] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.581924 12137 tablet_copy_client.cc:538] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.595185 12137 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:44.631179 12139 tablet_copy_client.cc:806] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.631915 12139 tablet_copy_client.cc:670] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.634280 12137 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.635385 12137 tablet_bootstrap.cc:492] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:44.636137 12137 ts_tablet_manager.cc:1403] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.017s
I20260709 12:09:44.638664 12139 tablet_copy_client.cc:538] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.640508 12137 raft_consensus.cc:359] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.641623 12137 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:44.642364 12137 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.657254 12137 ts_tablet_manager.cc:1434] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:09:44.666592 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-7a24a63c03ef4eb980303acb738b9641 received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:44.667128 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-7a24a63c03ef4eb980303acb738b9641 on tablet 7a24a63c03ef4eb980303acb738b9641 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:44.667320 12145 ts_tablet_manager.cc:933] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:44.670162 12142 ts_tablet_manager.cc:933] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:44.678030 12145 tablet_copy_client.cc:323] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.129:43503
I20260709 12:09:44.680727 11154 tablet_copy_service.cc:140] P 018d40ceb45d4447aa293f4c1d929bb8: Received BeginTabletCopySession request for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:40324)
I20260709 12:09:44.681473 11154 tablet_copy_service.cc:161] P 018d40ceb45d4447aa293f4c1d929bb8: Beginning new tablet copy session on tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:40324: session id = 2b4f4725b82b481ab53f0717a429e94a-0b1a0c01c80c45d5a5e2a78cec27d0b7
I20260709 12:09:44.682698 12139 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:44.693907 11154 tablet_copy_source_session.cc:215] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.696224 12142 tablet_copy_client.cc:323] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:44.698426 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 7bea72104a4f4494b28f5e58c9ce7e41 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:44.699205 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 7bea72104a4f4494b28f5e58c9ce7e41 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-7bea72104a4f4494b28f5e58c9ce7e41
I20260709 12:09:44.717803 11303 tablet_copy_source_session.cc:215] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.721302 12142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea72104a4f4494b28f5e58c9ce7e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.722676 12145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.743271 12142 tablet_copy_client.cc:806] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.746359 12139 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.747702 12139 tablet_bootstrap.cc:492] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:44.748407 12139 ts_tablet_manager.cc:1403] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.007s
I20260709 12:09:44.744001 12142 tablet_copy_client.cc:670] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.791072 12142 tablet_copy_client.cc:538] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.751948 12139 raft_consensus.cc:359] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.815137 12139 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:44.815985 12139 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.819427 12139 ts_tablet_manager.cc:1434] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.006s
I20260709 12:09:44.824357 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-9a38aa6d0e35417db86aadc82bb36b04 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:44.824812 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-9a38aa6d0e35417db86aadc82bb36b04 on tablet 9a38aa6d0e35417db86aadc82bb36b04 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:44.829615 12142 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:44.832762 12145 tablet_copy_client.cc:806] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.833907 12145 tablet_copy_client.cc:670] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.840536 12145 tablet_copy_client.cc:538] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.855749 12145 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:44.862684 12142 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.863660 12142 tablet_bootstrap.cc:492] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:44.864370 12142 ts_tablet_manager.cc:1403] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.006s
I20260709 12:09:44.868723 12142 raft_consensus.cc:359] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.878007 12142 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:44.878810 12142 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.885854 12142 ts_tablet_manager.cc:1434] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:09:44.889115 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-7bea72104a4f4494b28f5e58c9ce7e41 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:44.889530 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-7bea72104a4f4494b28f5e58c9ce7e41 on tablet 7bea72104a4f4494b28f5e58c9ce7e41 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:44.905431 12145 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.906355 12145 tablet_bootstrap.cc:492] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:44.906998 12145 ts_tablet_manager.cc:1403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.018s
I20260709 12:09:44.909605 12145 raft_consensus.cc:359] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.910243 12145 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:44.910795 12145 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:44.913215 12145 ts_tablet_manager.cc:1434] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:09:44.915843 11154 tablet_copy_service.cc:342] P 018d40ceb45d4447aa293f4c1d929bb8: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-0b1a0c01c80c45d5a5e2a78cec27d0b7 received from {username='slave'} at 127.0.0.1:40324
I20260709 12:09:44.916311 11154 tablet_copy_service.cc:434] P 018d40ceb45d4447aa293f4c1d929bb8: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-0b1a0c01c80c45d5a5e2a78cec27d0b7 on tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:45.004267 11859 raft_consensus.cc:1217] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.055749 11859 raft_consensus.cc:1217] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.167384 11859 raft_consensus.cc:1217] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.220072 11859 raft_consensus.cc:1217] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.401055 12115 raft_consensus.cc:1064] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:45.403764 12115 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.411813 11859 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.413498 12146 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.417588 11144 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.421545 11292 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.422734 12146 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.425613 12120 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.455420 11292 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.453305 12146 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.478993 11859 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.482075 11141 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.485848 11040 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.539649 11216 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.545266 11141 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.545403 11859 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.547801 12155 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.551265 12115 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.559288 12155 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.564527 11859 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.573021 11141 raft_consensus.cc:2955] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.576942 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a24a63c03ef4eb980303acb738b9641 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:45.580576 11038 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.606313 12130 raft_consensus.cc:1064] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:45.609184 12130 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.615440 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a24a63c03ef4eb980303acb738b9641 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:45.645254 11859 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.647111 12114 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.647464 12162 tablet_replica.cc:333] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:45.647343 11292 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.649104 12032 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.657788 12144 raft_consensus.cc:1064] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:45.648646 12162 raft_consensus.cc:2243] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:45.660861 12144 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.664809 12162 raft_consensus.cc:2272] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:45.673870 12162 ts_tablet_manager.cc:1916] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:45.678706 11216 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.680107 12114 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.695957 11212 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.696597 11860 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.701858 12130 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.704408 11212 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.703435 11144 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.707379 12088 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.713971 12128 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.719310 12144 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.729842 11292 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.747517 12168 raft_consensus.cc:1064] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:45.756986 11038 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.750422 12168 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.782867 12171 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.801182 11141 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.808354 11219 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.829862 11042 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.844092 11859 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.856444 12162 ts_tablet_manager.cc:1929] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:45.857128 12162 log.cc:1199] T 7a24a63c03ef4eb980303acb738b9641 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/7a24a63c03ef4eb980303acb738b9641
I20260709 12:09:45.858748 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 7a24a63c03ef4eb980303acb738b9641 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:45.863019 11861 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.864816 11135 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.864593 12144 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.868083 12128 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.875312 11212 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.878816 12144 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.901927 11135 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.914626 11860 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.917591 11292 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:45.918062 12032 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.928146 12114 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:45.913872 12144 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.919167 11860 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.924592 11219 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.961519 12114 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.970518 11859 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.977984 11861 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:45.980916 11292 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:45.988965 11042 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.003150 11219 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.005301 12168 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:45.982098 11135 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.020951 12088 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.025849 11219 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.032969 11290 raft_consensus.cc:2955] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.039492 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bea72104a4f4494b28f5e58c9ce7e41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.047448 11042 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.061425 11038 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:46.065557 11292 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:46.071838 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:46.079123 11212 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.081514 12171 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.082763 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bea72104a4f4494b28f5e58c9ce7e41 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:46.084331 11028 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.090385 12168 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.092669 11859 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.093102 11212 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.108860 11857 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.112564 12144 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.112475 12128 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:46.117332 11857 raft_consensus.cc:2955] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.124665 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a38aa6d0e35417db86aadc82bb36b04 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.136365 11861 raft_consensus.cc:2955] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.149688 12178 tablet_replica.cc:333] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:46.154609 12178 raft_consensus.cc:2243] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.153436 12177 tablet_replica.cc:333] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:46.160132 12177 raft_consensus.cc:2243] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.160828 12177 raft_consensus.cc:2272] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.161453 12178 raft_consensus.cc:2272] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.169644 11042 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:46.171932 12177 ts_tablet_manager.cc:1916] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.175108 12178 ts_tablet_manager.cc:1916] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.185635 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a38aa6d0e35417db86aadc82bb36b04 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:46.202615 12177 ts_tablet_manager.cc:1929] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.203297 12177 log.cc:1199] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/0b1a0c01c80c45d5a5e2a78cec27d0b7
I20260709 12:09:46.205295 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 0b1a0c01c80c45d5a5e2a78cec27d0b7 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:46.205585 12178 ts_tablet_manager.cc:1929] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.206063 12178 log.cc:1199] T 7bea72104a4f4494b28f5e58c9ce7e41 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/7bea72104a4f4494b28f5e58c9ce7e41
I20260709 12:09:46.207587 12178 tablet_replica.cc:333] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:46.207477 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 7bea72104a4f4494b28f5e58c9ce7e41 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:46.208568 12178 raft_consensus.cc:2243] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.209328 12178 raft_consensus.cc:2272] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.213461 12178 ts_tablet_manager.cc:1916] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.224438 12178 ts_tablet_manager.cc:1929] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.224840 12178 log.cc:1199] T 9a38aa6d0e35417db86aadc82bb36b04 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/9a38aa6d0e35417db86aadc82bb36b04
I20260709 12:09:46.226788 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 9a38aa6d0e35417db86aadc82bb36b04 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:47.268865 11144 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:09:47.277511 11107 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6250f2432a8a4fbb8c99e0f703ecd269. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.278321 11292 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.278358 11219 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.280597 12185 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.281682 12181 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.293088 12179 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.294736 11290 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.294814 11219 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.313862 11219 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.317554 11040 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:47.345760 11182 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8857ecbbb0c7485d9d6ff255660d2547. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.347239 11290 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.349078 11144 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:47.351238 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44471.2us
I20260709 12:09:47.351701 12146 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.354300 12146 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.372714 12146 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.379695 11135 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.401328 11285 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.412215 11292 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.424175 11219 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:47.424386 11256 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbfeda1095314856b34426f3195f5c23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.421470 11040 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.425832 12171 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.428973 11135 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.430919 12171 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.446733 12171 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.449345 11216 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.466194 11215 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.474529 11038 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.514099 11135 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:47.521364 11182 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d5a128ee9974008ab01b0d55cfbb77e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:47.526036 11290 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.528684 12146 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.532207 11144 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.533888 12146 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:47.565824 12146 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.569619 11144 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.573666 11285 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.589672 11038 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:47.698624 12206 ts_tablet_manager.cc:933] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:47.701172 12206 tablet_copy_client.cc:323] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.129:43503
I20260709 12:09:47.703334 11154 tablet_copy_service.cc:140] P 018d40ceb45d4447aa293f4c1d929bb8: Received BeginTabletCopySession request for tablet 6250f2432a8a4fbb8c99e0f703ecd269 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:40324)
I20260709 12:09:47.704087 11154 tablet_copy_service.cc:161] P 018d40ceb45d4447aa293f4c1d929bb8: Beginning new tablet copy session on tablet 6250f2432a8a4fbb8c99e0f703ecd269 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:40324: session id = 2b4f4725b82b481ab53f0717a429e94a-6250f2432a8a4fbb8c99e0f703ecd269
I20260709 12:09:47.712761 11154 tablet_copy_source_session.cc:215] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.717245 12206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6250f2432a8a4fbb8c99e0f703ecd269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.737371 12206 tablet_copy_client.cc:806] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.738207 12206 tablet_copy_client.cc:670] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.742210 12206 tablet_copy_client.cc:538] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.752874 12206 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:47.784956 12206 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.785831 12206 tablet_bootstrap.cc:492] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:47.786685 12206 ts_tablet_manager.cc:1403] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.016s
I20260709 12:09:47.789659 12206 raft_consensus.cc:359] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.790585 12206 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:47.791307 12206 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.795150 12206 ts_tablet_manager.cc:1434] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:09:47.796676 12210 ts_tablet_manager.cc:933] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:47.796967 11154 tablet_copy_service.cc:342] P 018d40ceb45d4447aa293f4c1d929bb8: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-6250f2432a8a4fbb8c99e0f703ecd269 received from {username='slave'} at 127.0.0.1:40324
I20260709 12:09:47.797576 11154 tablet_copy_service.cc:434] P 018d40ceb45d4447aa293f4c1d929bb8: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-6250f2432a8a4fbb8c99e0f703ecd269 on tablet 6250f2432a8a4fbb8c99e0f703ecd269 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:47.799600 12210 tablet_copy_client.cc:323] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:47.803309 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 8857ecbbb0c7485d9d6ff255660d2547 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:47.803835 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 8857ecbbb0c7485d9d6ff255660d2547 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-8857ecbbb0c7485d9d6ff255660d2547
I20260709 12:09:47.811285 11229 tablet_copy_source_session.cc:215] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.814132 12210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8857ecbbb0c7485d9d6ff255660d2547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.870769 12206 ts_tablet_manager.cc:933] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:47.880077 12210 tablet_copy_client.cc:806] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.880676 12206 tablet_copy_client.cc:323] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:47.880885 12210 tablet_copy_client.cc:670] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.883103 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet cbfeda1095314856b34426f3195f5c23 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:47.883728 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet cbfeda1095314856b34426f3195f5c23 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-cbfeda1095314856b34426f3195f5c23
I20260709 12:09:47.893813 11303 tablet_copy_source_session.cc:215] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:47.897428 12206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfeda1095314856b34426f3195f5c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:47.900179 12210 tablet_copy_client.cc:538] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.916601 12210 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:47.935281 12206 tablet_copy_client.cc:806] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:47.936057 12206 tablet_copy_client.cc:670] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:47.940932 12206 tablet_copy_client.cc:538] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:47.953742 12206 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:47.980216 12206 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.981268 12206 tablet_bootstrap.cc:492] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:47.980216 12210 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:47.982017 12206 ts_tablet_manager.cc:1403] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.010s
I20260709 12:09:47.984143 12210 tablet_bootstrap.cc:492] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:47.984719 12210 ts_tablet_manager.cc:1403] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.015s
I20260709 12:09:47.986239 12206 raft_consensus.cc:359] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.987588 12210 raft_consensus.cc:359] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.988608 12206 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:47.988785 12210 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:47.989498 12210 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.989390 12206 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:47.992468 12210 ts_tablet_manager.cc:1434] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:09:47.994189 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-8857ecbbb0c7485d9d6ff255660d2547 received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:47.994601 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-8857ecbbb0c7485d9d6ff255660d2547 on tablet 8857ecbbb0c7485d9d6ff255660d2547 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:47.997469 12206 ts_tablet_manager.cc:1434] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:48.000358 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-cbfeda1095314856b34426f3195f5c23 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:48.000754 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-cbfeda1095314856b34426f3195f5c23 on tablet cbfeda1095314856b34426f3195f5c23 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:48.130295 12206 ts_tablet_manager.cc:933] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:48.131973 12206 tablet_copy_client.cc:323] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:48.133363 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 8d5a128ee9974008ab01b0d55cfbb77e from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:48.133823 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 8d5a128ee9974008ab01b0d55cfbb77e from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-8d5a128ee9974008ab01b0d55cfbb77e
I20260709 12:09:48.139214 11229 tablet_copy_source_session.cc:215] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.141764 12206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5a128ee9974008ab01b0d55cfbb77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.155395 12206 tablet_copy_client.cc:806] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.155978 12206 tablet_copy_client.cc:670] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.160813 12206 tablet_copy_client.cc:538] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.168855 12206 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:48.192133 12206 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:48.193066 12206 tablet_bootstrap.cc:492] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:48.194267 12206 ts_tablet_manager.cc:1403] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.006s
I20260709 12:09:48.197134 12206 raft_consensus.cc:359] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:48.197937 12206 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:48.198577 12206 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:48.200857 12206 ts_tablet_manager.cc:1434] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:48.202953 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-8d5a128ee9974008ab01b0d55cfbb77e received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:48.203395 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-8d5a128ee9974008ab01b0d55cfbb77e on tablet 8d5a128ee9974008ab01b0d55cfbb77e with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:48.215366 11861 raft_consensus.cc:1217] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.383863 11861 raft_consensus.cc:1217] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.434015 11861 raft_consensus.cc:1217] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.625066 11861 raft_consensus.cc:1217] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:48.719408 12185 raft_consensus.cc:1064] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:48.722023 12185 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:48.729302 11857 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.729429 11290 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.731612 12185 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.732653 12188 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.733186 11216 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.735050 12185 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.766531 12185 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.776762 11216 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.786748 11857 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.800769 11285 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.807140 11040 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.834219 12146 raft_consensus.cc:1064] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:48.837273 12146 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:48.848083 11857 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.849056 11135 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.849942 12146 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.850932 11285 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.851167 12115 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.852762 12197 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.870982 12201 raft_consensus.cc:1064] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:48.873634 12201 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:48.891650 11859 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.894234 11141 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:48.897624 12218 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.896989 12115 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.900233 11861 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.907367 11860 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.909761 12220 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.914204 11290 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.916977 12188 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.926594 12220 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.932914 11040 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.937690 11141 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.945775 11135 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.949705 11215 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.951835 11290 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.955504 11219 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:48.961745 11285 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.967720 11861 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.969089 12115 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:48.969303 12201 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:48.956755 11859 raft_consensus.cc:2955] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.980551 12146 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:48.987165 11861 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.004690 12218 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:09:49.006119 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47625.3us
I20260709 12:09:49.013535 12235 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.020087 11028 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6250f2432a8a4fbb8c99e0f703ecd269 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.023993 11038 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.035560 11135 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.038106 11215 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.047514 12197 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.051988 11141 raft_consensus.cc:2955] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.066008 11144 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.073593 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8857ecbbb0c7485d9d6ff255660d2547 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.076946 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 6250f2432a8a4fbb8c99e0f703ecd269 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:49.081506 11038 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.095132 12242 tablet_replica.cc:333] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:49.096652 12242 raft_consensus.cc:2243] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.097610 12242 raft_consensus.cc:2272] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.104607 12242 ts_tablet_manager.cc:1916] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.096625 11040 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.111651 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 8857ecbbb0c7485d9d6ff255660d2547 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:49.128103 12243 tablet_replica.cc:333] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:49.129434 12243 raft_consensus.cc:2243] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.133484 12243 raft_consensus.cc:2272] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.136385 12242 ts_tablet_manager.cc:1929] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.136984 12242 log.cc:1199] T 6250f2432a8a4fbb8c99e0f703ecd269 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/6250f2432a8a4fbb8c99e0f703ecd269
I20260709 12:09:49.139187 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 6250f2432a8a4fbb8c99e0f703ecd269 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:49.140653 12243 ts_tablet_manager.cc:1916] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.145339 11861 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.158982 12243 ts_tablet_manager.cc:1929] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.159582 12243 log.cc:1199] T 8857ecbbb0c7485d9d6ff255660d2547 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/8857ecbbb0c7485d9d6ff255660d2547
I20260709 12:09:49.162086 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 8857ecbbb0c7485d9d6ff255660d2547 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:49.168704 11290 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:49.180665 11857 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.183300 12146 raft_consensus.cc:1064] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:49.184353 11215 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.187000 12201 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.188827 12201 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.193717 12146 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:49.195624 12218 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.197620 11215 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.198721 11857 raft_consensus.cc:2955] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.210202 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbfeda1095314856b34426f3195f5c23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.218410 11040 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.222754 11857 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.223101 11285 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.224889 12244 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.226562 12146 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.227803 11141 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.229084 12146 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.236102 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet cbfeda1095314856b34426f3195f5c23 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:49.288450 12248 tablet_replica.cc:333] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:49.301247 12115 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.303129 12248 raft_consensus.cc:2243] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.303963 12248 raft_consensus.cc:2272] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.303175 11861 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.316224 12248 ts_tablet_manager.cc:1916] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.322264 11039 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.337126 11290 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.339944 11141 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.370286 12248 ts_tablet_manager.cc:1929] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.375856 12248 log.cc:1199] T cbfeda1095314856b34426f3195f5c23 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/cbfeda1095314856b34426f3195f5c23
I20260709 12:09:49.361582 11215 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:49.386755 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet cbfeda1095314856b34426f3195f5c23 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:49.388314 11861 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.390051 12197 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.391924 11141 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.397939 12244 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.401302 12241 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.403291 11861 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.408349 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d5a128ee9974008ab01b0d55cfbb77e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.418629 11042 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.419634 11141 raft_consensus.cc:2955] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:49.430689 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d5a128ee9974008ab01b0d55cfbb77e with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:49.431746 12243 tablet_replica.cc:333] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:49.432612 12243 raft_consensus.cc:2243] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.433189 12243 raft_consensus.cc:2272] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.436555 12243 ts_tablet_manager.cc:1916] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:49.452456 12243 ts_tablet_manager.cc:1929] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:49.453002 12243 log.cc:1199] T 8d5a128ee9974008ab01b0d55cfbb77e P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/8d5a128ee9974008ab01b0d55cfbb77e
I20260709 12:09:49.455641 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 8d5a128ee9974008ab01b0d55cfbb77e (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:50.496704 11285 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:50.503911 11219 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.504781 11135 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:50.504907 11256 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5275fafd0e7457694ac49b17b3fcfc1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.505405 12252 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.506181 12250 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.515920 12250 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.522212 11219 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.525283 11135 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.530232 11141 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:50.544822 11285 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:50.545825 11107 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84d8da0a42f045c0919f6b93b4a3ca15. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.546201 12224 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.561066 11039 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.573523 11219 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.575874 12224 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.585813 12220 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.589632 11290 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.602258 11219 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.611541 11215 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:50.621960 11141 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.623467 12197 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:50.626377 11182 consensus_peers.cc:597] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fa9c55aa9ba49cc82db376e55f14ecc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.629891 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.632515 11290 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.640117 12197 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.656093 12197 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.663892 11285 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.673693 11141 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.681643 11135 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:50.685781 11042 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:09:50.718895 11107 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8f20890b5ce4b0294cf6746a2a341ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:50.720219 11215 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.722136 11285 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:50.721980 12258 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.723527 12224 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.731848 12258 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.735373 11215 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.744431 11285 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:50.752269 11040 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.052505 12270 ts_tablet_manager.cc:933] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:51.054539 12270 tablet_copy_client.cc:323] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:51.056075 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet a5275fafd0e7457694ac49b17b3fcfc1 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:51.056550 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet a5275fafd0e7457694ac49b17b3fcfc1 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-a5275fafd0e7457694ac49b17b3fcfc1
I20260709 12:09:51.064450 12272 ts_tablet_manager.cc:933] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:51.064532 11303 tablet_copy_source_session.cc:215] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.068480 12272 tablet_copy_client.cc:323] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.129:43503
I20260709 12:09:51.068840 12270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5275fafd0e7457694ac49b17b3fcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.070312 11154 tablet_copy_service.cc:140] P 018d40ceb45d4447aa293f4c1d929bb8: Received BeginTabletCopySession request for tablet 84d8da0a42f045c0919f6b93b4a3ca15 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:40324)
I20260709 12:09:51.070914 11154 tablet_copy_service.cc:161] P 018d40ceb45d4447aa293f4c1d929bb8: Beginning new tablet copy session on tablet 84d8da0a42f045c0919f6b93b4a3ca15 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:40324: session id = 2b4f4725b82b481ab53f0717a429e94a-84d8da0a42f045c0919f6b93b4a3ca15
I20260709 12:09:51.082592 11154 tablet_copy_source_session.cc:215] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.087672 12272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d8da0a42f045c0919f6b93b4a3ca15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.143101 12276 ts_tablet_manager.cc:933] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:51.145207 12274 ts_tablet_manager.cc:933] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:51.150288 12272 tablet_copy_client.cc:806] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.151049 12272 tablet_copy_client.cc:670] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.152257 12270 tablet_copy_client.cc:806] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.152878 12270 tablet_copy_client.cc:670] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.152844 12276 tablet_copy_client.cc:323] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:51.153738 12274 tablet_copy_client.cc:323] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.129:43503
I20260709 12:09:51.155853 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 2fa9c55aa9ba49cc82db376e55f14ecc from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:51.156386 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 2fa9c55aa9ba49cc82db376e55f14ecc from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-2fa9c55aa9ba49cc82db376e55f14ecc
I20260709 12:09:51.156605 12272 tablet_copy_client.cc:538] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.157829 11154 tablet_copy_service.cc:140] P 018d40ceb45d4447aa293f4c1d929bb8: Received BeginTabletCopySession request for tablet e8f20890b5ce4b0294cf6746a2a341ff from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:40324)
I20260709 12:09:51.158375 11154 tablet_copy_service.cc:161] P 018d40ceb45d4447aa293f4c1d929bb8: Beginning new tablet copy session on tablet e8f20890b5ce4b0294cf6746a2a341ff from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:40324: session id = 2b4f4725b82b481ab53f0717a429e94a-e8f20890b5ce4b0294cf6746a2a341ff
I20260709 12:09:51.164774 11229 tablet_copy_source_session.cc:215] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.167148 12272 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:51.173498 11154 tablet_copy_source_session.cc:215] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:51.174825 12276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa9c55aa9ba49cc82db376e55f14ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.186568 12270 tablet_copy_client.cc:538] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.197419 12270 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:51.198917 12274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f20890b5ce4b0294cf6746a2a341ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:51.226703 12274 tablet_copy_client.cc:806] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.227334 12274 tablet_copy_client.cc:670] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.234458 12270 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.236639 12276 tablet_copy_client.cc:806] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:51.238108 12276 tablet_copy_client.cc:670] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:51.238524 12270 tablet_bootstrap.cc:492] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:51.241019 12270 ts_tablet_manager.cc:1403] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.005s
I20260709 12:09:51.243831 12276 tablet_copy_client.cc:538] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.246382 12272 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.247272 12272 tablet_bootstrap.cc:492] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:51.247902 12272 ts_tablet_manager.cc:1403] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.081s	user 0.033s	sys 0.004s
I20260709 12:09:51.249969 12274 tablet_copy_client.cc:538] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:51.250783 12272 raft_consensus.cc:359] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.251672 12272 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:51.252513 12272 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.251055 12270 raft_consensus.cc:359] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.253587 12270 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:51.256033 12270 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.267922 12272 ts_tablet_manager.cc:1434] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:09:51.268309 12274 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:51.270012 11154 tablet_copy_service.cc:342] P 018d40ceb45d4447aa293f4c1d929bb8: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-84d8da0a42f045c0919f6b93b4a3ca15 received from {username='slave'} at 127.0.0.1:40324
I20260709 12:09:51.270471 11154 tablet_copy_service.cc:434] P 018d40ceb45d4447aa293f4c1d929bb8: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-84d8da0a42f045c0919f6b93b4a3ca15 on tablet 84d8da0a42f045c0919f6b93b4a3ca15 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:51.266261 12276 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:51.273437 12270 ts_tablet_manager.cc:1434] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:09:51.275331 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-a5275fafd0e7457694ac49b17b3fcfc1 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:09:51.275787 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-a5275fafd0e7457694ac49b17b3fcfc1 on tablet a5275fafd0e7457694ac49b17b3fcfc1 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:51.323443 12274 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.324527 12274 tablet_bootstrap.cc:492] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:51.325387 12274 ts_tablet_manager.cc:1403] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.016s
I20260709 12:09:51.328965 12276 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:51.329056 12274 raft_consensus.cc:359] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.330173 12276 tablet_bootstrap.cc:492] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:51.330312 12274 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:51.330981 12276 ts_tablet_manager.cc:1403] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.007s
I20260709 12:09:51.331120 12274 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.333916 12274 ts_tablet_manager.cc:1434] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.002s
I20260709 12:09:51.334448 12276 raft_consensus.cc:359] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.335793 11154 tablet_copy_service.cc:342] P 018d40ceb45d4447aa293f4c1d929bb8: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-e8f20890b5ce4b0294cf6746a2a341ff received from {username='slave'} at 127.0.0.1:40324
I20260709 12:09:51.336220 11154 tablet_copy_service.cc:434] P 018d40ceb45d4447aa293f4c1d929bb8: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-e8f20890b5ce4b0294cf6746a2a341ff on tablet e8f20890b5ce4b0294cf6746a2a341ff with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:51.335387 12276 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:51.351254 12276 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:51.356142 12276 ts_tablet_manager.cc:1434] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:09:51.666564 11861 raft_consensus.cc:1217] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.681056 11859 raft_consensus.cc:1217] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.812719 11857 raft_consensus.cc:1217] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:51.819993 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-2fa9c55aa9ba49cc82db376e55f14ecc received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:51.833863 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-2fa9c55aa9ba49cc82db376e55f14ecc on tablet 2fa9c55aa9ba49cc82db376e55f14ecc with peer 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:09:51.937340 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 161238us
W20260709 12:09:51.972682 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 241190us
W20260709 12:09:51.986374 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 104367us
I20260709 12:09:52.008921 12299 raft_consensus.cc:1064] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:52.012499 12299 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.045356 11212 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.051231 11859 raft_consensus.cc:1217] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.058282 12290 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.086380 11861 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.098275 12220 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:52.122535 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 90990.9us
I20260709 12:09:52.135043 12309 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.136744 11212 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.140877 11292 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.159442 12220 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.166102 11040 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.165527 11861 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.187996 11290 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.203557 12302 raft_consensus.cc:1064] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:52.206889 12302 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.217072 11861 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.219084 12294 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.221747 11290 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.225891 12288 raft_consensus.cc:1064] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:52.227967 11135 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.228332 12288 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.230444 12293 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.237119 12302 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:09:52.256968 12311 raft_consensus.cc:1064] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:52.260641 12311 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.301944 12302 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.305581 11861 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.306919 11292 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.307096 12309 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.309520 12309 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.317018 11212 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.327569 11861 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.329754 12304 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:09:52.341473 12297 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.331849 11136 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.334081 11211 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.322407 11290 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.339530 11861 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.351758 12285 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.370348 12285 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:52.466104 11038 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:52.484748 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61195us
I20260709 12:09:52.491439 11137 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:09:52.538861 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08000eabc0 after lost signal to thread 9941
W20260709 12:09:52.540515 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08001330e0 after lost signal to thread 11076
W20260709 12:09:52.542181 11314 debug-util.cc:398] Leaking SignalData structure 0x7b080027b160 after lost signal to thread 11168
W20260709 12:09:52.547148 11314 debug-util.cc:398] Leaking SignalData structure 0x7b0800307880 after lost signal to thread 11243
W20260709 12:09:52.548621 11314 debug-util.cc:398] Leaking SignalData structure 0x7b080033f7e0 after lost signal to thread 11317
W20260709 12:09:52.550141 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6b20 after lost signal to thread 11885
I20260709 12:09:52.551795 11212 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.560906 11861 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.565742 12292 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:09:52.577693 11290 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:09:52.574632 11314 debug-util.cc:398] Leaking SignalData structure 0x7b080031c700 after lost signal to thread 12254
I20260709 12:09:52.569782 12286 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.574601 11136 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.592758 12197 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.601364 12244 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.606639 11859 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.619568 12309 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.625478 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2fa9c55aa9ba49cc82db376e55f14ecc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.631589 11219 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.632215 11216 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.633215 11038 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.637494 11290 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.630452 11292 raft_consensus.cc:2955] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.655273 11857 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.674955 11042 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.700863 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.704986 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fa9c55aa9ba49cc82db376e55f14ecc with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:09:52.698534 11859 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.728972 12331 tablet_replica.cc:333] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:09:52.730055 12331 raft_consensus.cc:2243] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.730839 12331 raft_consensus.cc:2272] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.743040 11290 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.752976 11136 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.753057 12331 ts_tablet_manager.cc:1916] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.758323 11857 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.758563 11143 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.760212 12297 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.763664 12305 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.772691 11216 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.774195 12309 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.775175 12285 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.783092 11143 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.791282 11860 raft_consensus.cc:2955] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.799806  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.803175 12307 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.812227 11216 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.812739 11141 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:52.823279 11028 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84d8da0a42f045c0919f6b93b4a3ca15 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.840281 11290 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.839649 11038 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.841441 11038 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.842619 12288 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.826736 12331 ts_tablet_manager.cc:1929] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.831635 11861 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.853900 12331 log.cc:1199] T 2fa9c55aa9ba49cc82db376e55f14ecc P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/2fa9c55aa9ba49cc82db376e55f14ecc
I20260709 12:09:52.856336 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 2fa9c55aa9ba49cc82db376e55f14ecc (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:52.864002 12307 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.865276 11861 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.853443 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5275fafd0e7457694ac49b17b3fcfc1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.868031 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet a5275fafd0e7457694ac49b17b3fcfc1 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:52.868675 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 84d8da0a42f045c0919f6b93b4a3ca15 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:09:52.871789 12307 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.876518 12288 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.880604 11290 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.885712 11859 raft_consensus.cc:2955] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.900599 12333 tablet_replica.cc:333] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:09:52.901582 12332 tablet_replica.cc:333] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:52.894584 11860 raft_consensus.cc:2955] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:52.914616 12333 raft_consensus.cc:2243] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.915550 12333 raft_consensus.cc:2272] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.921897 12333 ts_tablet_manager.cc:1916] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.923597 11028 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8f20890b5ce4b0294cf6746a2a341ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.934825 11038 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 3 to 4, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 1 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.936623 12332 raft_consensus.cc:2243] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.940066 12332 raft_consensus.cc:2272] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.945956 12332 ts_tablet_manager.cc:1916] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.972827 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet e8f20890b5ce4b0294cf6746a2a341ff with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39586
I20260709 12:09:52.985878 12333 ts_tablet_manager.cc:1929] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.996467 12333 log.cc:1199] T 84d8da0a42f045c0919f6b93b4a3ca15 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/84d8da0a42f045c0919f6b93b4a3ca15
I20260709 12:09:52.999121 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 84d8da0a42f045c0919f6b93b4a3ca15 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:53.012377 12332 ts_tablet_manager.cc:1929] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.013087 12332 log.cc:1199] T a5275fafd0e7457694ac49b17b3fcfc1 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/a5275fafd0e7457694ac49b17b3fcfc1
I20260709 12:09:53.015311 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet a5275fafd0e7457694ac49b17b3fcfc1 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:53.015704 12332 tablet_replica.cc:333] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:09:53.016981 12332 raft_consensus.cc:2243] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.017940 12332 raft_consensus.cc:2272] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.022835 12332 ts_tablet_manager.cc:1916] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.032192 11141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:09:53.033051 11141 raft_consensus.cc:606] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:53.039222 12332 ts_tablet_manager.cc:1929] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.039776 12332 log.cc:1199] T e8f20890b5ce4b0294cf6746a2a341ff P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/e8f20890b5ce4b0294cf6746a2a341ff
I20260709 12:09:53.041627 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet e8f20890b5ce4b0294cf6746a2a341ff (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:09:53.055078 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:09:53.055658 11219 raft_consensus.cc:606] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:53.058656 11141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:09:53.059163 11141 raft_consensus.cc:606] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:53.061954 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:09:53.062624 11219 raft_consensus.cc:606] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:53.082621 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:09:53.083182 11290 raft_consensus.cc:606] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:53.085852 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:09:53.086522 11219 raft_consensus.cc:606] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:53.088124  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:53.089326  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:53.090366  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.102732 12307 raft_consensus.cc:993] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:53.103351 12307 raft_consensus.cc:1081] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:53.105381 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:41370
I20260709 12:09:53.106412 11860 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.106748 11860 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.114010 11860 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.117327 11860 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:53.117828 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:53.118536 11290 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.119796 12292 raft_consensus.cc:993] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:53.120424 12292 raft_consensus.cc:1081] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:53.122524 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:53.123205 11141 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.123484 11141 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:53.125162 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:09:53.125723 11136 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.125366 11141 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.126076 11136 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.127076 11141 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.132083 11136 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.133598 11136 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:53.134543 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:53.134356 11290 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:53.135039 11216 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.135380 11216 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:53.136087 11216 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.136294 11141 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:53.137073 11216 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.137588 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:53.138568 12334 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.139017 12334 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:53.139882 12334 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.144829 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:53.145450 11290 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.154201 11216 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:53.157606 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:53.158942 12309 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.159407 12309 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:53.160269 12309 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.161175 11290 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:53.170657 11040 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.184813 11042 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.241739 12244 raft_consensus.cc:993] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:53.242334 12244 raft_consensus.cc:1081] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:53.244634 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:09:53.245323 11136 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.245805 11136 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.255716 12292 raft_consensus.cc:993] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:53.256279 12244 raft_consensus.cc:1081] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:53.258025 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:09:53.258561 11141 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.258888 11141 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.265437 11141 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.266462 11136 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.267071 11141 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:53.267906 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:53.268455 11290 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.268685 11136 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:53.271538 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:53.272059 11219 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.272339 11219 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:53.272910 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:53.273087 11219 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.273586 11211 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.273936 11211 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:53.274310 11219 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.274765 11211 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.276228 11211 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.282142 11290 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:53.283685 11219 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:53.284246 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:53.285449 12309 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.285638 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:53.285972 12309 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:53.287001 12309 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.288252 11211 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:53.286176 11290 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.291446 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:53.292232 12288 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.292805 12288 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:53.293767 12288 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:53.298524 11290 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:53.318930 11042 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.338327 11042 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.465487 12307 raft_consensus.cc:993] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:53.465984 12307 raft_consensus.cc:1081] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:53.467566 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:41370
I20260709 12:09:53.468111 11860 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.468461 11860 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.476312 11860 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.478912 11860 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:53.479686 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:53.480289 11136 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.480160 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:53.480733 11136 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:53.481649 11290 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.482239 11136 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.484284 11136 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.491690 11290 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:53.492810 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:53.493655 12334 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.494165 12334 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:53.494767 11136 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:53.495020 12334 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.513765 11042 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.521929 12286 raft_consensus.cc:993] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:53.522439 12286 raft_consensus.cc:1081] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:53.524144 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:37100
I20260709 12:09:53.524751 11860 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.525116 11860 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.533823 11860 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.536536 11860 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:53.537187 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:53.537815 11211 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.537739 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:53.539135 11290 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.539441 11290 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:53.540191 11290 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.541250 11290 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.545284 11211 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:53.546744 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:53.547672 12334 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.548131 12334 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:53.548974 11290 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:53.549099 12334 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:53.560462 11042 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.645802 11290 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.647360 12288 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.661243 11211 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.664235 12307 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.697495 11290 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.700155 12334 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.712107 11290 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.727774 11141 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.729898 11211 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.731107 12334 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.735981 12307 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.752218 12307 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.791935 11292 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.805064 12288 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.841005 11216 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:53.842980 12355 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.933919 11211 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.935364 12281 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.946288 11292 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.953315 12281 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.011808 11292 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.013419 12334 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.053495 11141 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.057386 12334 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:54.150260 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53330.5us
I20260709 12:09:54.227828  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.248979 11211 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:09:54.261032 11182 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 557f4814dd3c4d4bb57340a9834ebd32. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.261058 11136 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.261454 11292 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.262861 12244 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.263726 12292 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.286391 12244 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.290189 11291 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.304454 11141 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:09:54.314744 11107 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ce10840f1d143948ae8836765fb74d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.315332 11042 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.316744 11143 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.320926 11216 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.324110 12288 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.324154 11292 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.330304 12288 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.334136 12309 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.345062 11216 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.352355 11291 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.360653 11143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:09:54.361307 11143 raft_consensus.cc:606] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:54.369488 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:09:54.370095 11290 raft_consensus.cc:606] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:54.373284 11143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:09:54.373817 11143 raft_consensus.cc:606] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:54.382720 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:09:54.383299 11216 raft_consensus.cc:606] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:54.384043 12365 raft_consensus.cc:993] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:54.384691 12250 raft_consensus.cc:1081] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:09:54.386582 11143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:09:54.388271 11143 raft_consensus.cc:606] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:54.392210 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:09:54.392802 11216 raft_consensus.cc:606] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:54.394132  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:54.396356  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:54.397686 11143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36066
I20260709 12:09:54.398388 11143 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.398833 11143 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.408159  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.421350 11216 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:54.428736 11040 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 3, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.418830 11143 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.435961 11143 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:54.437790 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:09:54.438558 11859 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.452872 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:54.453814 11291 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.454207 11291 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:54.455312 11291 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.463353 11859 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:09:54.465132 11291 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.470319 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:09:54.472884 11292 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.474476 12197 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.474197 11143 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.477963 12197 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:54.480171 11291 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
W20260709 12:09:54.485419 11182 consensus_peers.cc:597] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9d29c78e55e4b76a84881d4f97aaec8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.480506 12309 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.481688 12307 raft_consensus.cc:993] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.487285 12307 raft_consensus.cc:1081] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.486464 12309 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:54.498147 12288 raft_consensus.cc:993] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.498023 12309 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.498800 12288 raft_consensus.cc:1081] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.501410 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:41370
I20260709 12:09:54.500237 11859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:41370
I20260709 12:09:54.502068 11860 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.502790 11860 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.503249 11859 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.505651 11859 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.522651 12244 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.527098 11859 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.529739 11859 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:54.529676 11144 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.531149 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:54.531714 11292 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.528967 11290 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.538854 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:54.539951 11143 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.540336 11143 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:54.541155 11143 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.542348 11143 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.542800 11038 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.549538 11143 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.551024 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:09:54.551497 11285 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:54.554682 12334 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.555193 12334 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:54.556174 12334 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.557268 11042 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.569578 11292 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.571689 11860 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.579566 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:54.580219 11143 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.580562 11143 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:54.583163 11860 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:54.583712 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:54.584782 11216 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.598151 11215 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.605191 11136 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.604800 11143 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.607523 12250 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.617767 12250 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:54.621387 11256 consensus_peers.cc:597] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b238aa9f5b8450ca03fed7b6a294cf3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.624257 11216 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.626046 12244 raft_consensus.cc:993] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.622284 11143 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.628432 12292 raft_consensus.cc:1081] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.630980 11859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:37092
I20260709 12:09:54.631706 11859 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.632114 11859 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.636011 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:54.636991 12334 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.637861 12334 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:54.639101 12334 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.652447 11859 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.657604 11143 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.658699 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:54.659646 11136 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.662371 11859 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:54.663513 11038 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.658675 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:54.669308 12244 raft_consensus.cc:993] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.672610 12244 raft_consensus.cc:1081] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.673025 11216 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.673367 11216 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:54.670845 12365 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.674052 11216 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.674289 11859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:37092
I20260709 12:09:54.675148 11859 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.675431 11216 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.675726 11859 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.680289 11215 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.682545 11216 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.683848 11859 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.696696 11859 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:54.697041 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:54.699131 11219 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.699563 11219 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:54.700325 11219 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.701889 11219 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.710034 11144 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:09:54.712843 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:54.714306 12334 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.715026 12334 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:54.715951 12334 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.713984 11219 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.719059 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:54.720132 12363 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.720677 12363 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:54.721848 12363 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.727682 11040 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 2, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 1 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.737478 11136 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.797959 11038 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:54.811640 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46749.2us
I20260709 12:09:54.817621 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:54.818305 11292 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.802331 11038 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.831745 11038 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.835609 11292 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.847592 12391 ts_tablet_manager.cc:933] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:54.867187 12288 raft_consensus.cc:993] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.867743 12288 raft_consensus.cc:1081] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:09:54.870051 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:41370
I20260709 12:09:54.870726 11860 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.871088 11860 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.874747 12391 tablet_copy_client.cc:323] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:54.877923 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 557f4814dd3c4d4bb57340a9834ebd32 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:54.878153 11860 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.878751 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 557f4814dd3c4d4bb57340a9834ebd32 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-557f4814dd3c4d4bb57340a9834ebd32
I20260709 12:09:54.880306 11860 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:54.886312 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:54.886900 11211 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.887377 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:54.887936 11144 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.888190 11144 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:54.888864 11144 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.890009 11144 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.896190 11144 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.898073 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:09:54.899232 12334 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.899853 12334 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:09:54.900758 12334 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:54.904541 11211 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:54.917717 11229 tablet_copy_source_session.cc:215] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:54.919909 12393 ts_tablet_manager.cc:933] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:54.923422 12394 ts_tablet_manager.cc:933] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:54.927363 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 557f4814dd3c4d4bb57340a9834ebd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:54.925520 12393 tablet_copy_client.cc:323] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:09:54.931146 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet d9d29c78e55e4b76a84881d4f97aaec8 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:09:54.931694 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet d9d29c78e55e4b76a84881d4f97aaec8 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-d9d29c78e55e4b76a84881d4f97aaec8
I20260709 12:09:54.931948 11038 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.940941 11229 tablet_copy_source_session.cc:215] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:54.947718 12393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d29c78e55e4b76a84881d4f97aaec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:54.955240 12394 tablet_copy_client.cc:323] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.129:43503
I20260709 12:09:54.963587 11154 tablet_copy_service.cc:140] P 018d40ceb45d4447aa293f4c1d929bb8: Received BeginTabletCopySession request for tablet 8ce10840f1d143948ae8836765fb74d1 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:40324)
I20260709 12:09:54.964141 11154 tablet_copy_service.cc:161] P 018d40ceb45d4447aa293f4c1d929bb8: Beginning new tablet copy session on tablet 8ce10840f1d143948ae8836765fb74d1 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:40324: session id = 2b4f4725b82b481ab53f0717a429e94a-8ce10840f1d143948ae8836765fb74d1
I20260709 12:09:54.972198 11154 tablet_copy_source_session.cc:215] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:54.977377 12394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce10840f1d143948ae8836765fb74d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:54.979342 11859 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.987102 12309 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.311522 11290 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.336840 12393 tablet_copy_client.cc:806] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.337528 12393 tablet_copy_client.cc:670] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.338747 11216 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.360370 12363 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:09:55.356833 12307 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:09:55.412672 12394 tablet_copy_client.cc:806] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.420331 12394 tablet_copy_client.cc:670] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.423218 12393 tablet_copy_client.cc:538] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:55.429147 12398 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:09:55.436014 12391 tablet_copy_client.cc:806] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.436640 12391 tablet_copy_client.cc:670] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
W20260709 12:09:55.466701 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50814.3us
W20260709 12:09:55.474387 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85086.8us
I20260709 12:09:55.483557  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.526723 11289 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.531124 11211 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.533017 12417 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.534250 11289 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.543733 12360 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.545290 12363 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:09:55.556510 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88206.9us
I20260709 12:09:55.604887 12391 tablet_copy_client.cc:538] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.631482 11216 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.652314 11216 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.652511 12334 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.654609 12393 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:55.658562 11285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:09:55.659289 11285 raft_consensus.cc:606] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:55.663738 12334 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.664222 12391 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:55.665843 11211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:09:55.666422 11211 raft_consensus.cc:606] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:09:55.668496 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 268664us
I20260709 12:09:55.759687 11143 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.766129 11136 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.825376 11137 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.827389 11140 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.847638 12426 ts_tablet_manager.cc:933] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:55.850229 12417 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:09:55.889048 12394 tablet_copy_client.cc:538] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.866575 12360 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:09:55.866593 12363 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 12:09:56.004549 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 126865us
I20260709 12:09:56.017376 11291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:09:56.018402 11291 raft_consensus.cc:606] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:09:56.114645 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46596.9us
W20260709 12:09:56.128173 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56229.2us
W20260709 12:09:56.176765 12427 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:09:56.297658 12430 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:09:56.408334 12407 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:56.409229 12407 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:56.412950 12407 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:09:56.452000 11183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.012s	sys 0.021s
W20260709 12:09:56.472240 11183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.013s	sys 0.021s
W20260709 12:09:56.459401 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.019s
I20260709 12:09:56.473002  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:56.475772 12436 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:09:56.476023 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.019s
W20260709 12:09:56.476481 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.002s	sys 0.012s
W20260709 12:09:56.476811 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.002s	sys 0.012s
I20260709 12:09:56.476377 12436 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:56.477067 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 623382us
W20260709 12:09:56.476262 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 360192us
W20260709 12:09:56.475970 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.008s
W20260709 12:09:56.481375 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.003s	sys 0.008s
I20260709 12:09:56.471575 12391 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:56.491441 12436 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:56.492673 12391 tablet_bootstrap.cc:492] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:56.493508 12391 ts_tablet_manager.cc:1403] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.830s	user 0.045s	sys 0.062s
I20260709 12:09:56.475811 12394 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:09:56.539177 12431 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:09:56.541939 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:56.604569 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60525us
W20260709 12:09:56.656754 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51133.4us
W20260709 12:09:56.709940 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52247.3us
W20260709 12:09:56.723737 11292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.039s	sys 0.060s
W20260709 12:09:56.727283 11292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.039s	sys 0.061s
I20260709 12:09:56.732152 12391 raft_consensus.cc:359] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:09:56.736774 12421 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.007s	sys 0.022s
I20260709 12:09:56.748980 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:56.860080 11291 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:56.726737 12414 raft_consensus.cc:993] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:09:56.811844 12391 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
W20260709 12:09:56.874401 12421 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.008s	sys 0.023s
W20260709 12:09:56.885751 12393 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:09:56.898119 12388 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.003259 12437 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.028744 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1064) took 1341 ms. Trace:
W20260709 12:09:57.037194 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 325920us
I20260709 12:09:57.068965 12435 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.070111 12435 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.074505 12409 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.075528 12409 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.087042 12399 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.088047 12399 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:57.093542 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55314.5us
I20260709 12:09:57.024847 12388 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.105664 12388 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.111136 12390 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.118040 12409 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.117739 12384 raft_consensus.cc:1081] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Signalling peer 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:09:57.092320 12334 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.106444 12388 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.035108 11292 rpcz_store.cc:276] 0709 12:09:55.687577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.749614 (+ 62037us) service_pool.cc:224] Handling call
0709 12:09:55.749996 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:55.750426 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.750458 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:55.984372 (+233914us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:09:55.984902 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:09:56.728599 (+743697us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:56.737984 (+  9385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.738134 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:56.738206 (+    72us) raft_consensus.cc:1685] finished
0709 12:09:56.738227 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.028605 (+290378us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"spinlock_wait_cycles":2558720,"thread_start_us":708149,"threads_started":1,"wal-append.queue_time_us":733464}
I20260709 12:09:57.117944 12368 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.156287 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:57.082922 12437 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.161707 12437 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.128346 12435 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.162355 12437 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.108587 12391 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:57.148936 12334 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.190995 12399 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.163398 12368 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.154148 12388 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.111747 12390 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:57.202651 12390 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:57.204795 12334 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:57.192284 12437 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.210183 12368 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.212497 12437 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.212765 12393 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.217371 12393 tablet_bootstrap.cc:492] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:57.220026 12393 ts_tablet_manager.cc:1403] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 1.566s	user 0.037s	sys 0.011s
I20260709 12:09:57.231506 12451 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.232530 12451 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.277047 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:57.277707 12457 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.280781 12399 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.288215 12450 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.288838 12399 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.292536 12435 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.293358 12388 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:57.295003 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 200289us
I20260709 12:09:57.295281 12461 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.300366 12399 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.293622 12435 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.311622 12334 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.315094 12435 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.313064 12334 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.317745 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:57.318780 12391 ts_tablet_manager.cc:1434] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.825s	user 0.010s	sys 0.007s
W20260709 12:09:57.319314 12391 ts_tablet_manager.cc:1467] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Tablet startup took 825ms
I20260709 12:09:57.289693 12450 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:57.341789 12460 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:09:57.329366 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:57.328552 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:57.342794 12461 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.322166 12435 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.327951 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:57.330456 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:57.374686 12334 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.341440 12388 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.332188 12459 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.355633 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:57.384114 12435 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.332646 12390 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.388130 12390 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:09:57.388829 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 1.25654e+06us
W20260709 12:09:57.319796 12391 ts_tablet_manager.cc:1469] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Trace:
0709 12:09:54.837449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.837614 (+   165us) service_pool.cc:224] Handling call
0709 12:09:54.854641 (+ 17027us) ts_tablet_manager.cc:934] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
0709 12:09:54.926024 (+ 71383us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:54.974463 (+ 48439us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:54.974609 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:55.434253 (+459644us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:55.435035 (+   782us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:55.435592 (+   557us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:55.435685 (+    93us) inbound_call.cc:177] Queueing success response
0709 12:09:55.663809 (+228124us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:09:56.493816 (+830007us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:09:56.729240 (+235424us) tablet_replica.cc:261] Starting instrumentation
0709 12:09:56.730096 (+   856us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":412,"raft.queue_time_us":15933,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"tablet-copy.queue_time_us":9419,"tablet-download-pool.queue_time_us":13127,"tablet-download-pool.run_cpu_time_us":1860,"tablet-download-pool.run_wall_time_us":132680,"thread_start_us":125473,"threads_started":3}
I20260709 12:09:57.325088 12457 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.393451 12334 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.400020 12451 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:57.411273 12450 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.394317 12459 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.419358 12409 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.420320 12409 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.423108 12389 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.424193 12389 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:57.413143 12435 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.415663 12334 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.443179 12462 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.444077 12462 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.413422 12388 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.451198 12457 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.452435 12389 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:57.454686 12462 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.456218 12421 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.470083 12393 raft_consensus.cc:359] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:57.471694 12393 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:57.477797 12334 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.479208 12390 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.482543 12390 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.483366 12390 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.457232 12421 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.493338 12390 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:57.495268 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:57.495549 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:09:57.511149 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64986.3us
I20260709 12:09:57.517707 12416 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.527050 12461 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.518810 12416 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.541321 12416 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.472708 12393 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:09:57.562184 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45467.6us
I20260709 12:09:57.542260 12469 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.564931 12393 ts_tablet_manager.cc:1434] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.344s	user 0.004s	sys 0.009s
I20260709 12:09:57.542402 12388 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.556624 12421 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.582048 12469 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.614328 12469 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.616155 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.635762 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.641405 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.643882 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.644901 11137 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:57.646844 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.649302 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.651964 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.652786 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.657536 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.658157 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.659436 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.662127 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.673035 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.673897 11142 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:57.675266 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.679977 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.680392 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.681731 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.682225 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.690707 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:57.720335 12467 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.721210 12467 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.723966 12467 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:57.724489 12467 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.725206 12467 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.728101 12467 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.734535 12470 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.735350 12470 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.738102 12470 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.774631 12394 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:57.776160 12394 tablet_bootstrap.cc:492] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:09:57.776304 11038 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 245) took 1949 ms. Trace:
I20260709 12:09:57.776719 11038 rpcz_store.cc:276] 0709 12:09:55.826828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.826986 (+   158us) service_pool.cc:224] Handling call
0709 12:09:57.776074 (+1949088us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
I20260709 12:09:57.777323 12394 ts_tablet_manager.cc:1403] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 1.302s	user 0.029s	sys 0.028s
W20260709 12:09:57.784293 11109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.668s	user 0.033s	sys 0.053s
W20260709 12:09:57.784751 11109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.669s	user 0.033s	sys 0.053s
I20260709 12:09:57.797994 12445 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.801012 12438 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.802057 12438 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.805303 12445 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.799959 12402 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.809947 12415 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.812018 12459 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.805874 12469 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.814904 12402 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.816069 12415 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.823607 12469 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:57.825780 12469 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.830976 12438 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.843927 12415 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.830886 12466 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.846148 12466 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:57.866888 12466 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:57.860175 12402 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.869661 12436 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.880110 12436 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.882889 12436 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.887511 12445 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:57.894922 12394 raft_consensus.cc:359] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:57.896107 12394 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:09:57.897734 12394 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:57.902393 12459 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:57.907799 12394 ts_tablet_manager.cc:1434] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.000s
I20260709 12:09:57.910888 12459 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:57.914247 12459 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:09:57.918927 12365 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:57.919641 12365 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.922135 12365 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.924316 12420 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.926823 12445 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:57.927834 12445 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.956458 12445 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:57.984599 12384 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:57.925113 12420 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:57.985639 12384 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.062930 12419 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.067503 12197 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.068104 12453 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.069079 12453 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.068188 12197 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.063719 12419 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.065769 12365 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.077347 12406 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.087854 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:58.088861 12458 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.093648 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:58.098150 12420 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.098904 12420 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.099265 12420 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.099656 12420 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.102100 12406 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.104614 12406 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:09:58.105187 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.009s	sys 0.008s
W20260709 12:09:58.105661 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.009s	sys 0.008s
I20260709 12:09:58.107808 12459 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.108588 12459 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.113058 12244 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.113867 12244 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.116449 12244 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.118703 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.122838 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:58.102141 12426 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.696s	user 0.010s	sys 0.018s
W20260709 12:09:58.125000 12426 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 2.276s	user 0.010s	sys 0.023s
I20260709 12:09:58.125607 12426 tablet_copy_client.cc:323] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:09:58.127749 12419 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.128280 11861 raft_consensus.cc:1217] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:58.129226 12453 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.129866 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.133333 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.135046 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.136372 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.137801 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.141379 11154 tablet_copy_service.cc:342] P 018d40ceb45d4447aa293f4c1d929bb8: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-8ce10840f1d143948ae8836765fb74d1 received from {username='slave'} at 127.0.0.1:40324
I20260709 12:09:58.142064 11154 tablet_copy_service.cc:434] P 018d40ceb45d4447aa293f4c1d929bb8: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-8ce10840f1d143948ae8836765fb74d1 on tablet 8ce10840f1d143948ae8836765fb74d1 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.143307  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:58.144101 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.144910  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.145475 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.149453 12409 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.150104 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.152056 12400 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.152616 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 246) took 2293 ms. Trace:
I20260709 12:09:58.152756 12400 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.153149 11039 rpcz_store.cc:276] 0709 12:09:55.881577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.898302 (+ 16725us) service_pool.cc:224] Handling call
0709 12:09:58.152114 (+2253812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1895651,"reported_tablets":1}
I20260709 12:09:58.138556 12454 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:58.155364 12454 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.157481 12454 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.159332 12437 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.159915 12437 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.162439 12437 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.162986 12437 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.163542 12437 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.165556 12437 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.166014 12437 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.166782 12453 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:09:58.167913 12292 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.168537 12292 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.167619 12453 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.171829 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.172612 12453 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.177042 12244 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.177750 12244 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.178853 12197 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.183362 12400 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.186519 12368 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.187289 12368 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:58.189913 12368 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.191385 12384 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.193253 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.196743 12244 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.200145 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.191753 12389 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.201720 12389 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.202018 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.203225 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.204149 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.200361 11859 raft_consensus.cc:1217] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:58.219563 12400 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.220327 12400 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.221634 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.224516 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.213389 12368 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.200945 11142 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:09:58.227265 12368 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.228199 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.228816 11142 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:58.229080 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.229638 12368 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.222471 12400 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.230191 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.231346 12389 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.213586 12197 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.233353 12437 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:58.235945 12437 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.233517 12197 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.226122 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.237879 12197 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.184077 12365 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.251236 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.229689 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.252754 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.257913 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.258740 12459 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.259246 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.241700 12384 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.260586 12292 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.260924 12384 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.263389 12384 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.267976 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:09:58.271706 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.023s	sys 0.011s
W20260709 12:09:58.272097 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.023s	sys 0.011s
W20260709 12:09:58.272406 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 879828us
I20260709 12:09:58.279302 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.285312 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:09:58.285395 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62248.2us
I20260709 12:09:58.286679 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.288853 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 122) took 2445 ms. Trace:
I20260709 12:09:58.289320 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 240) took 2417 ms. Trace:
I20260709 12:09:58.289423 11040 rpcz_store.cc:276] 0709 12:09:55.842943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.843118 (+   175us) service_pool.cc:224] Handling call
0709 12:09:58.288642 (+2445524us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646947,"reported_tablets":1}
I20260709 12:09:58.289806 11042 rpcz_store.cc:276] 0709 12:09:55.872141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.872356 (+   215us) service_pool.cc:224] Handling call
0709 12:09:58.289109 (+2416753us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2134424,"reported_tablets":1,"spinlock_wait_cycles":429312}
I20260709 12:09:58.289181 12365 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.299152 12244 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.299801 12244 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.307392 12244 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:58.310091 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.330790 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.332463 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:58.339357 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:58.339355 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63334us
I20260709 12:09:58.337154 12409 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.342366 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.342473 12409 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.343231 12409 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.346611 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.348217 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.349418 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.351764 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:58.354216 12292 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:58.354638 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 158480us
I20260709 12:09:58.347332 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.358558 12250 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.362730 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:58.357818 12292 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.371032 12250 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.383289 12250 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.391393 12483 raft_consensus.cc:1064] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:58.373211 12292 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:58.405897 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 100674us
I20260709 12:09:58.380966 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.423038 12484 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.424439 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.425266 12484 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.425815 12483 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.427640 11256 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.435021 12420 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:58.438992 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58139.1us
I20260709 12:09:58.441767 12484 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.443941 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.448490 12409 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.438392 12420 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.439296 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.451478 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.451988 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.452811 12403 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.453358 12486 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:58.457211 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71156.7us
I20260709 12:09:58.453390 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.458540 12409 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.459224 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.461869 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.463716 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.467142 12484 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.475063 12409 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.475981 12409 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.470054 12486 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.469300 12403 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.479866 12403 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.489987 12409 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.482311 12403 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:58.512960 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59631.9us
I20260709 12:09:58.517747 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.519160 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.520210 12414 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.520362 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:09:58.521104 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet 1b238aa9f5b8450ca03fed7b6a294cf3 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-1b238aa9f5b8450ca03fed7b6a294cf3
I20260709 12:09:58.520866 12414 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.515995 12482 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.522727 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.524626 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.525262 11287 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:58.525547 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.525745 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.527016 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.527202 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.527667 11290 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:58.528384 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.528541 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.529862 11290 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.531005 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.531657 11288 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:58.532521 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.533125 11288 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:09:58.533434 12292 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.536882 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.537833 11291 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:58.522559 12482 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.538957 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.539798 12455 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.541148 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.526176 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.593211 11218 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:58.512354 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.593786 12482 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.594314 11286 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
W20260709 12:09:58.580726 11165 debug-util.cc:398] Leaking SignalData structure 0x7b0800120c60 after lost signal to thread 9941
W20260709 12:09:58.596892 11165 debug-util.cc:398] Leaking SignalData structure 0x7b08000c55c0 after lost signal to thread 11076
I20260709 12:09:58.539559 12486 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.583336 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.584455 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.518464 11292 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:58.592087 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.592715 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.586927 12456 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.579444 12292 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.603294 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.602468 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:58.598450 11165 debug-util.cc:398] Leaking SignalData structure 0x7b080028f2a0 after lost signal to thread 11168
I20260709 12:09:58.611313 12486 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.611702 12486 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.612042 12486 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:58.612218 11165 debug-util.cc:398] Leaking SignalData structure 0x7b080030a500 after lost signal to thread 11243
I20260709 12:09:58.612330 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:09:58.614043 11165 debug-util.cc:398] Leaking SignalData structure 0x7b0800366840 after lost signal to thread 11317
I20260709 12:09:58.614526 11856 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.601758 12484 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.615356 12484 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.600054 11137 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.603376 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.620657 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.604661 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.622252 11293 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:58.624215 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.622643 12450 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.600201 12456 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.629204 12403 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.631389 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:58.632489 12388 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.632853 12388 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.633208 12388 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.633147 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.634737 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.637077 12450 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.634308 11216 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:58.624976 12244 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:09:58.600517 12414 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.623106 12455 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.605715 12409 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.645370 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.645812 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.646209 12456 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.648105 12455 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.648473 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.645869 11284 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.652779 11303 tablet_copy_source_session.cc:215] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:58.653232 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.653656 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.654639 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.655831 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.655087 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:58.655243 11165 debug-util.cc:398] Leaking SignalData structure 0x7b0800367120 after lost signal to thread 11885
I20260709 12:09:58.660945 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.663250 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.665750 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.665971 12484 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.668354 12409 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:58.669539 11165 debug-util.cc:398] Leaking SignalData structure 0x7b0800367340 after lost signal to thread 12391
I20260709 12:09:58.666620 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.669904 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.672922 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:09:58.669895 11165 debug-util.cc:398] Leaking SignalData structure 0x7b0800367380 after lost signal to thread 12393
I20260709 12:09:58.675738 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.677243 11215 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.680171 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.682946 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.687472 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.692464 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.692939 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.693650 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.693651 11292 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:58.694375 11216 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:09:58.674403 12456 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.688843 12484 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.687022 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.691996 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.700615 11211 raft_consensus.cc:2410] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:09:58.673791 11137 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:09:58.686643 12412 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.706332 12412 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.690338 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:58.709250 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.709604 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-557f4814dd3c4d4bb57340a9834ebd32 received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:58.709915 11215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:39588
I20260709 12:09:58.710817 11215 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.711150 11215 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.711691 12419 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.712064 12419 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.712409 12419 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.709985 11214 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:09:58.710083 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-557f4814dd3c4d4bb57340a9834ebd32 on tablet 557f4814dd3c4d4bb57340a9834ebd32 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.719000 12426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b238aa9f5b8450ca03fed7b6a294cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:58.719985 12416 raft_consensus.cc:1064] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:09:58.707965 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:58.702111 12439 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:58.723363 12439 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.723698 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.725555 12439 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.705075 12409 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.726555 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.740302 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.741330 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.742421 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.700018 12484 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.744045 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.744566 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.745314 12484 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.746428 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.747902 12412 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.752461 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.759032 11215 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.766007 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:58.731048 12416 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.765020 12389 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:58.769647 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.769464 12389 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:58.771178 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-d9d29c78e55e4b76a84881d4f97aaec8 received from {username='slave'} at 127.0.0.1:44734
I20260709 12:09:58.772122 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-d9d29c78e55e4b76a84881d4f97aaec8 on tablet d9d29c78e55e4b76a84881d4f97aaec8 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:09:58.772497 12389 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:09:58.754065 12409 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.776841 11215 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.708900 12486 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.781006 12409 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:58.784071 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.791249 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.791744 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.779235 12388 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.801613 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.808128 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.808609 12419 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:58.809245 11218 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:09:58.809338 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.810070 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:58.810691 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.806830 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.811468 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.807715 12486 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.809386 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.813560 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.815152 11138 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:58.816318 12388 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.816620 12456 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.817108 12434 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.818956 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.819546 11144 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.829691 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.837816 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.838721 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:09:58.839640 12493 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:09:58.844229 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.844527 11219 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.844385 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:58.845669 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.846102 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.823220 12434 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.847729 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.848028 12434 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.847270 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:09:58.851171 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.856812 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:58.792248 12409 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:58.859062 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:58.832264 12486 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:09:58.876317 11292 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.875654 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:58.877991 11292 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:58.859889 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:58.892336 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:58.849925 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.868367 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:58.908802 11292 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:58.928932 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.929831 11292 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.899035 12419 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:58.937314 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:58.912395 12456 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.926368 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:09:58.967865 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.935434 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 101906us
I20260709 12:09:58.957492 12456 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.981544 11140 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:58.982014 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44804.3us
I20260709 12:09:58.966085 12419 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:58.982849 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:58.977835 12456 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.984040 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:58.986156 12309 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.975415 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.987483 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:58.995493 11856 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.002209 11292 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:58.988961 12499 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.006426 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:58.985759 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.012146 12417 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.012802 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.014328 12417 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.023046 11144 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:09:59.026448 12388 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.027429 12388 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.027850 12388 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.028306 12388 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.987043 12419 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:59.045006 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:59.052217 12499 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:09:59.073841 12499 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.074271 12499 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:59.075208 12499 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:59.080405 12499 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.087023 12453 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:59.090600 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:59.095124 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:59.099586 12419 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.107237 12292 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.107700 12292 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:59.108631 12292 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.112932 11210 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:59.125910 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 138480us
I20260709 12:09:59.126104 12309 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:59.126899 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.127782 12244 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.127638 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:59.128095 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.133143 11861 raft_consensus.cc:1217] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:59.134714 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.133685 12309 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.136042 12244 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:59.098588 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 81972.6us
I20260709 12:09:59.140328 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.143069 12244 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.138372 12503 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.143603 12244 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.143673 12503 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.144163 12244 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.147122 12309 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:59.147192 12498 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.183s	user 0.004s	sys 0.000s
W20260709 12:09:59.141630 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 149864us
I20260709 12:09:59.157147 11289 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:59.157608 12244 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.161530 12456 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:59.162252 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:09:59.163348 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.165468 12244 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.166610 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.167869 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.168708 12504 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.169009 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.169188 12504 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.169667 12504 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.171897 12500 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.172482 12471 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.152086 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:59.174505 12509 raft_consensus.cc:2764] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:09:59.176292 12456 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.144306 12503 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.170168 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.187429 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.172838 12471 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.194273 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.179911 12434 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:09:59.231854 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.213467 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:09:59.212991 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.232810 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:59.236581 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.230079 12471 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.212198 12509 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:59.240435 12309 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:59.242164 11857 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.230135 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:09:59.243343 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 71984.5us
I20260709 12:09:59.237313 12439 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.233510 12483 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:59.260567 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 176333us
I20260709 12:09:59.262018 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:09:59.236076 12450 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.275599 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.276015 12363 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.257797 12502 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.261623 12307 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:09:59.267654 12484 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:59.244963 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56658.9us
I20260709 12:09:59.286119 12244 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.261171 12483 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.278803 12502 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:09:59.299212 12309 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.317018 12244 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:09:59.317929 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56123.5us
W20260709 12:09:59.334226 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.338670 12309 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:59.342950 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 155586us
I20260709 12:09:59.310868 12483 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.271872 12509 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:59.317271 12502 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.351742 12244 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.308372 12307 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:59.364231 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52689.8us
I20260709 12:09:59.364566 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.348313 12506 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:09:59.374311 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67087.7us
I20260709 12:09:59.375744 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.377058 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:59.374670 12505 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:59.379616 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.381407 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.383157 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.390022 12426 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37100 (request call id 389) took 3660 ms. Trace:
I20260709 12:09:59.392256 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.393862 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.394716 12434 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.395799 12307 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.395972 12484 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.395826 12412 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.405231 12505 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.405936 12505 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.406050 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.410355 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.412959 12500 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.412902 12388 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.415350 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.403270 12450 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.419883 12500 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.423924 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.406360 12505 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:09:59.426214 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.427058 12450 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.428923 12450 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.429497 12450 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.430555 12509 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:09:59.432099 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.435672 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:09:59.443892 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 175038us
I20260709 12:09:59.428306 12505 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.407054 12516 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.448907 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:09:59.436046 12504 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:09:59.434847 12511 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:09:59.421031 12513 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:59.529242 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.433717 12307 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.455590 12486 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.435431 12500 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.547708 12307 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:09:59.488418 12517 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.523995 12504 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:09:59.565440 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 120615us
W20260709 12:09:59.568733 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 249398us
I20260709 12:09:59.531514 12513 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.549742 12505 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.575439 12513 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.554320 12307 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.575439 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.554857 12517 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.390551 12426 rpcz_store.cc:276] 0709 12:09:55.729245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.729394 (+   149us) service_pool.cc:224] Handling call
0709 12:09:55.847958 (+118564us) ts_tablet_manager.cc:934] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
0709 12:09:57.483872 (+1635914us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eacaa 00007f982d9eabd2 00007f9835a4f131
0709 12:09:58.717153 (+1233281us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:58.806250 (+ 89097us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:58.806365 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:59.224213 (+417848us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:59.224582 (+   369us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:59.389651 (+165069us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b71a2 00007f98368f8889 00007f9835a29d88 00007f9835af0973 00007f9835aec70f 00007f9835aee2d3 00007f9835b1ff4e 00007f9835b04fdd 00007f9835b04f89
0709 12:09:59.389800 (+   149us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:59.389890 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":251,"spinlock_wait_cycles":20169984,"tablet-copy.queue_time_us":117681,"thread_start_us":2350263,"threads_started":2}
I20260709 12:09:59.584465 12307 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:59.587193 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 193436us
I20260709 12:09:59.573319 12403 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:59.589329 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 140513us
I20260709 12:09:59.560487 12503 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.593206 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.595531 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.595690 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:09:59.584185 12517 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:09:59.598070 12517 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.603608 12521 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.606753 12412 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.610997 12388 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.613628 12503 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.599941 12522 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.624620 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:09:59.627326 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.631012 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.593056 12426 tablet_copy_client.cc:806] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.635599 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.617660 12471 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.636281 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.637084 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:09:59.637619 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.638823 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.648157 12431 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.648488 12389 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.649083 12426 tablet_copy_client.cc:670] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.659562 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.645186 12520 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.634670 12522 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.651095 11138 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.665027 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:59.667850 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.670604 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:59.671527 11291 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:09:59.658929 12412 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.674291 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.675951 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.689487 12450 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:09:59.667977 12528 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.695010 12528 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:59.702744 12292 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.674512 12502 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.704911 12483 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.705696 12502 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.707599 12471 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.697767 11040 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:59.714358 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44585.3us
I20260709 12:09:59.713564 11142 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.721777 11136 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:59.723793 12527 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.724272 12483 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.737838 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:09:59.735777 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66217us
I20260709 12:09:59.740839  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.741616 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.733036 11284 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:59.749428 12414 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.750665 12484 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.751009 12484 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:59.751813 12484 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.752739 12484 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.752942 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.753348 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.754046 12522 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.754436 12517 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:09:59.760123 12517 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.755486 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.756527 12450 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:09:59.764948 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.768963 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.769219 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.771350 11259 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.772055 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.773229 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.775676 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.776826 12524 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.777475 12524 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.745651 12504 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.774937 12520 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:59.765249 12412 consensus_queue.cc:1175] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "018d40ceb45d4447aa293f4c1d929bb8" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:09:59.775012 12388 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:09:59.770555 12522 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.805397 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.807413 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.812542 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.812878 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.793670 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.816572 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.825588 11858 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.825739 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.826952 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.827127 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.828145 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.829082 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.829965 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.830785 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.806727 12389 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:09:59.840423 12389 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.840792 12389 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:09:59.841642 12389 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:09:59.849422 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.851603 12513 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:09:59.878664 12513 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:09:59.853109 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.879781 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.881268 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.882952 11214 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.883111 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.884249 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.884904 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:09:59.864697 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.866863 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.889065 12434 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.828161 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.869194 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:09:59.869632 11857 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:59.891430 12518 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.875584 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:09:59.874325 11856 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:59.893946 12416 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.891368 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.896384 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:09:59.896847 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79895.8us
I20260709 12:09:59.903800 12518 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.904349 12416 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:59.906141 12389 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.911181 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.912519 12515 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.912598 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.913455 12502 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.915693 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.921618 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:09:59.920938 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 149663us
I20260709 12:09:59.923209 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.920861 12518 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.929958 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.930757 12244 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.934461 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.919582 11039 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:09:59.937780 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:09:59.938421 12450 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.939047 12534 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.942652 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.943707 12307 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.944571 12532 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.949268 11287 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.950552 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.952255 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:09:59.952732 11042 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.957427 12426 tablet_copy_client.cc:538] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.963272 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.964731 11259 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.966053 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.939545 12522 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:09:59.966913 12520 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.966977 12414 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.971946 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.969849 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:09:59.981572 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.984441 11215 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.985606 11216 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.985864 11219 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.971151 12484 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.990953 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:09:59.991647 11210 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.967795 12412 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.979409 12416 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.996973 11144 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.996872 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:09:59.964398 12439 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:09:59.983114 12522 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.007212 12525 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.983669 12524 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.012532 11212 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.013988 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.019081 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.020192 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.016717 11285 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:00.027063 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:00.023293 12403 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:10:00.029488 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55787.7us
I20260709 12:10:00.005275 12412 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:00.006276 12416 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:00.008385 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:00.011929 12414 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.025445 12450 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.025943 12521 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.051195 12439 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:10:00.060386 12524 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.060957 12524 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:00.034834 12522 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.062628 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76211.9us
I20260709 12:10:00.037415 12509 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:00.065809 12307 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.066270 12307 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.067313 12307 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:00.068912 12307 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.034283 12453 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.071202 12412 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:00.072929 12412 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.075412 11292 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:00.037689 12416 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.085170 11210 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.063706 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:00.091506 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:00.092476 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:00.083487 12403 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:00.100230 12389 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.100714 12533 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.063608 12515 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.101790 11217 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.102900 11139 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.062130 12524 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.103451 11214 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.110334 11291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:10:00.110806 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:00.116420 11213 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.107566 12403 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.122278 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:00.129348 11291 raft_consensus.cc:606] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:00.137883 12363 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.136534 12525 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.127213 12540 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.143322 12363 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:00.144122 12540 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:00.144719 12363 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:00.145185 12540 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.146569 12540 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.134898 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.151008 12450 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.141188 12416 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.171191 12403 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:00.158988 12518 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:00.181890 12544 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:00.150454 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 123532us
I20260709 12:10:00.183436 11291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:10:00.184031 11291 raft_consensus.cc:606] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:00.191284 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.196619 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:00.201819 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:00.210809 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.217522 11142 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.230291 12426 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:10:00.226011 12509 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:00.208778 12525 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:00.232026 12509 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.232156 12525 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.232481 12509 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.232601 12525 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.233552 12517 raft_consensus.cc:1064] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:10:00.234719 12416 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:00.218369 12453 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.212623 12307 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:00.239504 12519 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:00.246634 12519 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.247870 12519 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.235205 11214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:00.220186 12545 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:10:00.245570 12307 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.216064 12515 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:00.259366 12545 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.266227 12545 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.266286 12515 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.266860 12515 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.277070 12509 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.262012 12307 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.278340 12509 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.229378 12502 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:00.279860 12307 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.267472 11214 raft_consensus.cc:606] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:00.284395 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61012.3us
I20260709 12:10:00.285954 12517 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:00.286826 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 248) took 1049 ms. Trace:
I20260709 12:10:00.293582 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.295529 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:00.298377 12307 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.298696 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:00.297978 12525 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.300774 12525 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.283895 12412 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:00.285991 12502 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.311518 12554 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.312506  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:00.301901 12416 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:00.315184 12412 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.334533 12412 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:00.335529 11143 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.317746  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:00.338791  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.360931 12416 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.361528 12416 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:00.362524 12416 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.364073 12416 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.366683 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:00.367976 12539 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:00.368501 12539 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:00.372208 12545 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.307590 12519 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.375005 12518 raft_consensus.cc:993] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:00.375523 12486 raft_consensus.cc:1081] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:00.379655 11143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:10:00.380244 11143 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.380663 11143 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.380110 12539 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:00.387120 12546 raft_consensus.cc:993] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:10:00.387687 12546 raft_consensus.cc:1081] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Signalling peer 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:10:00.393993 12519 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:00.401655 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.379273 12515 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.404397 12515 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.411689 11217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:39588
I20260709 12:10:00.412446 11217 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.412823 11217 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.314805 12520 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:10:00.418679 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:00.419611 11856 raft_consensus.cc:2393] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:00.430076 12545 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.310467 12502 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:00.319965 12550 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:10:00.441987 12518 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:00.450260 12502 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:00.329766 12524 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.494650 11143 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:00.593479 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 131796us
I20260709 12:10:00.599911 11143 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:00.603296 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87346.1us
I20260709 12:10:00.594379 12554 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:00.598090 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 151271us
W20260709 12:10:00.639851 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.640763 12548 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.662985 12548 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:00.665890 12548 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:00.639451 12554 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:00.670653 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.673084 12554 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:00.287180 11040 rpcz_store.cc:276] 0709 12:09:59.237649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.237803 (+   154us) service_pool.cc:224] Handling call
0709 12:10:00.286766 (+1048963us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:59.997871 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:59.998471 (+   600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:59.998557 (+    86us) write_op.cc:435] Acquired schema lock
0709 12:09:59.998593 (+    36us) tablet.cc:662] Decoding operations
0709 12:09:59.999044 (+   451us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:59.999152 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:59.999181 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:59.999460 (+   279us) tablet.cc:701] Row locks acquired
0709 12:09:59.999515 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:09:59.999680 (+   165us) write_op.cc:270] Start()
0709 12:09:59.999831 (+   151us) write_op.cc:276] Timestamp: P: 1783598999999614 usec, L: 0
0709 12:09:59.999885 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 12:10:00.000620 (+   735us) log.cc:844] Serialized 541 byte log entry
0709 12:10:00.170836 (+170216us) op_driver.cc:464] REPLICATION: finished
0709 12:10:00.208318 (+ 37482us) write_op.cc:301] APPLY: starting
0709 12:10:00.208416 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:00.208547 (+   131us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:00.208672 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:00.212388 (+  3716us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:00.242972 (+ 30584us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:00.246145 (+  3173us) write_op.cc:312] APPLY: finished
0709 12:10:00.246536 (+   391us) log.cc:844] Serialized 23 byte log entry
0709 12:10:00.246782 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.246868 (+    86us) write_op.cc:454] Released schema lock
0709 12:10:00.246925 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:00.248139 (+  1214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.248165 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":7552,"child_traces":[["op",{"apply.queue_time_us":37156,"apply.run_cpu_time_us":3396,"apply.run_wall_time_us":39813,"num_ops":1,"prepare.queue_time_us":173884,"prepare.run_cpu_time_us":20197,"prepare.run_wall_time_us":33234,"raft.queue_time_us":471158,"raft.run_cpu_time_us":23910,"raft.run_wall_time_us":242575,"replication_time_us":166916,"spinlock_wait_cycles":45597568,"thread_start_us":305284,"threads_started":4,"wal-append.queue_time_us":61663}]]}
W20260709 12:10:00.689467 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 373940us
I20260709 12:10:00.699826 11136 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.709580 12389 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:00.710224 12389 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.712366 12389 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:00.722810 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:00.759977 11042 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:00.775111 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.756289 12554 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.844455 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 234577us
I20260709 12:10:00.829191 12518 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:00.879364 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:00.879670 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:00.880127 11291 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:00.895044 11291 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.907048 11290 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:00.875782 12517 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.842769 11217 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:00.918308 12517 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:00.932224 12517 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:00.933151 12532 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.933846 12532 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:00.945320 12502 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.955013 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:00.956300 11217 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:00.956451 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:00.957237 11136 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:00.968277 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:00.974987 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:00.969266 11144 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
W20260709 12:10:00.958268 12519 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.001s
I20260709 12:10:00.995607 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:00.995970 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.008512 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.009294 12412 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.983114 12520 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.009697 12412 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.030859 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.037158 11212 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.030520 12456 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:01.009979 12416 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.010777 12539 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:01.034785 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 381152us
I20260709 12:10:01.034245 11216 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.056036 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:01.057780 11857 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:01.034850 12532 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.065860 12532 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.041102 12412 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.044283 12416 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.052340 12539 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.043879 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.084491 12416 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.091905 11213 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.104411 12519 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:01.105058 12519 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.105471 12426 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:01.107160 12519 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.103762 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:01.108520 11136 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.088857 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.110917 11139 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:01.087440 12539 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.112574 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.116410 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.101745 11287 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.117420 11136 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:01.113122 11291 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:01.117066 11285 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.122172 11285 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:01.126457 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.127148 11292 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.125367 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:01.090054 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61491us
I20260709 12:10:01.131729 11285 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:01.122081 12426 tablet_bootstrap.cc:492] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:10:01.134886 12519 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.153622 12567 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.154068 12519 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:01.154548 12519 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.135021 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.155160 11214 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.155521 11214 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:01.156361 11214 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.157493 11214 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.161517 12416 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.163102 12519 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.166019 12426 ts_tablet_manager.cc:1403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.936s	user 0.025s	sys 0.021s
I20260709 12:10:01.131780 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.176519 11284 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.177392 12556 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.478s	user 0.003s	sys 0.010s
I20260709 12:10:01.178506 11142 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:01.187114 11136 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.147081 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.188316 11213 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.147462 12520 raft_consensus.cc:993] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:10:01.148181 11216 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.189357 12520 raft_consensus.cc:1081] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:10:01.178610 12416 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:01.139460 12486 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:01.190814 12486 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.192911 12486 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:01.193077 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1106) took 1083 ms. Trace:
I20260709 12:10:01.181047 11288 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:01.193578 11287 rpcz_store.cc:276] 0709 12:10:00.109613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.110380 (+   767us) service_pool.cc:224] Handling call
0709 12:10:01.192882 (+1082502us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540020a154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:01.192991 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753702144}
I20260709 12:10:01.194200 12539 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.187026 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:01.195725 11860 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.197706 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:01.200667 11861 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:01.201978 12453 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.202780 11860 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:01.204648 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:01.206939 12426 raft_consensus.cc:359] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:01.207813 12426 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:10:01.143488 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.202265 12539 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:01.170459 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:01.210582 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67188.8us
W20260709 12:10:01.210914 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63984.8us
I20260709 12:10:01.213032 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.213702 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.213724 11290 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:01.216445 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:01.216516 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:01.216976 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.213999 12502 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.223037 12502 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:01.228363 12502 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.229115 11284 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.229357 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.224629 11285 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.227748 12521 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.230647 12521 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:01.231122 12412 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.231602 12521 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.230105 11287 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.223486 12572 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.165247 12519 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.234217 12572 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.234618 12572 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.215266 12416 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.214506 12565 raft_consensus.cc:476] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:01.240612 12416 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:01.232146 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.243955 12572 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.242017 11184 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.248481 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.249615 11212 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.246412 12519 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.246603 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:01.255545 12565 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.265398 12519 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:01.265913 12565 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:01.266453 12519 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.267346 12565 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:01.262827 11287 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:01.265915 12577 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:01.270961 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:01.271840 11854 raft_consensus.cc:2368] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:01.247004 12412 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:01.274648 12416 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.263662 11860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:37100
I20260709 12:10:01.278040 11860 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.278422 11860 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.282693 11213 raft_consensus.cc:2368] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3.
I20260709 12:10:01.291229 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:01.291307 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:01.292040 11144 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.293535 11860 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:01.296448 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47895.9us
I20260709 12:10:01.307183 11144 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:01.309906 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.308354 11110 leader_election.cc:400] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3.
I20260709 12:10:01.311771 11110 leader_election.cc:403] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:01.312970 11860 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.311187 11256 leader_election.cc:400] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:01.313999 11256 leader_election.cc:403] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:01.312477 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.317170 11212 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.319634 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.320134 11285 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.320441 11285 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:01.298477 11214 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.324589 11285 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.329805 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:01.333472 12292 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.335412 11139 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:01.319708 12524 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
W20260709 12:10:01.339310 12584 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:01.340008 11854 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:01.340699 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.341409 11287 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.319192 12520 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.350543 11861 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.350410 12577 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:01.350802 12520 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:01.318758 12486 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.344233 12453 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.345032 12514 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.247720 12426 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:01.316612 12572 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.327570 12532 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:10:01.316730 12558 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3.
I20260709 12:10:01.368745 12453 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.373699 11213 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.346901 12502 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.377503 12502 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.342109 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:01.379738 12524 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.380259 12524 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:01.367918 12486 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:01.381214 12524 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.357395 11212 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:01.382037 12486 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.366952 12514 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:01.387621 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45565.1us
I20260709 12:10:01.386188 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.390758 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.391577 11143 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:01.392978 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.393707 12417 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.395942 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.396137 12417 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.396729 11210 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.400413 12417 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.357074 12539 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:01.405615 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.406334 11139 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:01.402832 11287 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:01.411485 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.412027 11290 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:01.415658 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.416162 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.421169 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.418531 12363 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.422688 12363 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:01.423607 12363 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.425433 11219 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.429387 12426 ts_tablet_manager.cc:1434] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.263s	user 0.005s	sys 0.004s
I20260709 12:10:01.431519 12520 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:01.432804 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.433491 11139 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:01.438243 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.454027 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.462330 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-1b238aa9f5b8450ca03fed7b6a294cf3 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:10:01.470818 11285 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.458811 11142 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:01.427836 12580 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.472703 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-1b238aa9f5b8450ca03fed7b6a294cf3 on tablet 1b238aa9f5b8450ca03fed7b6a294cf3 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:01.473160 11287 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:01.473366 12580 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.473910 12580 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.472110 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.474725 11219 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.476110 12514 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.477006 11259 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:01.477852 12541 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.480000 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.454983 12518 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.483657 11285 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:01.520391 12502 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.521148 12502 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.482317 12546 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.523376 12546 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.516250 12568 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.527215 12568 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.528707 11213 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.532900 11291 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.537500 12502 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.558441 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.558964 12568 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:01.559315 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:01.560335 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.561012 11142 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:01.526247 12546 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:01.572197 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:01.549202 12587 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:01.483031 12518 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.573922 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.575881 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.574515 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.578948 11219 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:01.581751 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.558506 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.597133 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.598014 12521 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.598559 12521 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.598964 12521 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.602836 12516 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:01.577384 12545 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.603420 12516 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.566190 12502 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.605051 12502 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.605808 12516 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:01.607446 12502 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.581776 12563 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:01.608952 12453 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.610850 12521 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.612860 12521 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.614286 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.614902 11212 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.585202 12568 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.616014 12568 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.616456 12568 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.603928 12545 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:01.627197 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:01.622164 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.628218 11219 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.622996 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:01.630834 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.624699 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.581622 12518 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.622133 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.640710 11290 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:01.623242 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.629627 11861 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:01.652019 12558 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.629427 12567 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.637856 12563 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.669817 12563 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.670094 12541 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.666769 12545 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.652235 12539 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.670288 12563 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:01.663239 12588 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.124s	user 0.004s	sys 0.000s
I20260709 12:10:01.662846 12558 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.685385 12558 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.684032 11042 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.671190 12580 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.692339 11038 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.693316 12580 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.664628 12567 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.672688 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.673584 12502 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.642774 12389 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.680887 11212 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.694205 12567 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.694548 11038 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.695992 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:01.698629 11136 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:01.702865 11143 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:01.702629 11214 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.714963 11038 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.706583 11861 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:01.702939 12548 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.730216 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:01.707195 12486 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.682962 12539 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:01.748636 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119321us
I20260709 12:10:01.710459 12389 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.757572 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:01.766405 12578 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:01.755321 12514 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.775177 12514 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.764792 12572 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:01.781742 12389 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:01.708365 12502 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.753876 12486 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:01.762357 12416 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.787055 12416 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.789645 12416 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.766181 12577 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.790932 12577 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:01.791327 12577 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.794723 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.784332 12502 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.797289 11219 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:01.803035 12453 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.803797 12453 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.804217 12557 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.804839 12557 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:01.789932 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:01.807363 11213 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:01.808815 12417 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.809420 12417 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.811007 12456 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.809999 11140 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:01.773908 12558 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:01.823877 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61424.1us
W20260709 12:10:01.821905 12587 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:10:01.840421 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44360.6us
I20260709 12:10:01.823526 12518 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:01.842379 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82328.2us
I20260709 12:10:01.845306 11291 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:01.851083 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.851794 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:01.851176 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.853583 11290 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:01.866750 11291 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.876286 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.877130 11140 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:01.879796 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.882051 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:01.882705 11144 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
W20260709 12:10:01.884117 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 45815.9us
W20260709 12:10:01.889329 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47484.6us
I20260709 12:10:01.892392 12417 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.897413 12514 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:01.899103 12557 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:01.899783 12601 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:10:01.902750 12573 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:01.902859 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.903739 11291 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:01.903563 12573 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.905386 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.905962 12573 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:01.907400 12594 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:01.907428 12431 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.908007 12431 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.908413 12431 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.747726 12548 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.817127 12502 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.925246 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 100263us
I20260709 12:10:01.932451 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.932775 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.933313 11291 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:01.934049 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.944183 11143 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:01.839027 12598 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.952152 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 195928us
I20260709 12:10:01.910313 12541 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:01.948276 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:01.958530 12541 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.959728 11291 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.962165 12541 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:01.963903 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:01.971554 12577 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:01.975836 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:01.976994 11212 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:01.981483 11291 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:01.956092 12609 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.981698 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.938073 12502 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.966292 12416 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.986637 11290 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:01.987205 12610 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:02.015202 11140 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:01.983987 12609 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.992624 12607 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.002709 12416 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.011430 12514 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.956281 12598 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:01.915185 12608 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:01.992924 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:01.966369 11854 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:02.028168 11861 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:01.987859 12563 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.031459 12568 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.036473 12502 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.026872 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:02.028800 12615 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.030128 12518 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.019322 12539 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:02.023427 12577 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:02.029451 12548 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.021416 12609 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.058911 11142 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:02.059473 12612 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.062649 12453 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:02.049876 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 89992.4us
I20260709 12:10:02.040848 12567 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.075377 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:02.076272 11290 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:01.993158 12614 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:10:02.028503 12603 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.056885 12615 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.037807 12416 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.021322 12607 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.052254 12558 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.091403 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.068027 11292 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:02.070847 12563 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.052146 11284 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:02.073380 12612 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:02.075590 11286 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:02.055794 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.080508 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:02.083621 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.084642 11144 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.086133 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:02.038870 12514 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.066967 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:02.093797 11212 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:02.091288 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.094552 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:02.095930 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.072732 12568 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:02.075367 11287 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:02.104147 11291 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:02.105131 11219 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:02.104701 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:02.098297 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:02.107632 11219 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.108381 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:02.108381 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.109174 11144 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:02.112404 12616 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.086824 12615 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.116191 11211 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:02.091606 12607 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.110412 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.118841 11219 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:02.078920 12610 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:02.102846 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:02.088426 12557 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:02.121398 12567 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:02.121729 11218 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:02.123525 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.136546 11219 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:02.113823 12563 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.110271 12558 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.108879 12502 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:02.113729 12520 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.141882 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:02.103984 12577 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:02.144551 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:02.099941 12603 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:02.142781 12558 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.144902 12520 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:02.157121 12412 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:02.159116 12617 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.159197 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.159727 11210 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.163347 11218 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:02.151046 12486 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.112982 12616 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:02.159757 12611 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.117s	user 0.000s	sys 0.002s
I20260709 12:10:02.150695 12502 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:02.157001 12514 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.187309 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:02.162209 12520 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.154163 12548 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:02.162546 12558 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.212770 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:02.217412 11212 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.222965 12616 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.226045 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:02.226444 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.164032 12412 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.168802 12617 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.214385 12486 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:02.235312 12617 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.225291 12565 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.245213 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.245906 11216 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:02.255218 11290 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:02.172608 12612 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:02.241449 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:02.256570 12598 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:02.261840 11856 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 1 LEARNER]: Advancing to term 2
I20260709 12:10:02.241093 12431 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:02.290402 11861 raft_consensus.cc:2368] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3.
I20260709 12:10:02.291739 12431 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.243276 12486 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.251140 12565 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.260547 12575 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.186s
I20260709 12:10:02.327397 11211 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:02.273517 11218 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:02.258507 12502 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.362057 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:02.362607 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:02.363350 11139 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.363777 12603 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:02.364825 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.365588 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:02.389086  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:02.417358 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 86866.8us
I20260709 12:10:02.418931 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:02.339643 12563 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.428278 11212 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:02.447230 12616 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.454387 12616 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.455255 12616 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.438987 12563 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.463352 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.481241 11182 leader_election.cc:400] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3.
I20260709 12:10:02.481782 11182 leader_election.cc:403] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:02.488353 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.470909 12412 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:02.490898 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:02.488309 12532 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.502298 12605 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.506270 11210 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.506320 12565 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.492403 12486 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.518406 11284 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.520336 12610 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.518707 12615 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.512861 12605 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.531680 12605 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.487675 12609 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:02.535856 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 428323us
I20260709 12:10:02.540475 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.556612 12598 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.559141 11258 leader_election.cc:400] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:02.559569 11258 leader_election.cc:403] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:10:02.559391 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 444024us
I20260709 12:10:02.576079 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:02.584997 11292 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.590447 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:02.591975 11144 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.568405 12622 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.536026 12416 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.682164 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.684314 12610 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.684918 12610 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.687515 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:02.722500 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 102406us
I20260709 12:10:02.722954 11140 raft_consensus.cc:2368] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:02.723160 11144 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:02.734822 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:02.736088 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:02.727258 12548 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:02.719148 12615 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.742158 11289 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:02.746323 12607 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.011s
I20260709 12:10:02.735407 12599 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:02.735605 12598 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:02.789768 12604 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.834797 12607 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:02.913800 11139 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.005s
I20260709 12:10:02.917682 12412 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.920099 11856 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.612s	user 0.004s	sys 0.014s
W20260709 12:10:02.920912 12611 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:10:03.009954 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.061s	sys 0.074s
W20260709 12:10:03.010439 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.061s	sys 0.074s
W20260709 12:10:03.010766 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 766123us
W20260709 12:10:03.017728 11290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.014s	sys 0.040s
W20260709 12:10:03.019631 11290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.014s	sys 0.040s
I20260709 12:10:03.022758 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:03.017113 12609 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.024653 11856 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.935055 11139 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:03.029536 11140 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:02.838085 12599 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.838194 12598 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:02.940761 12604 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:03.016489 12416 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:02.914011 12605 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:03.035712 12616 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.001s
W20260709 12:10:03.036813 12453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.017s
I20260709 12:10:03.027139 12572 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.023023 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:03.040028 11138 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:02.984452 12412 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:02.823997 12548 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.050326 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.052475 11292 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.026013 12292 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:10:03.048695 12453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.004s	sys 0.017s
W20260709 12:10:03.050958 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 316261us
I20260709 12:10:03.056741 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.058733 11285 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.060981 12604 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.065117 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.065831 11287 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.068048 12598 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:03.068826 12558 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.842s	user 0.002s	sys 0.019s
I20260709 12:10:03.069252 12558 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.070845 11143 raft_consensus.cc:2368] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:03.077279 11285 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:03.085799 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:03.086510 11215 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.088428 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1226) took 1006 ms. Trace:
I20260709 12:10:03.089715 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:03.084965 11216 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.088798 11143 rpcz_store.cc:276] 0709 12:10:02.082403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.083195 (+   792us) service_pool.cc:224] Handling call
0709 12:10:03.088243 (+1005048us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54003cad54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:03.088374 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220246272}
I20260709 12:10:03.096563 12628 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.096707 12572 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.097133 12628 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.097410 12572 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.098546 12412 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.099143 12412 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:03.099386 12628 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.099519 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:03.099637 12412 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.100492 11217 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.101169 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:03.100505 12572 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.048060 12616 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:03.104442 12532 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.001s
I20260709 12:10:03.105051 12532 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3.
I20260709 12:10:03.103536 11214 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.100076 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:03.104501 11144 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.094125 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:03.108283 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 251) took 1494 ms. Trace:
I20260709 12:10:03.114748 11211 raft_consensus.cc:2368] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:03.119534 11216 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.124678 11219 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:03.111402 12599 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:03.122252 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 391137us
W20260709 12:10:03.106455 12520 consensus_meta.cc:287] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.881s	user 0.016s	sys 0.003s
I20260709 12:10:03.126009 11212 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
W20260709 12:10:03.115792 12608 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.023s	user 0.013s	sys 0.006s
I20260709 12:10:03.121686 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:03.133184 12558 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.137349 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:03.123373 12563 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.003s
W20260709 12:10:03.143965 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 57775.3us
I20260709 12:10:03.121011 11042 rpcz_store.cc:276] 0709 12:10:01.613902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.620770 (+  6868us) service_pool.cc:224] Handling call
0709 12:10:03.108184 (+1487414us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:01.909747 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:01.915188 (+  5441us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:01.915247 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:01.915268 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:01.915621 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:01.915679 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:01.918874 (+  3195us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:01.919130 (+   256us) tablet.cc:701] Row locks acquired
0709 12:10:01.919145 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:10:01.919286 (+   141us) write_op.cc:270] Start()
0709 12:10:01.919395 (+   109us) write_op.cc:276] Timestamp: P: 1783599001919244 usec, L: 0
0709 12:10:01.919413 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:10:01.973500 (+ 54087us) log.cc:844] Serialized 599 byte log entry
0709 12:10:02.466141 (+492641us) op_driver.cc:464] REPLICATION: finished
0709 12:10:02.905946 (+439805us) write_op.cc:301] APPLY: starting
0709 12:10:02.906056 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:02.906192 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:02.906341 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:02.906688 (+   347us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:02.906872 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:02.906920 (+    48us) write_op.cc:312] APPLY: finished
0709 12:10:02.907162 (+   242us) log.cc:844] Serialized 23 byte log entry
0709 12:10:02.907370 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.907462 (+    92us) write_op.cc:454] Released schema lock
0709 12:10:02.907505 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:02.907983 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.908015 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":439475,"apply.run_cpu_time_us":2052,"apply.run_wall_time_us":2052,"num_ops":1,"prepare.queue_time_us":220946,"prepare.run_cpu_time_us":3499,"prepare.run_wall_time_us":64086,"replication_time_us":544943,"thread_start_us":248096,"threads_started":2}]]}
I20260709 12:10:03.148131 12412 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.148818 12640 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:03.149359 12609 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.150808 12640 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.151373 12640 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:03.152040 12599 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.152796 12599 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.153744 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:03.167075 11292 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:03.169509 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.170518 11292 raft_consensus.cc:2368] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3.
I20260709 12:10:03.171432 11215 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:03.171923 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.135612 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:03.135046 12607 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.167534 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:03.178961 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.183190 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:03.184285 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.185024 11285 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.184536 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.185735 11292 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:03.130273 12520 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.141230 12644 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.187726 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:03.194585 11211 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.188015 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.188848 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.173126 12412 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.198503 11292 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:03.142969 12502 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:03.181438 12598 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.147324 12563 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.155032 12642 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:10:03.191294 11218 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:03.194640 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:03.191520 12639 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.152647 12640 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.318359 11038 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 247) took 1708 ms. Trace:
W20260709 12:10:03.343171 11136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1233) took 1201 ms (client timeout 1502 ms). Trace:
I20260709 12:10:03.382764 11140 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:03.348469 11259 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.392699 11259 leader_election.cc:403] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:03.200941 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.214030 11285 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:03.393947 11292 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:03.348770 11211 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
W20260709 12:10:03.394729 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46421.3us
I20260709 12:10:03.396417 11259 leader_election.cc:400] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:03.396721 11259 leader_election.cc:403] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:03.303974 11216 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
W20260709 12:10:03.258267 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 90820.6us
I20260709 12:10:03.366288 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.296344 11287 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:03.288514 12520 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.370353 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.363178 12610 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:03.201232 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63982.1us
I20260709 12:10:03.400532 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:03.324043 12622 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
W20260709 12:10:03.391387 11136 rpcz_store.cc:269] 0709 12:10:02.141456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.141630 (+   174us) service_pool.cc:224] Handling call
0709 12:10:03.342819 (+1201189us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54002e31d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:03.343036 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590974720}
I20260709 12:10:03.378515 11039 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:03.335069 12617 consensus_meta.cc:287] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.099s	user 0.017s	sys 0.008s
W20260709 12:10:03.374923 12635 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.327s	user 0.004s	sys 0.000s
I20260709 12:10:03.200580 12607 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.407630 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.318646 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.448748 11285 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:03.283293 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.254005 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.402701 12417 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:03.291787 12614 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.414438 12502 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.322976 12642 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.332603 12567 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.460058 11214 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:03.318748 12649 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.306164 12605 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:03.484748 12623 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.699s	user 0.010s	sys 0.005s
I20260709 12:10:03.482445 12578 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:03.496490 12641 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.498106 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 1558) took 1050 ms. Trace:
I20260709 12:10:03.403216 12568 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.361289 12548 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.415303 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:03.408530 12639 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.414808 12622 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.308427 12532 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 12:10:03.222635 12412 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.244987 12598 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:03.452068 11854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.001s	sys 0.023s
I20260709 12:10:03.391350 11038 rpcz_store.cc:276] 0709 12:10:01.609953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.634128 (+ 24175us) service_pool.cc:224] Handling call
0709 12:10:03.318283 (+1684155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:01.973988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:01.974838 (+   850us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:01.974886 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:10:01.974917 (+    31us) tablet.cc:662] Decoding operations
0709 12:10:01.975837 (+   920us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:01.980824 (+  4987us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:01.981463 (+   639us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:01.985318 (+  3855us) tablet.cc:701] Row locks acquired
0709 12:10:01.985337 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:01.985443 (+   106us) write_op.cc:270] Start()
0709 12:10:01.985519 (+    76us) write_op.cc:276] Timestamp: P: 1783599001985407 usec, L: 0
0709 12:10:01.985533 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:10:02.051278 (+ 65745us) log.cc:844] Serialized 1312 byte log entry
0709 12:10:02.736080 (+684802us) op_driver.cc:464] REPLICATION: finished
0709 12:10:02.908417 (+172337us) write_op.cc:301] APPLY: starting
0709 12:10:02.908503 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:02.908648 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:02.908767 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:02.909256 (+   489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:02.909434 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:02.909480 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:02.909703 (+   223us) log.cc:844] Serialized 35 byte log entry
0709 12:10:02.909909 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.910027 (+   118us) write_op.cc:454] Released schema lock
0709 12:10:02.910073 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":186536,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":165851,"apply.run_cpu_time_us":2016,"apply.run_wall_time_us":15218,"num_ops":3,"prepare.queue_time_us":220235,"prepare.run_cpu_time_us":4240,"prepare.run_wall_time_us":86934,"replication_time_us":700762,"spinlock_wait_cycles":1811328,"thread_start_us":326781,"threads_started":1}]]}
I20260709 12:10:03.455533 11284 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:10:03.451164 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54841.4us
I20260709 12:10:03.457617 12431 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.484236 12649 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.464847 12614 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.539850 12431 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.412230 12657 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:10:03.543565 12657 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.544023 12657 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:03.518678 12610 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.545068 12657 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.447619 12617 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.503883 11040 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:03.547263 11137 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:03.513886 11138 rpcz_store.cc:276] 0709 12:10:02.447394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.450652 (+  3258us) service_pool.cc:224] Handling call
0709 12:10:03.497862 (+1047210us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540032f0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:03.498035 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266744192}
I20260709 12:10:03.507304 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.548535 12617 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.552794 12598 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.553541 12412 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.553748 12657 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.542239 12649 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.559105 12563 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.542351 12614 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.509352 12641 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:03.509564 12616 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.483126 12567 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:03.514078 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 98885us
I20260709 12:10:03.200045 12608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39586 (request call id 75) took 2047 ms. Trace:
I20260709 12:10:03.458401 12607 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:03.455247 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50884.1us
W20260709 12:10:03.529452 11854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.002s	sys 0.023s
I20260709 12:10:03.470018 12642 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:03.521219 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1144) took 1438 ms. Trace:
I20260709 12:10:03.515215 12578 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.602633 12608 rpcz_store.cc:276] 0709 12:10:01.143918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.144074 (+   156us) service_pool.cc:224] Handling call
0709 12:10:01.191639 (+ 47565us) log.cc:844] Serialized 501 byte log entry
0709 12:10:01.405657 (+214018us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b5400236f20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a50dbe 00007f9830a5b930 00007f9830a5b8d8 00007f9830a5b858 00007f9830a5b813 00007f9830a5aa9c 00007f98369462f6 00007f9836940aa8 00007f9830a977cb 00007f9830a9a2c0
0709 12:10:03.187434 (+1781777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43051,"raft.queue_time_us":52568,"raft.run_cpu_time_us":1475,"raft.run_wall_time_us":68935,"spinlock_wait_cycles":9935616,"thread_start_us":123456,"threads_started":1,"wal-append.queue_time_us":149905,"wal-append.run_cpu_time_us":4015,"wal-append.run_wall_time_us":1066621}
I20260709 12:10:03.330317 12599 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.610941 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.611153 12578 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.611636 11859 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:03.521893 12644 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:03.613088 12644 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.598428 11288 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:03.598662 12639 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.599248 12614 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.625218 12655 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.603348 12607 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:03.614864 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.597574 12610 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:03.631093 12578 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.631434 12610 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.633817 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1146) took 1459 ms. Trace:
I20260709 12:10:03.610144 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.618916 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:03.624787 12614 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.611572 12599 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.625821 12655 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.628062 12616 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.609050 12563 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:03.634204 11291 rpcz_store.cc:276] 0709 12:10:02.173989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.174406 (+   417us) service_pool.cc:224] Handling call
0709 12:10:02.174755 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.175110 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.175139 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.214041 (+ 38902us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.567726 (+353685us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.567770 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.567842 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.630305 (+1062463us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b240020b0e8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2cfb0 00007f98306a3488 00007f98306a3be8 00007f983067b398 00007f983067676a 00007f9830675bb6
0709 12:10:03.633494 (+  3189us) raft_consensus.cc:1685] finished
0709 12:10:03.633517 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.633750 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36073,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7787,"spinlock_wait_cycles":27539200,"thread_start_us":332994,"threads_started":1,"wal-append.queue_time_us":676341}
I20260709 12:10:03.523840 12502 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:03.626096 12642 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.623447 12567 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.627223 12431 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.667402 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.605357 11293 rpcz_store.cc:276] 0709 12:10:02.079378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.079482 (+   104us) service_pool.cc:224] Handling call
0709 12:10:02.079759 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.081579 (+  1820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.081605 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.091671 (+ 10066us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.497890 (+406219us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.497931 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.498003 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.484385 (+986382us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b240020b0e8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2d09d 00007f983065f10e 00007f983067688c 00007f9830675bb6 00007f98306757d8 00007f983067f221
0709 12:10:03.513199 (+ 28814us) raft_consensus.cc:1685] finished
0709 12:10:03.513220 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.517261 (+  4041us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2808,"raft.queue_time_us":1623,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5694,"spinlock_wait_cycles":35150592,"thread_start_us":385596,"threads_started":1,"wal-append.queue_time_us":577886}
I20260709 12:10:03.644488 12639 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.680258 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 1566) took 1141 ms. Trace:
I20260709 12:10:03.683964 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 95) took 1095 ms. Trace:
I20260709 12:10:03.652087 12616 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.684561 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.685998 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:03.675118 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:03.728140 11140 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:03.644842 12565 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.724687 11292 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:03.724707 11210 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:03.726094 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.691915 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.695735 11137 rpcz_store.cc:276] 0709 12:10:02.538412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.538599 (+   187us) service_pool.cc:224] Handling call
0709 12:10:03.680041 (+1141442us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400252bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:03.680194 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313389952}
I20260709 12:10:03.691386 12568 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.653378 12578 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:03.646941 12557 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:03.726631 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.695832 11212 rpcz_store.cc:276] 0709 12:10:02.575594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.575731 (+   137us) service_pool.cc:224] Handling call
0709 12:10:03.671066 (+1095335us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54000122d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:03.671167 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216485760}
I20260709 12:10:03.728070 11144 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:03.693439 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:03.816957 11143 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:03.728746 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.817709 11291 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.731283 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.645450 12599 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.761868 12614 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.762769 11290 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
W20260709 12:10:03.759444 11258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.020s	sys 0.018s
W20260709 12:10:03.827459 11258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.035s	sys 0.024s
W20260709 12:10:03.827857 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 1.10515e+06us
I20260709 12:10:03.829180 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:03.672451 12563 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.695667 12639 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.843006 12639 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.843974 12563 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:03.815016 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:03.850025 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.813349 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.850975 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.741214 12565 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.825659 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.836265 11258 leader_election.cc:400] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.890759 11258 leader_election.cc:403] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:03.891844 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55791.4us
I20260709 12:10:03.809767 12578 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.815208 12557 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.845261 12655 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.898980 11293 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:03.835249 12651 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.852663 12502 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.823891 11292 raft_consensus.cc:1813] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Handling vote request from an unknown peer 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:03.895182 11258 leader_election.cc:400] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:03.903422 11258 leader_election.cc:403] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:03.905728 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.908012 11291 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:03.846192 12567 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.915705 11292 raft_consensus.cc:2410] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:03.916486 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:03.921197 11258 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.926782 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.942751 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:03.949919 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.946916 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9d29c78e55e4b76a84881d4f97aaec8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:03.899787 12648 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:03.921816 12614 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.943881 12655 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.976642 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:03.958941 12661 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:03.962913 12605 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:03.987576 12605 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:03.988632 12557 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:03.988569 12605 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:03.980118 11292 raft_consensus.cc:2955] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:03.927241 12651 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:03.985090 11284 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:03.969887 12431 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:03.998061 11293 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:04.032729 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:03.972750 12614 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.009871 12568 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:04.016223 12616 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.033555 12599 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:03.994285 12655 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.073001 12614 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.010735 12661 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.059319 12558 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.117197 12655 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:04.118551 12665 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:04.080719 12654 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:04.153760 12654 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.156687 12654 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.068938 12616 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:04.114641 12599 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:04.151437 11290 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:10:04.178776 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 232452us
I20260709 12:10:04.148232 12565 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:04.186472 11857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.014s	sys 0.039s
W20260709 12:10:04.186877 11857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.014s	sys 0.039s
I20260709 12:10:04.148703 12558 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:04.199522 11110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.021s
W20260709 12:10:04.211052 11110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.014s	sys 0.021s
I20260709 12:10:04.213716 11284 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.203797 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:04.211417 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 522819us
I20260709 12:10:04.181969 12599 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.190207 12578 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.245679 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.183106 12616 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:04.210222 12532 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:04.253145 12664 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:04.254920 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.255498 11854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 129) took 1661 ms. Trace:
I20260709 12:10:04.255556 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:04.257783 12599 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.258345 12677 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:04.258915 11185 leader_election.cc:400] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3.
I20260709 12:10:04.259001 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:04.259397 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.260247 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.262181 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:04.207825 12604 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.258852 12578 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:04.210371 12608 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.304694 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.261165 12661 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.255564 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:04.348229 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:04.362207 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.322548 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.363986 11143 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:04.352254 11216 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:04.306068 12655 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.359891 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.362524 11144 raft_consensus.cc:2368] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
W20260709 12:10:04.349574 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 90824.2us
I20260709 12:10:04.374385 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.307673 12563 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:04.384403 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.263818 12558 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.322861 11218 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.406355 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.259233 12651 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:04.303550 12532 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:04.428601 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54327.9us
W20260709 12:10:04.358268 12639 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.009s
I20260709 12:10:04.433013 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.483367 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.361785 12614 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:04.487756 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54821.5us
I20260709 12:10:04.492239 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:04.405040 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.494000 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.366600 12610 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.407693 12563 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.494974 12292 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.501163 12292 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:04.480037 12644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.009s	sys 0.015s
I20260709 12:10:04.504148 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:04.496325 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.501653 12292 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.507261 11137 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:04.507503 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.501695 11215 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:04.509974 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:04.358562 12604 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.479269 12679 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.483227 12599 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:04.484681 12558 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:04.366959 12608 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.480070 12502 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:04.522353 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:04.363019 12677 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.367101 12578 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:04.537009 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 333256us
I20260709 12:10:04.491250 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1403) took 1312 ms. Trace:
I20260709 12:10:04.412582 12655 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.503482 12563 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.511639 12678 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.494612 12629 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.555375 12643 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.583514 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.489094 12639 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.593711 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.595556 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.562714 11138 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:04.587980 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.552265 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:04.541152 12616 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.603492 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.511152 12662 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:04.574649 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:04.575685 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.597213 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:04.588665 12673 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
W20260709 12:10:04.583775 12674 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260709 12:10:04.619473 11141 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:04.629602 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:04.521549 12614 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.635108 11213 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:04.635804 12681 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:04.638067 12677 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.638799 12677 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.641717 12655 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.643831 12639 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.596891 12640 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:04.647815 12617 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.648028 12604 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.649237 12532 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.650161 12617 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.702723 12617 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.703670 12532 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.704305 12532 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.651499 12578 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.557161 12502 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.708312 12502 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.654006 11284 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:04.656019 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.710022 11138 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:04.656947 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.522207 12610 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.718598 12610 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.720151 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:04.306116 11854 rpcz_store.cc:276] 0709 12:10:02.593943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.598083 (+  4140us) service_pool.cc:224] Handling call
0709 12:10:02.686880 (+ 88797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.290581 (+603701us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b180004cea0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:03.363431 (+ 72850us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060
0709 12:10:03.618577 (+255146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.622208 (+  3631us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.652266 (+ 30058us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.075105 (+422839us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:04.084400 (+  9295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.140758 (+ 56358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.255181 (+114423us) raft_consensus.cc:1685] finished
0709 12:10:04.255217 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.255402 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42498,"raft.run_cpu_time_us":9037,"raft.run_wall_time_us":95300,"spinlock_wait_cycles":295223424,"thread_start_us":1222351,"threads_started":2,"wal-append.queue_time_us":549479}
I20260709 12:10:04.664569 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.665217 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:04.671675 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:04.677220 12668 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.530s	user 0.004s	sys 0.008s
I20260709 12:10:04.679522 12612 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.602082 12417 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.684756 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:04.686000 12608 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:04.687686 11857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 345) took 1041 ms. Trace:
I20260709 12:10:04.590255 12558 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.691704 12642 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.688344 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 117) took 1170 ms. Trace:
I20260709 12:10:04.716003 12539 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:04.562243 11287 rpcz_store.cc:276] 0709 12:10:03.182078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.453917 (+271839us) service_pool.cc:224] Handling call
0709 12:10:03.454290 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.454668 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.454700 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.456667 (+  1967us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.655763 (+199096us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:04.171955 (+516192us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.181745 (+  9790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.186374 (+  4629us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.429117 (+242743us) raft_consensus.cc:1685] finished
0709 12:10:04.431126 (+  2009us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.487949 (+ 56823us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":623463,"prepare.run_cpu_time_us":367,"prepare.run_wall_time_us":15457,"raft.queue_time_us":46453,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":3764,"thread_start_us":572531,"threads_started":2,"wal-append.queue_time_us":553503}
I20260709 12:10:04.724695 12292 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:04.729423 12568 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:04.725662 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96162.7us
I20260709 12:10:04.732347 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.560732 12599 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.734035 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:04.736550 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 229620us
I20260709 12:10:04.718318 11218 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:04.729972 12610 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.755472 11285 rpcz_store.cc:276] 0709 12:10:03.517954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.851224 (+333270us) service_pool.cc:224] Handling call
0709 12:10:04.687400 (+836176us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:04.687694 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.687916 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.687958 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.688012 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:04.688050 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.688119 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.688261 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17045376}
I20260709 12:10:04.757781 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.743602 11857 rpcz_store.cc:276] 0709 12:10:03.646528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.648438 (+  1910us) service_pool.cc:224] Handling call
0709 12:10:03.648846 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.660476 (+ 11630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.660546 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.661333 (+   787us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.189208 (+527875us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:04.394331 (+205123us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.399685 (+  5354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.399821 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.687494 (+287673us) raft_consensus.cc:1685] finished
0709 12:10:04.687515 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.687630 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41723,"prepare.queue_time_us":436626,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":11394,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":40197,"thread_start_us":730736,"threads_started":2,"wal-append.queue_time_us":560741}
I20260709 12:10:04.725845 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:04.736847 12598 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.766816 11110 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.769659 12292 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.770411 11144 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:04.634234 12662 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.780256 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:04.792047 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.781304 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 116) took 1264 ms. Trace:
I20260709 12:10:04.781893 12502 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.782480 12655 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.782649 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:04.747287 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:04.785941 12598 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.739205 12612 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.800006 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 251) took 3038 ms. Trace:
I20260709 12:10:04.801920 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:04.802769 11292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.062s	sys 0.116s
W20260709 12:10:04.807065 11292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.062s	sys 0.116s
I20260709 12:10:04.808082 12656 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:04.809060 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83304us
I20260709 12:10:04.771700 12568 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.811283 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:04.812568 12568 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:04.812790 12292 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.813159 12292 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:04.813500 12292 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.815397 12677 raft_consensus.cc:1064] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:10:04.812587 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:04.812597 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:04.822826 12644 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:04.824285 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.506s (SENT) [suppressed 2 similar messages]
I20260709 12:10:04.825060 12679 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.788738 12610 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:04.826769 12610 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.830634 12532 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.835383 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:04.763939 12539 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.839061 12539 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:04.842272 12598 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:04.772926 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:04.845017 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.776172 12678 raft_consensus.cc:2764] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:04.873615 12502 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.875634 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:04.876547 11218 raft_consensus.cc:606] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:04.880649 11144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:10:04.881445 11144 raft_consensus.cc:606] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.890793 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 129) took 3207 ms. Trace:
I20260709 12:10:04.805261 12616 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:04.916064 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51585.6us
I20260709 12:10:04.919611 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.921007 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.921765 12532 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.892020 11038 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 3, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.921973 12292 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:04.924754 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:04.923980 11038 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.861819 12656 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:04.922295 12678 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.928180 11038 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 2 to 3, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:04.932282 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:04.900177 11040 rpcz_store.cc:276] 0709 12:10:01.683282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.683397 (+   115us) service_pool.cc:224] Handling call
0709 12:10:04.890702 (+3207305us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:03.559116 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:03.559644 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:03.559683 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:03.560564 (+   881us) tablet.cc:662] Decoding operations
0709 12:10:03.566983 (+  6419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:03.567044 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:03.567071 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:03.567276 (+   205us) tablet.cc:701] Row locks acquired
0709 12:10:03.567290 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:10:03.567434 (+   144us) write_op.cc:270] Start()
0709 12:10:03.567572 (+   138us) write_op.cc:276] Timestamp: P: 1783599003567390 usec, L: 0
0709 12:10:03.567591 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:03.568205 (+   614us) log.cc:844] Serialized 536 byte log entry
0709 12:10:03.571301 (+  3096us) op_driver.cc:464] REPLICATION: finished
0709 12:10:03.600041 (+ 28740us) write_op.cc:301] APPLY: starting
0709 12:10:03.600133 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:03.600271 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:03.600417 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:03.600699 (+   282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:03.600895 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:03.600962 (+    67us) write_op.cc:312] APPLY: finished
0709 12:10:03.601134 (+   172us) log.cc:844] Serialized 23 byte log entry
0709 12:10:03.601333 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.601428 (+    95us) write_op.cc:454] Released schema lock
0709 12:10:03.601520 (+    92us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1207399,"reported_tablets":2,"spinlock_wait_cycles":750464,"child_traces":[["op",{"apply.queue_time_us":28502,"apply.run_cpu_time_us":1865,"apply.run_wall_time_us":1866,"num_ops":1,"prepare.queue_time_us":10091,"prepare.run_cpu_time_us":2555,"prepare.run_wall_time_us":9393,"replication_time_us":3590,"spinlock_wait_cycles":24320,"thread_start_us":438914,"threads_started":1}]]}
I20260709 12:10:04.946463 11038 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 3 to 4, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:04.896593 12558 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.862782 12578 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:10:04.953368 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:04.958866 11144 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.959483 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.960547 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.933454 12608 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.979405 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.806246 11039 rpcz_store.cc:276] 0709 12:10:01.762040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.767734 (+  5694us) service_pool.cc:224] Handling call
0709 12:10:01.909434 (+141700us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b5400101210. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b70b2 00007f9836930759 00007f98368c8a76 00007f9836899d58 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc
0709 12:10:04.799923 (+2890489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:03.554600 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:03.555262 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:03.555302 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:10:03.555323 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:03.555686 (+   363us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:03.555748 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:03.555776 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:03.555992 (+   216us) tablet.cc:701] Row locks acquired
0709 12:10:03.556003 (+    11us) write_op.cc:260] PREPARE: finished
0709 12:10:03.556153 (+   150us) write_op.cc:270] Start()
0709 12:10:03.556270 (+   117us) write_op.cc:276] Timestamp: P: 1783599003556105 usec, L: 0
0709 12:10:03.556292 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:03.557012 (+   720us) log.cc:844] Serialized 541 byte log entry
0709 12:10:03.558984 (+  1972us) op_driver.cc:464] REPLICATION: finished
0709 12:10:03.559678 (+   694us) write_op.cc:301] APPLY: starting
0709 12:10:03.559754 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:03.559872 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:03.560048 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:03.560267 (+   219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:03.560417 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:03.560464 (+    47us) write_op.cc:312] APPLY: finished
0709 12:10:03.598950 (+ 38486us) log.cc:844] Serialized 23 byte log entry
0709 12:10:03.599195 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.599282 (+    87us) write_op.cc:454] Released schema lock
0709 12:10:03.599321 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:03.599665 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.599692 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":22964992,"child_traces":[["op",{"apply.queue_time_us":437,"apply.run_cpu_time_us":2128,"apply.run_wall_time_us":39989,"num_ops":1,"prepare.queue_time_us":106727,"prepare.run_cpu_time_us":2801,"prepare.run_wall_time_us":4359,"replication_time_us":2562,"thread_start_us":70610,"threads_started":1}]]}
I20260709 12:10:04.929940 12614 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.964527 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:04.985273 11211 raft_consensus.cc:2368] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:04.983017 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:04.986937 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 162722us
I20260709 12:10:04.800374 11286 rpcz_store.cc:276] 0709 12:10:03.517411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.517700 (+   289us) service_pool.cc:224] Handling call
0709 12:10:03.539295 (+ 21595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.613042 (+ 73747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.613082 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.613594 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.980382 (+366788us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:03.980439 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.676546 (+696107us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:04.737384 (+ 60838us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b54003f20d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:04.744619 (+  7235us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.777992 (+ 33373us) raft_consensus.cc:1685] finished
0709 12:10:04.780937 (+  2945us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.781220 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4824,"raft.queue_time_us":4685,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":2974,"spinlock_wait_cycles":154547968,"thread_start_us":359337,"threads_started":1,"wal-append.queue_time_us":452668}
I20260709 12:10:04.990882 12292 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.962162 12453 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.949748 12599 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:04.991915 11293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:10:04.961978 12661 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:05.023129 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:05.000965 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 226899us
I20260709 12:10:04.889400 12677 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:04.999892 12292 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:05.017494 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 417705us
I20260709 12:10:05.027004 12292 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.033847 11144 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:05.035200 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:04.998212 12605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.020s	sys 0.022s
I20260709 12:10:04.995158 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.018967 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.036580 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.019774 11293 raft_consensus.cc:606] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:04.992602 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:04.980545 12563 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.040951 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.052740 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:05.058807 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 128797us
I20260709 12:10:05.059624 11217 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: [2.4-3.5]
I20260709 12:10:05.065042 12612 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:04.992975 12644 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:05.065498 12431 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:05.028455 12453 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:05.040710 12605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.021s	sys 0.023s
I20260709 12:10:05.041018 12292 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.067993  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:05.095918  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:05.096889  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.076103 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.098841 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:05.080181 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.080260 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.066013 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.058280 12417 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.083626 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.084019 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.084297 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.087117 12453 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.028883 12661 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:05.089111 12659 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.082s	user 0.013s	sys 0.005s
I20260709 12:10:05.091007 11284 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:05.092453 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.099833 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.132232 11285 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:05.100687 11291 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:05.080549 12568 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:05.101819 11258 leader_election.cc:400] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:05.135954 11258 leader_election.cc:403] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:05.049528 12608 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:05.112965 11219 raft_consensus.cc:2368] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:05.128011 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:05.129369 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.130087 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.146310 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.130165 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.135162 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.149327 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:05.137045 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:05.141070 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.075125 12614 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 12:10:05.153898 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52264.4us
I20260709 12:10:05.117239 12412 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.155059 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:05.161918 12539 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:05.163990 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.160976 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.037477 12656 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.162762 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.171505 11258 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:05.131680 12671 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:05.179139 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:05.177037 11259 leader_election.cc:400] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:05.066035 12644 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.133219 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.185693 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.129190 12617 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.170408 12412 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.186957 11218 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:05.175769 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.184011 12539 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.154129 12568 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.184257 12599 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.206125 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.207098 11135 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.185227 12651 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:05.207659 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.212397 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:05.197510 12706 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.193732 12639 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.219664 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.223765 12639 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.228780 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.185563 12671 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.229723 11137 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:05.200565 12539 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:05.206458 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.207484 12412 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.206372 11286 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:05.219521 12614 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.239550 12539 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.260329 12662 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:05.240953 12563 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.220650 12651 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.227135 12706 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.252552 12614 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:05.308123 12614 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.300073 12671 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.302150 12644 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:05.303287 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.304368 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.319901 12608 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:05.305073 12661 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:05.320737 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.321087 12608 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.305351 12567 raft_consensus.cc:993] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:05.323737 12567 raft_consensus.cc:1081] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
W20260709 12:10:05.305802 12700 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 12:10:05.306293 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.316035 12620 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.261096 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.317800 12651 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.325132 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1407) took 1393 ms. Trace:
W20260709 12:10:05.319450 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 184617us
I20260709 12:10:05.336442 11136 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:05.347458 11293 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:05.356226 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.338384 11290 rpcz_store.cc:276] 0709 12:10:03.931846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.974759 (+ 42913us) service_pool.cc:224] Handling call
0709 12:10:03.975103 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.151247 (+176144us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:04.619902 (+468655us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.991373 (+371471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.991433 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:04.991480 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.324823 (+333343us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540008f054. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:05.324883 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.325061 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":546,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3160,"spinlock_wait_cycles":404325120,"thread_start_us":370117,"threads_started":1,"wal-append.queue_time_us":502887}
I20260709 12:10:05.319625 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.364315 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.333187 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.369339 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.391281 12568 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:05.403721 12565 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:05.404325 12565 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.385313 12679 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.341310 12620 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.427270 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:05.388329 11284 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
W20260709 12:10:05.439298 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 246702us
I20260709 12:10:05.440526 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:05.447311 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 228924us
I20260709 12:10:05.452538 12679 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:05.432165 12617 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.456256 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.431844 12565 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:05.462158 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.461122 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.468086 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.477695 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.477926 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.481186 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.484088 12292 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:05.485641 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 304423us
I20260709 12:10:05.485662 12292 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:05.486717 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.488771 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:05.489522 11292 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.461098 12486 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.483330 12711 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.490829 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.485338 12567 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:05.488297 12548 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.483476 12565 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.490756 12502 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.529816 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:05.552697 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61965.6us
I20260709 12:10:05.553172 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.553498 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.530090 11292 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:05.530781 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.533574 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.554714 11290 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:05.555130 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.461294 12679 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.543099 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:05.489706 12661 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.466975 12568 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.560940 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.559630 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.565790 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.567309 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:05.568236 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:05.536650 12642 consensus_meta.cc:287] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.005s
I20260709 12:10:05.560096 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:05.556638 12726 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.578001 11143 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:05.579676 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:05.580355 11259 leader_election.cc:400] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:05.580691 11259 leader_election.cc:403] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:05.587235 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:05.587918 12486 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.563900 12644 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.564591 12706 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.570106 12711 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.571659 12453 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.599519 12292 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:05.604787 12292 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.544888 12567 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.581208 12558 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.576664 12726 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:05.606285 12726 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.564055 12639 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:05.584829 12642 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.591218 12720 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.588441 12657 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.549856 12614 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:05.593751 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.581391 12656 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.628885 12292 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:05.596280 12655 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.646976 12655 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:05.647478 12655 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.597573 12717 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:05.598717 12486 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.606822 12714 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:05.678828 12695 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.654711 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.629685 12699 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:05.661193 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.661792 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.612675 12558 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.673513 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.686709 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.670548 12486 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.708642 12695 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:05.687523 12565 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.676678 12620 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:05.679981 12714 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:05.688916 12717 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.738375 12565 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.697695 12412 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.745929 12539 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.747428 11287 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:05.749738 12567 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:05.751443 12614 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.757336 11216 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:05.757800 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.758421 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.759390 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:05.762657 11210 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:05.774338 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.774626 11140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36066
I20260709 12:10:05.775096 11140 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:05.775416 11140 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.775823 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.777020 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.777259 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.774109 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:05.781800 11291 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.753368 12412 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:05.827171 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 238005us
I20260709 12:10:05.836606 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.828267 12412 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.828663 12532 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:05.832126 12695 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.862900 12715 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.863610 12715 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:05.864116 12715 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.870826 12718 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:05.872941 12729 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:10:05.832520 12679 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:05.836666 12565 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:05.874459 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 97348.2us
I20260709 12:10:05.850325 12620 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.872064 12532 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:05.866942 12714 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:05.887450 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:05.890223 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:05.881350 12730 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.197s	user 0.002s	sys 0.000s
I20260709 12:10:05.979811 11285 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:06.013875 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:06.014050 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 123964us
I20260709 12:10:06.020254 12486 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.021281 12679 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.026688 11140 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:05.990439 12705 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.611s	user 0.005s	sys 0.001s
I20260709 12:10:06.041426 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:05.984023 12502 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.055475 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:05.989612 12620 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.079516 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.083029 11218 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.084846 11140 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.126165 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.127626 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 359) took 1206 ms. Trace:
I20260709 12:10:06.128397 12486 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.072698 12502 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.074510 12706 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.135004 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:06.135659 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.010s	sys 0.017s
W20260709 12:10:06.137449 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.017s
W20260709 12:10:06.137713 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 553736us
I20260709 12:10:06.139003 11217 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:06.141609 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:06.147140 12743 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:10:06.071018 12671 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:10:06.088725 12539 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.072131 12679 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.129420 12723 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.155332 12724 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.214736 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:06.219439 11861 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.216267 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63722.5us
I20260709 12:10:06.135390 12727 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:06.217335 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59079.2us
I20260709 12:10:06.144801 12502 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.087246 12620 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:06.214605 12655 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
I20260709 12:10:06.243602 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.244419 12709 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.157269 12567 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:06.246399 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 172212us
I20260709 12:10:06.247680 11217 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
W20260709 12:10:06.248864 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 97309.1us
I20260709 12:10:06.254560 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:06.221498 12727 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.254321 12717 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.248502 12640 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:06.292218 11861 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:06.274078 12727 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.285130 12657 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.272866 11284 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 1
I20260709 12:10:06.298889 12749 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:06.281307 12732 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.446s	user 0.001s	sys 0.001s
I20260709 12:10:06.249542 12655 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:06.302345 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47917.4us
I20260709 12:10:06.134755 11858 rpcz_store.cc:276] 0709 12:10:04.921249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.921572 (+   323us) service_pool.cc:224] Handling call
0709 12:10:06.028037 (+1106465us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:06.074831 (+ 46794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.088260 (+ 13429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.127219 (+ 38959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.127290 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:06.127336 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.127408 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.127561 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6221696}
I20260709 12:10:06.300725 12711 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.320539 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:06.222936 12723 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.300513 12678 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.290118 12714 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:10:06.319659 12616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.187s	user 0.011s	sys 0.013s
I20260709 12:10:06.339066 12738 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.339007 12616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.215s	user 0.011s	sys 0.014s
I20260709 12:10:06.304592 11284 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:06.299366 12751 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.307068 12657 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.319139 12532 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:06.343806 12742 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 12:10:06.328363 12671 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.308224 12640 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.298189 12717 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.316349 12749 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.352543 12616 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.246467 12724 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.342247 11139 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.340520 11284 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:06.355089 12737 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:06.355403 12741 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:10:06.302465 12753 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.271587 12709 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.335125 12711 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.365700 12740 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.341768 12678 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.375874 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.376830 12717 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.377125 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.378453 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.379566 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:06.384296 11290 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:06.387070 12708 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.255s	user 0.000s	sys 0.008s
I20260709 12:10:06.361526 12616 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.393090 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.393757 11217 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:06.382794 12620 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:06.399420 12739 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.107s	user 0.001s	sys 0.001s
I20260709 12:10:06.365685 12737 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.385330 12695 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:06.372655 12740 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.358645 12751 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.367707 12753 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.407246 12750 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.407572 12655 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:06.418454 12699 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
I20260709 12:10:06.425606 12754 raft_consensus.cc:993] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:10:06.434166 12711 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.434378 12756 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.435107 12655 raft_consensus.cc:1081] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:10:06.442122 12709 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.442330 12616 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.447885 12657 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.448374 12678 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.451052 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.435000 12756 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.451897 11219 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:06.444851 12640 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.477200 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.477852 11217 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
W20260709 12:10:06.478365 11287 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.007s
I20260709 12:10:06.430177 12750 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.467209 12724 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.472783 12719 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.469929 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:06.457474 12715 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.593s	user 0.014s	sys 0.000s
I20260709 12:10:06.548306 11861 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:06.543855 12726 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.004s
W20260709 12:10:06.544484 12412 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.676s	user 0.014s	sys 0.000s
I20260709 12:10:06.568792 12699 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.569859 12699 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:06.552742 12657 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:06.571488 12740 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.565940 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 113) took 1028 ms. Trace:
I20260709 12:10:06.566228 12412 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.577265 12718 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:06.579221 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 110) took 1048 ms. Trace:
I20260709 12:10:06.587306 11212 rpcz_store.cc:276] 0709 12:10:05.531280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.531453 (+   173us) service_pool.cc:224] Handling call
0709 12:10:05.531757 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.585868 (+ 54111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.585904 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.585949 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:05.585986 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.578955 (+992969us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54003c50d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:06.579007 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.579148 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123928960}
I20260709 12:10:06.581122 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1170) took 1449 ms. Trace:
I20260709 12:10:06.582679 11138 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.583228 11214 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.566418 12558 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.588292 11215 rpcz_store.cc:276] 0709 12:10:05.131290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.145928 (+ 14638us) service_pool.cc:224] Handling call
0709 12:10:06.580887 (+1434959us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54002954d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:06.581063 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041498368}
I20260709 12:10:06.545887 12502 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.567615 12737 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.590137 12718 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.571272 12699 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.551530 12715 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.543399 12719 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.567065 12726 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.585273 11213 rpcz_store.cc:276] 0709 12:10:05.537578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.558394 (+ 20816us) service_pool.cc:224] Handling call
0709 12:10:06.495869 (+937475us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5800004b98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:06.542419 (+ 46550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.546703 (+  4284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.550455 (+  3752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.551780 (+  1325us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:06.551826 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.551898 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.565856 (+ 13958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9693056}
I20260709 12:10:06.608970 11289 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.611145 12760 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.618574 12502 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.620271 12715 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.621008 12750 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.618436 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.617126 12412 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.627980 12726 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.613255 12699 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.612619 12760 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.633221 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.646812 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.649189 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.651918 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.653817 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.633698 12726 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.633520 12756 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:06.671295 12761 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:06.686532 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:06.694962 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.675570 12738 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:06.695784 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 355537us
I20260709 12:10:06.676079 12753 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.682250 12719 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.683734 12412 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.673079 12727 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.695477 12756 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.712493 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.708760 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.720829 12412 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.684068 12726 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.733342 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.751574 12756 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:06.756441 12756 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.751313 12763 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.763494 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.760277 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.769609 12599 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.770150 12599 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.772286 12599 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.773907 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.775256 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.776007 11213 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:06.776307 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:06.745704 12753 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.776885 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.777102 12661 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.783377 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.766564 12763 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.780074 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.791357 12763 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.789335 12614 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.780458 12502 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:06.796454 12766 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:06.796610 12502 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.788959 12715 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.798775 12502 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.781965 12610 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.782189 12661 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:06.807541 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.842623 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.843538 11861 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:06.805168 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.845543 12727 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:06.846079 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.785679 12753 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.854779 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.862780 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.849224 12661 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.867528 12661 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.867579 12412 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.868016 12755 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.868535 12755 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:06.869891 11136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1263) took 1663 ms (client timeout 2122 ms). Trace:
W20260709 12:10:06.870402 11136 rpcz_store.cc:269] 0709 12:10:05.206469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.207140 (+   671us) service_pool.cc:224] Handling call
0709 12:10:06.869744 (+1662604us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400263c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:06.869837 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276868352}
I20260709 12:10:06.850016 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.873512 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:06.807121 12715 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.875577 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:06.877015 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:06.829612 12610 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.863801 12599 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.881115 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.865227 12724 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:06.883708 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:06.878994 11284 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:06.910113 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.911221 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.914299 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:06.908869 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.905337 12599 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:06.910233 11852 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.923648 12718 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.909056 12724 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.929538 12715 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.935883 12717 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:06.960078 12717 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.961259 12726 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.937034 12755 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.938356 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.943279 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.946918 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.949903 12610 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.951378 12724 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.951941 12599 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.952271 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1264) took 1179 ms. Trace:
I20260709 12:10:06.952404 12753 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:06.967696 11284 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:06.947445 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.964771 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.967142 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.967494 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.971896 12760 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:06.972671 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.973353 11860 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:06.973853 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.974459 11291 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:06.975293 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:06.975849 11291 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.976150 11291 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:06.972991 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:06.978932 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:06.981600 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:06.969214 11139 rpcz_store.cc:276] 0709 12:10:05.773191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.779287 (+  6096us) service_pool.cc:224] Handling call
0709 12:10:05.831516 (+ 52229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.362383 (+530867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.951985 (+589602us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001261d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:06.952183 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137766272}
I20260709 12:10:06.980278 11291 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:06.984814 11291 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.996049 11291 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:06.999698 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.000058 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.000398 11139 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.001328 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.001929 11136 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:07.002410 11135 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.002354 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.002803 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.003715 11142 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:07.003837 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:06.980413 12717 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.001838 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1194) took 1397 ms. Trace:
I20260709 12:10:07.007259 11292 rpcz_store.cc:276] 0709 12:10:05.604614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.604753 (+   139us) service_pool.cc:224] Handling call
0709 12:10:05.605091 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.641443 (+ 36352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.641510 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.641569 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:05.641614 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.001611 (+1359997us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540017fcd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:07.001659 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.001782 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82979200}
I20260709 12:10:07.005743 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:07.008733 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:07.009202 11291 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.009861 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.010010 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1173) took 1247 ms. Trace:
I20260709 12:10:07.011879 11218 rpcz_store.cc:276] 0709 12:10:05.756808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.760806 (+  3998us) service_pool.cc:224] Handling call
0709 12:10:05.795909 (+ 35103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.083519 (+287610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.004180 (+920661us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540035aa54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:07.004352 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589714816}
I20260709 12:10:07.012723 11140 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:07.012951 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.013018 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.015552 11137 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:07.014688 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.016717 11136 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.018697 11142 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:07.019836 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.021912 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:06.983614 11284 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:06.983349 12718 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:07.032217 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.034374 11292 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:07.036505 11140 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.034286 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.037302 12599 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.039574 11292 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.040920 12759 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.041676 12759 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.034360 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.043494 12706 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.044116 12706 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.045279 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1188) took 1958 ms. Trace:
I20260709 12:10:07.015033 12715 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.046411 12715 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:07.048012 11143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1261) took 1842 ms (client timeout 1869 ms). Trace:
W20260709 12:10:07.048396 11143 rpcz_store.cc:269] 0709 12:10:05.205703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.205831 (+   128us) service_pool.cc:224] Handling call
0709 12:10:07.047836 (+1842005us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400371c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:07.047956 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853278464}
I20260709 12:10:07.052042 11286 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.052691 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1427) took 1569 ms. Trace:
I20260709 12:10:07.052867 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.053051 11286 rpcz_store.cc:276] 0709 12:10:05.483869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.485736 (+  1867us) service_pool.cc:224] Handling call
0709 12:10:07.051637 (+1565901us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:07.051843 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.052482 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.052646 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67404032}
I20260709 12:10:07.050642 12431 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:07.055523 12431 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.057852 12431 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:07.059516 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.059990 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1267) took 2101 ms. Trace:
I20260709 12:10:07.060169 11218 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:07.060302 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.061964 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.027573 12724 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.030224 12717 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.065603 11291 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:07.045996 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.077237 12662 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.076596 12717 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.079438 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.080283 12717 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.081650 11139 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
W20260709 12:10:07.071058 12731 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.244s	user 0.001s	sys 0.007s
I20260709 12:10:07.071676 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1431) took 1580 ms. Trace:
I20260709 12:10:07.045681 11288 rpcz_store.cc:276] 0709 12:10:05.086578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.086742 (+   164us) service_pool.cc:224] Handling call
0709 12:10:05.087031 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.238555 (+151524us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:05.239040 (+   485us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.572713 (+333673us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.582097 (+  9384us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.584601 (+  2504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.044484 (+1459883us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b1800044380. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419
0709 12:10:07.045058 (+   574us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540020b7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:07.045107 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.045223 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15301,"prepare.queue_time_us":6692,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":28720,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6296,"spinlock_wait_cycles":334303872,"thread_start_us":310088,"threads_started":1,"wal-append.queue_time_us":434227,"wal-append.run_cpu_time_us":1917,"wal-append.run_wall_time_us":1064679}
I20260709 12:10:07.043818 12759 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.071668 12724 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.072541 12691 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.073861 12715 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.074432 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.074697 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:07.110833 12709 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:07.112267 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.113137 12691 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.046265 12706 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.076673 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.082041 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.060465 11214 rpcz_store.cc:276] 0709 12:10:04.958744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.980081 (+ 21337us) service_pool.cc:224] Handling call
0709 12:10:05.299889 (+319808us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800004b98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:06.583036 (+1283147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.593375 (+ 10339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.059744 (+466369us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002954d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:07.059891 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2955220224}
I20260709 12:10:07.084969 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.084622 12751 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.086148 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:07.147105 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61049.4us
I20260709 12:10:07.085774 11291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45942
I20260709 12:10:07.087278 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.087348 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:07.091866 12716 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.933s	user 0.014s	sys 0.000s
I20260709 12:10:07.090301 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:07.152894 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62712.8us
I20260709 12:10:07.094365 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.094751 11141 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.097059 12723 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.097069 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.098553 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.103822 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.095721 12617 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.114058 12759 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.129982 12662 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.113691 12691 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.154280 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:07.103289 11289 rpcz_store.cc:276] 0709 12:10:05.523184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.523745 (+   561us) service_pool.cc:224] Handling call
0709 12:10:05.570768 (+ 47023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.609499 (+1038731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.071391 (+461892us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004268d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:07.071607 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377469824}
I20260709 12:10:07.148387 12755 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:07.106572 12717 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.160564 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.164021 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.160681 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:07.150111 12715 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.149160 12749 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.163278 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.149598 11142 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:07.155836 12599 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.170715 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.164819 12759 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.173113 12604 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.175597 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.168205 12548 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.177369 12548 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.177803 12548 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.159608 12617 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.180701 11143 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:07.174340 12604 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.163066 12751 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.186707 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:07.180806 12617 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.171526 12755 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:07.183512 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.183782 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.201071 11218 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:07.186161 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1435) took 1354 ms. Trace:
I20260709 12:10:07.201661 11285 rpcz_store.cc:276] 0709 12:10:05.831973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.025572 (+193599us) service_pool.cc:224] Handling call
0709 12:10:06.025917 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.026374 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.026415 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.031997 (+  5582us) log.cc:844] Serialized 26 byte log entry
0709 12:10:07.058791 (+1026794us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b180033d8a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:10:07.146211 (+ 87420us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:07.146263 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.146343 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.174300 (+ 27957us) raft_consensus.cc:1685] finished
0709 12:10:07.174318 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.186107 (+ 11789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2451,"raft.queue_time_us":1799,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":51211,"spinlock_wait_cycles":71471872,"thread_start_us":44557,"threads_started":1,"wal-append.queue_time_us":1094939}
I20260709 12:10:07.187516 12723 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:07.176496 12703 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.187732 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.206768 12412 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.169541 12717 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.163484 12662 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.182384 12724 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:07.209216 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.221614 11038 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 252) took 2597 ms. Trace:
I20260709 12:10:07.238968 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.227154 12412 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.241411 12412 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.208268 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.219838 12759 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.188264 12751 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.211936 12679 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:07.184252 12604 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.235881 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:07.247867 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.243502 11136 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:07.239326 11038 rpcz_store.cc:276] 0709 12:10:04.624518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.624724 (+   206us) service_pool.cc:224] Handling call
0709 12:10:07.221526 (+2596802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.135525 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.160808 (+ 25283us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.160860 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:10:05.160888 (+    28us) tablet.cc:662] Decoding operations
0709 12:10:05.161827 (+   939us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.161917 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.161964 (+    47us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:05.183692 (+ 21728us) tablet.cc:701] Row locks acquired
0709 12:10:05.183711 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:05.196295 (+ 12584us) write_op.cc:270] Start()
0709 12:10:05.205704 (+  9409us) write_op.cc:276] Timestamp: P: 1783599005194369 usec, L: 0
0709 12:10:05.205737 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.279990 (+ 74253us) log.cc:844] Serialized 1759 byte log entry
0709 12:10:06.272319 (+992329us) op_driver.cc:464] REPLICATION: finished
0709 12:10:06.367539 (+ 95220us) write_op.cc:301] APPLY: starting
0709 12:10:06.367633 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.367832 (+   199us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.389810 (+ 21978us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.429900 (+ 40090us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.430094 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:06.430140 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:06.445383 (+ 15243us) log.cc:844] Serialized 41 byte log entry
0709 12:10:06.449604 (+  4221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.455489 (+  5885us) write_op.cc:454] Released schema lock
0709 12:10:06.457980 (+  2491us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:06.757370 (+299390us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad6e28 00007f9834511581 00007f9834510d58 00007f98345159f1 00007f98345159a9 00007f9834515939 00007f9834515901 00007f9834514b2d 0000000000388634 0000000000388479
0709 12:10:06.781423 (+ 24053us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.784743 (+  3320us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167710,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":87920,"apply.run_cpu_time_us":4295,"apply.run_wall_time_us":108661,"num_ops":4,"prepare.queue_time_us":108361,"prepare.run_cpu_time_us":55912,"prepare.run_wall_time_us":1640022,"raft.queue_time_us":363369,"raft.run_cpu_time_us":20340,"raft.run_wall_time_us":102793,"replication_time_us":1048016,"spinlock_wait_cycles":22301952,"thread_start_us":654741,"threads_started":4,"wal-append.queue_time_us":401415}]]}
I20260709 12:10:07.248791 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.250391 12749 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.253932 11291 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:07.254387 11291 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.246331 12751 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.233469 12703 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:07.249516 12784 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:10:07.242334 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 136) took 1552 ms. Trace:
I20260709 12:10:07.261574 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.211908 12755 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.265228 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:07.270152 11258 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:07.271070 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.258908 12749 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.285511 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.286383 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.287774 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.288489 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.290158 11140 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.275517 12724 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.276607 12548 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.257225 12604 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:07.278455 12744 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.393s	user 0.000s	sys 0.004s
I20260709 12:10:07.278980 11216 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.279984 12737 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.280167 12412 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.283037 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.303931 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.283833 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.284474 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.290658 12598 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:07.294181 11137 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.294790 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:07.259142 12703 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.188201 12691 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.297551 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.292584 12749 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.324556 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.326273 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.319093 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.301534 12614 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:07.270820 12563 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:07.337076 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.309423 12417 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.295972 12771 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:10:07.317749 12724 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:07.338461 12786 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:10:07.331409 12749 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.351001 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52004.3us
I20260709 12:10:07.342855 11856 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.306298 12678 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:07.339326 12604 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.358397 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1196) took 1733 ms. Trace:
I20260709 12:10:07.340803 12738 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.272615 11291 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.341308 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:07.345657 11289 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.364300 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.364923 11288 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.365403 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.369093 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:07.369675 11292 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
W20260709 12:10:07.370268 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.350435 12724 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.355159 12691 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.363801 12548 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:07.362306 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.380204 11860 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:07.358866 11293 rpcz_store.cc:276] 0709 12:10:05.624719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.629963 (+  5244us) service_pool.cc:224] Handling call
0709 12:10:05.630385 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.649043 (+ 18658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.649070 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.671193 (+ 22123us) log.cc:844] Serialized 26 byte log entry
0709 12:10:05.832353 (+161160us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:05.832409 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.832518 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.266817 (+1434299us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:07.352894 (+ 86077us) raft_consensus.cc:1685] finished
0709 12:10:07.352914 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.358301 (+  5387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18020,"raft.queue_time_us":32320,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8775,"spinlock_wait_cycles":14921600,"thread_start_us":152961,"threads_started":1,"wal-append.queue_time_us":205724}
I20260709 12:10:07.380442 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.366173 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:07.370424 11288 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.343009 12614 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:07.394348 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 112504us
I20260709 12:10:07.380385 12771 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.376624 12724 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.401413 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:07.361761 12453 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:10:07.384687 12661 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.392546 12717 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.403110 12678 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.385102 12734 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:10:07.406025 12662 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.435883 12771 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.448972 12738 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.447791 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:07.407071 12695 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:10:07.451925 12661 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.263134 11287 rpcz_store.cc:276] 0709 12:10:05.689812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.691832 (+  2020us) service_pool.cc:224] Handling call
0709 12:10:05.747087 (+ 55255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.747303 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:06.478819 (+731516us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.173499 (+694680us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800372ee0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf
0709 12:10:07.173680 (+   181us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.185422 (+ 11742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:07.186158 (+   736us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:07.189826 (+  3668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.207984 (+ 18158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.238719 (+ 30735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2314,"prepare.queue_time_us":95665,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3165,"raft.queue_time_us":12062,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":2949,"spinlock_wait_cycles":8232192,"thread_start_us":213007,"threads_started":2,"wal-append.queue_time_us":218048}
I20260709 12:10:07.465288 12738 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.452950 12598 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:07.490935 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 187074us
I20260709 12:10:07.496618 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.488349 12738 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.501860 12412 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:07.513478 12787 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:10:07.514513 12789 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:10:07.516062 12292 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.515794 12598 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.518183 12614 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.520586 12292 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.522665 12292 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.523820 12292 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.523082 12661 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:07.527796 12775 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.668s	user 0.006s	sys 0.000s
I20260709 12:10:07.537326 12703 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.520612 12751 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.549511 12751 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.537326 12738 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.544219 12724 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.552059 12703 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.546700 12749 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.552896 12724 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.554754 12749 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.555040 12738 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.553548 12771 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.557327 12620 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.558370 12620 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.558960 12771 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.559304 12620 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.560384 12620 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.561664 12568 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.562049 12568 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:07.550279 11855 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.563416 12568 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.564826 12568 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.568084 12678 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.568656 12678 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.569743 12678 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.571272 12678 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.616035 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 292503us
W20260709 12:10:07.618153 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.619057 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.619527 11141 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.625170 11140 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.618153 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.645128 11287 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.646361 11288 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.490628 11289 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.650615 11293 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.653609 11286 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.659595 12804 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:07.660892 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 348189us
W20260709 12:10:07.670357 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52155.1us
I20260709 12:10:07.677312 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:07.678013 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:07.678602 11290 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:07.676285 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:07.681674 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:07.683111 12804 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.688512 12804 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.690508 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.661401 11138 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.760253 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.780117 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.737607 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.781939 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.737129 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:07.713280 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:07.740540 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50896.4us
I20260709 12:10:07.741658 11291 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:07.732473 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.741026 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:07.763718 12804 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.764392 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.763720 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.736132 11141 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:07.740808 11288 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.750795 12431 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.776784 12486 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:07.723162 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.719460 12412 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.732538 12292 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.783142 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.783469 12568 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.808285 12568 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.808918 12568 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.784329 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.758507 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:07.785254 12598 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.811690 12598 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.812197 12598 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.812278 11289 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:07.786465 12610 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:07.788931 12642 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:07.790916 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.791867 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:07.793403 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:07.726065 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 229385us
W20260709 12:10:07.801839 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.772941 11039 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 2 to 3, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132), now has a pending config: VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129), VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130), VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131), VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 3 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:07.813390 12804 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:07.815140 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74370.9us
I20260709 12:10:07.832077 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.813635 12610 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.836462 12755 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.837662 12610 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.837862 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45942 (request call id 1210) took 1095 ms. Trace:
I20260709 12:10:07.838853 12795 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.839363 11291 rpcz_store.cc:276] 0709 12:10:06.713000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.085649 (+372649us) service_pool.cc:224] Handling call
0709 12:10:07.662072 (+576423us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400404554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad2a3d 00007f9835aa2cd0 00007f982f027254 00007f982f0271e2 00007f982f027111 00007f982f02708c 00007f982f026342 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:07.805570 (+143498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241067392}
I20260709 12:10:07.843931 11861 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.845676 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:07.848039 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48691.9us
I20260709 12:10:07.848377 11855 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:07.814960 12642 consensus_queue.cc:1243] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:07.854561 12759 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.855059 12759 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:07.856491 12759 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.859354 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.839459 12795 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.863641 12759 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.864130 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72605.2us
I20260709 12:10:07.871335 12747 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.874318 12747 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.871120 12691 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.878669 12747 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.876416 11140 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.878660 12642 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.881313 12804 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.869678 12795 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.867256 12771 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:07.898533 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.899590 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.883069 12642 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:07.900213 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:07.900743 12798 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:07.901499 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.901733 12798 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.890455 12657 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.904035 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:07.904634 12798 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:07.903178 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.882227 11140 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:07.892642 12292 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.907773 12797 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.908867 12801 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.910002 12691 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.910427 12691 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.910877 12691 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.904631 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.915696 11861 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:07.903218 12657 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:07.920290 12657 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:07.906098 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:07.901355 12642 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.905391 12798 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.868487 12412 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:07.932123 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49859.8us
I20260709 12:10:07.928004 12755 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:07.933789 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55535.8us
I20260709 12:10:07.935108 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:07.931565 12292 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:07.937254 12771 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.937077 12755 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:07.942559 12755 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.940025 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:07.883443 12486 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:07.950825 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 49596.1us
I20260709 12:10:07.953161 12771 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.953501 12690 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:07.954308 11856 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:07.956207 12678 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.956689 12678 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:07.957751 12678 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:07.959749 12678 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.965718 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:07.959753 12412 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:07.971439 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 103330us
I20260709 12:10:07.973326 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:07.977092 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.978919 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:07.980999 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:07.981673 12771 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.980798 12690 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.982062 12679 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.983405 12679 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.984174 12679 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:07.984736 12679 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.969352 11039 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 3, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 3 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.993672 11142 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
W20260709 12:10:07.999030 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49256.8us
I20260709 12:10:08.002277 12610 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.004191 12610 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:08.004132 12751 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:08.004851 12610 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.988780 12412 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.984117 12690 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:08.008261 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.002177 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.002604 11140 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:08.012197 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.025151 12797 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.026027 12797 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.027627 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.028419 12797 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.028501 12568 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.031210 12629 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:08.038126 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77374.7us
I20260709 12:10:07.996420 12755 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.011767 12690 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:08.051303 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.052142 11858 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:08.052434 12568 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:08.057121 11140 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.056193 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.064330 12568 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.064787 12568 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.065259 12568 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.070629 12565 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.071429 12565 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.073575 12565 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.073871 12568 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.074105 12604 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:10:08.074807 11855 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:08.076668 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.082813 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:08.039209 12747 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.089581 11289 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:08.091182 12486 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.093080 12755 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.082643 12565 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.095486 12565 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.098554 12578 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:08.098059 12565 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.104401 12747 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.107481 12679 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.108500 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.118544 11140 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
W20260709 12:10:08.123298 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 109489us
W20260709 12:10:08.128132 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65159.1us
I20260709 12:10:08.127700 12431 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:08.146273 12699 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.146764 12699 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:08.147730 12699 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.149317 12699 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.155694 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:08.159771 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 102880us
I20260709 12:10:08.165503 12801 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.165375 12771 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.166325 12801 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.166775 12771 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.167248 12771 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:08.167687 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:08.168356 11852 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.168164 12771 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.169833 12771 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.171016 12801 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.124441 12412 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.184142 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:08.186450 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 137666us
W20260709 12:10:08.186949 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.188450 11137 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:08.164449 12568 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.131234 12657 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:08.199064 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:08.200351 12738 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:08.201879 12749 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.203933 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:08.204677 12657 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.205344 12657 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:08.205859 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:08.212846 12797 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.211503 12771 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:08.213376 11860 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:08.215314 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.234045 11210 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:08.216907 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.234928 11288 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:08.217751 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.218469 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.224680 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.219129 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.237509 11284 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:08.220275  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.238561 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:08.230798 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67385us
I20260709 12:10:08.240583 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.242123 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.242969 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:08.243443 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.243664 11292 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.247045 11142 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:08.248226 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.248111 12691 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.249058 11138 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.239519 12798 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.239221 12568 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.251322 11137 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:08.252907 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.253501 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:08.253176 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:08.253832 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.265781 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:08.276192 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45163.1us
I20260709 12:10:08.277667 11292 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:08.189554 12610 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.195214 12679 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.281286 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.250451 12691 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.251845 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.274314 12801 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.273293 12565 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.302341 11142 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:08.182811 12690 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.295496 12486 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:08.308108 12565 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.308795 11286 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.310065 11286 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.310832 12578 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:08.311353 11138 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.311570 12578 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.312896 11852 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:08.315563 12747 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.317057 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.295375 12678 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.319350 12678 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.319591 12629 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.320161 12629 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.320536 12629 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.319494 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.321673 12678 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.318697 12578 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.322701 12810 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:08.323360 12810 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.325584 12810 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.318511 12801 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.326768 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.327940 12801 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.316897 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.328754 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:08.340104 11293 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.308346 12486 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.253693 12598 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:08.336786 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.355953 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 78677.2us
I20260709 12:10:08.358578 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.376085 12657 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.378033 12755 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:08.382916 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.384707 12801 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.385696 12801 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.388586 12801 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:08.390600 12817 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:10:08.392063 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.393019 11852 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:10:08.395236 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78296.6us
I20260709 12:10:08.361340 12292 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.398106 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:08.396025 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.302366 12642 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.367658 12568 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.406198 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.409873 12292 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:08.411978 12292 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:08.412662 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:08.404850 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.418349 11293 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:08.423118 12604 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.423745 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.395485 12565 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.423805 12604 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.438663 11140 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.361898 12751 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:08.440549 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.451433 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.455122 12604 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.430238 12810 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.456353 12810 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.456802 12810 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.431788 12568 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:08.434012 12801 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.467190 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.464272 12620 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:08.476756 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78063.9us
I20260709 12:10:08.466315 12657 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.473456 12690 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.504303 12568 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.505268 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.485831 12759 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:08.490706 12795 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.003s
I20260709 12:10:08.490881 12801 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:08.515497 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48464us
I20260709 12:10:08.512750 12620 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:08.517880 12795 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.524777 11290 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.525763 12691 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.526626 12747 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.527196 12747 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.527443 12795 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:08.527351 12821 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:08.528170 12821 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.529323 12747 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.531569 12821 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.532357 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.533967 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.534950 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.535322 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.512761 12759 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.526319 12691 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:08.557051 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.518918 12610 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.535254 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.575495 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.569599 12678 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.580500 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.580986 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.580888 12678 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:10:08.576347 12486 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.581841 11216 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:08.583277 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.583491 12678 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.584657 12691 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.586403 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.587363 11210 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:08.588503 12819 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.589021 12819 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.590072 12486 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:08.591168 12819 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:08.591557 12604 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:08.587401 12412 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.593075 12604 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.593286 12412 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.594066 12747 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.594823 12747 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:08.595721 12412 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:08.595877 12747 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.597723 12747 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.599390 12801 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.574609 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.608181 11290 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:08.561865 12759 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.563706 12598 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:08.627569 11213 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:08.629314 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.630378 11284 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:08.534173 12620 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.640591 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.644465 11291 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:08.652151 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:08.643812 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 141567us
I20260709 12:10:08.643570 12642 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:08.699970 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47951us
I20260709 12:10:08.705662 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:08.708467 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 117952us
I20260709 12:10:08.709233 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:08.715837 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.729610 12292 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.742550 12610 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.713814 12819 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.710501 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:08.751958 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.758069 12771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39586 (request call id 76) took 1506 ms. Trace:
I20260709 12:10:08.757995 12801 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.705058 12629 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.742236 12810 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:08.787982 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 78825.1us
I20260709 12:10:08.757054 12691 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.790146 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:08.790983 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73540.7us
I20260709 12:10:08.799145 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.771390 12568 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.800061 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.809980 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:08.811887 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.810878 12679 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.823405 12412 raft_consensus.cc:2764] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:08.816144 12568 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.825305 12629 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:08.832327 12699 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.006s
I20260709 12:10:08.833630 12598 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.834338 12598 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:08.837359 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.838356 12412 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.839004 12412 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.839385 12412 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.817620 12819 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.808087 12678 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:08.838585 12825 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:10:08.854365 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.863974 11218 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:08.856212 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.864867 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.865219 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.865559 11218 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:08.865805 11211 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:08.844732 12679 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.846376 12695 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.867136 12695 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.856549 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.867609 12695 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:08.868400 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.868980 11212 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.849304 12678 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.848546 12838 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:08.870971 12678 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.870788 12838 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.871835 12795 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:08.872018 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.857926 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.872597 12795 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:08.873464 11217 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:08.873553 11211 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.874467 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.852830 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.853286 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.853528 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:08.875721 11216 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.876154 11291 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.851712 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:08.855782 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.877337 12839 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.877697 11214 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.854408 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.879225 11215 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:08.850315 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.868546 12695 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:08.866441 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.887094 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.836755 12598 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:08.891095 12292 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.895709 11292 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:08.880357 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.901027 12838 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.901331 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.857432 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:08.898880 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.833647 12568 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:08.909336 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.909464 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:08.911334 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.912322 12798 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.913050 12798 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.913424 12798 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:08.913816 12798 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.918404 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.925997 11216 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:08.926505 11215 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.904070 12657 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.911497 12811 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.759241 12771 rpcz_store.cc:276] 0709 12:10:07.251905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.252205 (+   300us) service_pool.cc:224] Handling call
0709 12:10:07.277965 (+ 25760us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5800164fd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad670a 00007f9830ad776a 00007f9830ad691b 00007f9830ae203c 00007f9830ae16b3 00007f9830ad99fa 00007f9835aa14c9 00007f982f01dc54
0709 12:10:07.315287 (+ 37322us) log.cc:844] Serialized 501 byte log entry
0709 12:10:08.757905 (+1442618us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":6642,"raft.queue_time_us":273221,"raft.run_cpu_time_us":1491,"raft.run_wall_time_us":6550,"spinlock_wait_cycles":51958528,"thread_start_us":148468,"threads_started":1,"wal-append.queue_time_us":183578,"wal-append.run_cpu_time_us":2230,"wal-append.run_wall_time_us":1029190}
I20260709 12:10:08.910959 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.922641 12598 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.938978 12695 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.939169 12598 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:08.939630 12598 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.904891 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:08.949070 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:08.949930 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.950893 11860 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:08.951895 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:08.950060 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.954095 12751 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:08.955272 12836 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 12:10:08.905267 12839 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:10:08.955892 12598 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:08.957394 12839 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.957825 12839 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:08.950013 11216 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.966251 11291 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:10:08.959362 12832 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:08.960253 11214 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:08.983606 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.984210 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:08.984719 11210 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:08.987089 11212 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:08.971961 11216 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:08.975549 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:08.979758 11211 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:08.922559 12678 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.991051 11218 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.993739 11213 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:08.999090 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.002694 12610 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.007649 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.013161 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.014523 11217 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:08.998176 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 557f4814dd3c4d4bb57340a9834ebd32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:09.025094 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.024422 12412 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.027361 11142 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:10:09.028216 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.933564 12657 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:09.032799 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48685.3us
I20260709 12:10:09.033761 12292 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.036701 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.037781 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.035473 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.041707 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:08.998219 12755 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.047622 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.045141 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:09.050243 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:09.052809 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.032867 12657 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.056526 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 145242us
I20260709 12:10:09.057530 11135 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:09.058182 12292 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.060586 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:09.063565 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:08.999303 12798 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.050058 12811 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.050405 12838 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.056526 12810 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.057024 12565 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.053862 12691 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.058465 12738 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.091333 12841 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.092607 12610 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.095923 12798 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.096058 12412 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.071970 12598 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:10:09.104432 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63852.4us
I20260709 12:10:09.068490 12759 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.123665 11291 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:09.061797 12839 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.097996 12691 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:09.134357 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.140956 11140 raft_consensus.cc:2955] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:09.163748 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.166919 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.143335 12598 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.172264 12798 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.142709 12755 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:09.149263 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.176558 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.186311 12292 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.142844 12738 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:09.188251 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:09.175127 12819 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.223006 12839 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.223013 12826 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.223641 12759 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.194621 12848 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:09.230166 12292 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:09.204461 12691 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:09.234841 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47795.7us
W20260709 12:10:09.249203 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 194010us
W20260709 12:10:09.247339 12690 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.002s
I20260709 12:10:09.253966 11215 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
W20260709 12:10:09.254550 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87716.6us
I20260709 12:10:09.248459 12798 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:09.264391 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84402us
I20260709 12:10:09.257289 11110 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.268641 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.250578 12412 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.271739 12798 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.272710 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:09.272784 12755 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:09.310540 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87128.8us
I20260709 12:10:09.277017 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.273272 12838 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.273317 12848 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.275101 12292 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.281334 12738 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.284363 12565 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.284420 12795 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:09.288125 12840 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.292826 11138 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.264868 12819 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.299521 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 130) took 3738 ms. Trace:
I20260709 12:10:09.314067 11291 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:09.331251 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67600.4us
I20260709 12:10:09.341091 11140 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.344376 11140 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:09.353469 11040 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:09.360364 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.358649 12823 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:10:09.340709 12699 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.341127 11138 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:09.345109 12565 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.396202 12822 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.322713 12598 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.334028 12759 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.397161 11040 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.342240 11039 rpcz_store.cc:276] 0709 12:10:05.560960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.572968 (+ 12008us) service_pool.cc:224] Handling call
0709 12:10:09.299388 (+3726420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:08.194511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:08.444763 (+250252us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:08.466795 (+ 22032us) write_op.cc:435] Acquired schema lock
0709 12:10:08.473824 (+  7029us) tablet.cc:662] Decoding operations
0709 12:10:08.608987 (+135163us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:08.634556 (+ 25569us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:08.634613 (+    57us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:08.635023 (+   410us) tablet.cc:701] Row locks acquired
0709 12:10:08.635077 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:10:08.635261 (+   184us) write_op.cc:270] Start()
0709 12:10:08.635421 (+   160us) write_op.cc:276] Timestamp: P: 1783599008635188 usec, L: 0
0709 12:10:08.635464 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:10:08.636304 (+   840us) log.cc:844] Serialized 1233 byte log entry
0709 12:10:09.017626 (+381322us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.019637 (+  2011us) write_op.cc:301] APPLY: starting
0709 12:10:09.019781 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.019976 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.020148 (+   172us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.020802 (+   654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.021308 (+   506us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:09.021398 (+    90us) write_op.cc:312] APPLY: finished
0709 12:10:09.021808 (+   410us) log.cc:844] Serialized 29 byte log entry
0709 12:10:09.022046 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.022171 (+   125us) write_op.cc:454] Released schema lock
0709 12:10:09.022249 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:09.077245 (+ 54996us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:09.079066 (+  1821us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":1578,"apply.run_cpu_time_us":3059,"apply.run_wall_time_us":34227,"num_ops":2,"prepare.queue_time_us":90981,"prepare.run_cpu_time_us":12667,"prepare.run_wall_time_us":565469,"raft.queue_time_us":135578,"raft.run_cpu_time_us":1843,"raft.run_wall_time_us":1902,"replication_time_us":381944,"spinlock_wait_cycles":26880,"thread_start_us":219754,"threads_started":4,"wal-append.queue_time_us":242997}]]}
I20260709 12:10:09.359942 12610 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:09.407624 12859 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.407979 12848 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.405469 12690 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.409210 12690 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.409633 11138 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.410822 12565 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.411177 11138 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.411454 12690 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.411746 11289 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.394894 12795 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:09.417078 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.404574 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.414358 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:09.414783 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71219.1us
I20260709 12:10:09.413435 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:09.420331 11291 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:09.420776 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.404330 12412 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.423652 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.424891 11141 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:09.425625 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.434054 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:09.432363 11040 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:09.399204 12838 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:09.353612 12851 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:10:09.443123 12851 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.443545 12851 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:09.444396 12851 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.445753 12851 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.422304 12610 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.435127 12690 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.441676 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:09.349138 12840 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.456637 11214 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:09.439934 12858 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.459388 12858 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.459704 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:09.461606 12858 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.463833 11856 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:09.403963 12822 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.465473 12795 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.466378 12822 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.446967 12690 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.468757 12690 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.472455 12853 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:09.473049 12853 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.474181 11852 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:09.476117 12853 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.441747 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:09.477532 12657 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.426832 12620 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:10:09.477856 11213 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.419615 12859 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.401202 12699 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.442723 12412 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.515336 12699 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.458254 12840 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:09.453470 12861 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.454734 12855 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.476426 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:09.482257 12657 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.533390 11217 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.483768 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 82827.3us
I20260709 12:10:09.488436 11218 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:09.454063 12598 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.479839 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.492168 12819 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.512833 12859 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.531855 11213 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:09.479427 11138 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.536607 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.493155 12822 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:09.541774 11141 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:09.540298 11135 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:09.538364 12861 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.544414 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.539601 12855 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.585593 12822 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:09.548426 12642 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:09.593603 11217 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:09.598282 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.607285 11215 raft_consensus.cc:606] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:09.607800 11215 raft_consensus.cc:614] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.603768 11139 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:09.609923 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.611501 12486 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.611996 12486 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.611855 12839 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.612586 12486 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.613855 11140 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.614965 11140 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.615530 12755 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.620414 12872 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:09.623584 12872 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.626998 12486 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.616776 12755 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.609076 12823 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.638119 11140 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.640048 12867 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:09.640702 12867 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:09.627532 12872 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.684023 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.684753 11137 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
W20260709 12:10:09.683529 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74640.6us
W20260709 12:10:09.688843 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 148888us
W20260709 12:10:09.688789 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 140334us
W20260709 12:10:09.703750 12866 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:10:09.707821 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.708957 12864 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.710000 12864 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.711611 12751 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:09.712015 11214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:09.712855 11214 raft_consensus.cc:606] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.713279 11214 raft_consensus.cc:614] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.712102 12751 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:09.715309 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.716022 11142 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
W20260709 12:10:09.717072 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.715834 12751 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.717935 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:09.718663 11212 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:09.724917 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:09.725755 11292 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:09.732678 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:09.733575 11291 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:09.737138 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:09.740860 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.742838 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.743475 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:09.744400 11210 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.710181 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.705659 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:09.737775 11143 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:09.749244 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.686784 12840 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:09.755625 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:09.756485 11291 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
W20260709 12:10:09.756371 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50783.8us
I20260709 12:10:09.758705 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:09.759272 11213 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:09.759397 11217 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:09.761027 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.718170 12751 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.763330 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:09.761895 12755 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.765707 11291 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:09.766135 11215 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:09.769212 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:09.771847 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.773774 11219 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:09.769877 11290 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:09.775748 12844 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.776834 12822 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:09.777369 12868 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:09.778386 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:09.779114 11293 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:09.779711 12867 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:09.760854 12798 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.786093 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:09.755173 12568 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.688218 12861 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.770251 12642 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.790158 12819 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.790787 11143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:10:09.772006 12855 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.791800 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:09.792302 12690 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.788028 11210 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:09.804224 11219 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
W20260709 12:10:09.808220 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 98147.4us
I20260709 12:10:09.810652 12568 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.801527 12819 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.822012 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:09.801180 12844 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.831744 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:09.833076 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:09.844359 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.858626 12869 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.825742 12819 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.878837 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.880409 11137 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.880796 11137 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:09.886925 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:09.890875 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:09.879647 11141 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:09.891525 11142 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.899703 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:09.900005 12755 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.859167 12869 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:09.902102 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84518.2us
I20260709 12:10:09.862269 12838 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.858695 12798 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:09.907725 12838 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.913318 12838 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.915724 12798 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.917460 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:09.887823 12867 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:09.909876 12869 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.923292 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:09.894035 12486 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:09.905764 12873 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.890115 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:09.900646 12848 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.901048 12822 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.900664 12755 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:09.945971 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.997s (SENT) [suppressed 12 similar messages]
W20260709 12:10:09.982326 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.971899 12873 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.929174 11142 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:09.904986 12859 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:09.988356 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65293.7us
I20260709 12:10:09.965428 12864 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.972642 12848 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.984841 12873 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.976505 12755 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.998214 11138 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:09.991928 12823 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.007681 11293 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:10.015285 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.967402 12867 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.017916 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:10.019521 12867 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:09.924794 12568 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:09.996318 12848 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.027480 12738 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:10.037660 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:10.004555 12859 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.030315 12690 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:10.049301 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 148087us
I20260709 12:10:10.052006 11143 raft_consensus.cc:606] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:10.052470 11143 raft_consensus.cc:614] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:10.053105 12876 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:10:10.056036 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:10.043433 12864 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.066190 11210 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:10.066431 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.054780 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.082935 11143 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:10.099462 11217 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:10.106506 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 335026us
W20260709 12:10:10.080264 12878 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:10:10.081559 12751 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.121165 11138 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.996853 12844 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:10.143911 12869 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.146165 12869 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.149267 12859 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.151163 11140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:10:10.151882 11140 raft_consensus.cc:606] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:10.162804  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:10.172451 12620 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:10:10.178377 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:10.179112 11217 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:10.184394 11137 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.188350 11137 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.184549 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:10.193009 12819 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.194589 11214 raft_consensus.cc:2368] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4.
I20260709 12:10:10.203439 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:10.208266 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:10.213320 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:10.219789 11137 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:10.220554 11137 pending_rounds.cc:85] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 1
W20260709 12:10:10.228055 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.221212 11137 pending_rounds.cc:107] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:10.232116 11137 raft_consensus.cc:2889] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:10.196312 12819 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:10.228374 12838 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.227362 12888 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.240386 11826 leader_election.cc:400] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4.
I20260709 12:10:10.240759 11826 leader_election.cc:403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:10.246841 11211 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:10.247368 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.248200 11140 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.236620 12853 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:10.246870 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:10.262930 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:10.267421 11210 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:10.267460 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:10.229602 12431 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:10.275085 12819 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.237318 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:10.273659 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:10.278708 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:10.284829 11219 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.288648 11141 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.289191 11141 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:10.283867 12598 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:10.290156 11141 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.313678 11141 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:10.313846 12890 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:10:10.287293 12795 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.314817 12795 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:10.316341 12795 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.319525 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:10.321677 11285 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.322536 12813 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:10.323199 12813 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.325264 12813 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.271792 12660 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.335126 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:10.277416 12642 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.336323 12642 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.284049 12844 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.342724 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:10.313959 12858 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.286798 12819 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.335799 11289 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:10.248214 12862 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:10:10.292567 11136 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.291131 11140 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:10.337841 12839 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.276321 12848 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.291707 11284 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:10.349455 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 70976.9us
I20260709 12:10:10.353284 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:10.346973 12844 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.452584 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:10.359270 11141 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:10.464432 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:10.371912 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.406037 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:10.473583 11141 pending_rounds.cc:85] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 2
I20260709 12:10:10.474615 11141 pending_rounds.cc:107] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 12:10:10.474654 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 121482us
I20260709 12:10:10.354887 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:10.349948 12858 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:10.475052 11141 raft_consensus.cc:2889] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:10.475231 12844 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.348928 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.485145 12292 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.464872 11138 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:10.487138 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:10.487775 11290 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.485651 12292 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.415438 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:10.367655 11288 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:10.467021 12660 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4.
I20260709 12:10:10.536171 12292 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.500638 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.500236 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:10.480842 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 126023us
I20260709 12:10:10.537075 11140 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.506876 11210 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:10.507298 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.412328 12819 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:10.505056 12862 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:10:10.484684 12795 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:10.511610 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 109842us
I20260709 12:10:10.513396 12412 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:10.514871 12657 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:10.467780 12848 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.479444 12699 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.487679 12691 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.487162 12864 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.506808 12822 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.408402 12873 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.519285 11139 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:10.519666 11256 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:10.419966 12838 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.400293 12642 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.486351 12858 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.543417 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:10.545462 11140 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:10.357599 12755 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.550742 11213 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:10.550343 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.473649 12839 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.552349 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:10.583112 11860 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4.
I20260709 12:10:10.553121 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:10.555197 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:10.559434 11211 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.554563 12795 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:10.572734 11142 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:10.570869 11184 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:10.558415 12699 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:10.589779 12699 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.590183 12867 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.565444 12891 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:10.588968 12795 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.594412 12898 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.595027 12898 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:10.596012 12898 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.598800 12838 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.598860 12486 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.572697 12412 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.601511 12412 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.588224 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:10.603091 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:10.603657 12880 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.589s	user 0.004s	sys 0.002s
I20260709 12:10:10.599470 12838 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:10.605756 12893 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.606328 12893 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:10.605926 12838 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.551774 12840 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:10.607643 11852 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:10.610719 11136 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.612392 12755 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:10.615083 12902 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:10.567332 12598 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:10.616935 11107 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4.
I20260709 12:10:10.617336 11107 leader_election.cc:403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:10.566962 12691 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:10.618323 12691 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.618920 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.619693 11141 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:10.584060 11212 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:10.621176 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.607293 12893 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.629398 11290 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:10.607302 12620 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.562227 12657 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.644827 12844 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.648945 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:10.649379 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92331.1us
W20260709 12:10:10.653792 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 134223us
I20260709 12:10:10.654273 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:10.658066 11212 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:10.660871 12844 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.639462 12822 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.646346 12795 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:10.725440 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.747860 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.663115 12660 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.682896 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:10.757030 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63146.9us
I20260709 12:10:10.763672 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:10.764657 11292 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.767942 12861 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:10.769196 12657 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.772174 12839 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:10.772768 12873 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:10.779105 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 112704us
I20260709 12:10:10.779556 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:10.780520 11290 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.793121 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:10.793958 11860 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:10.795483 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:10.809521 11215 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:10.809521 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:10.787457 12660 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:10.831178 12906 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:10:10.831457 12678 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:10.824218 12839 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.832075 12678 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.832644 12839 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.835307 11292 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:10.863646 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:10.826333 12909 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:10:10.870359 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 90386.1us
I20260709 12:10:10.873265 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:10.876139 11290 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:10.833243 12839 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.804320 11288 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:10.848681 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:10.866034 12642 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.874658 12823 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.847812 12620 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.832628 12660 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.883241 12642 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:10.884256 12823 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:10.904935 12856 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:10.905504 12856 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:10.906893 12642 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.912284 12898 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.891515 12620 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.915203 12678 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.906530 12823 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.915876 12620 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:10.917761 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:10.921494 11136 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:10.918059 12568 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.922375 12568 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:10.923497 12568 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.924572 12568 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.904728 12858 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.918596 12898 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:10.918883 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:10.933216 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:10.938928 12858 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.939687 12795 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:10.955878 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:10.957013 11291 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:10.961812 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:10.962684 11290 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:10.964522 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:10.964672 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:10.965619 11135 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.954216  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:10.986716 11290 raft_consensus.cc:2410] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:10.988883 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:10.990248 12883 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.948695 12863 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:10.998018 12883 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:10.998785 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:10.999603 11216 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:11.000131 12883 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.000335 11212 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:11.000895 11211 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.002835 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet d9d29c78e55e4b76a84881d4f97aaec8 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36044
I20260709 12:10:10.985927 12699 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.007771 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:11.008548 11142 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:11.009238 12699 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.012424 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 248) took 4230 ms. Trace:
I20260709 12:10:10.942723 12642 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.014900  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:10.979936 12565 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:11.033084 11258 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.757s (SENT)
I20260709 12:10:11.035369 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.052927 11215 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:10.993700 12910 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:11.059908 11139 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:11.060230 11213 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:11.031558 12565 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.062222 12565 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.054618 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 191077us
I20260709 12:10:11.055936 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:11.065697 11135 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:11.066603 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:11.052693 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:11.070521 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.073663 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:11.075337 11137 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:11.079099 12898 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.085896 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:11.087508 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.088694 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.012825 11040 rpcz_store.cc:276] 0709 12:10:06.782158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.782338 (+   180us) service_pool.cc:224] Handling call
0709 12:10:11.012332 (+4229994us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.610613 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.611209 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.611248 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:09.611266 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:09.619818 (+  8552us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.619910 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.619953 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:09.620482 (+   529us) tablet.cc:701] Row locks acquired
0709 12:10:09.620506 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:10:09.620732 (+   226us) write_op.cc:270] Start()
0709 12:10:09.620862 (+   130us) write_op.cc:276] Timestamp: P: 1783599009620605 usec, L: 0
0709 12:10:09.620884 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.621606 (+   722us) log.cc:844] Serialized 1313 byte log entry
0709 12:10:09.693847 (+ 72241us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.864318 (+170471us) write_op.cc:301] APPLY: starting
0709 12:10:09.880324 (+ 16006us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.906131 (+ 25807us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.913101 (+  6970us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:09.913707 (+   606us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:09.913907 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:09.913954 (+    47us) write_op.cc:312] APPLY: finished
0709 12:10:10.011098 (+ 97144us) log.cc:844] Serialized 35 byte log entry
0709 12:10:10.023363 (+ 12265us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.023497 (+   134us) write_op.cc:454] Released schema lock
0709 12:10:10.027297 (+  3800us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.048598 (+ 21301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.049805 (+  1207us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":394917,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":130804,"apply.run_cpu_time_us":3220,"apply.run_wall_time_us":205220,"num_ops":3,"prepare.queue_time_us":92906,"prepare.run_cpu_time_us":3612,"prepare.run_wall_time_us":11371,"replication_time_us":72717,"thread_start_us":155423,"threads_started":2}]]}
W20260709 12:10:11.098351 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.100517 11284 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.100801 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.102159 12699 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.102685 11135 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.103071 12699 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:11.103576 12699 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.104889 12738 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:11.105095 12839 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.109200 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:11.109926 11291 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.123056 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.138579 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:11.137452 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50694.8us
I20260709 12:10:11.147486 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:11.148066 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:11.148644 11290 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:11.148861 11292 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.154678 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.161927 11292 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:11.169596 11290 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:11.177062 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:11.195503 11293 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.138016 12859 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.178222 12292 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.178951 11215 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:10:11.136831 12851 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:11.199000 12859 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.200160 12851 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.203245 12851 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.153810 12822 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4.
I20260709 12:10:11.206540 12859 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:11.209041 11290 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.214524 11141 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:11.151417 12923 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:11.183498 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 150452us
I20260709 12:10:11.182087 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:11.180528 12912 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.221678 11290 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.226867 11291 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:11.181596 12856 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.235347 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.236660 11292 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:11.225198 11293 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:10:11.239647 11258 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.749s (SENT)
I20260709 12:10:11.238922 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.251516 11290 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.255483 11290 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:11.253434 11292 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.265352 12699 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.267174 12642 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:11.267911 12839 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:11.271852 12891 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.273056 12891 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:11.273835 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:11.274657 12858 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:11.277168 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:11.277835 11137 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:11.277348 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.265974 12927 tablet_replica.cc:333] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:10:11.278842 11291 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4.
I20260709 12:10:11.275216 12858 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.239351 11288 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:11.293005 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:11.293831 11135 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:11.301426 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 119425us
I20260709 12:10:11.303507 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:11.250805 12910 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:11.305052 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:11.321172 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.325104 11215 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.333148 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:11.289049 12912 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.301052 12642 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.350638 12699 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:11.355798 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.357180 11135 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:11.321501 12898 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:11.358901 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.274137 12891 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.362532 12921 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.369354 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:11.370069 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.370843 12292 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:11.371323 12292 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.374467 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.346480 12923 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:11.380923 11216 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:11.361337 12898 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:11.387718 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:11.390012 12938 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:11.390451 12839 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:11.395686 12898 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.396947 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:11.355388 12642 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:11.403522 11258 leader_election.cc:336] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.800s (SENT)
I20260709 12:10:11.411010 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:11.411249 12292 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.412202 12938 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.382916 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:11.439437 11258 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.830s (SENT)
I20260709 12:10:11.342948 12910 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.411283 11211 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:11.386023 12921 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:11.404808 12839 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.476565 12927 raft_consensus.cc:2243] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:11.396781 12823 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.478603 12642 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.382349 12925 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 12:10:11.480242 12934 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:10:11.480696 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.481796 11859 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:11.473371 12292 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.396618 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.475005 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:11.487287 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.494910 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:11.496081 12923 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.491848 12839 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:11.497808 12839 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.500146 12910 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:11.500360 12823 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:11.502163 12927 raft_consensus.cc:2272] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:11.505172 12927 ts_tablet_manager.cc:1916] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:11.506229 12921 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.507448 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:11.509303 11857 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.482545 12858 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:11.491788 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60317.9us
W20260709 12:10:11.512686 12904 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:10:11.541661 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:11.544592 12910 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:11.549723 12839 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.551009 11143 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:11.552757 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55723us
W20260709 12:10:11.559226 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 119834us
W20260709 12:10:11.560542 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.566637 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:11.553151 12642 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.552678 11214 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.571095 11216 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.573359 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:11.575103 12912 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:11.564920 12938 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:11.578336 11258 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.840s (SENT)
I20260709 12:10:11.556902 12899 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.566881 12858 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.585876 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:11.591151 12412 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.576009 12916 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:11.556824 12565 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.587790 12859 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:11.581548 12642 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:11.617588 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:11.623361 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45066.8us
W20260709 12:10:11.624305 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.858s (SENT)
I20260709 12:10:11.626143 11210 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:11.624892 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:11.581061 12851 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:11.613289 12838 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.590675 12795 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:10:11.639074 11258 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.992s (SENT)
I20260709 12:10:11.639601 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:11.641743 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.642596 11216 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:11.643426 11219 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.644361 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.644876 11211 raft_consensus.cc:2368] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:11.645377 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.646051 11217 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:11.604418 12858 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.619405 12859 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:11.651567 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.609786 12910 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:11.658265 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.659245 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:11.671905 11216 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:11.675973 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:11.677649 11258 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.134s (SENT)
W20260709 12:10:11.685492 12941 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:11.667312 12859 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:11.691183 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 100491us
I20260709 12:10:11.689625 12839 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.694383 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.660954 12899 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.701699 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.706424 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:11.709342 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.690357 12947 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.647693 12838 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:11.736281 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.749903 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:11.726933 12642 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.753657 12899 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:11.755731 12899 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.756484 12858 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:11.690239 12898 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.756374 12899 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:11.770740 12899 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.790966 12565 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.803053 12898 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.804435 12838 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.813462 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:11.814229 11852 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:11.827095 11258 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.520s (SENT)
W20260709 12:10:11.828502 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.829348 11258 leader_election.cc:336] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.992s (SENT)
I20260709 12:10:11.844007 12859 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:11.864734 11852 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:11.870134 11292 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:11.877724 11858 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.878572 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 530) took 1477 ms. Trace:
I20260709 12:10:11.879002 11858 rpcz_store.cc:276] 0709 12:10:10.400925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.402722 (+  1797us) service_pool.cc:224] Handling call
0709 12:10:11.875847 (+1473125us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:11.877532 (+  1685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.878260 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.878462 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34586368}
I20260709 12:10:11.884768 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:11.896826 11216 raft_consensus.cc:1217] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 12:10:11.897302 11216 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:11.900875 11216 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.902460 12859 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:11.904603 11285 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.912165 12927 ts_tablet_manager.cc:1929] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:11.912786 12927 log.cc:1199] T d9d29c78e55e4b76a84881d4f97aaec8 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/d9d29c78e55e4b76a84881d4f97aaec8
I20260709 12:10:11.914057 12927 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36044 (request call id 72) took 1006 ms. Trace:
I20260709 12:10:11.914376 12927 rpcz_store.cc:276] 0709 12:10:10.968409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.002538 (+ 34129us) service_pool.cc:224] Handling call
0709 12:10:11.264627 (+262089us) ts_tablet_manager.cc:1151] Deleting tablet d9d29c78e55e4b76a84881d4f97aaec8
0709 12:10:11.264730 (+   103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:11.811841 (+547111us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:11.911999 (+100158us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:11.913909 (+  1910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6228,"tablet-delete.queue_time_us":236246,"thread_start_us":135376,"threads_started":1}
I20260709 12:10:11.930240 12947 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:11.931550 12947 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.931958 12947 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:11.932870 12947 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.934062 12947 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.951911 11286 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.715128 11211 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:11.959072 11211 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.979698 12431 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:11.980346 12431 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:11.981786 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 170) took 1293 ms. Trace:
I20260709 12:10:11.982508 12431 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:11.982144 11141 rpcz_store.cc:276] 0709 12:10:10.688515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.688687 (+   172us) service_pool.cc:224] Handling call
0709 12:10:11.981576 (+1292889us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400253ad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:11.981703 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035572992}
W20260709 12:10:11.998010 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.998850 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.015373 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 311453us
W20260709 12:10:12.021410 11258 leader_election.cc:336] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.948s (SENT)
W20260709 12:10:12.023401 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.023321 12893 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.023976 12893 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:12.035296 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.038339 11258 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.116s (SENT)
I20260709 12:10:12.043380 11855 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.045953 12947 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:12.048851 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.050092 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:11.997397 11217 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:12.057893 11217 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:12.060413 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:12.062860 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.060426 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:12.064777 12947 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.026258 12893 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:12.064837 11284 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.066921 12755 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:12.072518 11219 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.077417 12864 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:12.077625 12642 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:12.064970 11258 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.997s (SENT)
I20260709 12:10:12.086877 11285 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:12.088406 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:12.078063 12864 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.074537 11284 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:12.078163 12642 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.099622 12642 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:12.097190 12864 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:12.114795 11290 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:12.115301 11290 pending_rounds.cc:85] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 1
I20260709 12:10:12.115525 11290 pending_rounds.cc:107] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:12.115784 11290 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:12.118300 11217 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.121948 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:12.122318 12965 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.122993 12965 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.126071 12864 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:12.126629 12864 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.128664 12864 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.129070 11290 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:12.132418 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:12.134967 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.135977 11141 raft_consensus.cc:2410] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:12.136301 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:12.137176 11215 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:12.138033 11858 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:12.139348 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.140251 11141 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:12.143093 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.143885 11141 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:12.146831 11219 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.134284 12965 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.148533 12620 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:12.150823 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.150795 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:12.152724 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.157531 11144 raft_consensus.cc:2410] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:12.153885 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:12.154408 12926 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.158620 12926 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.161129 12926 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.154875 11143 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:12.155126 12678 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.163852 12678 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.169977 12678 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:12.171660 11214 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 12:10:12.172098 11214 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:12.172984 11216 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.175846 11212 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:12.176040 12893 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:12.171710 12926 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.180408 12926 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:12.180516 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:12.180930 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1367) took 1192 ms. Trace:
I20260709 12:10:12.181272 11210 rpcz_store.cc:276] 0709 12:10:10.988273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.988426 (+   153us) service_pool.cc:224] Handling call
0709 12:10:12.180725 (+1192299us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b540035c354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:12.180851 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463019264}
I20260709 12:10:12.181560 12926 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.183504 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:12.184250 12660 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.184724 12965 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.184824 12660 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.185364 12965 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:12.186852 11258 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.666s (SENT)
I20260709 12:10:12.210193 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.190428 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:12.226933 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.227241 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:12.218776 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.213109 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.230717 12965 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.230993 12840 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:12.229266 12838 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:12.232857 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.233829 11140 raft_consensus.cc:2368] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:12.193408 12660 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:12.235688 12938 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:12.237362 11290 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.188325 12864 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:12.239012 12864 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.239578 12838 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:12.240568 12838 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.242455 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:12.250604 12864 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.266256 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.267588 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.268112 11144 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.277756 12798 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.278226 12798 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:12.279192 12798 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.280457 12798 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.283375 12938 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:12.285539 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.286195 11140 raft_consensus.cc:2376] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4. Re-sending same reply.
W20260709 12:10:12.422849 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.566680 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.571444 12965 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.572265 12965 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.576632 12965 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:12.586750 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.725934 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.589499 12565 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.726971 12565 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.730018 12565 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.602792 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.731276 11140 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:12.607177 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.735153 12565 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.735967 12565 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.666085 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.600908 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.743328 11138 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:12.605003 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.743889 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.744735 11136 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:12.745002 11140 raft_consensus.cc:2368] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:10:12.746338 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.747324 11141 raft_consensus.cc:2376] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4. Re-sending same reply.
I20260709 12:10:12.748615 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.749755 11143 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:12.740548 12965 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.741173 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.770643 12965 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.773720 12965 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:12.855530 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.890558 12965 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:12.875842 11215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.013s	sys 0.022s
I20260709 12:10:12.885049 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:12.891273 11215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.013s	sys 0.022s
I20260709 12:10:12.886970 12678 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.891070 12965 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.895310 12565 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.896394 12565 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:12.896898 12565 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.892812 12678 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.900377 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1370) took 1831 ms. Trace:
I20260709 12:10:12.901286 12678 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.900772 11213 rpcz_store.cc:276] 0709 12:10:11.069355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.069515 (+   160us) service_pool.cc:224] Handling call
0709 12:10:11.077186 (+  7671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.077508 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.077535 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.239123 (+1161588us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:10:12.239593 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.266114 (+ 26521us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:12.266148 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.266210 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.900029 (+633819us) raft_consensus.cc:1685] finished
0709 12:10:12.900049 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.900295 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4220,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":39151872,"thread_start_us":26196,"threads_started":1,"wal-append.queue_time_us":653719}
I20260709 12:10:12.903033 12678 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.902422 11211 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.903556 12678 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.905954 12965 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:12.645202 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.908494 12565 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:12.909137 11137 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:12.911824 12965 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:12.913784 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.912431 12965 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.915810 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.917470 11137 raft_consensus.cc:1813] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Handling vote request from an unknown peer ba2779405e8d452e95f42421b2b60928
I20260709 12:10:12.918005 11137 raft_consensus.cc:2410] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:12.918391 12678 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.923118 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.924026 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.924993 11139 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:12.924850 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.925688 11142 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:12.926113 12975 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.926699 12975 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.929180 12975 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:12.929704 12975 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:12.931034 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.932904 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:12.936880 11144 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.666s	user 0.003s	sys 0.004s
I20260709 12:10:12.937269 11144 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:12.939401 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.941800 11143 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.942269 11143 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:12.948549 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.945334 11143 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.950479 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.950565 11141 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.951452 11141 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:12.952165 11141 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.950551 11142 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:10:12.953527 11143 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.952939 11142 pending_rounds.cc:85] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 1
I20260709 12:10:12.930264 12975 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:12.954612 11142 pending_rounds.cc:107] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:10:12.954924 11141 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.955206 11142 raft_consensus.cc:2889] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:12.954367 11144 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:12.960245 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.967667 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:12.968735 11137 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:12.979544 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:12.980439 11142 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:12.987883 11141 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:12.979619 12747 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.998060 12747 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:12.998962 12691 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.999588 12691 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.000077 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 1537) took 1294 ms. Trace:
I20260709 12:10:13.000579 12747 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:13.000474 11292 rpcz_store.cc:276] 0709 12:10:11.705605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.706097 (+   492us) service_pool.cc:224] Handling call
0709 12:10:12.999796 (+1293699us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000f69d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:12.999983 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373715328}
I20260709 12:10:13.005209 12642 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.005896 12642 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.006345 12691 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.008656 12642 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.012605 12975 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.016752 11289 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.018121 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1238) took 1854 ms. Trace:
I20260709 12:10:13.018594 11143 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.019001 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1223) took 1339 ms. Trace:
I20260709 12:10:13.019394 11217 rpcz_store.cc:276] 0709 12:10:11.679395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.059937 (+380542us) service_pool.cc:224] Handling call
0709 12:10:12.118133 (+ 58196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.118873 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.018815 (+899942us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b5400294fd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:13.018941 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126840576}
I20260709 12:10:13.024204 12858 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:13.024809 12858 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.020727 11289 rpcz_store.cc:276] 0709 12:10:11.163840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.163987 (+   147us) service_pool.cc:224] Handling call
0709 12:10:11.714372 (+550385us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:13.016547 (+1302175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.017244 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.017886 (+   642us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000f69d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:13.018035 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3003359360}
I20260709 12:10:13.027208 12858 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.029567 12858 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.030334 11287 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.030110 12858 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.031155 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1240) took 1866 ms. Trace:
I20260709 12:10:13.031564 11287 rpcz_store.cc:276] 0709 12:10:11.164984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.165109 (+   125us) service_pool.cc:224] Handling call
0709 12:10:13.029906 (+1864797us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:13.030135 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.030878 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.031096 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6761216}
I20260709 12:10:13.032459 12858 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.028419 12965 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:13.034960 11143 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:13.035419 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.035409 11143 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:13.037134 11143 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.037809 11142 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.038125 11143 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.038249 11142 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:13.039253 11142 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:13.040150 11142 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.040849 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.045329 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.046597 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.048861 11141 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:13.049005 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 173) took 1655 ms. Trace:
I20260709 12:10:13.049435 11218 rpcz_store.cc:276] 0709 12:10:11.393692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.393838 (+   146us) service_pool.cc:224] Handling call
0709 12:10:13.048415 (+1654577us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5800004b98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:13.048574 (+   159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.048718 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.048743 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.048779 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.048805 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.048853 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.048946 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10747648}
I20260709 12:10:13.050704 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.051003 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.051507 11137 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:13.052472 11144 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:13.053965 11144 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.054268 11144 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:13.054839 11143 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:13.055089 11144 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.056327 11144 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.056839 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.057942 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.058522 11140 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.059077 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.064144 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.064762 11143 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.070302 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.071007 12840 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.071596 12840 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.072088 11143 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:13.073418 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.074028 11136 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:13.074539 12840 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.076687 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.081103 11142 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:13.076719 11140 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
W20260709 12:10:13.083102 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.085067 11135 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:13.095126 11144 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.097416 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.098476 11144 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:13.095216 12910 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.099242 12910 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:13.100102 12798 consensus_meta.cc:287] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.819s	user 0.014s	sys 0.000s
W20260709 12:10:13.101822 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.101791 12910 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.113736 11861 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:13.122339 12840 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.123025 12840 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:13.124879 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.125356 12840 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.127131 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:13.129462 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.129685 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.130692 11136 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:13.132416 12598 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:13.133351 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.132993 12598 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.135454 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.135692 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.136283 11141 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:13.136456 11144 raft_consensus.cc:2368] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:13.137079 12910 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:13.135557 12598 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.137902 12910 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:13.138374 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.139696 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.142992 11135 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.143298 11135 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:13.144979 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.138774 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:13.146193 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.152923 11140 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:13.145018 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.160830 11213 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:13.114243 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.160548 11135 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.163121 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.257463 12412 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.319100 11144 raft_consensus.cc:2410] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:13.192320 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.319839 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.200917 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.319264 12412 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.159564 12950 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 12:10:13.320966 11142 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.166548 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.316833 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:13.285622 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 150554us
W20260709 12:10:13.320272 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.316494 12983 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.317785 11135 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.325344 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.243295 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.326079 11140 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.326366 11138 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.327124 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.328351 12412 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.324440 11259 leader_election.cc:400] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:13.329253 12412 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.329258 11259 leader_election.cc:403] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:13.329741 12412 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:13.324564 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82521.5us
I20260709 12:10:13.322088 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.249275 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.331537 11137 raft_consensus.cc:2376] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5. Re-sending same reply.
I20260709 12:10:13.189297 11141 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:13.327339 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.158286 12910 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:13.223254 11143 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.334939 11143 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:13.324564 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.335681 11143 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.320219 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.338125 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:13.338886 11143 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.339753 11144 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.341480 11140 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:13.341593 11135 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.342245 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.343259 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.341899 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:13.338598 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.344957 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.345448 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.348377 11140 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:13.333525 12864 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.349117 12864 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:13.350266 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.158602 12598 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:13.344995 12412 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.357597 12883 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.358465 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.368144 11137 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:13.368999 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.368470 12910 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.369597 11137 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:13.358156 12883 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.354190 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.396610 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.240258 12920 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.355261 12598 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.370227 12910 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.344143 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.379048 12982 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.400305 11140 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:13.379655 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1222) took 1713 ms. Trace:
I20260709 12:10:13.380672 12892 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:13.391415 11137 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.406211 11141 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:13.392598 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.407107 11140 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:13.407675 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.408869 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.409523 11210 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:13.392664 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.393839 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:13.415954 11218 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.393085 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.394308 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.394934 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:13.393296 11215 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.337122 12983 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.343055 12935 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.376646 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:13.444682 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 109817us
I20260709 12:10:13.399317 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.370601 12755 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:13.404999 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.406384 11137 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:13.391924 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49999.7us
I20260709 12:10:13.402405 11211 rpcz_store.cc:276] 0709 12:10:11.666531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.959763 (+293232us) service_pool.cc:224] Handling call
0709 12:10:12.902245 (+942482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.903909 (+  1664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.379401 (+475492us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54001d3650. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:13.379581 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166885248}
W20260709 12:10:13.418910 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.353363 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.455399 11135 raft_consensus.cc:2376] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2. Re-sending same reply.
I20260709 12:10:13.456656 11135 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.417183 11212 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:13.431244 11143 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:13.459633 11143 pending_rounds.cc:85] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 5
I20260709 12:10:13.459949 11143 pending_rounds.cc:107] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:13.460228 11143 raft_consensus.cc:2889] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:13.433600 11210 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.436761 12989 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:13.436731 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 106510us
W20260709 12:10:13.443418 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.445560 11219 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:13.396564 12883 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.451236 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.452172 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:13.466588 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 49673.4us
I20260709 12:10:13.468075 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:13.409435 11139 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.432996 12965 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:13.474056 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:13.420969 12642 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.471391 11140 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:13.474409 11137 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.476522 11137 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.458297 12892 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.483206 11218 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:13.485175 12598 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:13.485402 12944 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:13.486131 12892 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.405761 12920 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.488432 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:13.420616 12982 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.479869 12642 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.502851 11137 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:13.503005 12642 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:13.478435 12965 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.500972 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.504374 11292 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.479379 12620 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:13.505189 12965 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:13.505089 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:13.506115 12943 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.500757 12823 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.510695 12983 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.510818 12949 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.512914 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.513638 11292 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.504369 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.517490 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.468839 12990 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:10:13.520733 11258 connection.cc:256] RPC call timeout handler was delayed by -1.2663166190000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 12:10:13.521077 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:13.522282 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:13.523696 12892 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.523762 12839 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.520884 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.524435 12839 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.469053 12989 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.524825 12839 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.526908 12989 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.528170 12920 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:13.529568 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.531349 12926 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.531780 12926 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.531967 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet d9d29c78e55e4b76a84881d4f97aaec8 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:10:13.532182 12926 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.533107 12660 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.533600 12660 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:13.542441 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:13.580068 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.585062 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119990us
W20260709 12:10:13.592458 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70603.5us
W20260709 12:10:13.593075 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.602368 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79366us
W20260709 12:10:13.603545 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 135554us
I20260709 12:10:13.604278 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:13.608193 12819 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:13.597271 11240 debug-util.cc:398] Leaking SignalData structure 0x7b08001cb280 after lost signal to thread 9941
I20260709 12:10:13.608721 12819 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:13.609153 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:13.609539 11258 connection.cc:256] RPC call timeout handler was delayed by -1.0602166190001299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:10:13.610119 11258 connection.cc:256] RPC call timeout handler was delayed by -1.0112007969999013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 12:10:13.610639 12987 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.611228 12987 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.612003 12819 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:13.613272 12987 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:13.613960 12883 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.615056 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.616065 12982 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:13.616659 12982 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:13.617107 12982 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.617560 11038 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:13.619309 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:13.619231 11038 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 3 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129), VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130), VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131), VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 3 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:13.622846 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.567431 12691 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.623951 11210 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:13.604710 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:13.626017 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:13.626057 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.627420 11215 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:13.633137 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:13.633834 11141 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:13.634873 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:13.636543 11143 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.671818 11110 leader_election.cc:400] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:13.622144 12935 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:13.674099 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:13.624058 12950 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.674453 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:13.672652 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.680387 11212 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:13.682358 11038 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:10:13.689473 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.675565 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 206349us
I20260709 12:10:13.642275 12991 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.634861 12691 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.700366 11143 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:13.641644 12944 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.676810 11240 debug-util.cc:398] Leaking SignalData structure 0x7b080019c5c0 after lost signal to thread 11076
I20260709 12:10:13.534746 12660 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.672464 12486 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.703099 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:13.723824 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.727370 12486 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:13.727770 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.727888 12486 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.728163 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.728621 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.728953 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.729287 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.729579 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.645918 12690 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:13.676561 13003 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.673915 12998 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.679862 12892 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:13.696592 12883 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:13.747529 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 105601us
I20260709 12:10:13.749743 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:13.703050 12965 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.704191 12944 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.703497 12991 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.702533 12691 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.754299 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.787714 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.759478 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:13.769351 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.789202 12989 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:13.791028 12989 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:13.794333 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.739141 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.702656 12920 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:10:13.803802 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:13.806730 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:13.783483 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57817.1us
I20260709 12:10:13.706348 13001 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.794018 12991 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.768517 12996 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.786794 12944 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.751329 12975 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.792862 12823 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.798054 12660 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.824415 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.836572 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:13.837275 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.802044 12642 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:13.812165 12982 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:13.821192 12995 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.812379 12841 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.784384 12892 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.823252 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.793491 12965 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.853691 11286 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.826972 12924 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.805908 12755 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:13.831511 11287 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:13.838689 12996 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:13.857266 12935 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.859272 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.784797 12998 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:13.888821 11143 raft_consensus.cc:2376] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4. Re-sending same reply.
I20260709 12:10:13.890887 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.892546 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.835433 13003 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:13.839298 12975 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.898088 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.870867 12823 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.826481 13001 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:13.904515 13005 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:13.905311 12965 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:13.905895 12992 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:10:13.869705 12995 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:13.871287 12604 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.870358 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:13.964246 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.887154 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:13.976701 11286 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:13.866088 12841 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:13.999377 12412 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:10:13.997480 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.076756 11290 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:14.041213 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:13.989754 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:14.037312 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.078974 11286 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:14.086407 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.040279 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.117072 11855 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:14.080830 12486 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.120472 12486 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.120882  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:13.995366 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.121281 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.041683 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.122641 11289 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
W20260709 12:10:14.125406 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.979518 13006 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 12:10:14.055312 13002 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.303s	user 0.000s	sys 0.003s
I20260709 12:10:13.992894 13001 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.040868 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:14.001823 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.008065 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.044198 13000 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.044271 12989 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.145704 12486 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.988984 12604 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.168814 12486 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.169066 13000 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.170725 12841 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.171114 12604 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:14.151307 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 339945us
I20260709 12:10:14.172075 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:14.173359 12893 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.173746 12893 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:13.999181 13025 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.157s
W20260709 12:10:14.174476 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.005126 12892 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:14.158881 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 322373us
I20260709 12:10:14.181173 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.182111 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:14.151741 12950 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:13.976394 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.161306 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.162288 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:13.879572 12924 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:14.174052 12926 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.010s
W20260709 12:10:14.180311 13026 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:14.025610 13018 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.154942 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 324042us
W20260709 12:10:14.205726 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.183097 11144 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:14.179551 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.003557 12998 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:14.208319 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 47138.6us
I20260709 12:10:14.209986 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:14.192684 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:13.899537 12935 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.164619 12975 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:14.150377 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 308189us
I20260709 12:10:14.199664 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.171049 12486 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.174096 12893 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.172075 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.195075 12841 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:14.231935 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.171059 13000 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:14.218945 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.191219 13019 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:14.198081 12949 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.000339 12996 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.222718 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:14.206318 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.229213 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:14.277676 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48541.9us
I20260709 12:10:14.261899 12691 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.242362 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:14.243625 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.244414 12935 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.217054 13018 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.223896 12982 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.245489 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:14.246903 12839 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.722s	user 0.018s	sys 0.002s
I20260709 12:10:14.238508 12949 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.248381 12991 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.223685 12994 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.249466 12864 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.249148 13019 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:14.251359 11240 debug-util.cc:398] Leaking SignalData structure 0x7b080038c020 after lost signal to thread 11168
I20260709 12:10:14.239108 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.249176 12893 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:14.256819 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.363214 11219 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:14.363595 11215 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.256522 12950 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.256985 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.238653 12841 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.267410 13028 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:14.268839 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1532) took 2678 ms. Trace:
I20260709 12:10:14.203464 12926 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.047621 12995 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.226388 12983 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:10:14.273886 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.275278 12924 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.275801 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.225677 12486 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:14.277740 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71520.2us
I20260709 12:10:14.378720 12486 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.379269 12486 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.278469 11860 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:14.381547 11218 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.279601 13033 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.382180 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.382275 13027 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:14.382898 13033 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.382669 12858 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.383292 13033 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.383204 12798 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:14.384282 13027 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.278100 13025 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.297791 11139 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.385948 11258 leader_election.cc:400] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:14.386269 11258 leader_election.cc:403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:14.387249 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:14.388721 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.389513 13027 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.304159 13040 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.278921 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:14.390621 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.311510 13018 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:14.391158 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 112338us
I20260709 12:10:14.391290 12598 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.391703 12598 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.391857 13018 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.392086 12598 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.393543 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.394004 12926 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.312242 12982 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.313539 13044 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.319614 12949 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.364535 11292 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:14.402835 11139 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:14.365465 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.366525 11293 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:14.368521 11291 rpcz_store.cc:276] 0709 12:10:11.590441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.590592 (+   151us) service_pool.cc:224] Handling call
0709 12:10:11.590891 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.704363 (+113472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.704391 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.722223 (+ 17832us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.796335 (+ 74112us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:11.809787 (+ 13452us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.810043 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.268375 (+2458332us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400418cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:14.268432 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.268487 (+    55us) raft_consensus.cc:1685] finished
0709 12:10:14.268599 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.268748 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23384,"prepare.queue_time_us":14346,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":20392,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":276,"spinlock_wait_cycles":236388736,"thread_start_us":45037,"threads_started":1,"wal-append.queue_time_us":97956,"wal-append.run_cpu_time_us":2478,"wal-append.run_wall_time_us":1002496}
I20260709 12:10:14.320160 12839 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:14.281149 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.387475 13025 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
W20260709 12:10:14.407807 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.408341 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.408679 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.303284 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84416us
I20260709 12:10:14.410931 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.390676 13040 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.316056 13003 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.396339 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.318789 12944 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.402071 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.429721 12823 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.429977 12944 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.431058 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.431568 12991 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.432193 12991 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.432448 11286 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:14.433383 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.433681 11286 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:14.435212 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.437104 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 224986us
I20260709 12:10:14.438355 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:14.384135 12858 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:14.406795 13018 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:10:14.414175 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.415422 12864 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.395198 13028 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:14.419529 13037 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:10:14.419950 13042 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.422304 12982 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.423475 11212 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.425348 13003 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.426380 12965 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.427284 12893 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:14.443192 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.379448 12983 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
W20260709 12:10:14.445096 11240 debug-util.cc:398] Leaking SignalData structure 0x7b080035bc20 after lost signal to thread 11243
I20260709 12:10:14.468284 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.484068 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.471303 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:14.476086 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 442) took 1367 ms. Trace:
I20260709 12:10:14.484611 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.440368 12823 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:14.488551 12823 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.487020 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.489674 11210 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:14.435817 13040 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.486270 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.485356 11860 rpcz_store.cc:276] 0709 12:10:13.108419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.108527 (+   108us) service_pool.cc:224] Handling call
0709 12:10:13.608984 (+500457us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:14.475744 (+866760us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400659854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:14.475966 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550468224}
W20260709 12:10:14.486946 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72881.5us
I20260709 12:10:14.489831 12823 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.447010 13003 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.500597 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50116.6us
I20260709 12:10:14.481248 13047 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.492739 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.494362 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:14.448427 12965 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:14.463136 12991 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.500504 11289 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:14.504334 11144 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.511248 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.504309 11210 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:14.505276 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:14.483585 11240 debug-util.cc:398] Leaking SignalData structure 0x7b0800396460 after lost signal to thread 11244
I20260709 12:10:14.514540 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:14.515319 11139 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.517735 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:14.524032 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.526984 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.490937 12926 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.482677 12864 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:14.539909 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:14.535813 12863 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:10:14.561508 12993 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.738s	user 0.000s	sys 0.003s
I20260709 12:10:14.541478 12999 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:10:14.564200 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79651.5us
I20260709 12:10:14.565564 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.566849 12935 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.567247 12935 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.567625 12935 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.500511 12642 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.565788 13032 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.577181 11144 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:10:14.582536 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.586786 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44165.8us
I20260709 12:10:14.588904 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.536736 13025 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.558478 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:14.551697 11139 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:14.536309 13044 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.489585 12893 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:14.610766 11213 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.542928 12926 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.604717 11212 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:14.628114 13063 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.628609 13055 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.628798 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:14.637935 11139 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:14.586216 13032 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:14.631013 11258 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.021s (SENT)
I20260709 12:10:14.623092 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.594370 12691 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:14.640347 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.643911 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.613272 13047 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:14.630909 11240 debug-util.cc:398] Leaking SignalData structure 0x7b0800355480 after lost signal to thread 11317
W20260709 12:10:14.645251 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 103465us
I20260709 12:10:14.557986 12660 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:10:14.598968 12642 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.620671 12995 raft_consensus.cc:2764] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 12:10:14.647642 11258 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.180s (SENT)
W20260709 12:10:14.667171 11258 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.200s (SENT)
I20260709 12:10:14.639552 13032 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.556677 12990 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:10:14.634161 12926 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.649367 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.670877 11213 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:14.672107 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.673092 11213 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:14.674206 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.652556 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:14.675114 11139 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.675726 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.656634 12486 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.595170 12996 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:14.650454 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.670181 12841 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:14.723049 13062 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:10:14.662607 11240 debug-util.cc:398] Leaking SignalData structure 0x7b0800386b60 after lost signal to thread 11318
I20260709 12:10:14.727469 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:14.639875 13063 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:14.731024 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80789.4us
W20260709 12:10:14.737421 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.736302 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:14.741027 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:14.744709 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.745316 11217 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.745852 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.752678 12920 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.753082 12920 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:14.637908 12965 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.757795 13064 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.760485 13028 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.762430 13036 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.769104 12996 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.671598 12864 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.773968 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.775434 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.737181 12839 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.776839 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.776906 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:14.777712 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 188894us
I20260709 12:10:14.777383 12920 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.779742 11139 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:14.786952 12412 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:14.788414 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.792418 11213 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.824662 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.824802 12412 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.825273 12412 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:14.796489 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
W20260709 12:10:14.822551 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45725.4us
I20260709 12:10:14.826226 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:14.779265 11136 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:14.827087 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1369) took 1510 ms. Trace:
I20260709 12:10:14.825814 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:14.828178 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:14.828989 11259 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.828099 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.831065 11216 raft_consensus.cc:606] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:14.826345 12412 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.831444 11216 raft_consensus.cc:614] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:14.832274 12412 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.834179 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:14.834379 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.827517 11136 rpcz_store.cc:276] 0709 12:10:13.316968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.335925 (+ 18957us) service_pool.cc:224] Handling call
0709 12:10:14.740865 (+1404940us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800005198. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:14.827024 (+ 86159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8172800}
I20260709 12:10:14.838742 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.839113 11259 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:14.794062 11240 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4b00 after lost signal to thread 11885
I20260709 12:10:14.840917 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:14.843948 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:14.789887 13036 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:14.846107 11857 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.817536 12642 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.801959 12965 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.846386 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:14.849001 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:14.820441 12691 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.830003 13046 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.830272 12995 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.830878 12996 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:14.841744 11240 debug-util.cc:398] Leaking SignalData structure 0x7b0800296ea0 after lost signal to thread 11886
I20260709 12:10:14.848093 12989 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.873723 12989 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:14.874027 11216 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:14.875141 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:14.875708 11216 raft_consensus.cc:606] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.853067 13042 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.876628 13042 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.877122 13042 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.879648 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:14.880241 11218 raft_consensus.cc:606] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.853142 13029 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.848400 13018 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.855728 11110 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4.
I20260709 12:10:14.884452 11139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:10:14.856056 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:14.885085 11139 raft_consensus.cc:606] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.885238 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:14.885510 11139 raft_consensus.cc:614] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:14.857223 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 1563) took 1169 ms. Trace:
W20260709 12:10:14.864991 13035 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.496s	user 0.003s	sys 0.000s
I20260709 12:10:14.868607 12691 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:14.858438 12798 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.858521 12755 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.887210 11287 rpcz_store.cc:276] 0709 12:10:13.687821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.697030 (+  9209us) service_pool.cc:224] Handling call
0709 12:10:14.857005 (+1159975us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54003f0cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:14.857154 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45674368}
I20260709 12:10:14.888062 12755 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:14.888989 12691 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.889219 13040 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.889104 12755 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.889989  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:14.890695 11138 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.890231 11287 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:14.871081 12996 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:14.893196 12996 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.868732 11136 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.894017 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.897351 12995 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.897709 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.787747 12935 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.854307 13069 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.903414 11216 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.907672 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:14.910895 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:14.911232 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53598.7us
I20260709 12:10:14.911239 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:14.874362 12989 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:14.913913 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.914536 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:14.907326 13033 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.006s
W20260709 12:10:14.906045 12598 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260709 12:10:14.914937 13055 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.886142 13032 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.913347 12642 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.922116 12598 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.929021 13063 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:14.921914 13033 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.962815 13036 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.916869 13044 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.974671 13055 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.975632 12660 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:14.987954 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:14.975025 12949 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.552s	user 0.002s	sys 0.011s
I20260709 12:10:14.990689 11288 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.990360 12598 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.994570 12486 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:14.995486 13032 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:14.997457 13061 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 12:10:14.998782 13025 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.998528 13003 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:14.998982 13014 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:14.999953 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:14.985383 13040 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.007556 11286 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:15.017036 12996 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:15.028072 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113654us
I20260709 12:10:15.032078 11291 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.025990 13044 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:15.038311 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.039880 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.042691 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.037009 13025 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.054093 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.044519 13063 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.056515 12412 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.056993 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.030941 12660 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.059581 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.062004 11292 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:15.044900 13055 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.029186 12949 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.043030 13044 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.049853 13040 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.065990 11140 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.067608 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.063079 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.069209 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.074153 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.077287 11140 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:15.068799 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.078915 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.079053 11855 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.080437 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.073951 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.082108 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.082683 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.083184 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.083909 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.086889 11215 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.068167 13072 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:10:15.063333 12935 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.088579 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.064131 13055 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:15.087066 12910 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:15.089689 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.065742 13040 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:15.090796 12989 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.093791 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 194) took 1339 ms. Trace:
W20260709 12:10:15.065871 13071 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:15.042388 13014 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.067893 12965 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.099733 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.102596 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.074867 12996 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.108151 12949 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.108608 12660 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:15.109454 12983 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:15.111295 12823 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.605s	user 0.014s	sys 0.003s
I20260709 12:10:15.099316 12598 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:15.112485 13019 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.105805 11143 rpcz_store.cc:276] 0709 12:10:13.754534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.759205 (+  4671us) service_pool.cc:224] Handling call
0709 12:10:15.093561 (+1334356us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400253ad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:15.093712 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230118784}
I20260709 12:10:15.074268 12926 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.113282 13040 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.116371 13042 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.118854 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.119522 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.123358 11290 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.104619 13055 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.128983 11144 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.133587 12926 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:15.134260 13031 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.867s	user 0.003s	sys 0.000s
I20260709 12:10:15.120491 12983 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:15.130291 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.136605 11139 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:10:15.145970 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.146283 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 196) took 1388 ms. Trace:
I20260709 12:10:15.146723 11135 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:15.146834 11141 rpcz_store.cc:276] 0709 12:10:13.755197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.756446 (+  1249us) service_pool.cc:224] Handling call
0709 12:10:13.756771 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.757134 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.757170 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.757694 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.153831 (+396137us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.153889 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.153988 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.133670 (+979682us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:15.137872 (+  4202us) raft_consensus.cc:1685] finished
0709 12:10:15.137905 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.144016 (+  6111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12910,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":8827,"spinlock_wait_cycles":12524416,"thread_start_us":349131,"threads_started":1,"wal-append.queue_time_us":482217}
I20260709 12:10:15.124317 13033 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.159186 11139 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:15.160490 13003 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.161448 13014 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:15.165611 12996 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:15.120788 12965 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.122778 12598 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.136489 12983 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.183979 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.181102 13033 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.166991 12660 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:15.164906 12920 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.176198 12863 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:15.198962 11135 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:15.188831 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:15.193570 13033 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.209100 13033 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:15.205706 13040 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.214922 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.215265 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.216804 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.217587 11141 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:15.218168 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.218979 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:15.220355 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.223841 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.224057 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.225730 11859 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.226543 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.227174 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.229228 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.232887 12412 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.234021 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.203105 12983 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.223105 13040 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.232288 13033 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.257725 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.256844 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.230423 12858 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.268657 12412 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.239172 12935 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.235285 12982 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.252256 13047 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.225147 13014 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:15.252004 12989 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.237022 13042 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:15.272331 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.253551 13073 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.238911 12755 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:15.273728 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.271081 13047 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:15.260282 12965 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.259646 11287 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.274010 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.292497 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:15.285948 12935 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:15.279934 12994 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:15.293771 13047 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.308995 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:15.301882 11143 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.313995 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.326824 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.328081 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.331779 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:15.332894 12950 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.333280 12598 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:15.332916 12990 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:15.336948 13084 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:10:15.337901 13030 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.066s	user 0.003s	sys 0.014s
I20260709 12:10:15.339169 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1555) took 1855 ms. Trace:
I20260709 12:10:15.339497 11285 rpcz_store.cc:276] 0709 12:10:13.483613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.483973 (+   360us) service_pool.cc:224] Handling call
0709 12:10:13.484247 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.600115 (+115868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.600387 (+   272us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.629857 (+ 29470us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.158044 (+528187us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:14.158084 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.158155 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.321857 (+1163702us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:15.338861 (+ 17004us) raft_consensus.cc:1685] finished
0709 12:10:15.338882 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.339114 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1677,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":14014336,"thread_start_us":575080,"threads_started":2,"wal-append.queue_time_us":565342}
I20260709 12:10:15.341784 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.302179 13073 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:15.345324 13073 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.345741 13073 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:15.346731 13073 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:15.350891 13082 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:10:15.351975 13025 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.353084 12982 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.353669 12982 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.354079 12982 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:15.311578 13081 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:10:15.358297 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:15.359707 11143 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.304315 12989 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.348059 13073 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:15.331846 13080 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:10:15.332345 12691 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:15.368883 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.374759 11143 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:15.376453 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:15.373289 13025 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.365330 12893 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.365110 12920 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.369822 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:15.388741 11182 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.215s (SENT) [suppressed 22 similar messages]
I20260709 12:10:15.369652 12691 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:15.408165 12893 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:15.409513 12893 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:15.414186 12691 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.408031 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.422907 12935 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.430565 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.431363 11293 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.447371 11289 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.383008 12598 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:15.472536 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 140825us
I20260709 12:10:15.476030 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:15.492980 11293 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:15.384537 12950 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:15.497772 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.496784 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:15.501173 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.501901 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:15.495529 13090 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:10:15.510736 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:15.496265 12598 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:15.499428 12604 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.517372 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.519126 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.519969 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.520560 11141 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:10:15.475651 13044 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.522891 11213 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.509585 12926 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.508111 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1553) took 2023 ms. Trace:
I20260709 12:10:15.525189 12994 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.525471 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.542658 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.526379 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 189) took 1057 ms. Trace:
W20260709 12:10:15.530040 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 141322us
I20260709 12:10:15.531147 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.541731 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.543473 11217 rpcz_store.cc:276] 0709 12:10:14.469319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.469462 (+   143us) service_pool.cc:224] Handling call
0709 12:10:14.469790 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.745671 (+275881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.526139 (+780468us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54002a03d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:15.526321 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633256832}
I20260709 12:10:15.544054 11212 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:15.546584 11218 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:15.550540 11218 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.553655 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.556005 11213 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:15.561173 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.561414 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.529397 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.559949 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.530136 12926 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:15.566035 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.565073 11212 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:15.564507 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52055.3us
I20260709 12:10:15.605840 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.606570 11213 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.607237 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.558264 13094 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.532013 11284 rpcz_store.cc:276] 0709 12:10:13.482981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.483107 (+   126us) service_pool.cc:224] Handling call
0709 12:10:13.483390 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.165172 (+681782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.174987 (+  9815us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.229377 (+ 54390us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.487818 (+258441us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:14.494028 (+  6210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.444471 (+950443us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540017e8d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:15.457872 (+ 13401us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.461060 (+  3188us) raft_consensus.cc:1685] finished
0709 12:10:15.475112 (+ 14052us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.506595 (+ 31483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33047,"raft.queue_time_us":178495,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10175,"spinlock_wait_cycles":276775680,"thread_start_us":614433,"threads_started":2,"wal-append.queue_time_us":363737}
I20260709 12:10:15.611624 11284 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.590679 12690 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.616099 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.617636 11289 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.617854 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.574368 12604 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:15.575227 12926 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.628727 12604 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.629716 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.632097 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.635937 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.636767 11214 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.637130 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.639112 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.619498 11287 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:15.614198 12839 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:15.643656 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.557382 12950 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.650827 13101 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.645346 12620 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.652218 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.653888 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.621553 13094 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:15.659550 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.662312 11214 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:15.665025 13102 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.681407 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.683101 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.684228 11143 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:15.686043 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:15.596784 12598 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.680739 13094 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.664521 13101 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.686736 11860 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:15.698462 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:15.674649 12690 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.659611 12839 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:15.711448 13092 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:10:15.711995 13101 raft_consensus.cc:2764] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:15.753057 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.745530 13044 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:15.754407 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 86963.5us
I20260709 12:10:15.769122 11140 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.775583 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:15.776680 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.778599 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.779681 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.780680 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.785475 13028 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.783308 12823 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.782769 13040 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.767479 12691 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.785849 12944 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.787061 13044 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:15.796252 13103 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:10:15.808144 11218 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:15.810213 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1430) took 1063 ms. Trace:
W20260709 12:10:15.810913 13104 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:10:15.813589 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.814085 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.810757 11216 rpcz_store.cc:276] 0709 12:10:14.747268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.879748 (+132480us) service_pool.cc:224] Handling call
0709 12:10:14.880037 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.907295 (+ 27258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.809919 (+902624us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54000262d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:15.810143 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52009344}
I20260709 12:10:15.819411 12823 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:15.820098 12823 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:15.821316 13055 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
I20260709 12:10:15.798208 13028 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:15.829632 12839 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.830297 12982 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.821796 13055 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.833055 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 219) took 1470 ms. Trace:
I20260709 12:10:15.833525 11291 rpcz_store.cc:276] 0709 12:10:14.362809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.405672 (+ 42863us) service_pool.cc:224] Handling call
0709 12:10:14.405960 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.038999 (+633039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.832796 (+793797us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54003f20d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:15.832991 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439529216}
I20260709 12:10:15.837525 12982 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:15.849540 13110 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:15.854755 12995 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:15.884078 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.884555 12995 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.885164 13042 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.886976 12995 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.856057 12691 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.860136 12823 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.870877 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:15.888976 11137 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:15.872619 13036 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.873472 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:15.875404 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:15.875481 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 198) took 1898 ms. Trace:
I20260709 12:10:15.876837 12982 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:15.892148 11142 rpcz_store.cc:276] 0709 12:10:13.977050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.008629 (+ 31579us) service_pool.cc:224] Handling call
0709 12:10:15.095244 (+1086615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.095800 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.095847 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.096506 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.149073 (+ 52567us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.149121 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.149192 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.352000 (+202808us) raft_consensus.cc:1685] finished
0709 12:10:15.352027 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.875158 (+523131us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400253ad0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:15.875406 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2458,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":5173,"spinlock_wait_cycles":2498279680,"thread_start_us":35481,"threads_started":1,"wal-append.queue_time_us":81243}
I20260709 12:10:15.878425 12989 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.878892 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.878938 12598 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.880131 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:15.847723 13028 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.882814 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:15.883024 13047 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
I20260709 12:10:15.918980 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.898320 12989 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:15.906582 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 125961us
I20260709 12:10:15.921149 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.921850 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.924288 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.925876 12982 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.926364 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:15.928635 11852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 559) took 1492 ms (client timeout 1950 ms). Trace:
I20260709 12:10:15.929001 13116 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.924782 12823 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:15.929177 11852 rpcz_store.cc:269] 0709 12:10:14.436369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.443446 (+  7077us) service_pool.cc:224] Handling call
0709 12:10:15.882607 (+1439161us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:15.928557 (+ 45950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22408064}
I20260709 12:10:15.931609 12965 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:15.933346 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:15.933662 12982 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.935103 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.937187 13121 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.937420 12965 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.938928 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:15.914146 13117 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.938076 13121 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:15.940263 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.940156 13117 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.940553 13121 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.941859 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:15.942420 13117 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:15.943342 13117 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.943465 12982 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.943629 13055 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.944145 12982 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:15.945595 13077 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.839s	user 0.006s	sys 0.000s
I20260709 12:10:15.945598 13073 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.946753 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.926882 12598 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.946893 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:15.947718 13088 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.692s	user 0.000s	sys 0.004s
I20260709 12:10:15.945048 12982 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.949011 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 185) took 1535 ms. Trace:
I20260709 12:10:15.951676 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 229) took 1120 ms. Trace:
I20260709 12:10:15.952051 11292 rpcz_store.cc:276] 0709 12:10:14.830994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.137803 (+306809us) service_pool.cc:224] Handling call
0709 12:10:15.138108 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.143982 (+  5874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.144012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.147652 (+  3640us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.256989 (+109337us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.257028 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.257088 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.947131 (+690043us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:15.951425 (+  4294us) raft_consensus.cc:1685] finished
0709 12:10:15.951445 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.951623 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4549,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2082,"spinlock_wait_cycles":3611008,"thread_start_us":81309,"threads_started":1,"wal-append.queue_time_us":85827}
I20260709 12:10:15.949369 11215 rpcz_store.cc:276] 0709 12:10:14.413496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.413673 (+   177us) service_pool.cc:224] Handling call
0709 12:10:14.413969 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.087290 (+673321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.948811 (+861521us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54000e79d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:15.948956 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542439168}
I20260709 12:10:15.942646 13121 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:15.955861 12863 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.956380 12863 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:15.957437 12863 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.959436 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 211) took 1601 ms. Trace:
I20260709 12:10:15.962937 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:15.965823 12412 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.977347 12412 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:15.978647 12412 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:15.980281 12412 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.966768 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:15.971073 11141 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:15.999075 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:16.000113 11137 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.906026 13047 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:15.971377 12965 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.936466 12995 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 12:10:16.013473 13109 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:10:16.008766 13055 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:10:16.019771 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.021639 13121 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.022049 13121 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:15.976195 11288 rpcz_store.cc:276] 0709 12:10:14.358150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.364453 (+  6303us) service_pool.cc:224] Handling call
0709 12:10:14.436062 (+ 71609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.030824 (+594762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.959154 (+928330us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54002d19d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:15.959369 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265709312}
I20260709 12:10:16.025599 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:16.017020 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 1588) took 1226 ms. Trace:
I20260709 12:10:16.105763 11038 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 252) took 7917 ms. Trace:
I20260709 12:10:16.106248 12910 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:16.108605 13047 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.110003 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:16.113945 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1388) took 1044 ms. Trace:
I20260709 12:10:16.154284 11144 rpcz_store.cc:276] 0709 12:10:15.079569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.088410 (+  8841us) service_pool.cc:224] Handling call
0709 12:10:15.088687 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.133037 (+ 44350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.035092 (+902055us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b54003e8854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:16.113882 (+ 78790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91840512}
I20260709 12:10:16.155591 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:16.116272 12926 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.123396 13033 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.158409 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.159219 11293 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:16.124516 12747 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:16.130513 13032 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.016541 12924 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.134366 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 213) took 1775 ms. Trace:
I20260709 12:10:16.134953 13044 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.135926 12893 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:16.036152 11286 rpcz_store.cc:276] 0709 12:10:14.791055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.855849 (+ 64794us) service_pool.cc:224] Handling call
0709 12:10:16.016861 (+1161012us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54000609d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:16.016966 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52189056}
I20260709 12:10:16.139711  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:16.167272 11290 rpcz_store.cc:276] 0709 12:10:14.359562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.361828 (+  2266us) service_pool.cc:224] Handling call
0709 12:10:14.858152 (+496324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.128959 (+270807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.031410 (+902451us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54003f0cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:16.134192 (+102782us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54003f0cd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:16.134311 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693224064}
I20260709 12:10:16.141336 11040 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 3 to 4, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 1 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:16.145817 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.145771 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:16.159456 11289 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.159397 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.167675 11292 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.171149  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:16.141988 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:16.176221 13040 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:16.179710 11210 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.179702 11040 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 4 to 5, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 5 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.142817 11038 rpcz_store.cc:276] 0709 12:10:08.188313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.190456 (+  2143us) service_pool.cc:224] Handling call
0709 12:10:16.105692 (+7915236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:14.216878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:14.231298 (+ 14420us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:14.231333 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:10:14.231351 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:14.253436 (+ 22085us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:14.253512 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:14.253549 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:14.253980 (+   431us) tablet.cc:701] Row locks acquired
0709 12:10:14.254005 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:10:14.254188 (+   183us) write_op.cc:270] Start()
0709 12:10:14.254345 (+   157us) write_op.cc:276] Timestamp: P: 1783599014254136 usec, L: 0
0709 12:10:14.254381 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:10:14.255217 (+   836us) log.cc:844] Serialized 1371 byte log entry
0709 12:10:14.316839 (+ 61622us) op_driver.cc:464] REPLICATION: finished
0709 12:10:14.479787 (+162948us) write_op.cc:301] APPLY: starting
0709 12:10:14.486284 (+  6497us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:14.536442 (+ 50158us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:14.635460 (+ 99018us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:14.671985 (+ 36525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:14.744227 (+ 72242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:14.752588 (+  8361us) write_op.cc:312] APPLY: finished
0709 12:10:14.752924 (+   336us) log.cc:844] Serialized 35 byte log entry
0709 12:10:14.753164 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.753327 (+   163us) write_op.cc:454] Released schema lock
0709 12:10:14.775887 (+ 22560us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:14.801696 (+ 25809us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.809091 (+  7395us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":130882,"apply.run_cpu_time_us":4289,"apply.run_wall_time_us":324968,"num_ops":3,"prepare.queue_time_us":459076,"prepare.run_cpu_time_us":30282,"prepare.run_wall_time_us":104281,"raft.queue_time_us":9105,"raft.run_cpu_time_us":4432,"raft.run_wall_time_us":39056,"replication_time_us":62271,"thread_start_us":525445,"threads_started":4,"wal-append.queue_time_us":49751,"wal-append.run_cpu_time_us":6811,"wal-append.run_wall_time_us":1455220}]]}
I20260709 12:10:16.158324 13033 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:16.183260 11040 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.179382 13040 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.182520 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:16.212994 11040 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.213933 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1390) took 1133 ms. Trace:
I20260709 12:10:16.214562 11138 rpcz_store.cc:276] 0709 12:10:15.080315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.112109 (+ 31794us) service_pool.cc:224] Handling call
0709 12:10:15.112626 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.856795 (+744169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.856831 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.857358 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.904790 (+ 47432us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:16.128300 (+223510us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.128618 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.187731 (+ 59113us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54003cad54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:16.187816 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.187885 (+    69us) raft_consensus.cc:1685] finished
0709 12:10:16.213683 (+ 25798us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.213861 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221757,"prepare.queue_time_us":231967,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":4520,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"spinlock_wait_cycles":1682170240,"thread_start_us":46980,"threads_started":1,"wal-append.queue_time_us":74017}
I20260709 12:10:16.216241 12944 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.220094 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.222738 12620 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.224859 13040 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.224960 12620 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.167145 12924 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:16.231654 11143 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.237957 12924 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.239478 12924 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.239751 11855 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:16.210841 12950 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.153932 12910 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.170794 13121 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.242413 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:16.242650 12412 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:10:16.251406 12412 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:16.251866 12412 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:16.252657 12412 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.245361 12910 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.225800 12620 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.266906 11138 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.269129 11142 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:10:16.181733 13047 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:16.281796 13047 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.269562 12989 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.284083 13047 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.180459 12893 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.284595 12620 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.285301 12989 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.286128 12893 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.243709 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.288535 11138 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:16.293231 13033 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.299818 12926 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.168282 12747 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.300510 13033 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.253055 13069 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.304563 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.304731 13069 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.295217 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:16.176193 13044 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.308954 13044 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.280952 11144 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:10:16.309844 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:16.310527 12598 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.310825 12910 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.286298 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.312909 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:16.319257 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:16.320255 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:16.323946 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:16.327148 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:16.333747 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62775.1us
I20260709 12:10:16.335836 11140 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:16.336176 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:16.337014 12755 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.337889 13036 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.337980 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:16.338407 11856 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:16.339073 12995 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:16.339753 12995 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.340689 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:16.343001 12995 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.343537 11287 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.344604 11141 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.346527 13069 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.347564 11139 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.348248 11144 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.350993 11135 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:16.356484 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.356735 11292 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.311656 12910 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.357245 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:16.357537 12910 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:16.358678 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 96166us
I20260709 12:10:16.358461 12910 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.359969 12910 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.363579 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.363929 12747 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:16.363571 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:16.367229 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48047.3us
I20260709 12:10:16.368475 12989 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.369066 12989 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:16.371007 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:16.368630 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48477.1us
I20260709 12:10:16.368500 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:16.374572 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:16.181406 12965 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:16.387327 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:16.389231 11135 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.397372 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:16.365120 11287 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:16.403258 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:16.377663 12989 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.435405 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.376384 13014 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.439329 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:16.402406 12965 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.446852 12999 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.395699 12926 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:10:16.448928 12965 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.449443 12620 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.434677 12990 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.403988 13064 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:16.401672 13042 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:16.403240 12944 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:16.400279 13033 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:16.455827 13033 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.456255 13033 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:16.457254 13033 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.457796 13014 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.458185 13014 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:16.459164 13014 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.460772 13014 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.460987 12950 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.462342 12620 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.462790 12620 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:16.463753 12620 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.468879 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:16.460795 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.456044 12944 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:16.478662 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.483026 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.491899 11139 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:16.493983 11218 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.495054 11215 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.500469 11857 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:16.501044 11857 pending_rounds.cc:85] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 4
I20260709 12:10:16.501353 11857 pending_rounds.cc:107] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:16.501719 11857 raft_consensus.cc:2889] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:16.503198 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.504110 11135 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
W20260709 12:10:16.506422 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45699.2us
I20260709 12:10:16.438406 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:16.515110 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.520744 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:16.469415 13069 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.471457 12965 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.537533 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.516919 12620 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:16.569026 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52560.9us
I20260709 12:10:16.569886 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.526477 12486 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.523762 12924 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:16.580176 13107 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.564636 12965 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.583153 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:16.584193 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:16.560917 13069 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:16.596371 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 190846us
I20260709 12:10:16.616854 11135 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:16.604406 12990 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.607815 12982 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.600562 13111 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.623353 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.638873 11137 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:16.626873 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 258896us
I20260709 12:10:16.607000 12944 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.626711 12995 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:16.645447 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.586421 13101 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:10:16.696786 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73532.2us
I20260709 12:10:16.628528 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.718451 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.724067 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.638845 13111 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.621491 12990 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:16.752517 13125 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:10:16.754653 13073 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.755199 13073 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.757555 13073 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:16.759001 12965 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.709393 12995 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.761883 12995 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.717466 13019 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.744474 13111 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.688325 12982 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:16.764549 12982 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:16.724732 12944 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:10:16.767313 13069 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:16.771763 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1386) took 1703 ms. Trace:
W20260709 12:10:16.775189 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51228.1us
I20260709 12:10:16.725884 11287 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:16.772322 11136 rpcz_store.cc:276] 0709 12:10:15.068819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.084398 (+ 15579us) service_pool.cc:224] Handling call
0709 12:10:15.084601 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.105593 (+1020992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.105624 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.106144 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.182106 (+ 75962us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:16.235154 (+ 53048us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.235499 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.287385 (+ 51886us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b1800351940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419
0709 12:10:16.288031 (+   646us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b5400264654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:16.288088 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.303957 (+ 15869us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800351940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:16.771487 (+467530us) raft_consensus.cc:1685] finished
0709 12:10:16.771521 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.771691 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55171,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":104,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5250,"spinlock_wait_cycles":2245648896,"thread_start_us":75597,"threads_started":1,"wal-append.queue_time_us":409048}
W20260709 12:10:16.794562 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.725504 12839 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.808308 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.758116 13073 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:16.815989 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:16.822533 11292 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.825621 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.780961 13032 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.838603 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:16.843361 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:16.844909 13069 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.845405 13069 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.845815 13069 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:16.840958 13132 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:10:16.851475 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 448514us
I20260709 12:10:16.861512 12995 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:16.847267 12990 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.842137 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:16.849484 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.867489 12989 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.848235 13094 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.874063 13033 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.876302 13121 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.878768 12755 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:16.882880 13136 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:16.911144 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.912742 11139 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:16.908298 12412 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.927044 12412 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.894299 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:16.909106 12982 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:16.891304 13133 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:16.886370 13032 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:10:16.909447 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59319.2us
I20260709 12:10:16.911175 13019 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.877558 13069 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.893191 12620 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:16.892791 13111 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.932508 12412 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:16.932968 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 334009us
I20260709 12:10:16.924055 12990 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.893643 12995 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.932047 11288 raft_consensus.cc:2410] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.937479 13133 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:16.936966 12982 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:16.954540 12660 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:10:16.987286 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.973691 12893 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.958976 13107 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:16.995126 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:16.998889 11215 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:17.006323 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85307.9us
I20260709 12:10:17.007014 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:17.008880 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119536us
I20260709 12:10:17.006075 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.027035 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.027964 11214 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
W20260709 12:10:17.034214 13143 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:10:17.034760 12995 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.036150 13149 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:17.019196 13044 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.040984 12939 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.041699 13146 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:17.040984 13044 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:17.044013 13133 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.044878 12982 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.045635 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:17.046464 13147 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:17.046883 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:17.047751 11288 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:17.048159 11218 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.054668 13014 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.055116 13014 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.057906 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:17.058432 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.058518 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:17.058982 12989 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.059327 11288 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:17.059629 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.060118 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:17.060427 11141 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:17.060709 11860 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:17.064901 13150 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.065366 13150 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.067735 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 458) took 1462 ms. Trace:
I20260709 12:10:17.068315 13044 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.068320 13064 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.069521 13064 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.070436 13064 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:17.072837 13028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.029s	sys 0.082s
W20260709 12:10:17.073362 13028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.029s	sys 0.082s
I20260709 12:10:17.074225 11217 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.073274 13150 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.075851 13150 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.058584 11287 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:17.093729 11214 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:17.094288 11214 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 3
I20260709 12:10:17.094732 11214 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:17.095068 11214 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.070449 12924 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.089517 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:17.130446 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.128947 12924 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.132109 12995 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.132669 12995 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.132728 12989 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:17.133181 12995 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.133399 12989 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.135154 12910 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:17.135625 11859 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.136090 11859 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.135799 12910 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.136705 12989 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.136950 11859 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.137856 12924 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.138275 11859 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.144611 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.145509 11141 raft_consensus.cc:2393] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:17.088552 13042 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.146356 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.149084 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.162010 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.163404 11214 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
W20260709 12:10:17.156656 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 198711us
I20260709 12:10:17.138321 12910 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.168087 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:17.183802 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.150100 12982 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.146268 13033 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.178681 12989 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.198558 11140 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.181969 13069 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:17.203114 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 193471us
I20260709 12:10:17.205066 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:17.208630 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.209034 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.209444 11215 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:17.210302 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.210444 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.210886 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.211402 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:17.211676 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.212188 11215 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:17.212550 11210 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:17.213562 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.214831 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.216105 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.217573 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:17.218279 11857 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:17.218791 11214 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:17.198271 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.223170 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:17.226830 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:17.228677 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:17.230296 11107 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.228716 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.228464 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.231215 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.232337 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.233701 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:17.178251 13042 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.244200 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:17.237075 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.189349 13157 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:17.245421 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:17.195894 13033 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.194401 12982 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.232923 13044 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.233204 13069 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.236346 13121 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.237207 13073 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.201584 12965 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:17.263286 11288 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:17.068176 11855 rpcz_store.cc:276] 0709 12:10:15.605374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.614152 (+  8778us) service_pool.cc:224] Handling call
0709 12:10:16.239166 (+625014us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6eee 000000000036eb39 00007f9835a2a1e0 00007f9835af30c4 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:16.239355 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.239593 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:16.452748 (+213155us) log.cc:844] Serialized 14 byte log entry
0709 12:10:17.067185 (+614437us) log.cc:844] Serialized 14 byte log entry
0709 12:10:17.067388 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.067437 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:17.067486 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.067564 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.067679 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26320,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":186224,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":3715,"spinlock_wait_cycles":9900928,"thread_start_us":518784,"threads_started":2,"wal-append.queue_time_us":403263}
I20260709 12:10:17.308498 12965 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.265842 13014 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.265543 13160 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:17.309713 12939 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:17.310053 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.310101 12939 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.267834 13033 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.271090 12982 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:17.271931 13168 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:17.248776 12598 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.246693 13134 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.280691 12893 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.281262 13036 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.217351 12989 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.281277 13042 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.259089 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:17.303929 13113 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:17.304436 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56835.4us
I20260709 12:10:17.304610 12863 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.317504 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74475.2us
I20260709 12:10:17.323446 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:17.359599 11144 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:17.360519 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:17.361680 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:17.361706 11138 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.328308 12598 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.374541 13160 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:17.339685 13036 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.375977 12982 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.355005 13113 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:17.436318 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55380.3us
W20260709 12:10:17.439648 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 207382us
I20260709 12:10:17.440927 11285 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:17.345455 13094 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:10:17.375396 13099 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:17.440673 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:17.375880 13042 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.452531 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.449775 11107 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.373800 12995 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:17.422833 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.379307 12598 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.380020 12989 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:17.456933 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 93141.8us
I20260709 12:10:17.344875 13134 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.431486 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:17.472510 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103058us
W20260709 12:10:17.474665 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.475886 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.476402 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.363343 12939 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.481138 12939 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.483831 12924 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.474730 11135 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.453979 13044 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.456046 13069 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.488955 11286 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:17.480312 13164 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.284s	user 0.003s	sys 0.000s
I20260709 12:10:17.500852 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:17.502256 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50964.8us
I20260709 12:10:17.530113 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.502791 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.531100 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.464453 13160 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:17.503759 11213 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:17.510514 13036 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:17.484867 13165 consensus_queue.cc:1175] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ba2779405e8d452e95f42421b2b60928" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:10:17.492386 12996 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.538087 13042 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.519826 13134 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.521250 12982 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.525309 12990 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.480327 12995 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.531617 11218 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
W20260709 12:10:17.512341 13178 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:10:17.534757 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.539701 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:17.539438 13173 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:10:17.543601 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:17.564208 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.544407 13184 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.495667 12660 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:17.549477 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.566535 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:17.569005 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.551826 12990 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.578342 11259 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:17.560117 13036 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.584841 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:17.572649 13014 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.592788 12598 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.595918 11856 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:17.596364 11856 pending_rounds.cc:85] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 4
I20260709 12:10:17.596618 11856 pending_rounds.cc:107] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:17.596885 11856 raft_consensus.cc:2889] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.597188 13111 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:17.599040 13044 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.599598 13044 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.603019 12990 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.604962 12598 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.607553 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:17.609354 13150 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.003s
I20260709 12:10:17.611634 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:17.612134 11857 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:17.573199 12950 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:17.583515 13133 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.586086 13033 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.588505 12660 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.623180 11293 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.625784 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:17.626526 13014 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:17.625301 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:17.630276 11259 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:17.576805 13184 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.626551 11852 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.635424 13184 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.624557 12660 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:17.637490 13189 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:17.623401 13133 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.632344 13154 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.638866 13154 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:17.585886 13073 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:17.640410 13154 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.641149 13064 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.636893 12660 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.632828 13014 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.641836 11288 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.641916 13154 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.617667 13159 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.644398 13014 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.652499 12982 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:17.654019 12982 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.654553 12982 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.654150 13027 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.655611 13027 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.656335 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 200) took 1164 ms. Trace:
I20260709 12:10:17.656708 11217 rpcz_store.cc:276] 0709 12:10:16.491966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.492080 (+   114us) service_pool.cc:224] Handling call
0709 12:10:16.492351 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.074660 (+582309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.656062 (+581402us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54002a1cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:17.656272 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337680128}
I20260709 12:10:17.657414 12982 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.657972 13027 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.659063 12660 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.621011 12598 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.667593 13014 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.676247 13133 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:17.678457 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:17.678849 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 63765.1us
I20260709 12:10:17.686817 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:17.686295 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71582.5us
W20260709 12:10:17.698626 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.702315 13138 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.702147 13133 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.703001 13138 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.704430 11858 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:17.699082 13144 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.705392 13144 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:17.707016 13144 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.708278 13144 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.715580 12990 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.717351 11217 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.718113 11212 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.720281 11212 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.720785 13113 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.722193 13113 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.723078 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.747573 11212 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:17.723472 13138 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.723822 11852 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:17.726073 13042 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.737702 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 131) took 6509 ms. Trace:
I20260709 12:10:17.738896 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 557f4814dd3c4d4bb57340a9834ebd32 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45926
I20260709 12:10:17.739239 13028 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:17.742040 13121 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.748687 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:17.755419 11040 rpcz_store.cc:276] 0709 12:10:11.228627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.251502 (+ 22875us) service_pool.cc:224] Handling call
0709 12:10:17.737629 (+6486127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:16.594457 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:16.758711 (+164254us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:16.758750 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:16.758767 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:16.759353 (+   586us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:16.759432 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:16.759458 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:16.759842 (+   384us) tablet.cc:701] Row locks acquired
0709 12:10:16.759860 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:16.759987 (+   127us) write_op.cc:270] Start()
0709 12:10:16.760092 (+   105us) write_op.cc:276] Timestamp: P: 1783599016759950 usec, L: 0
0709 12:10:16.760112 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:16.760742 (+   630us) log.cc:844] Serialized 1686 byte log entry
0709 12:10:17.342271 (+581529us) op_driver.cc:464] REPLICATION: finished
0709 12:10:17.381702 (+ 39431us) write_op.cc:301] APPLY: starting
0709 12:10:17.381786 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:17.381980 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:17.382117 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:17.382914 (+   797us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:17.383123 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:17.383172 (+    49us) write_op.cc:312] APPLY: finished
0709 12:10:17.383720 (+   548us) log.cc:844] Serialized 41 byte log entry
0709 12:10:17.383880 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.383971 (+    91us) write_op.cc:454] Released schema lock
0709 12:10:17.384011 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:17.419052 (+ 35041us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.419097 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30122,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":39140,"apply.run_cpu_time_us":2388,"apply.run_wall_time_us":2640,"num_ops":4,"prepare.queue_time_us":376762,"prepare.run_cpu_time_us":25216,"prepare.run_wall_time_us":409608,"raft.queue_time_us":240053,"raft.run_cpu_time_us":23715,"raft.run_wall_time_us":142294,"replication_time_us":563672,"thread_start_us":709702,"threads_started":4,"wal-append.queue_time_us":268965}]]}
I20260709 12:10:17.770618 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:17.772900 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:17.773635 11292 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.774032 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:17.781543 11292 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:17.715606 13019 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.714773 13069 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.787155 11293 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:17.791158 11293 pending_rounds.cc:85] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 1
I20260709 12:10:17.791420 11293 pending_rounds.cc:107] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:17.791640 11293 raft_consensus.cc:2889] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.788369 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:17.789208 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:17.793362 11213 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.788542 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.752158 12995 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.801959 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.792091 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.803434 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.802421 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.804406 11211 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:17.816596 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:17.818554 11213 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:17.825436 13198 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.818127 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:17.783051 13138 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.831466 12412 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:17.833534 12412 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.798875 13135 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.845768 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:17.846678 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45448.1us
I20260709 12:10:17.859225 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:17.847357 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.847738 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.852556 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.854015 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.863840 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.865717 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:17.869200 11136 pending_rounds.cc:85] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 2
I20260709 12:10:17.869513 11136 pending_rounds.cc:107] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:17.869740 11136 raft_consensus.cc:2889] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.854530 13198 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:17.818509 12965 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:17.901557 12412 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:17.903128 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.849378 13138 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.839145 13159 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.784308 13121 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.804026 13019 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.920213 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:17.855916 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:17.865394 13175 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.819450 12995 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:17.942943 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.915634 13174 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:10:17.911157 13198 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:17.946838 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 94379.5us
I20260709 12:10:17.887127 12989 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:17.907676 13149 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.932124 13069 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.957580 11140 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:17.943219 13194 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:10:17.964838 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:17.918849 13138 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.971014 11139 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:17.874964 13014 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.911697 12944 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:10:17.912297 12965 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:17.993099 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:17.966450 13149 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.972136 13133 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.970289 13036 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.987022 11288 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:18.008472 13149 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.957553 13175 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.005594 13033 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.039892 13044 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.014497 13036 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:17.940670 13159 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.046777 11853 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:18.084815 13159 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.059486 13200 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:18.085949 13200 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.089288 13200 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.090058 13200 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.059779 12965 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:18.060241 13197 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:18.061481 12995 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.065584 13032 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:18.102626 13032 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:18.103118 12995 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.104225 12995 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:18.104993 12995 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.056092 12920 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.106740 12920 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:18.108033 12920 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.109584 12920 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.013932 13133 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.113503 13133 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.096524 13036 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:18.091661 13175 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.098275 13014 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.103722 13032 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:18.116523 13196 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.160s	user 0.005s	sys 0.000s
I20260709 12:10:18.117374 13032 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.099232 13019 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:18.067181 13121 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.144451 13044 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.151451 13138 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.151450 13198 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.154438 13198 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:18.193549 11142 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:18.223978 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.231114 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 224550us
I20260709 12:10:18.232311 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:18.297031 13138 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:18.298349 13042 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.299397 13042 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.147866 12995 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:18.229867 11039 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 3, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.322361 11039 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 3, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.332849 13187 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.333907 13187 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.356541 13032 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:18.357865 13032 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.358283 13032 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:18.358705 13186 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.359694 13032 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.359843 13186 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.361603 13032 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.363667 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.366971 13201 tablet_replica.cc:333] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:10:18.365928 11039 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:18.370870 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:18.372324 11135 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:18.374969 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:18.375954 11135 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.379206 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:18.380242 11212 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:18.380821 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:18.381835 11214 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:18.382012 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:18.383332 11211 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.389878 12839 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.390750 12839 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.391412 12839 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.392691 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 166421us
I20260709 12:10:18.352067 13042 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:18.369382 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:18.154292 13149 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.416147 13149 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.417301 11290 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:18.418866 11039 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 3, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:18.421149 11135 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:18.421661 13187 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.424535 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:18.425967 12920 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.426577 12920 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.426679 12926 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.427228 12920 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.427825 12926 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.421828 11039 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 5, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.442106 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:18.443001 11853 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:18.431815 11039 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 4, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 4 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.442978 13186 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.447474 11039 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 3, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.449054 11039 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 3, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.450829 13149 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:18.451069 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:18.452030 11858 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:18.451792 13149 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.455895 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:18.457183 13042 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.457296 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:18.457968 13042 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.458292 13149 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.458423 13042 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.459229 13149 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.456919 11039 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.459671 13149 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:18.462129 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 497253us
I20260709 12:10:18.467722 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:18.496536 12839 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.499367 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:18.466288 12920 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.513726 12839 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.514827 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:18.501088 11213 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.515488 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:18.516323 11215 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.505388 12893 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.469113 13149 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.507107 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:18.517611 11217 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:18.517439 12893 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.507967 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:18.518801 11214 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:18.500204 12747 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.510864 12926 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.520372 11210 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:18.513785 12920 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:18.519505 12747 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.522776 12747 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.510635 11039 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 3, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.527484 11039 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:18.531451 12893 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:18.531673 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:18.532521 11210 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.538537 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:18.539693 12926 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.540125 12926 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.540516 12926 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.541030 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:18.542006 11858 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:18.544700 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 86188.3us
I20260709 12:10:18.547698 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:18.548729 11858 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:18.553537 12747 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.555119 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:18.572697 12989 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.573205 12989 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.573622 12989 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.560554 11215 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:18.561350 12893 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:18.568504 11211 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:18.568686 13149 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.600984 12893 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:18.602113 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 103086us
I20260709 12:10:18.603005 13149 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.568364 11210 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:18.583369 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:18.606523 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:18.608856 13204 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:18.608934 12989 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.611431 12920 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.611910 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:18.612499 12920 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:18.614945 13198 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.615597 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:18.609705 13204 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.611593 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:18.617238 11214 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.624228 12995 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.624760 12995 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:18.625169 12995 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.613705 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:18.628438 11139 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.624929 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:18.632822 12893 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:18.613705 12920 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.633774 13149 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.630664 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:18.630620 12989 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:18.644203 13121 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.654102 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:18.654870 11210 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.648289 13149 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:18.659195 13204 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.665675 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:18.687844 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:18.691882 11214 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:18.689776 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:18.701140 12747 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.704903 11210 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:18.713032 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:18.717103 13069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.041s	sys 0.073s
W20260709 12:10:18.717798 13069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.041s	sys 0.074s
I20260709 12:10:18.718124 13069 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:18.719931 13069 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.726532 13113 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.727285 13113 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:18.728322 13113 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.730654 13133 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.731262 13133 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:18.732647 13133 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.751555 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:18.712435 13121 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.708629 12926 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:18.768296 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78659.2us
I20260709 12:10:18.759855 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:18.795096 13135 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.010s	sys 0.012s
W20260709 12:10:18.795697 13135 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.010s	sys 0.012s
I20260709 12:10:18.795985 13135 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:18.796412 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.784513 11858 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.766078 13042 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:18.803122 11256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.012s	sys 0.052s
W20260709 12:10:18.808853 11256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.013s	sys 0.052s
I20260709 12:10:18.808976 13207 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.809757 13207 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:18.811343 13207 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:18.776786 13149 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:18.822275 13203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.000s	sys 0.027s
W20260709 12:10:18.822837 13203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.001s	sys 0.027s
W20260709 12:10:18.828765 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 59564.6us
I20260709 12:10:18.859506 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:18.839481 11143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.007s	sys 0.026s
W20260709 12:10:18.843855 11141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.031s	sys 0.027s
W20260709 12:10:18.868003 11141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.032s	sys 0.027s
I20260709 12:10:18.846318 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:18.843778 12412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.014s	sys 0.009s
W20260709 12:10:18.870980 12412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.014s	sys 0.009s
W20260709 12:10:18.871155 11143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.007s	sys 0.027s
I20260709 12:10:18.852172 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:18.872116 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:18.872700 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1472) took 1083 ms. Trace:
I20260709 12:10:18.872848 11852 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.873452 11139 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:18.874168 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:18.853356 13135 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.872221 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1457) took 1020 ms. Trace:
I20260709 12:10:18.873126 11857 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:18.828474 12598 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:18.836486 11107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.008s	sys 0.024s
W20260709 12:10:18.843564 11218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.080s	sys 0.068s
I20260709 12:10:18.860430 11856 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.891603 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:18.892488 11139 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:18.890992 11107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.009s	sys 0.024s
W20260709 12:10:18.878746 11292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.006s	sys 0.021s
I20260709 12:10:18.874956 11853 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.837065 12893 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:18.856927 12926 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:18.903687 11218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.080s	sys 0.069s
I20260709 12:10:18.874454 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:18.839321 12989 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.908850 11292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.007s	sys 0.021s
I20260709 12:10:18.907071 11860 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:18.876582 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:18.897279 13211 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.873162 11219 rpcz_store.cc:276] 0709 12:10:17.788744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.788870 (+   126us) service_pool.cc:224] Handling call
0709 12:10:17.826908 (+ 38038us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:17.871867 (+ 44959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.871906 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:17.905829 (+ 33923us) log.cc:844] Serialized 52 byte log entry
0709 12:10:18.460443 (+554614us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:18.460517 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.460673 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:18.860429 (+399756us) raft_consensus.cc:1685] finished
0709 12:10:18.860452 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.872514 (+ 12062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45916,"raft.queue_time_us":28419,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":41324,"thread_start_us":494755,"threads_started":1,"wal-append.queue_time_us":884733}
W20260709 12:10:18.922888 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76710.1us
I20260709 12:10:18.925166 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:18.926857 13204 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.927147 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:18.927948 11859 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.929497 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:18.931058 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:18.930367 11140 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:18.926926 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 1846) took 1180 ms. Trace:
I20260709 12:10:18.936144 11141 rpcz_store.cc:276] 0709 12:10:17.746711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.746857 (+   146us) service_pool.cc:224] Handling call
0709 12:10:17.747202 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.747459 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:17.769522 (+ 22063us) log.cc:844] Serialized 14 byte log entry
0709 12:10:17.776332 (+  6810us) log.cc:844] Serialized 14 byte log entry
0709 12:10:18.204097 (+427765us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b180031bd60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:10:18.912894 (+708797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.920206 (+  7312us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.926568 (+  6362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.926695 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.926855 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28710,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":53897,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":16390,"spinlock_wait_cycles":18410240,"thread_start_us":664017,"threads_started":1}
I20260709 12:10:18.897549 12893 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.945583 12995 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.950456 11852 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:18.950659 13211 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.953265 13211 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.953802 13201 raft_consensus.cc:2243] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:18.954941 13201 raft_consensus.cc:2272] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:18.959597 13201 ts_tablet_manager.cc:1916] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:10:18.960162 13209 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:18.963626 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:18.964370 11137 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:18.967866 11859 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:18.970821 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:18.972051 11142 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.877094 11143 rpcz_store.cc:276] 0709 12:10:17.851904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.868767 (+ 16863us) service_pool.cc:224] Handling call
0709 12:10:17.869168 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.869466 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:17.869821 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 12:10:18.871704 (+1001883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.871815 (+   111us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.871881 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.871963 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.872141 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37715,"prepare.queue_time_us":444,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":230858,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":24697,"thread_start_us":972658,"threads_started":1}
I20260709 12:10:18.919678 13217 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.921579 13042 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:18.978652 13204 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.965190 12989 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:18.990721 12926 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:19.003957 11285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.037s	sys 0.073s
W20260709 12:10:19.004602 11285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.037s	sys 0.074s
W20260709 12:10:19.005159 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80110.8us
I20260709 12:10:18.997723 13211 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.006647 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 106266us
I20260709 12:10:19.009166 13138 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.013466 13134 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.018869 11858 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:19.023403 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.025135 12926 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.025787 12926 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:19.013846 13211 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.027071 12926 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.058844 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1645) took 1202 ms. Trace:
W20260709 12:10:19.058698 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46763.9us
W20260709 12:10:19.058462 13219 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:19.061142 11293 rpcz_store.cc:276] 0709 12:10:17.856547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.856722 (+   175us) service_pool.cc:224] Handling call
0709 12:10:17.856989 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.857185 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.857208 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.857801 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.462653 (+604852us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.462759 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.462929 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.057704 (+594775us) raft_consensus.cc:1685] finished
0709 12:10:19.057735 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.058577 (+   842us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":424953,"threads_started":1,"wal-append.queue_time_us":923845}
I20260709 12:10:19.013686 13138 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.070245 12839 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.075557 12989 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.079105 13221 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.125814 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:19.132553 13215 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:10:19.134869 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1473) took 1345 ms. Trace:
I20260709 12:10:19.135357 11218 rpcz_store.cc:276] 0709 12:10:17.789007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.801411 (+ 12404us) service_pool.cc:224] Handling call
0709 12:10:17.836224 (+ 34813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.968256 (+132032us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:17.991794 (+ 23538us) log.cc:844] Serialized 14 byte log entry
0709 12:10:18.930687 (+938893us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.931281 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.931454 (+   173us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:18.931481 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.936428 (+  4947us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002f53d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:18.936483 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.134382 (+197899us) raft_consensus.cc:1685] finished
0709 12:10:19.134516 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.134778 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8431,"prepare.queue_time_us":21342,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":6976,"raft.queue_time_us":6190,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":2483,"spinlock_wait_cycles":302758272,"thread_start_us":914697,"threads_started":1,"wal-append.queue_time_us":1005606}
I20260709 12:10:19.138008 12893 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.138684 12839 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.139739 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.141360 12839 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.083581 13211 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.162344 13221 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.130154 13217 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.165094 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 81724.6us
I20260709 12:10:19.167837 13214 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.160916 12995 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.158710 11853 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:19.205862 11856 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:19.207847 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.208750 12893 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.209242 12893 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:19.210153 12893 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.178169 13217 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:19.265839 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 249569us
I20260709 12:10:19.263454 12920 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.329985 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:19.329154 13138 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:19.344823 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 352756us
I20260709 12:10:19.331584 12920 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.346786 12598 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:19.367167 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 307761us
I20260709 12:10:19.352141 13138 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.353724 13069 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.354036 13135 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.386662 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:19.370626 13186 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.367823 13221 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.381902 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.400609 13113 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:19.404234 13113 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.406816 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.408845 13113 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.388384 13214 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.411273 13214 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.412292 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:19.393836 13207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.020s
I20260709 12:10:19.413535 13214 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.388664 12995 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.414870 13213 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.387315 13238 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:19.414976 12995 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.415689 13213 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.416186 13238 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.416463 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1634) took 1942 ms. Trace:
I20260709 12:10:19.416612 13238 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:19.417327 12995 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.386564 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.417876 13213 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.417517 13238 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.418490 13218 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.418659 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.418879 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:19.403663  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:19.419162 13218 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:19.413548 13207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.004s	sys 0.020s
I20260709 12:10:19.421291 13218 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.416810 11285 rpcz_store.cc:276] 0709 12:10:17.474610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.474787 (+   177us) service_pool.cc:224] Handling call
0709 12:10:17.475152 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.475548 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.475585 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.476163 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.290551 (+814388us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003ce380. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:10:19.009078 (+718527us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:19.012037 (+  2959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.014107 (+  2070us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.416186 (+402079us) raft_consensus.cc:1685] finished
0709 12:10:19.416205 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.416405 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3609,"raft.queue_time_us":686,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":24947456,"thread_start_us":714293,"threads_started":1,"wal-append.queue_time_us":1852374}
I20260709 12:10:19.382400 13138 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.382867 13134 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.423550 13134 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.424901 13138 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.425896 13217 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.427819 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.428624 11858 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:19.430519 13134 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.435755 12920 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.437253 12598 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.438184 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.438935 11858 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:19.439289 13238 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.384882 13211 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.440342 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:19.419382 11855 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:19.446316 11852 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:19.456035 13217 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.457346 13217 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.457682 13217 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.458206 13232 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.458837 13232 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.460502 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1642) took 1649 ms. Trace:
I20260709 12:10:19.467983 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:19.468478 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.421855 13069 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.461117 11292 rpcz_store.cc:276] 0709 12:10:17.811116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.816275 (+  5159us) service_pool.cc:224] Handling call
0709 12:10:17.816560 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.816747 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:18.920529 (+1103782us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.459935 (+539406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.460034 (+    99us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.460107 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.460229 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.460420 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68454,"prepare.queue_time_us":55327,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3480,"raft.queue_time_us":69932,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":1538801,"threads_started":2}
I20260709 12:10:19.462689 13133 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:19.487854 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 149806us
I20260709 12:10:19.466914 13232 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.461428 13211 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.509953 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.511201 12839 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.454842 13135 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.516654 12926 raft_consensus.cc:2764] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:19.545099 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:19.521198 12839 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.504817 12747 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.517426 13218 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.554726 13218 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.555243 13218 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.557484 12747 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.558672 13069 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.560078 12747 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.507757 13233 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.561053 13233 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:19.563858 13233 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:19.546234 13213 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.565363 13213 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.565922 13213 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.518150 13133 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.553730 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.542614 13211 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.550369 12839 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.570850 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.570935 13149 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.573395 13149 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.569664 13133 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:19.577723 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45315.9us
I20260709 12:10:19.579180 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:19.507187 13234 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.590819 12839 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.587064 13234 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.503942 13208 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.593760 13234 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.593796 13208 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.605857 12995 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.605898 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.598240 13208 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.606596 12995 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.619864 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.607224 13069 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.628567 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.628979 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.640218 11143 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:19.640415 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:19.630002 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 239814us
I20260709 12:10:19.640981 11218 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.630674 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.624740 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.633210 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.624740 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:19.637051 12995 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.637699 11142 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:19.638186 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.615517 13186 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.642557 11135 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:19.645386 11858 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:19.648729 11141 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.650882 13240 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.651283 11291 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:19.651558 13186 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.652439 13149 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.653784 13186 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.655452 13217 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.657753 13217 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.661852 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.662251 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.662911 11286 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:19.663582 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.665674 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:19.670125 12920 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.670575 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:19.671253 11852 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.672047 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.670177 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.672808 11291 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:19.670763 12920 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.674909 12920 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.651594 13240 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.677091 13240 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.678206 13208 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.678925 13208 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.680913 13208 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.678196 13135 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:19.684541 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:19.688772 13149 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.662911 11285 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:19.689476 11288 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:19.691005 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:19.692690 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.693544 13249 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.693979 13249 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.694319 13249 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.695242 12995 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.695840 12995 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.701577 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.702808 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:19.703689 13149 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:19.703420 13069 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.705545 12995 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.714191 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.714792 13201 ts_tablet_manager.cc:1929] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:19.715513 13201 log.cc:1199] T 557f4814dd3c4d4bb57340a9834ebd32 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/557f4814dd3c4d4bb57340a9834ebd32
I20260709 12:10:19.705962 13069 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.706162 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:19.707319 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.708540 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:19.718878 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 71669.7us
I20260709 12:10:19.712396 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.711454 11135 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.727211 11285 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:19.726775 11218 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:19.728457 13113 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.730674 11210 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.731726 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.731938 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.732740 11215 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:19.715523 12995 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.733752 12995 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.735160 11214 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.736162 11141 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:19.737001 13149 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.738602 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.739318 11858 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:19.739506 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:19.740306 13149 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.740696 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:19.742928 13252 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:10:19.736264 12995 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.745720 13246 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.745833 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.746984 13249 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.747679 13236 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.748001 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.760811 12920 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.761221 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.762097 11855 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:19.763561 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.764003 13069 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.764422 13069 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.764575 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:19.750659 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.750952 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.767951 11214 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:19.768107 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.753592 11141 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:19.753111 13246 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.768978 11856 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:19.756269 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.757405 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.769171 12920 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.769527 11137 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:19.769624 11139 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:19.770687 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:19.770874 13246 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.771174 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.771260 11137 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.771713 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.772109 11139 raft_consensus.cc:2410] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:19.772855 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:19.773586 11140 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:19.759302 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.775267 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:19.775985 11293 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.760807 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:19.766103 13201 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45926 (request call id 78) took 2027 ms. Trace:
I20260709 12:10:19.786932 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.748708 13213 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.768445 13218 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.775925 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.778019 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.764803 13069 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.790021 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.789219 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:19.793510 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.795241 13250 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.795454 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.795665 13250 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.796017 13250 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.796321 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:19.796666 13032 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.797128 13032 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.797494 13032 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.790766 11288 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.798723 11290 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:19.799894 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.800307 11853 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.800648 11290 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:19.801524 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.792263 11858 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.802659 13248 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.803092 13241 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.803253 13248 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.803772 13248 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.787930 13249 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.806630 13241 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.807709 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.798061 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.809305 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:19.808218 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.818337 11859 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:19.823338 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:19.824041 11286 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.826846 11218 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:19.827077 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:19.828140 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.828315 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:19.829056 11285 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.833207 11860 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.833483 11857 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:19.834414 11291 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:19.834770 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.835007 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.835441 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.836064 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:19.836488 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.836671 11290 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.795464 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.807780 13240 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.838639 13236 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.842760 13236 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:19.843183 13236 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.807098 13249 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.844254 13240 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.844827 13240 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.845407 13249 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.852154 11144 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:19.861665 11137 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:19.861737 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:19.864650 11138 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:19.869637 11143 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.874280 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:19.877329 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.879976 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.881292 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.882752 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.884238 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:19.884851 11136 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.884999 13032 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:19.876840 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.865064 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:19.887243 11856 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:19.892004 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.892716 11291 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:19.898890 11293 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:19.900454 11290 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:19.909456 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:19.910256 11139 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:19.914850 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53209.3us
I20260709 12:10:19.907374 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:19.903187 12995 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.917764 12995 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:19.917948 13244 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.918915 12995 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:19.919957 13244 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:19.920439 13244 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.926883 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:19.898638 13214 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:19.928633 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 135764us
I20260709 12:10:19.933532 12598 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.935705 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:19.936439 13238 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.936683 11287 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:19.936069 12598 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:19.947069 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:19.949133 13218 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.949981 11858 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:19.946731 12598 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.952872 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:19.955139 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:19.926573 13113 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:19.939234 13213 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:19.958928 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:19.942369 13032 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:19.968693 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:19.970309 13214 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.970749 13214 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.946885 11852 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:19.971092 13214 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.787230 13201 rpcz_store.cc:276] 0709 12:10:17.738391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.738595 (+   204us) service_pool.cc:224] Handling call
0709 12:10:18.364021 (+625426us) ts_tablet_manager.cc:1151] Deleting tablet 557f4814dd3c4d4bb57340a9834ebd32
0709 12:10:18.364165 (+   144us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:19.452386 (+1088221us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:19.714620 (+262234us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:19.765978 (+ 51358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585238,"tablet-delete.queue_time_us":594817,"thread_start_us":170968,"threads_started":1}
I20260709 12:10:19.976552 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:19.982842 13218 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:19.988404 11286 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:19.993606 13134 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:19.994218 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:19.992414 13149 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:20.001183 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:20.003504 11139 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:19.994390 11285 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:20.002679 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:20.015251 11136 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:20.018901 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.019945 11286 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:20.020078 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:20.017007 12989 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.029629 12989 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:20.030565 13138 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.031164 13138 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:20.030915 12989 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.032207 13138 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.022799 13217 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:19.998320 13213 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.041471 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:20.052805 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.056634 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 99465.4us
I20260709 12:10:20.023784 13218 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.090167 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:19.964393 13113 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.098557 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:20.103737 11210 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.057331 12920 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.051599 13246 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:20.108335 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.000437 13250 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.042652 13214 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:20.127530 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 86517.1us
I20260709 12:10:20.100907 13238 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:20.131651 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:20.091492 13248 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:20.135644 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:20.136224 13250 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.136375 11286 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:20.133800 13236 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.137852 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:20.119882 13233 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.138569 11292 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:20.139597 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:20.140127 11857 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.140277 11856 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.140686 13214 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.112874 13069 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.142268 11141 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:20.160069 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:20.160660 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:20.180675 11218 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:20.111093 12598 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.187330 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.188411 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.130357 13246 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.198645 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.200124 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.201328 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.202754 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.202889 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.203599 11142 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:20.203902 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.204347 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.204995 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.206204 11144 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:20.209205 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.210660 13238 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.195825 13133 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.218695 11857 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:20.217918 12598 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.219172 12926 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.221346 13069 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.221276 12926 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.222538 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:20.223181 11857 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.214802 13260 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:10:20.225931 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 557f4814dd3c4d4bb57340a9834ebd32 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:10:20.220232 13262 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.226284 12926 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.217918 13133 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.197664 13135 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:20.214008 13244 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:20.234120 13248 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:20.244002 11258 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:20.255278 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:20.272419 11137 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:20.255380 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.257690 11857 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:20.273304 11218 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:20.224975 13113 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:20.271907 11029 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46142.6us
I20260709 12:10:20.298678 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:20.302290 13274 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.304641 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60728us
I20260709 12:10:20.308400 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.309059 11285 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.232672 13240 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:20.312775 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:20.313530 11857 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:20.314203 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:20.214345 11288 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:20.260015 13133 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.259863 13262 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:20.294739 13208 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.333654 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.334445 11292 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.311563 12989 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.327957 13233 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.311121 13213 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:20.351243 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:20.355890 11285 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:20.333333 13208 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:20.387691 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79973.9us
I20260709 12:10:20.342139 13246 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.345799 13217 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:20.414873 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:20.638923 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:20.455050 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 157499us
W20260709 12:10:20.454523 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 191516us
I20260709 12:10:20.620622 11855 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.353276 11857 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:20.428527 13262 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:20.644193 11292 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:20.641897 11861 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:20.637346 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:20.645783 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.640753 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:20.646704 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 265080us
I20260709 12:10:20.649034 11293 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.650318 11286 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.650799 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:20.653236 13268 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.680037 13268 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:20.680485 13268 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.691454 13283 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:20.692330 13283 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:20.645781 13113 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:20.694931 13113 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.695463 13217 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.697350 13243 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.697793 13243 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.698119 13243 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.700184 13208 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.703078 13240 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:20.689807 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43770.2us
I20260709 12:10:20.717856 11860 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:20.719221 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76226.7us
I20260709 12:10:20.720479 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:20.708693 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:20.750862 13213 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:20.760070 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 112772us
W20260709 12:10:20.764180 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.765297 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 114588us
I20260709 12:10:20.771962 12989 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:20.765818 13271 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.788935 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45088.8us
I20260709 12:10:20.777144 13244 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:20.796499 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 120605us
I20260709 12:10:20.802608 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:20.803434 11144 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:20.802830 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:20.806730 11143 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.766619 13133 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:20.787973 13284 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.797937 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:20.818926 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:20.817101 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76132.7us
I20260709 12:10:20.820067 11142 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:20.820951 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:20.822598 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:20.824565 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:20.828207 11258 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:20.810506 13283 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:20.824039 12920 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.013s
I20260709 12:10:20.818771 13244 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.840168 13286 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:10:20.841565 13287 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:10:20.842943 13276 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:20.844710 13208 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.844954 13243 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.863063 13297 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.863446 13133 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:20.856540 13291 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:20.867161 13291 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:20.862114 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:20.884406 13280 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.886706 13113 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:20.887132 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:20.896668 13286 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:20.856715 12920 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.899642 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70176.7us
I20260709 12:10:20.904013 11258 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:20.874615 13283 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.872215 13243 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.904404 11258 leader_election.cc:403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:20.906875 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.907321 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:20.908089 11210 raft_consensus.cc:2368] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
W20260709 12:10:20.909636 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85180us
I20260709 12:10:20.910547 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:20.911859 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:20.912806 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.912892 13288 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.913726 13288 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:20.913853 11214 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:20.914179 13288 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.914773 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:20.914937 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.915493 11219 raft_consensus.cc:2368] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:20.916282 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:20.916847 11217 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.913167 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.924594 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.927695 11210 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:20.930254 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.932705 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.933697 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:20.934120 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.935322 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.925623 13284 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.936623 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:20.937600 11219 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:20.937952 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.938176 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.943516 11289 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:20.938728 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.928869 11858 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:20.933789 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.938757 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.945236 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.945255 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:20.946715 11210 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
W20260709 12:10:20.935341 11110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.752s (SENT) [suppressed 3 similar messages]
I20260709 12:10:20.954602 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:20.958132 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54357.5us
I20260709 12:10:20.958384 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:20.959318 11287 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:20.959369 11143 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:20.939322 13298 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:20.970971 13113 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.971230 13298 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.971527 13113 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:20.973542 13113 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:20.911924 13286 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:20.954926 11288 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.981356 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:20.984575 11217 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:20.967365 12598 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:20.973559 13298 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:20.992326 13288 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:21.001725 13255 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.880s	user 0.000s	sys 0.003s
I20260709 12:10:21.002419 13288 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:10:21.011447 13290 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:10:21.013795 13264 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.887s	user 0.003s	sys 0.000s
I20260709 12:10:21.015023 11216 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:21.017189 13304 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.020855 13236 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:21.025718 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.026203 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:21.027348 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:21.028173 13217 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.028574 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.029042 13273 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:21.029471 13273 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:21.029827 13273 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.030169 13218 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:21.031059 13069 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.031752 13218 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:21.032662 13218 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.033036 13218 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:21.028723 13217 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:21.035950 13217 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:21.038597 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84101.1us
I20260709 12:10:21.039220 13282 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.039953 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.041230 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.042320 11137 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.043941 11136 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.039175 13273 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.044889 11140 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:21.046802 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.047180 13273 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:21.047753 11144 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:21.042377 13305 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.049088 13305 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.050138 12598 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.051415 13305 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:21.055641 13297 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.057708 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.058379 11142 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.060392 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.064352 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.064914 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.065518 11213 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:21.066820 11855 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:21.068733 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:21.070408 12920 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.074697 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:21.074980 13269 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.726s	user 0.003s	sys 0.000s
I20260709 12:10:21.042279 11256 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:21.076465 12598 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.078725 13233 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.084271 11142 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:21.033833 13218 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.087603 11859 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:21.086356 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 151043us
I20260709 12:10:21.093010 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:21.093868 11859 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.088584 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.097747 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.092460 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:21.095793 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.099063 11210 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.105413 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.106277 11210 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.110719 11213 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:21.103780 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.122354 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.128691 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.129016 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.130949 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 240) took 1380 ms. Trace:
I20260709 12:10:21.133395 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:21.133560 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.135838 11215 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:21.131108 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.131340 11135 rpcz_store.cc:276] 0709 12:10:19.750900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.751412 (+   512us) service_pool.cc:224] Handling call
0709 12:10:19.751735 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.756971 (+  5236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.756999 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.757579 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.897913 (+140334us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:19.906662 (+  8749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.906777 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.000999 (+1094222us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:21.098506 (+ 97507us) raft_consensus.cc:1685] finished
0709 12:10:21.098528 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.130887 (+ 32359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2525,"raft.queue_time_us":19486,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":23530880,"thread_start_us":139881,"threads_started":1,"wal-append.queue_time_us":290887}
I20260709 12:10:21.142730 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.143633 11143 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:21.142736 11218 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:21.111548 13282 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.160670 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.166347 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:21.026382 13268 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.087320 13236 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:21.170842 11135 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.098053 13149 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:21.141862 13286 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.097950 12989 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:10:21.174222 11136 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.175493 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.141624 13262 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.156646 13218 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.133034 13135 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:21.194883 11856 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.214279 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:21.215626 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54778.2us
I20260709 12:10:21.199801 13265 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.195809 13262 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:21.217406 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95189.2us
I20260709 12:10:21.224512 11859 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:21.229281 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:21.258255 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44038.7us
I20260709 12:10:21.259490 11110 leader_election.cc:400] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:21.226302 13138 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.254375 13273 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.300658 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.300658 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.305292 11219 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:21.260509 13217 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:21.262812 12989 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:21.314929 11859 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:21.308666 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:21.325677 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.340773 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:21.344396 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 115201us
I20260709 12:10:21.266508 13304 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:21.311308 13133 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.357374 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:21.325589 11858 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:21.324558 13274 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.345671 13208 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.326020 13217 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:21.312518 13149 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:21.354368 13213 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.298748 13282 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:21.375413 11140 raft_consensus.cc:2368] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5.
I20260709 12:10:21.384059 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.351598 13273 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:21.408179 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:21.410987 13308 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:10:21.372255 13262 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.387408 13208 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:21.413327 13291 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.405740 13268 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:21.417100 13312 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:10:21.417681 13328 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:21.419159 13316 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:10:21.421067 13313 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 12:10:21.424616 13322 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:21.415201 13324 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.427007 13274 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.427871 13274 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.434892 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.422185 11288 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:21.449112 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 288541us
I20260709 12:10:21.450343 11825 leader_election.cc:400] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5.
I20260709 12:10:21.450757 11825 leader_election.cc:403] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.451673 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:21.422237 13321 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:21.445381 13291 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.446640 13213 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:21.497882 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47806.1us
I20260709 12:10:21.426038 13217 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.504436 11856 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:21.522200 13218 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:21.523984 13218 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.524719 11290 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.527055 12920 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.494449 13328 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.534085 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:21.541952 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91689.6us
I20260709 12:10:21.546221 11214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:21.547114 11214 raft_consensus.cc:606] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.549376 11286 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.550457 13325 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.551062 13325 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.553084 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:21.414791 13208 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:21.497136 13149 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:21.559439 13149 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.561933 13149 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:21.533645 13236 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5.
I20260709 12:10:21.518975 13274 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.572001 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.583669 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.572582 13337 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.551939 13268 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:21.574143 13250 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.575181 13289 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:21.575968 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.569190 13249 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.596549 13249 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.598801 13289 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:21.608395 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 156807us
I20260709 12:10:21.609503 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.589783 12920 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.602029 13250 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:21.641079 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57503.2us
I20260709 12:10:21.642987 11110 leader_election.cc:400] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:10:21.643594 11110 leader_election.cc:403] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.613898 12920 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:21.620846 13236 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.648465 13304 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:21.651814 13250 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.653070 13289 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.655532 11142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:10:21.656965 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.659948 11216 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.662845 11142 raft_consensus.cc:606] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.663450 11142 raft_consensus.cc:614] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:21.665269 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.646939 12920 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.676923 13304 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.679865 13249 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.664659 13069 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.744508 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.714919 13335 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:21.745195 13330 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.097s	user 0.004s	sys 0.003s
I20260709 12:10:21.668164 13281 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:21.726199 11142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:51338
I20260709 12:10:21.746132 11142 raft_consensus.cc:606] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.746620 11142 raft_consensus.cc:614] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:21.747967 13281 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.749205 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:21.750330 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:21.750620 13281 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.668848 13282 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:21.728248 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62870.3us
I20260709 12:10:21.751541 11284 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.737030 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.753209  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:21.756251 13325 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.756990 13335 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.757598 13335 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.760339 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.761165 11216 raft_consensus.cc:2376] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3. Re-sending same reply.
I20260709 12:10:21.761752 13335 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:21.762181 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.661415 13342 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:10:21.737828 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.771596 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:21.772070 11135 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.737120 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.665742 13274 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:21.743366 11290 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:21.743914 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.744282 13304 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:21.746188 11211 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.768294 13218 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.769126 13069 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.782727 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:21.777156 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107501us
I20260709 12:10:21.779422 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.783203 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:21.788955 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.785504 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.780475 13282 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.770871 13134 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.799631 11857 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:21.794833 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:21.772156 13335 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:21.788374 13218 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.808391 13134 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.808499 12989 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.810612 13218 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:21.812808 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.814193 13133 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.814478 13348 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.814630 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:21.805261 13069 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:21.804649 12598 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:21.819140 12598 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:21.819536 12598 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:21.820402 12598 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.821671 12598 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.822165 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.822269 13342 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:21.822921 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:21.823213 11210 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:21.820631 13069 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:21.811206 13134 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:21.812979 13335 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:21.890478 12920 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:21.895998 13335 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.898528 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:21.898933 11289 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:21.920702 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:21.921463 11293 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:21.928828 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:21.893326 12920 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:21.883271 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:21.961402 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:21.996462 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:21.997605 12920 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.034003 13069 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.043217 13069 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.047509 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.048383 11287 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:22.056403 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.067653 11143 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:22.072391 13294 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:22.075925 13294 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.079165 13069 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:22.078235 13294 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.053562 13218 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.054199 13328 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.096755 13345 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.097436 13345 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.101286 13328 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.104007 13328 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:22.106207 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.107697 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.108417 11215 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:22.107300 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.110592 13345 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.110968 13218 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.119756 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.127071 13218 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.135171 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.136564 11286 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:22.140264 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.150421 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.150897 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.151335 11286 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:22.152909 11287 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:22.154812 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:22.155751 13236 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:22.156152 13236 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.156497 13236 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:22.176445 13286 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:22.179090 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:22.206976 13324 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.207711 13324 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.211634 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.212374 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.212805 11137 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:22.212975 13324 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.213747 11856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 536) took 1330 ms. Trace:
I20260709 12:10:22.214679 11856 rpcz_store.cc:276] 0709 12:10:20.883554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.886771 (+  3217us) service_pool.cc:224] Handling call
0709 12:10:22.213559 (+1326788us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540067ff54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:22.213659 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685500160}
I20260709 12:10:22.216467 13248 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:22.226987 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:22.228168 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.227928 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:22.229771 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.232412 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:22.236495 13342 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.236901 13342 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.237262 13342 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.237540 13069 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.237955 13069 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.238283 13069 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.230736 13328 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.255012 11217 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:22.229868 13274 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:10:22.266355 13324 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:22.270558 13351 log.cc:927] Time spent T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.308s	user 0.000s	sys 0.003s
I20260709 12:10:22.279134 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.255031 13328 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.296633 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:22.292171 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.302973 13340 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.303763 13340 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.307003 13340 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.310799 13289 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.299218 13328 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:22.402778 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48857.3us
I20260709 12:10:22.408030 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:22.409693 13370 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.411736 13250 raft_consensus.cc:993] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:10:22.412196 13250 raft_consensus.cc:1081] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:10:22.299942 13133 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:10:22.421903 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:22.424446 13318 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:22.426096 13361 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:10:22.427963 13372 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:10:22.431272 13283 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:22.431684 13283 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:22.432636 13283 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.433609 13364 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:22.434018 13283 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.434259 13364 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.343626 13236 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.455446 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:22.489171 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 255887us
I20260709 12:10:22.493507 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:22.496793 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 171770us
I20260709 12:10:22.504976 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:22.514079 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:22.503355 13342 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.495018 13274 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.505927 13280 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.521921 13274 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.524114 13274 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.527868 13364 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:22.512669 13340 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.507906 13133 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.496451 13069 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.544601 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:22.547147 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:22.551956 13354 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.522s	user 0.004s	sys 0.005s
I20260709 12:10:22.557179 13373 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:22.563238 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:22.549724 13340 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.595395 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 86611.1us
I20260709 12:10:22.570995 13318 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:22.571187 13337 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:22.579341 12920 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.592972 13380 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.621125 13373 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.609722 13337 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:22.627025 13365 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.616s	user 0.000s	sys 0.007s
I20260709 12:10:22.628443 13337 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:22.612136 12920 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.609639 11293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:10:22.635011 11293 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:22.635437 11293 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.637495 13380 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:22.640030 13380 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.641302 13236 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.642319 13380 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:22.652081 13069 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:22.658298 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50094.2us
I20260709 12:10:22.659127 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.659874 11136 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:22.607966 13318 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.660094 13274 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.669945 11293 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.671387 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.675411 11143 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:22.678431 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:22.682015 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:22.682600 11218 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:22.660791 13342 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.668975 13069 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:22.679329 13268 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.678500 13328 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.701864 11142 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.705811 13328 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.716904 11218 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:22.723542 11293 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:22.699532 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 136394us
W20260709 12:10:22.725872 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 217377us
I20260709 12:10:22.733095 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:22.733837 12598 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.734670 12598 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:22.735627 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.736330 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:22.732000 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:22.736996 11214 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.737509 13218 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:22.737643 11214 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:22.737988 13218 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.740084 13218 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.743527 12598 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:22.744158 13291 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.744907 13291 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:22.843957 13390 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:22.844485 11854 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:22.847591 13291 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:22.852614 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104664us
I20260709 12:10:22.854247 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:22.702899 13069 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.711092 13268 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.850239 13291 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:22.863098 13113 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:22.939052 13113 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.941280 13113 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.943295 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:22.945248 13342 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.936666 13328 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:22.949084 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 103398us
I20260709 12:10:22.949817 13113 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:22.950378 13113 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.950598 13236 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.951354 13236 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.952456 13113 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.953573 13032 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:22.936327 13380 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:22.956722 13380 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.945297 13385 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.954110 13032 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.959404 13113 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:22.960357 13113 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:22.966939 13032 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.967868 13113 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:22.967912 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:22.974843 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.974897 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:22.975270 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:22.977557 12598 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:22.978272 12598 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:22.983124 12598 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:22.994976 13236 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:22.995564 13358 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.978s	user 0.045s	sys 0.054s
I20260709 12:10:22.982764 13319 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:23.000625 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:23.001328 11137 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.001567 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.005914 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.007421 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.010114 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:22.844566 13318 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.037820 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.041006 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.039145 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:23.047530 11140 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.020179 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.050192 11854 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:23.054319 11219 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:23.048243 11136 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:23.059444 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.060124 11141 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:23.059440 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.063298 11137 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:23.066334 13069 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:23.071218 13268 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:23.072093 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.036286 13335 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:23.078647 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:23.086910 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70409us
I20260709 12:10:23.093778 11292 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:10:23.105123 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 157204us
I20260709 12:10:23.121476 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:23.098304 13380 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.130285 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.091097 13335 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.148874 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:23.157742 11140 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:23.158990 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:23.159989 11291 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.159273 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:23.163105 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.163040 11288 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:23.167608 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.173012 11141 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:23.174441 11144 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.160231 12839 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.178915 12839 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:23.179098 13186 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.190120 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:23.178233 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.187404 12839 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.194998 11284 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:23.199062 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.201817 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:23.218755 13394 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:23.219826 13340 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:23.220355 13340 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:23.221230 13340 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:23.222927 13394 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.225821 12839 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.228269 11291 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:23.232335 12839 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.235934 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:23.237284 13335 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.254354 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.237052 13218 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:23.205459 13186 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:23.241510 13380 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.250736 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:23.247071 13393 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.256546 11215 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:23.258139 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:23.281424 11291 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.239532 13340 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.263063 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.266000 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 1957) took 1014 ms. Trace:
I20260709 12:10:23.266582 13186 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.268728 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.288525 11142 rpcz_store.cc:276] 0709 12:10:22.251326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.251549 (+   223us) service_pool.cc:224] Handling call
0709 12:10:22.251897 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.702251 (+450354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.265743 (+563492us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003c9954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:23.265932 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034331520}
I20260709 12:10:23.271819 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.288741 11143 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:23.253340 12920 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:23.269378 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:23.302002 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51397.6us
I20260709 12:10:23.302716 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:23.312088 11291 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:23.317746 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:23.318327 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119345us
I20260709 12:10:23.306711 13383 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:10:23.321887 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.319765 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.324818 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:23.326148 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:23.328935 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.332002 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.290227 13393 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.309136 13364 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.327348 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:23.316561 13262 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:23.334686 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:23.319379 12920 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:23.346597 11859 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.340442 13262 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:23.348234 13262 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.335281 13335 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.348664 13335 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:23.349079 13335 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.333801 13380 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.350190 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.338995 13364 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:23.344710 13284 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.366741 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.367499 11292 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:23.367753 13356 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:23.368584 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:23.370301 11292 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:23.369966 13299 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:23.370877 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.371227 13299 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.371639 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:23.373517 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.371665 13299 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:23.375722 13299 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:23.376361 13333 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.971s	user 0.000s	sys 0.015s
I20260709 12:10:23.377372 13299 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.377444 13393 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.350267 13395 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.378516 13395 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:23.379521 13395 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.371177 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.395673 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:23.398083 11135 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.395499 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:23.374367 13379 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.857s	user 0.004s	sys 0.000s
I20260709 12:10:23.400069 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:23.402025 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.402727 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.383239 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:23.406008 11859 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:10:23.411476 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67012.2us
I20260709 12:10:23.499132 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:23.500479 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:23.500408 13134 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:23.503350 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.364253 13364 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.406556 13406 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:23.513307 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 113336us
I20260709 12:10:23.524160 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:23.360817 13286 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 12:10:23.404666 11853 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:23.505298 13362 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.512892 13373 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:23.551945 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:23.497423 13328 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.557006 11861 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.504405 13268 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.511782 12920 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:23.505004 13319 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:23.512814 11854 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.511816 13393 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.514937 13284 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.585330 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:23.562605 13394 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:23.573347 13218 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:23.574021 13324 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:23.566037 13373 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:23.609699 12920 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.611315 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.611565 13373 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:23.613950 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.605583 13394 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.617003 13394 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.569819 13328 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:23.609774 13405 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:10:23.620604 13328 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:23.575572 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.518774 13406 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.586130 11213 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.583248 13265 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.584110 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:23.654417 13324 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.656080 13265 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:23.656962 13324 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.654343 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.665841 11861 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
W20260709 12:10:23.670135 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 118833us
I20260709 12:10:23.654994 13406 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:23.683267 13386 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.062s	user 0.001s	sys 0.014s
I20260709 12:10:23.685082 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 1954) took 1460 ms. Trace:
W20260709 12:10:23.685281 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 115797us
I20260709 12:10:23.685499 11139 rpcz_store.cc:276] 0709 12:10:22.224865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.226009 (+  1144us) service_pool.cc:224] Handling call
0709 12:10:22.235008 (+  8999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.507268 (+272260us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:22.537156 (+ 29888us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.617170 (+ 80014us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.618966 (+  1796us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.639458 (+ 20492us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.657071 (+ 17613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.657476 (+   405us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.682636 (+1025160us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:23.684694 (+  2058us) raft_consensus.cc:1685] finished
0709 12:10:23.684823 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.684972 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29343,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":45229,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":201,"spinlock_wait_cycles":39761280,"thread_start_us":324862,"threads_started":2,"wal-append.queue_time_us":81104}
I20260709 12:10:23.686367 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:23.706749 11825 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:23.720430 13380 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:23.721153 13380 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:23.738909 11213 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:23.741535 11212 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:23.666841 13364 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.750165 11218 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.751232 13364 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.733281 13416 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:23.763773 13410 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.765875 13186 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:23.854990 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:23.858047 11854 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:23.859119 13416 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.861969 13186 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:23.781955 13409 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.831533 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:23.892350 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:23.914243 13409 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:23.961819 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 197878us
I20260709 12:10:23.838380 13380 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.011927 12598 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.015030 12598 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.017477 13113 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:24.018397 12598 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:23.960088 13409 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:24.023864 13398 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.790s	user 0.003s	sys 0.000s
I20260709 12:10:24.010164 13297 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:10:24.034473 13297 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:24.034699 13406 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.034947 13297 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:24.035125 13406 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:24.035878 13297 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:24.038331 13417 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 12:10:24.041414 13335 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.001s
I20260709 12:10:24.041945 13335 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.046250 13335 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:24.048514 13262 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.003s
I20260709 12:10:24.035950 13406 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:24.059799 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97222.5us
I20260709 12:10:24.071892 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:24.064926 13297 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:24.058308 13340 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.002s
W20260709 12:10:24.078673 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 234729us
I20260709 12:10:24.079319 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.078420 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:24.083365 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.083962 11287 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:24.084057 11107 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.084008 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.086727 13406 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:24.142772 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 58813.1us
I20260709 12:10:24.143366 11143 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:24.143694 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:24.144476 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.145419 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.146154 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.148483 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.151161 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.152274 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:24.152590 11143 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:24.152309 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:24.158213 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.155473 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.160833 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:24.163470 13430 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.164142 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.165076 11290 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
W20260709 12:10:24.166229 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.172335 11286 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:24.175601 13340 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.176205 13340 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.176644 13340 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.187157 13342 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.187737 13328 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.076426 13262 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.188498 13328 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.190709 13262 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.194677 13421 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.195215 11852 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:24.195763 13421 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.161209 13395 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.202054 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.161515 13281 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.203697 13424 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.203788 13281 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:24.147572 13335 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.205233 13335 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.205488 13281 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.205914 13335 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.133559 13380 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:24.223476 13424 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.226928 13424 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:24.229136 13328 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:24.254967 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:24.241765 13423 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.295058 13335 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:24.293339 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141072us
W20260709 12:10:24.262826 13374 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.520s	user 0.012s	sys 0.005s
I20260709 12:10:24.300134 13421 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.301755 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:24.302248 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 144105us
I20260709 12:10:24.302594 11212 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:24.303745 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:24.310137 11244 heartbeater.cc:646] Failed to heartbeat to 127.9.180.190:38919 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.180.190:38919 timed out after 15.000s (SENT)
I20260709 12:10:24.295671 13293 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.325083 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.303647 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.329890 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.334941 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.335409 11857 raft_consensus.cc:2376] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5. Re-sending same reply.
W20260709 12:10:24.349022 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 188248us
I20260709 12:10:24.350229 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.318061 13340 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.332288 13274 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.351265 13328 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:24.359875 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:24.360412 13388 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.390336 11212 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.390156 13388 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.360865 13380 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.361325 13342 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.363827 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.371167 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.325743 13421 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.332599 13293 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.327328 13262 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.302107 13423 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.383302 13433 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.308296 13335 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.393708 13395 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.407819 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.401441 13421 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.409466 13433 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.422619 13340 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.424448 13433 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.428676 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.429294 11288 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:24.430145 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:24.395799 13428 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:24.430760 13418 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.435477 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:24.409348 13395 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.403439 13380 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.429977 13421 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.449925 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:24.407138 13262 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.452090 11856 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.453552 11857 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:24.447261 13395 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.449184 13436 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:24.465973 11214 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.445492 13418 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.505622 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.492769 13388 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:24.509109 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50676us
I20260709 12:10:24.515601 13424 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.516327 13424 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.518082 13262 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.519089 13423 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:24.519922 13293 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.480449 13370 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:24.521526 11288 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.523777 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:24.526022 13149 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.529556 13149 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.533823 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.535424 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:24.536885 13418 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.537434 13149 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:24.541950 11292 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:24.546686 13409 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.547164 13380 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.547426 13409 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.557979 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.561509 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:24.558378 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.567238 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.567616 11291 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:24.567940 11286 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:24.568595 13433 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.569087 13433 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:24.569444 13380 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.534752 13424 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:24.570017 13380 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.570243 13395 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.571782 13265 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.572538 13380 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.570040 13433 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.574460 13433 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.575986 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.577606 13032 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.578055 13032 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:24.578919 13032 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.580058 13032 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:24.580924 13429 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.287s	user 0.000s	sys 0.003s
I20260709 12:10:24.581259 13436 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:24.583195 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.583509 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.583461 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:24.584332 11138 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:24.585516 13436 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.585948 13436 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.586326 13436 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.596809 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:24.595685 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.601050 11138 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:24.601135 13392 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.594053 13393 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.603714 13395 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.604038 13393 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.550446 13409 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:24.601652 13304 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.607049 13304 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.609314 13304 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:24.622764 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.629489 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:24.615379 13393 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:24.628469 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.646613 11287 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:24.657111 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.657784 11288 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:24.659055 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:24.625204 13370 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.625113 13392 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:24.624713 13320 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.625875 13324 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:24.675132 11288 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
W20260709 12:10:24.685421 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.679755 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:24.674572  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:24.648797 13304 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.688333 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.689038 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.643254 13421 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.695391 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.696265 11288 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:24.690222 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:24.703603 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:24.716677 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:24.719453 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71131.4us
I20260709 12:10:24.699931 13380 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.701713 13324 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:24.709856 13335 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.706132 13304 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:24.706336 13340 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.686276 13370 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.743221 13442 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.743844 13442 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.746153 13442 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.687646 13320 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.752285 11142 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.751914 13324 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:24.759420 13442 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.763691 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.765225 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.735270 13340 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.770596 13421 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.764822 13304 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.739392 13335 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:24.731125 13380 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.790009 13335 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.791076 13380 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.791697 13380 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.774868 13364 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:24.775107 13406 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.774456 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:24.793886 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.794222 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:24.795238 13268 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.795619 13268 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:24.795960 13268 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.798724 13406 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.778307 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:24.800052 13340 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.775575 13265 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:24.800732 13265 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.754922  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:24.792181 13380 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.807787 13380 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.821029 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.814546 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.825548 11136 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:24.807556 13297 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.808738 13265 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.847074 13297 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:24.821580 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:24.848713 13433 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.849152 13433 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.849541 13433 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.777667 13442 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.853715 13442 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.816712 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.830550 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.831173 13410 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:24.832154 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.834152 13320 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:24.841313 13370 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:24.842250 13284 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.842700 13436 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:24.844259 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:24.844766 11141 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.846094 11135 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:24.848184 13297 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.987564 13297 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.816390 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:24.991062 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 174754us
I20260709 12:10:24.858526 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:24.892370 13380 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.842273 13268 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:24.997511 13268 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:24.966531 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 249) took 11433 ms (client timeout 15000 ms). Trace:
I20260709 12:10:24.966842 13391 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.892905 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:24.999198 11144 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.998888 13391 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.001680 13391 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:24.967563 13384 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:24.892609 13283 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:25.002611 13283 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.003655 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:25.009359 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.013417 13262 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:25.014204 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.014009 13262 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.016345 13262 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:24.998658 11039 rpcz_store.cc:269] 0709 12:10:13.533141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.533331 (+   190us) service_pool.cc:224] Handling call
0709 12:10:24.962811 (+11429480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:19.391093 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:19.407081 (+ 15988us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:19.407165 (+    84us) write_op.cc:435] Acquired schema lock
0709 12:10:19.407214 (+    49us) tablet.cc:662] Decoding operations
0709 12:10:19.408651 (+  1437us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:19.408759 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:19.408798 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:10:19.410060 (+  1262us) tablet.cc:701] Row locks acquired
0709 12:10:19.410116 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:10:19.410312 (+   196us) write_op.cc:270] Start()
0709 12:10:19.410476 (+   164us) write_op.cc:276] Timestamp: P: 1783599019410235 usec, L: 0
0709 12:10:19.443514 (+ 33038us) op_driver.cc:348] REPLICATION: starting
0709 12:10:19.447670 (+  4156us) log.cc:844] Serialized 4795 byte log entry
0709 12:10:20.048477 (+600807us) op_driver.cc:464] REPLICATION: finished
0709 12:10:20.231384 (+182907us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f9834511ef0
0709 12:10:20.678722 (+447338us) write_op.cc:301] APPLY: starting
0709 12:10:20.678831 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:20.679100 (+   269us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:20.679136 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:20.808345 (+129209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:20.846130 (+ 37785us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:10:20.846197 (+    67us) write_op.cc:312] APPLY: finished
0709 12:10:20.846646 (+   449us) log.cc:844] Serialized 89 byte log entry
0709 12:10:20.846878 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.847026 (+   148us) write_op.cc:454] Released schema lock
0709 12:10:20.847093 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:20.878315 (+ 31222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.878349 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10814,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":571748,"apply.run_cpu_time_us":5833,"apply.run_wall_time_us":168822,"num_ops":12,"prepare.queue_time_us":807144,"prepare.run_cpu_time_us":19505,"prepare.run_wall_time_us":135259,"raft.queue_time_us":192604,"raft.run_cpu_time_us":34120,"raft.run_wall_time_us":333641,"replication_time_us":588366,"spinlock_wait_cycles":8602496,"thread_start_us":780487,"threads_started":4,"wal-append.queue_time_us":160128,"wal-append.run_cpu_time_us":20756,"wal-append.run_wall_time_us":2262772}]]}
I20260709 12:10:24.983721 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:24.990912 13436 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.022742 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2005) took 1141 ms. Trace:
I20260709 12:10:24.995371 13328 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.995038 13380 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.024482 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:25.023521 13442 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.985175 13284 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.025504 13442 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.002539 13384 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.025704 11861 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.026329 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.027045 11135 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:25.027393 13384 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.028385 13442 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.023205 11141 rpcz_store.cc:276] 0709 12:10:23.881240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.881388 (+   148us) service_pool.cc:224] Handling call
0709 12:10:24.844237 (+962849us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800005198. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:24.844472 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.022410 (+177938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.022681 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6941568}
I20260709 12:10:25.052186 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.053028 11136 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:25.007364 13433 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.058849 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:24.972760 11040 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 2 to 3, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 3 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:25.004828 13283 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.072098 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:25.081981 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 57600.9us
I20260709 12:10:25.085166 11214 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.087242 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.087312 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.074929 13391 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:25.091578 13391 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.092373 13430 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.093995 13391 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.086228 13384 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.025679 13380 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:25.097272 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 109737us
W20260709 12:10:25.108789 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 337440us
I20260709 12:10:25.108908 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.110296 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:25.075176 13248 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.074028 13395 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:25.084024 13218 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:25.083221 13268 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:25.117893 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:25.136667 11144 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:25.120942 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:25.139870 11144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2004) took 1312 ms (client timeout 1576 ms). Trace:
I20260709 12:10:25.140137 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:25.126119 11137 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.137921 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.127347 13248 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.120358 13133 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:25.116622 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.027303 13284 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.126893 11214 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
W20260709 12:10:25.140249 11144 rpcz_store.cc:269] 0709 12:10:23.827614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.827801 (+   187us) service_pool.cc:224] Handling call
0709 12:10:24.892658 (+1064857us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800005198. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:25.139781 (+247123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25900288}
I20260709 12:10:25.147841 13248 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.149446 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:25.152222 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 77495.3us
I20260709 12:10:25.152665 13444 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.153059 13444 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.153388 13444 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.148624 13370 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:25.148357 13133 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.159159 13370 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.160513 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.161033 13133 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:25.161322 13370 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:25.163499 11214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1556) took 2412 ms (client timeout 2193 ms). Trace:
W20260709 12:10:25.164073 11214 rpcz_store.cc:269] 0709 12:10:22.735939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.736052 (+   113us) service_pool.cc:224] Handling call
0709 12:10:24.465378 (+1729326us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b4c001f1e00. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982ed7e644 00007f982eda5f2d 00007f982eda5b93 00007f9830ad618b 00007f9830ad6cb5 00007f9830ad1f30 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17
0709 12:10:24.838403 (+373025us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b58006d07d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c
0709 12:10:25.084376 (+245973us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400227ca0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a50a1d 00007f9830a371a4 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591
0709 12:10:25.148616 (+ 64240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670781440}
I20260709 12:10:25.171530 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:25.175462 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.178097 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:25.179795 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.142628 13281 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.148831 13418 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.221621 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58966.8us
I20260709 12:10:25.136237 13395 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.222816 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:25.173158 13456 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.179498 13285 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.221210 13218 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.221277 13244 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.223544 13370 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.232292 13240 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.249188 13218 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:25.261581 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83565.3us
I20260709 12:10:25.222579 13281 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.253499 13293 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:25.265648 13324 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.267402 13380 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.222744 13418 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.263620 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:25.289002 13424 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.289456 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.263713 12920 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:25.291002 12920 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.290737 13324 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.263936 13218 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.296597 13433 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.297849 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:25.300483 13442 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.304903 11292 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:25.305377 11292 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 4
I20260709 12:10:25.306820 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.247200 13456 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.304982 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.308139 11290 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:25.255070 13244 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.284936 13293 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.309553 11136 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:25.310420 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.311008 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.316658 13293 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.307657 13286 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.318099 13335 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:25.322829 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.305619 11292 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:25.327246 11292 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.329083 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.255952 13370 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.335904 11859 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:25.312741 13340 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.001s
I20260709 12:10:25.332122 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.332924 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.342463 11216 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:25.342213 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.344094 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.333457 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.330674 11040 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:25.264565 13240 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.284513 13380 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:25.361907 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.338716 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.347713 11219 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.348026 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.348775 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.349720 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:25.336347 13362 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:10:25.342698 13436 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:25.324154 13455 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.331580 13324 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:25.335281 13133 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:25.356355 13395 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.357551 13281 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:25.359086 13370 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:25.375656 11214 raft_consensus.cc:2376] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5. Re-sending same reply.
I20260709 12:10:25.397083 11214 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:25.398198 13380 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.399760 13380 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.402596 13356 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:25.404083 13356 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.404562 13356 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:25.399065 13218 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.405668 13356 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.362862 11292 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:25.353768 13240 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.374611 11210 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:25.380141 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.389997 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:25.391088 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.392021 13244 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.407665 13218 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.411083 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:25.435719 11290 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.411366 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.413040 13293 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.376140 11861 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:25.421640 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:25.426296 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.430315 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.432394 12920 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.433954 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:25.434551 13244 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:25.437621 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.437572 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.438414 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.393832 13456 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.350057 13340 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.480711 11213 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:25.445791 13268 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.529836 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87613.9us
I20260709 12:10:25.516456 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.471740 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:25.542333 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:25.542951 11142 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.543458 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:25.543977 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.544626 13436 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.544687 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.545380 13436 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:25.546504 13436 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.547381 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.462991 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.548658 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.548957 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.549314 11212 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:25.551115 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.552505 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.553181 11212 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.560021 11142 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:25.451318 13218 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:25.539551 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.564848 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.565632 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:25.529424 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95518.2us
I20260709 12:10:25.540500 13268 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.469988 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.516561 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:25.564857 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 253) took 16376 ms (client timeout 15000 ms). Trace:
I20260709 12:10:25.564854 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:25.549316 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.571264 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:25.572305 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.568984 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.566622 11040 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:10:25.571345 11042 rpcz_store.cc:269] 0709 12:10:09.225542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.225784 (+   242us) service_pool.cc:224] Handling call
0709 12:10:09.303902 (+ 78118us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:10:25.564629 (+16260727us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4430573,"reported_tablets":15,"spinlock_wait_cycles":4814080}
I20260709 12:10:25.448511 13244 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.461179 13362 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.580727 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.580801 11214 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:25.531662 13442 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.445683 13425 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:10:25.593075 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.569157 13218 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:25.585266 13244 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.584424 11040 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 2 to 3, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:25.593480 13288 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:25.586915 13423 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.606442 13423 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:25.503157 13356 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.603560 13218 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.608928 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.612932 11040 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 3 to 4, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 4 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:25.619833 11040 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:25.600018 11216 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:25.608744 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.603030 13362 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:25.625602 13362 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.622884 11040 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 2 to 3, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:25.606037 13288 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.639424 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.607451 13424 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.643312 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.646615 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.645380 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:25.649344 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84599.4us
I20260709 12:10:25.650033 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.651320 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.657389 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.657951 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.658533 11144 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.661931 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.665423 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.667773 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.668799 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.671550 11142 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.670912 13474 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.696838 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.698248 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:25.703469 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51589.7us
I20260709 12:10:25.706277 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.707975 13395 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.710769 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44988.8us
I20260709 12:10:25.712663 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:25.719941 11143 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:25.665721 13433 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:25.698954 13444 consensus_meta.cc:287] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.001s
I20260709 12:10:25.719424 13289 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.673420 13406 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:25.724324 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 121464us
I20260709 12:10:25.741374 13395 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.741997 13395 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.744462 13395 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.702914 12920 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.756055 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.713680 13474 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.712052 13442 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.763371 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.764436 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.765312 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.765467 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.694657 13430 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:10:25.776199 11860 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.773981 13320 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.665096 13423 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.779193 11212 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:25.760502 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.754458 13289 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.786737 13281 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.786581 13456 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:25.789723 13456 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.784953 13406 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.773371 13425 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:25.791287 13288 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.791759 13425 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.792232 13425 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:25.793323 13425 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.796869 13418 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:25.731788 13444 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.798861 11219 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:25.799074 13444 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.800453 11217 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.776544 13293 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.790378 13289 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:25.804260 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.805943 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:25.806167 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:25.786898 13384 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.791808 13288 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.790167 13456 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:25.792155 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.790078 13284 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.811510 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.815093 13289 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.816020 13281 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.816630 13250 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.817178 13250 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:25.818264 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.778759 13442 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.819590 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54181.4us
I20260709 12:10:25.781337 13340 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.821498 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.822840 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:25.823621 11217 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:25.808734 13425 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.829631 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.832787 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.833498 11213 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:25.845681 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:25.846719 11219 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:25.822042 13240 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.851081 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.853360 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.827703 13482 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.854668 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.855408 13284 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.855787 13288 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:25.859110 13483 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.865953 13483 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.866322 13483 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:25.824797 13442 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.818192 13250 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.875403 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:25.856288 13456 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:25.878438 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.879153 13456 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.879750 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.880473 13328 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.880841 13328 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:25.881187 13328 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.881815 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.854578 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.861835 13424 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.862126 13340 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.889845 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:25.828742 13218 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.872541 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:25.888521 13474 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.902432 11110 leader_election.cc:400] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:25.900969 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:25.885541 13468 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.916574 11136 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.917812 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:25.919680 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 221508us
W20260709 12:10:25.943550 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.867036 13483 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.892628 13324 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.908941 13391 raft_consensus.cc:2764] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:25.947239 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46393us
I20260709 12:10:25.894956 11855 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:25.886641 13482 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:25.952420 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:25.907020 13436 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:10:25.417815 13335 consensus_queue.cc:1175] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2b4f4725b82b481ab53f0717a429e94a" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:25.915735 11854 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:25.945963 13474 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:25.950788 13384 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.969960 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:25.955904 13424 consensus_queue.cc:1175] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "018d40ceb45d4447aa293f4c1d929bb8" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:10:25.911412 13465 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:25.965026 13483 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.997963 13442 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:25.977332 11858 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.000757 13218 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.969769 13474 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.002925 13244 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:25.972642 13370 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.983892 13410 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:25.994588 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.971285 13492 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.968549 13384 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:26.019001 13384 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.019562 13244 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:25.994203 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:26.025774 11143 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:26.016649 13410 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.008247 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.003516 13474 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:26.009536 13370 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.028321 13370 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.028445 13410 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:26.033576 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:26.034245 11139 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:10:26.036968 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.040012 11858 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:26.043903 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 91616.8us
I20260709 12:10:26.043937 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:26.044549 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.045044 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:26.047930 13483 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.054765 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:26.056185 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:26.057174 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.057811 11217 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:26.064146 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:26.067575 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:26.071681 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:26.077075 13430 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.081409 13430 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.081799 13430 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.099464 13335 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:26.100018 13335 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.101488 13393 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:26.102002 13393 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.102002 13335 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:26.104038 13393 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:26.107813 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47417.3us
I20260709 12:10:26.109274 13268 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:26.110622 13488 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:26.116726 11210 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:26.117051 13291 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.117637 13291 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.119522 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:26.119938 13291 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:26.120257 11854 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:26.120993 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.122691 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:26.123914 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:26.124873 13456 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:26.125201 13465 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.125712 13465 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:26.125941 13456 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.126052 13465 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.127489 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:26.130105 11291 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:26.130859 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.133330 13430 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.136615 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:26.137005 13430 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:26.137292 11139 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:26.137820 13465 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.139158 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:26.149485 11143 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.139853 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:26.140969 13324 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:26.156399 13133 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.156864 13133 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:26.157243 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.144393 13436 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:26.159160 13436 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:26.159758 13453 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:26.160019 13436 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:26.162964 13476 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.440s	user 0.003s	sys 0.000s
I20260709 12:10:26.166349 13436 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.177299 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.073331 13490 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.091761 13250 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.183725 11143 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:26.184443 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:26.157256 13133 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:26.125084 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74777.3us
I20260709 12:10:26.199237 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.204741 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.210711 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.212882 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.207262 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:26.216260 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.216641 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.126449 13456 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:26.219410 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.218757 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.176017 13483 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:26.223402 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.226468 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:26.227483 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:26.228255 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.232131 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:26.233626 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.191430 13424 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:26.236966 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:26.237355 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:26.238957 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:26.239750 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:26.241551 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:26.243592 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:26.248410 11216 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:26.230085 13392 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:26.215240 13406 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.251323 13384 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.253852 11284 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:26.222154 13288 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:26.222695 13488 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.225929 13218 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.256398 13488 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:26.256682 13218 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:26.257220 13384 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:26.251480 13392 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.257432 13488 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.222373 13335 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.258749 13335 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.194551 13328 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.235106 13483 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.260993 13456 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.258749 13424 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.264822 13496 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.288106 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:26.257882 13218 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:26.288765 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54487.7us
I20260709 12:10:26.315081 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.317655 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:26.324179 11140 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.329052 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.292498 13335 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.338502 11143 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.342664 13465 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:26.345749 13490 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:26.333592 13395 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.345854 13328 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:26.355150 11136 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:26.359176 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:26.323772 13456 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.406643 11860 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:26.414583 12920 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:26.351751 13468 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:26.367429 13324 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:26.424302 13424 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:26.429417 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:26.429694 11219 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:26.430521 11860 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:26.431191 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:26.433568 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62280.1us
I20260709 12:10:26.392860 13370 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.394471 13392 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:26.372963 13418 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:26.403986 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:26.449061 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.474620 11212 raft_consensus.cc:2368] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:10:26.473328 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:26.457427 13436 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.490471 13393 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.498674 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:26.505797 13304 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.511646 13472 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:26.512188 13472 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:26.513195 13472 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.497640 13436 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:26.523469 13436 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:26.525465 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76529.5us
I20260709 12:10:26.526821 13293 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.531967 13370 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:26.534554 13483 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:26.540386 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.540601 13393 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:26.543303 13393 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.526366 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.546622 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.546981 13418 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.548007 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.548614 13418 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.549045 13472 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:26.548414 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:26.551597 11854 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.556856 13293 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.558362 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.559476 13293 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:26.561424 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.538477 13335 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:26.573092 11217 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:26.576516 11217 pending_rounds.cc:85] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 6
I20260709 12:10:26.576846 11217 pending_rounds.cc:107] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:26.577111 11217 raft_consensus.cc:2889] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.579542 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:26.580356 13453 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.580852 13453 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:26.587113 11144 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:26.586898 13133 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:26.588960 13503 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.196s	user 0.004s	sys 0.000s
I20260709 12:10:26.591992 13335 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:26.598877 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:26.581843 13453 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:26.600586 13453 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.603721 11288 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.603945 13133 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:26.561439 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:26.617211 13370 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:26.618530 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57161.9us
I20260709 12:10:26.620066 13410 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:26.624907 13304 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:26.628880 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 298376us
I20260709 12:10:26.628047 11852 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.453258 11290 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:26.643743 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:26.767414 13512 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:10:27.231786 13218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.011s	sys 0.020s
W20260709 12:10:27.238404 13218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.011s	sys 0.020s
W20260709 12:10:27.411643 13513 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:10:27.427881 13519 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:10:27.429764 13515 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:10:27.988744 11823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.012s	sys 0.025s
W20260709 12:10:27.989730 11823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.012s	sys 0.025s
I20260709 12:10:27.990911 13520 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:27.991612 13520 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:27.994560 13520 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.335423 13522 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.336519 13522 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.340085 13522 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:28.349713 11212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.775s	user 0.014s	sys 0.025s
W20260709 12:10:28.350680 11212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.776s	user 0.014s	sys 0.026s
I20260709 12:10:28.352154 13523 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.352949 13523 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.356129 13523 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.356812 13522 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.358528 13522 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.361574 13522 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.362877 13523 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:28.363713 13523 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.365970 13520 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:28.362279 13522 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.366640 13520 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.366827 13522 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.368880 13520 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.369612 13522 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.370389 13523 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.379415 13527 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.380057 13527 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.382635 13527 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.385257 13520 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.385811 13520 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.387919 13520 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.391117 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 609) took 2221 ms. Trace:
I20260709 12:10:28.391707 11852 rpcz_store.cc:276] 0709 12:10:26.169362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.175895 (+  6533us) service_pool.cc:224] Handling call
0709 12:10:26.215420 (+ 39525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.631503 (+416083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.382468 (+1750965us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400361d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:28.391021 (+  8553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932635008}
W20260709 12:10:28.402205 11290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1376) took 2279 ms (client timeout 1715 ms). Trace:
W20260709 12:10:28.402686 11290 rpcz_store.cc:269] 0709 12:10:26.122301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.122424 (+   123us) service_pool.cc:224] Handling call
0709 12:10:28.401993 (+2279569us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54000618d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:28.402110 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584917888}
I20260709 12:10:28.403606 13522 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.404451 13522 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.425196 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 637) took 1981 ms. Trace:
I20260709 12:10:28.425575 13522 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.426266 13522 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.426843 13522 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.422209 13523 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.427994 13523 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.429375 13530 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.432040 13530 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.432698 13527 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.436638 13527 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.439612 13527 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.440414 13527 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.441084 13527 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:28.441901 13517 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.209s	user 0.000s	sys 0.012s
I20260709 12:10:28.444379 13527 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.435115 13525 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.433379 13520 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.425892 11860 rpcz_store.cc:276] 0709 12:10:26.444287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.444447 (+   160us) service_pool.cc:224] Handling call
0709 12:10:26.444770 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.445190 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.445221 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.464735 (+ 19514us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.646777 (+182042us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.646825 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.646911 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.424818 (+1777907us) raft_consensus.cc:1685] finished
0709 12:10:28.424852 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.425080 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13115,"raft.queue_time_us":12604,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4805,"thread_start_us":153219,"threads_started":1,"wal-append.queue_time_us":743978,"wal-append.run_cpu_time_us":3301,"wal-append.run_wall_time_us":1182349}
I20260709 12:10:28.453883 13520 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.460091 13520 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.460080 13526 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.461333 13526 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.452477 13523 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.462838 13532 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.467114 13532 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.468959 13530 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.455090 13522 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.469648 13532 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.452947 13525 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.463406 13520 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.521157 13522 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.519919 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.525287 13527 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:28.470896 13532 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:28.525857 13522 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.526386 13527 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.527451 13532 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.529201 13522 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.529937 13527 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.466693 13523 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.523028 13530 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.523718 13533 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.541378 13530 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.518908 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.543082 11860 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:28.531039 13532 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.544366 13532 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:28.538657 13527 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.545274 13532 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.545553 13527 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.548388 13532 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.549057 13532 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.549621 13527 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.531490 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.551213 11858 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:28.532445 13520 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.524500 13528 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.541514 13533 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.554231 13520 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.562674 13520 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.563611 13520 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.564556 13533 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.567349 13530 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.574903 13520 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.578572 13527 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:28.579574 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.579766 13527 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.556087 13528 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.549916 13532 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.557608 13523 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.578444 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.582859 11860 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
W20260709 12:10:28.556234 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.650s (SENT) [suppressed 7 similar messages]
I20260709 12:10:28.588511 13324 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:28.590948 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.590973 13324 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.597115 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.597728 13523 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.598623 13526 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.599558 13526 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:28.599792 13527 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.600030 13526 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.600477 13526 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.601109 13538 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.601817 13538 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.586826 11852 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:28.605399 11858 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:28.612679 13525 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.613430 13525 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.607851 13533 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.615450 13533 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.614204 13525 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:28.624217 11143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.150s	user 0.021s	sys 0.029s
I20260709 12:10:28.663823 13529 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:28.690248 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 133442us
W20260709 12:10:28.690588 11143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.216s	user 0.022s	sys 0.054s
I20260709 12:10:28.687780 13532 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.631280 13538 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.622789 13528 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:28.693624 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 95143us
I20260709 12:10:28.691237 13533 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.695473 13523 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.699470 13523 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.691593 13529 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.705523 13545 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.706553 13545 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.709663 13545 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.712013 13533 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.714677 13533 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.713657 13523 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.702780 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.731047 13542 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:28.732460 13542 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.733776 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 293) took 2296 ms. Trace:
I20260709 12:10:28.734426 11143 rpcz_store.cc:276] 0709 12:10:26.437526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.437651 (+   125us) service_pool.cc:224] Handling call
0709 12:10:26.437974 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.438433 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.438474 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.439444 (+   970us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.732957 (+2293513us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:28.733043 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.733213 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.733331 (+   118us) raft_consensus.cc:1685] finished
0709 12:10:28.733345 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.733616 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16736,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8742,"thread_start_us":2219041,"threads_started":1,"wal-append.queue_time_us":780901}
I20260709 12:10:28.737061 13546 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:28.742918 13533 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.746500 13545 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.747514 13545 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.746385 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.698403 13522 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.752029 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.750293 13545 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.726025 13526 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.760635 13546 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.762149 13526 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.756475 11140 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:28.757678 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.759099 13542 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.759630 13540 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.762825 13522 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.763653 11139 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:28.763958 13540 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.760187 13525 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.766064 13522 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:28.767606 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 68946.4us
I20260709 12:10:28.737986 13529 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.768256 13542 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.770820 13542 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.770954 13549 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.771325 13542 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.771669 13549 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.768399 13540 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.786926 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.787861 11136 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:28.795843 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.802112 11852 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 1.
I20260709 12:10:28.799293 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.796706 13547 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.803891 13547 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.796723 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.796238 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:28.807209 11141 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:28.808073 13523 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.808938 13523 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.810686 13526 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.811491 13526 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.813977 13546 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.814998 13526 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.815131 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.815869 13550 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.816695 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.816588 13550 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:28.817437 11286 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:28.819049 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.819290 13525 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.819487 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:28.820399 11139 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.820271 13525 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.820925 11144 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:28.822710 13533 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.823561 13533 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.824179 13529 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.825073 13529 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.825654 13522 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.826417 13522 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.828693 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:28.829443 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 2.18558e+06us
I20260709 12:10:28.829959 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:28.831445 13525 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.831722 11286 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:28.819135 13550 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:28.826262 13533 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.806444 13547 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.829458 11861 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.829512 13522 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.819108 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.837500 13523 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:28.841507 13529 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.799777 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.845588 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.845850 11139 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:28.849110 13549 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.854817 11141 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:28.859213 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.863395 11140 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:28.856750 13545 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:28.864763 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.865257 13545 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.867980 13545 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.872920 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.873394 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.874280 11288 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:28.875308 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.877661 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.879895 13528 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.880266 13528 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.880618 13528 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.880877 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.883107 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.885097 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.886174 11293 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:28.887866 13542 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.889778 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.890897 11287 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:28.891314 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:28.891928 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:28.894037 11289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.245s	user 0.018s	sys 0.016s
W20260709 12:10:28.894970 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 95370.1us
I20260709 12:10:28.896203 13523 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.896791 13523 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:28.897316 13523 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.897444 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.900971 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.903065 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.903494 13520 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.903934 13520 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.904331 13520 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.905104 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:28.891948 11291 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:28.906792 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:28.907305 13551 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:28.907717 11859 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.894986 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.911772 11138 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:28.913372 11286 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:28.914208 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.915566 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.916867 13537 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.917328 13537 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.917699 13537 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.917728 13535 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:28.918570 13535 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.919077 13535 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:28.904033 11858 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
W20260709 12:10:28.908632 11289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.260s	user 0.018s	sys 0.017s
I20260709 12:10:28.903139 13536 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.925026 13536 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.927340 13536 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.928766 13534 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:28.929311 11852 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:28.929620 13534 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.931128 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.931478 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.932397 11140 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:28.928813 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 305) took 2639 ms. Trace:
I20260709 12:10:28.932854 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:28.934667 11861 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:28.933779 11141 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
W20260709 12:10:28.941596 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 112707us
I20260709 12:10:28.942612 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:28.943646 13549 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:28.944168 13549 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:28.945333 13549 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:28.947256 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:28.890278 13542 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.950404 13522 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.952236 13522 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:28.952706 13522 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.952937 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:28.954887 11854 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 2.403s	user 0.022s	sys 0.013s
I20260709 12:10:28.955492 11854 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:28.958977 11854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 613) took 2414 ms (client timeout 1780 ms). Trace:
W20260709 12:10:28.959463 11854 rpcz_store.cc:269] 0709 12:10:26.544376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.548084 (+  3708us) service_pool.cc:224] Handling call
0709 12:10:28.958874 (+2410790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.962610 13538 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.964563 13324 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:28.933326 11289 rpcz_store.cc:276] 0709 12:10:26.289270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.296376 (+  7106us) service_pool.cc:224] Handling call
0709 12:10:26.297094 (+   718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.297342 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:26.648174 (+350832us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.928300 (+2280126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.928408 (+   108us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:28.928505 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.928612 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.928731 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88975,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":2604863,"threads_started":2,"wal-append.queue_time_us":620002,"wal-append.run_cpu_time_us":2338,"wal-append.run_wall_time_us":1159476}
I20260709 12:10:28.969486 11859 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:28.956012 13551 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:28.986804 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44428.4us
I20260709 12:10:28.979111 13538 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:28.997210 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 2.36693e+06us
I20260709 12:10:29.000823 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 251) took 2428 ms. Trace:
I20260709 12:10:29.001458 11212 rpcz_store.cc:276] 0709 12:10:26.571816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.573455 (+  1639us) service_pool.cc:224] Handling call
0709 12:10:26.573834 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.574143 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:28.351226 (+1777083us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.999645 (+648419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.999777 (+   132us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:28.999914 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.000114 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.000490 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":496056,"prepare.queue_time_us":662553,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":1927153,"threads_started":2,"wal-append.queue_time_us":61131}
I20260709 12:10:28.992110 13551 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:28.976622 13528 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:28.992507 13537 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.054733 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:29.055778 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67693.1us
I20260709 12:10:29.071811 13520 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.056667 13324 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.076051 13324 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.089679 13523 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.054702 13557 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.104298 13557 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.105046 13540 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.105729 13540 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.108429 13528 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.109726 13538 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:29.110560 13540 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.093039 13560 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.114457 13520 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.128293 13560 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.124742 13534 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.131796 13558 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.132494 13558 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.097501 13551 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.101279 13250 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:29.102033 13537 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.111809 13522 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.133890 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.113008 13557 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:28.774116  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:29.115787 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.119794 13555 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.120282 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.121049 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.121596 13523 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.144586 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:29.121855 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.145254 11287 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.145473 11291 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:29.149433 13362 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.139971 13549 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.150444 13549 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.152956 13549 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.157747 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.158450 11284 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:29.158823 11288 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.159528 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.160197 11284 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:29.162300 13262 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.126227 13324 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.092360 13535 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:29.139468 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 308748us
I20260709 12:10:29.142050 11292 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:29.139971 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:29.142938 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:29.171406 11285 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.143756 11293 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:29.143653 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:29.144443 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:29.153252 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.154110 13557 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.118265 13545 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:10:29.155500 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.172338 11290 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.175081 11291 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 1.
I20260709 12:10:29.150039 13362 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.165130 13540 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:29.193710 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.173732 13537 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.201009 11289 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.201642 11287 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:29.211845 13540 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.213299 13535 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.214568 13549 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:29.214764 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 129887us
I20260709 12:10:29.215237 13549 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.216858 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:29.217459 13549 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.218617 13527 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.218858 13032 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.219237 13527 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.219841 13527 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.219689 13032 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.202878 13560 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.222801 13418 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.223446 13418 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.224793 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.225565 13552 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.226348 13370 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.226655 13564 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.227005 13370 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.227460 13564 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.198836 13537 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.228986 13537 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.225086 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:29.201812 13557 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.233220 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 132) took 10702 ms. Trace:
I20260709 12:10:29.234155 13557 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.225690 13418 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.227543 13526 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:29.162935 13262 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.245890 13362 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.246058 13262 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.222282 13032 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.246580 13240 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.247243 13240 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.247977 13370 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.249743 13240 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.249357 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:29.250981 11038 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 3, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:29.241482 11288 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:29.253577 13559 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.253152 11038 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:29.253971 13559 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:29.231372 13563 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:10:29.214320 13540 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.230211 13564 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.254549 13559 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.257916 11290 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:29.241024 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:29.259148 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:29.200539 13523 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:29.264957 13523 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.265386 13523 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:29.267525 13538 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:29.259752 11110 connection.cc:256] RPC call timeout handler was delayed by -1.6232566690002841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:10:29.226362 13552 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.276005 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.277109 13532 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:29.263465 13557 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.277361 11285 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:29.277505 13532 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.278030 13532 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:29.277839 13557 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.279033 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.279349 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.279712 11139 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.278571 13552 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.256136 11038 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 6, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 6 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:29.276369 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:29.274233 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:29.280907 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.281319 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.281929 11288 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 2: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:29.281936 11139 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:29.282717 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.283360 11141 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.283573 11038 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:10:29.285645 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87540.8us
I20260709 12:10:29.285231 11038 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:29.285972 13293 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.280612 13557 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.287031 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:29.288100 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.288661 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.289355 11140 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:29.289705 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.290359 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.274839 13526 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:29.290925 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.291293 11143 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:29.289381 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.291641 11137 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.288932 11139 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:29.291786 13526 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.238978 13555 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.292904 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.289614 13293 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:29.256925 13472 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.293928 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.294224 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.293308 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.295122 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.259474 13558 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.296051 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.300232 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:29.300498 13536 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.296458 13535 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:29.233632 11040 rpcz_store.cc:276] 0709 12:10:18.531113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.531486 (+   373us) service_pool.cc:224] Handling call
0709 12:10:29.232899 (+10701413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:25.912743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:25.935354 (+ 22611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:25.935392 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:10:25.935412 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:25.936531 (+  1119us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:25.936631 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:25.936680 (+    49us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:25.937473 (+   793us) tablet.cc:701] Row locks acquired
0709 12:10:25.937500 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:10:25.937705 (+   205us) write_op.cc:270] Start()
0709 12:10:25.937877 (+   172us) write_op.cc:276] Timestamp: P: 1783599025937639 usec, L: 0
0709 12:10:25.937909 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:10:25.938906 (+   997us) log.cc:844] Serialized 2898 byte log entry
0709 12:10:26.404533 (+465627us) op_driver.cc:464] REPLICATION: finished
0709 12:10:28.409943 (+2005410us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18003085c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:28.410080 (+   137us) write_op.cc:301] APPLY: starting
0709 12:10:28.410173 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:28.410391 (+   218us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:28.410415 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:28.411343 (+   928us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:28.411627 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:28.411681 (+    54us) write_op.cc:312] APPLY: finished
0709 12:10:28.411975 (+   294us) log.cc:844] Serialized 59 byte log entry
0709 12:10:28.418464 (+  6489us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.418645 (+   181us) write_op.cc:454] Released schema lock
0709 12:10:28.418697 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:28.419175 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.419203 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":464558,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":229706,"apply.run_cpu_time_us":3275,"apply.run_wall_time_us":9069,"num_ops":7,"prepare.queue_time_us":206216,"prepare.run_cpu_time_us":15270,"prepare.run_wall_time_us":117989,"raft.queue_time_us":265546,"raft.run_cpu_time_us":8642,"raft.run_wall_time_us":318222,"replication_time_us":429311,"spinlock_wait_cycles":13723392,"thread_start_us":621460,"threads_started":5,"wal-append.queue_time_us":107535,"wal-append.run_cpu_time_us":104687,"wal-append.run_wall_time_us":1232302}]]}
I20260709 12:10:29.300927 13536 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.301218 13535 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.301424 13536 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.301801 13535 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:29.298767 11136 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:29.303687 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.304315 11137 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.298923 11139 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:29.293258 13555 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.316380 13555 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.316497 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.318301 13324 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.319129 13324 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:29.319309 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.319792 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.320319 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.320631 11142 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:29.320210 13324 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.321523 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.321614 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.322479 11140 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:29.324326 11288 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.324496 11139 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.324955 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.322630 13528 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.326437 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.322849 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.326798 13528 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:29.327186 11288 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:29.310155 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.328212 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.311391 13520 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.266481 13523 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.318578 13538 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.323169 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.330896 13538 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.323603 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.331758 13538 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.332141 11135 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.328251 13528 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.331296 13522 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.334129 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.335155 11288 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:29.325670 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.330669 13523 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.335913 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.321523 13324 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.336525 11139 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:29.326454 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:29.323159 13561 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:29.338672 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.338819 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.339828 11142 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.339923 11290 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:29.287055 11038 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 3, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:29.326105 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.353479 11140 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:29.365459 11038 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 4, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 4 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.375494 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.376322 11290 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:29.378940 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.381381 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.379094 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.391487 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.392311 11291 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:29.393230 11289 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:29.394253 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.394937 11290 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:29.326550 13472 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.398665 13453 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.423096 11038 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 6, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 6 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:29.430083 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 129920us
I20260709 12:10:29.432972 11825 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:29.435345 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:29.436663 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 141594us
I20260709 12:10:29.436153 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:29.436496 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64114.4us
I20260709 12:10:29.438138 11288 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:29.438097 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:29.442088 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.445710 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 294384us
I20260709 12:10:29.445989 11038 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 5, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:29.450018 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.442698 13032 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.435073 13240 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.440021 13520 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.453002 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.456449 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.488032 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.488688 11140 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.486835 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.446058 13293 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:29.458978 13569 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.494290 13032 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.495908 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.483250 11038 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 5, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:29.499987 11859 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:29.441480 13453 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.483811 13551 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.505446 13542 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.505877 13542 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.506229 13542 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.512758 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.486896 13530 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:29.514811 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.514959 13530 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:29.516121 13530 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.517241 11216 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:29.517633 11216 pending_rounds.cc:85] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 6
I20260709 12:10:29.517884 11216 pending_rounds.cc:107] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:29.518147 11216 raft_consensus.cc:2889] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:29.519186 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.519379 13244 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.519615 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.520381 11210 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
W20260709 12:10:29.520462 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61554.7us
I20260709 12:10:29.521224 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:29.521538 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.519994 13244 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.487548 13362 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.524914 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.525538 11214 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:29.525254 13527 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.526870 13244 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.527344 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.527062 11855 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.525202 13362 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.527561 13244 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.528692 11138 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:29.496357 13568 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.530853 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.522423 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:29.530725 11213 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:29.533074 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:29.533478 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47278.5us
I20260709 12:10:29.495420 13293 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.541797 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.526823 13529 raft_consensus.cc:2764] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:29.527463 13569 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.501386 13526 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.548683 11219 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:29.561846 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.562170 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.562753 13553 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.563685 11861 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.565878 13032 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.553534 11038 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.566653 13244 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.555506 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.567740 11038 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 4, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 4 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.569604 13537 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.570968 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.571615 13527 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:29.572798 13472 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.483644 13250 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:29.575748 11211 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:10:29.574769 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 139283us
W20260709 12:10:29.574815 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52462us
I20260709 12:10:29.575867 11217 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:29.583209 13568 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:29.583549 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.584352 13568 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.585541 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.587690 11038 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.591668 13551 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.592247 13551 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.592701 13551 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.594370 13535 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.595249 13523 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.595714 13523 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.596069 13523 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.596850 11859 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:29.590719 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.598104 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.570132 13542 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.603842 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.605379 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.609328 11861 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.618079 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.574731 13453 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.582077 13526 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:29.628765 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.552762 13240 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.596210 13370 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:29.560855 13536 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.615309 13555 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.635257 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.619493 13564 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.624477 11038 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.603156 13535 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:29.615520 13558 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.626163 13552 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.627677 13540 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:29.631574 13530 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.581408 13567 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:29.646521 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.642498 13324 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.670816 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.649510 13537 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:29.650998 13573 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:10:29.651189 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:29.674121 11284 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:29.651857 13370 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:29.653329 13244 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.670564 13324 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.676934 13370 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:29.677460 13567 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:29.640348 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:29.678785 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.643996 11211 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:29.679279 13522 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.677553 13324 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.679713 13522 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.680164 13522 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.632606 13565 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:29.655532 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.602996 13250 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.639482 13549 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:29.684038 13549 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:29.684443 13549 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:29.684921 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44659.2us
I20260709 12:10:29.643618 13555 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.685345 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.685729 13555 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.667042 13558 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.686604 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.686913 13558 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.667549 13552 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.687184 13370 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.687898 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.688367 13552 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.689206 13370 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:29.689270 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.690227 13560 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.690706 13560 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.691116 13560 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.690822 13526 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.693169 13547 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.693612 13547 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.690124 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.676802 13240 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.695031 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.603189 13538 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.695773 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.693971 13547 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.694079 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.697486 13293 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.697902 11860 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.698261 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.678208 13567 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:29.699103 11215 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:29.699627 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:29.700114 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:29.700668 11213 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:29.701330 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:29.685398 13549 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.701648 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:29.702550 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:29.702883 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:29.703688 11217 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.693956 11038 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.705201 11038 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:29.711652 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.728308 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.694885 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:29.745512 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50729.3us
I20260709 12:10:29.716657 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.717747 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.718920 11291 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.746868 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:29.702481 13549 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.706701 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:29.709333 13250 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.719632 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.699565 13567 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.710937 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.685949 13559 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.707036 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.765985 11856 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:29.716112 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.717387 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.713721 13542 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.711827 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:29.754498 13580 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:29.754333 11038 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:29.670516 13530 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.656708 13564 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.768137 11284 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:29.768535 11293 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:29.673358 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:29.744287 13540 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.756300 13529 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.743785 13557 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.743474 13545 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.776923 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:29.778877 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.773298 13564 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.779881 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.780264 13538 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.778892 13534 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.769691 13569 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:29.784750 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.786721 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.812930 11291 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:29.755486 13362 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:29.790212 13250 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:29.679972 13566 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.814375 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.815937 11860 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:29.816025 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.755486 13536 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:29.820093 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:29.820837 11290 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:29.804875 13534 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.821730 13534 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.824157 13293 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.791216 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:29.824576 13293 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:29.824986 11859 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:29.825469 13293 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.826783 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.827419 11144 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:29.827723 13293 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.769842 11286 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:29.791625 13565 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.843475 13565 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:29.843966 13569 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.844743 13565 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.846082 13565 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.828969 11852 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.791921 11855 raft_consensus.cc:2376] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6. Re-sending same reply.
I20260709 12:10:29.799943 13545 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.847913 13545 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.773335 13530 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.850929 13244 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:29.813898 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.814603 13566 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.809654 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.860858 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:29.798245 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:29.835675 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.839979 13538 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:29.841727 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:29.800639 13557 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.847571 11857 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.787456 13540 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:29.902598 13557 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.902963 13540 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.904350 13032 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.904841 13289 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.904994 13032 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.905340 13289 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.904408 13244 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:29.798416 13240 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:10:29.907002 13567 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.907549 13240 consensus_queue.cc:1243] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:29.908190 13240 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.908521 13418 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.908699 13240 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.909196 13418 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.810235 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:29.911159 11856 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:29.911634 13538 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.912077 13538 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:29.912530 13538 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.911101 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.913262 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.913934 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.872529 13566 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.903005 13250 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.842761 13472 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:29.915146 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:29.915307 13250 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:29.915799 11143 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.887779 13559 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:29.916383 13250 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:29.918385 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76725.4us
I20260709 12:10:29.920365 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:29.921504 13578 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.921957 13578 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:29.922920 13453 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:29.859371 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45826.5us
W20260709 12:10:29.896893 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080030c340 after lost signal to thread 9941
I20260709 12:10:29.923414 13453 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:29.924479 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080030d3c0 after lost signal to thread 11076
I20260709 12:10:29.925272 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:29.926229 11135 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:29.914106 11136 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:29.813330 11038 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 5, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.862596 11288 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:29.917836 13250 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.927614 11038 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:29.926345 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8bc0 after lost signal to thread 11168
I20260709 12:10:29.931763 13032 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.996114 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:29.997268 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 301526us
W20260709 12:10:30.021056 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8360 after lost signal to thread 11243
I20260709 12:10:29.906817 13244 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:30.031409 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 284615us
W20260709 12:10:30.040716 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 141807us
W20260709 12:10:30.042888 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4700 after lost signal to thread 11317
W20260709 12:10:30.043330 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7ea0 after lost signal to thread 11318
I20260709 12:10:29.933204 13530 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:29.917218 13472 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:29.934649 13240 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:29.922070 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:29.924558 13453 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:29.922389 13578 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.117576 11144 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:30.104771 13289 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.105069 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:30.106591 11856 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:30.106665 13555 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.109249 11852 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:30.128899 11143 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
W20260709 12:10:30.109730 13532 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.831s	user 0.015s	sys 0.010s
I20260709 12:10:30.109474 13557 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:30.111256 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.111640 13520 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.012s
I20260709 12:10:30.112149 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:30.112356 13566 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.113374 11217 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:30.114869 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:30.077237 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8060 after lost signal to thread 11885
W20260709 12:10:30.120882 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 198877us
I20260709 12:10:30.123797 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:30.124181 11140 consensus_meta.cc:287] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.011s
I20260709 12:10:30.127243 11038 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 4, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 4 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:30.115768 13523 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.501s	user 0.016s	sys 0.000s
W20260709 12:10:30.228317 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74766.3us
W20260709 12:10:30.228740 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 116654us
I20260709 12:10:30.231614 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.211210 11140 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
W20260709 12:10:30.233096 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118342us
I20260709 12:10:30.124784 13568 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.149010 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.115828 13324 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.114424 13534 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.124485 13472 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:30.128750 13032 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.129300 13558 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:30.124518 13551 consensus_meta.cc:287] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.005s
I20260709 12:10:30.128989 13547 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.287017 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.285411 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.234663 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.137847 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:30.295614 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61784.3us
I20260709 12:10:30.244097 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.297044 11215 raft_consensus.cc:2368] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:10:30.297180 11216 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.149165 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.297994 11143 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
W20260709 12:10:30.268648 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.296379 11217 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.232146 13567 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:30.294534 11140 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.285516 11859 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:30.235029 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.158773 13453 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:30.157094 13549 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:30.240849 13581 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:10:30.234414 13293 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:30.211804 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080035db40 after lost signal to thread 13475
I20260709 12:10:30.150731 13555 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.299338 11184 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.153689 13530 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.299918 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:30.323908 13553 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.324312 13553 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:30.324731 13553 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.324915 13545 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.326675 11142 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:30.327452 13527 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.327900 13527 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:30.328286 13527 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.330607 13588 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:10:30.332211 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.333566 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.334044 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.312165 13549 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.334667 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.334079 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.335827 11212 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:30.336733 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:30.336997 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.239271 13542 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.243391 13568 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:30.342396 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 225407us
I20260709 12:10:30.315495 13324 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.151360 13538 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.295287 13520 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.318065 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.115353 13522 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.319514 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.359231 11215 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
W20260709 12:10:30.319629 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 94608.9us
I20260709 12:10:30.287142 13032 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.301038 13262 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.153874 13532 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.320097 11219 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:30.234226 13523 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:30.323035 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 89217.7us
I20260709 12:10:30.375295 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.334934 13549 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.303387 13567 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.284754 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:30.338600 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.340054 11144 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:30.334720 11218 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:30.338886 11038 catalog_manager.cc:5697] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:30.348102 11140 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:30.306870 11141 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.286078 13551 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.398811 13577 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.399293 13577 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:30.399699 13577 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.400417 13551 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:30.356230 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 121233us
I20260709 12:10:30.360145 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:30.361042 11259 leader_election.cc:336] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.650s (SENT)
I20260709 12:10:30.357072 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:30.365595 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.404693 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:30.366392 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 261395us
I20260709 12:10:30.368230 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.241357 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:30.350832 13568 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.348539 13555 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.345832 13542 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:30.376999 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.392817 11140 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:30.395526 13589 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:10:30.396633 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.397311 13523 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.398020 13591 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:30.315948 13418 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.428352 13262 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:30.442781 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 158162us
I20260709 12:10:30.442970 13262 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:30.382249 11214 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:30.444154 13262 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.431977 13551 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.445530 13362 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:30.446797 13362 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.420488 13244 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:10:30.418031 13560 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.726s	user 0.018s	sys 0.000s
I20260709 12:10:30.364609 11217 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:30.430549 13542 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.447654 13560 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.448196 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.449314 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.449867 11217 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:30.450008 13560 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:30.412308 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55341.3us
I20260709 12:10:30.423121 13520 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.403155 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.414685 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.369668 13530 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.412165 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:30.455428 11136 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.455470 11216 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
W20260709 12:10:30.431159 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54239.1us
I20260709 12:10:30.454466 13520 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.457680 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.381606 13529 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:30.403180 13567 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:30.433182 13564 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.004s
I20260709 12:10:30.346005 13472 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.432013 13545 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:30.438458 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77449.7us
I20260709 12:10:30.486385 11258 leader_election.cc:400] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:30.446645 13240 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:30.456452 13552 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.018s
I20260709 12:10:30.412381 11143 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:30.451167 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:30.417810 13540 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.007s
I20260709 12:10:30.400866 13558 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.451282 11212 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:30.493569 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.494022 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:30.452538 13526 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.494382 11140 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:30.458309 11217 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.434144 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.457384 13530 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.457708 13250 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.458226 13591 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.432022 11854 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:30.488952 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.491108 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.501556 11291 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.501643 11290 raft_consensus.cc:2368] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
W20260709 12:10:30.474189 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 118852us
I20260709 12:10:30.496018 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.497494 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:30.503731 11143 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:30.505350 11143 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:30.447185 13362 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:30.501610 11218 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:30.466315 13520 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.507272 11140 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:30.478533 13557 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.480254 13418 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:30.528383 13418 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.528746 13418 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:30.529686 13418 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.511332 11140 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:30.508123 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49086.9us
I20260709 12:10:30.551400 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.552362 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:30.452157 13553 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.514309 13591 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.500125 13536 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.517704 13568 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.519238 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.519445 11288 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:30.520232 11210 raft_consensus.cc:606] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:30.583779 11289 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:30.584025 11210 raft_consensus.cc:614] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:30.522298 11284 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:30.584523 11213 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:30.524115 11291 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:30.492311 13564 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.525063 13567 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.498211 13540 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.532184 13566 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.475061 13595 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:30.498961 13552 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.450973 13324 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:30.598788 11137 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:30.598974 13324 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.599465 13324 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:30.600469 13324 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.601799 13324 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.535403 13534 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.536664 13532 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.508880 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.538502 13578 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.542168 13538 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.499329 13594 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.511718 13547 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.530289 13542 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.543521 13362 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.610338 13553 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.554839 11216 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:30.606455 13557 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:30.611529 13542 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.611430 13557 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.555883 11217 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:30.612946 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.613698 13557 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.572274 11140 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:30.573866 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 117578us
I20260709 12:10:30.614177 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.582039 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.620417 11292 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:30.582402 11285 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:30.587172 11293 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:30.621627 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:30.575276 13526 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:30.622834 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:30.570801 13529 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:30.590596 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.582640 13523 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.623821 13529 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.625737 13529 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:30.626793 11219 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.626668 13529 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.604910 13595 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:30.626209 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.623214 11217 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:30.603405 11139 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.633126 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.633872 13564 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.633684 13577 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.634220 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.634665 11860 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.624825 13532 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.635387 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.635685 13532 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:30.624765 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.636623 13532 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.637499 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.638826 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.639547 11218 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:30.639925 13540 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.620438 13567 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.640383 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.605571 11138 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.586129 13591 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:30.608768 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.611697 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.642989 11287 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:30.614104 13552 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.644176 13591 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.645017 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.645474 13530 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.646157 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.610616 13362 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.618984 13520 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.622956 13538 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:30.628150 13529 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.605110 11212 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:30.653802 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.653861 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.654378 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.655151 11212 raft_consensus.cc:2368] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:30.656050 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.656306 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.656607 11212 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:30.657068 11292 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:30.657498 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.657968 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.658814 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:30.659377 11136 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:30.657922 13520 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:30.659902 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.660463 11292 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.660486 11286 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.628402 13595 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.662075 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.663287 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.664229 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.665655 13577 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.666965 11854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 617) took 1176 ms. Trace:
I20260709 12:10:30.667523 11854 rpcz_store.cc:276] 0709 12:10:29.490536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.492496 (+  1960us) service_pool.cc:224] Handling call
0709 12:10:29.511013 (+ 18517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.504384 (+993371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.666705 (+162321us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400486cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:30.666881 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072081792}
I20260709 12:10:30.667063 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.594033 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.595239 13418 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.670420 11291 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:30.670646 13250 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:30.671770 13250 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:30.672128 13250 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:30.672590 11212 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:30.637826 13527 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.573127 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.577875 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:30.653034 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.675423 11216 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
W20260709 12:10:30.675611 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97859.4us
I20260709 12:10:30.677098 11286 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:30.641554 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.678987 11217 raft_consensus.cc:2376] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6. Re-sending same reply.
I20260709 12:10:30.679103 11858 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.679793 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:30.680279 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107226us
I20260709 12:10:30.680460 11217 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.677295 11218 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:30.681483 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.681753 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.592886 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.682044 11218 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.683202 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.630156 13578 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.685057 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.694321 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:30.683300 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.631404 13568 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:30.690086 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.691111 11212 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.686612 11292 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:30.694098 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.686033 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.696933 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.695611 11293 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.683738 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:30.723358 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.700044 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:30.725936 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.726712 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.729984 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.730130 13578 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.731135 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.731782 11210 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:30.732115 13578 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.732472 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:30.700383 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.738225 13520 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:30.739370 11854 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:30.739812 13584 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.623s	user 0.006s	sys 0.000s
I20260709 12:10:30.700747 13523 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.740711 13523 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:30.676496 13538 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:30.742741 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2089) took 1038 ms. Trace:
I20260709 12:10:30.743155 11139 rpcz_store.cc:276] 0709 12:10:29.704335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.705443 (+  1108us) service_pool.cc:224] Handling call
0709 12:10:29.705745 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.632664 (+926919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.742549 (+109885us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54003ca354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:30.742691 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064039296}
I20260709 12:10:30.744141 13591 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.745604 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 662) took 1033 ms. Trace:
I20260709 12:10:30.745982 11860 rpcz_store.cc:276] 0709 12:10:29.712522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.859088 (+146566us) service_pool.cc:224] Handling call
0709 12:10:30.114569 (+255481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.635045 (+520476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.745375 (+110330us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54005703d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:30.745527 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195710848}
I20260709 12:10:30.747730 13585 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.748816 13585 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.749094 13472 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.749150 13585 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:30.750700 11212 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:30.753685 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2086) took 1050 ms. Trace:
I20260709 12:10:30.753968 11212 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:30.754101 11138 rpcz_store.cc:276] 0709 12:10:29.703409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.703541 (+   132us) service_pool.cc:224] Handling call
0709 12:10:29.703828 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.641050 (+937222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.753451 (+112401us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54003ca854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:30.753602 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073450368}
I20260709 12:10:30.756414 13522 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:30.762745 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71488.2us
I20260709 12:10:30.763710 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.764989 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.741107 13523 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.742224 13538 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.764905 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:30.777328 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:30.779284 11110 leader_election.cc:400] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:30.779672 11110 leader_election.cc:403] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:30.763720 11210 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:30.770073 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.766830 11217 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:30.785600 11139 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:30.789363 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.791893 11144 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:30.793495 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.796223 11139 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:30.815780 11216 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:30.797971 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.818162 11212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:30.818976 11212 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:30.819344 11212 raft_consensus.cc:614] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:30.822290 11216 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.672973 13250 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.819738 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:30.824378 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:30.824589 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.828895 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.829655 11211 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:30.825688 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:30.831067 11136 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:30.826323 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:30.775511 13553 raft_consensus.cc:2764] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:30.736539 13569 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:30.838791 11212 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:30.814939 13591 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.839236 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:30.837455 11218 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:30.843628 11211 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.775259 13542 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:30.775382 13530 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:30.830793 13587 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:30.823899 13032 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:30.845388 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.830801 13588 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.854327 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.870718 13588 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:30.871193 13588 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.871385 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:30.833501 13578 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:30.841224 13453 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:30.875078 13453 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:30.875572 13453 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.875840 13601 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:30.876384 13601 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:30.877849 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.775013 13582 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:30.860051 11212 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:30.846808 11854 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.750137 13585 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.844334 13529 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.838824 13557 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:30.881266 11293 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:30.854146 13568 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.833083 13262 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:10:30.921974 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.859579 13587 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.932031 13587 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.875298 13600 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.890987 13032 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:30.877315 13601 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:30.907398 13523 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:30.915331 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51031.7us
I20260709 12:10:30.888581 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:30.926419 13557 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.893815 13547 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:30.921885 13250 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:30.928753 13522 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.881865 13244 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:30.955345 13244 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.955826 13244 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:30.956440 13604 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:30.956900 13244 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.933347 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:30.892000 13529 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:30.958930 13529 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.859822 13549 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:30.943255 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:30.927546 11259 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.151s (SENT)
W20260709 12:10:30.947170 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.948836 13370 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.944978 13240 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:30.950348 11854 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.941733 13289 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:30.945345 13600 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:30.952020 13551 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.971825 13547 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:31.007031 13526 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:30.954190 13522 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:30.968035 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79541.9us
I20260709 12:10:30.969448 11858 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:30.972618 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45090.9us
I20260709 12:10:30.972694 11211 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.943694 13585 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.007407 13551 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.953817 11215 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:30.980909 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.027647 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83259.2us
I20260709 12:10:30.971765 13362 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.015672 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 183210us
I20260709 12:10:31.034063 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:30.995637 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.020733 11135 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:30.968529 13244 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.943567 13262 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:31.034521 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:31.040199 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:31.040382 13576 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.972055 13555 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:31.040961 13532 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.970166 13370 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:31.040982 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:30.990985 13552 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.041180 13576 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:31.036062 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.002272 13540 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.021358 13566 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.008433 13569 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:31.048794 11213 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:31.050089 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.007767 13547 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.031634 13551 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:30.977818 13530 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:10:31.039165 13557 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:31.073709 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.045439 13532 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:31.036556 13418 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:31.038196 13558 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:10:31.033303 13534 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:10:31.038688 13362 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:31.120365 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57135.4us
I20260709 12:10:31.125487 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.049857 13240 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:10:31.052227 13578 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 12:10:31.128415 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 94411.4us
I20260709 12:10:31.057133 13552 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.061932 13540 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.051924 13588 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.156682 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:31.129838 13418 consensus_queue.cc:1243] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:10:31.155707 11259 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.152s (SENT)
I20260709 12:10:31.160205 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.164263 11217 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:31.111934 13566 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.132056 13293 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:31.196013 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.110929 13522 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.136255 13555 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:31.205945 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50264.7us
W20260709 12:10:31.208243 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47122.6us
I20260709 12:10:31.211776 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:31.203069 13605 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:31.221419 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.222311 11217 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:31.123803 13370 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.204144 13418 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.230396 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.212322 13293 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:31.262828 11259 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.224s (SENT)
I20260709 12:10:31.231132 11214 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:31.213107 13618 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:31.155169 13551 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.152595 13600 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.273166 13523 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:31.263566 13608 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.278893 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.265947 13522 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.162969 13576 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:31.286226 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.266242 13558 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:31.293541 13618 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:31.294500 13293 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.296231 13362 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:31.299746 13616 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:10:31.301153 13612 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:31.292999 13370 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.302939 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.303604 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.304252 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.306885 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:31.315135 13613 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:10:31.317083 13566 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:31.322299 11216 raft_consensus.cc:606] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:31.354419 11216 raft_consensus.cc:614] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:31.268537 13582 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:31.335007 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.367141 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.235868 13418 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.344014 11217 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:31.329237 13608 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:31.341619 11211 raft_consensus.cc:2376] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3. Re-sending same reply.
I20260709 12:10:31.353248 11135 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:31.357568 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:31.376232 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.376431 11858 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:31.364377 11141 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:31.367966 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:31.367975 11213 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:31.217406 13569 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.370923 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.371115 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.366178 13527 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:31.372918 13567 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:31.338614 13558 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.373375 13618 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.233507 13532 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.379694 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.391495 13567 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:31.395306 11213 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:31.396132 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.396929 11213 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:31.383016 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.389869 11858 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:31.390733 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.398794 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.373730 13472 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:31.405666 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:31.399789 11219 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:31.400995 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.400807 13567 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.408200 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.426931 11290 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:31.429903 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.393805 13293 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.434365 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:31.430935 11217 raft_consensus.cc:2368] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:31.434480 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.436010 11219 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:31.435225 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.437054 11213 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:31.436234 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:31.439199 11218 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:31.439594 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:31.440136 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.440352 11143 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:31.386281 13568 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:31.449904 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.371522 13582 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.404088 13472 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:31.400851 13549 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:31.454571 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:31.460844 11860 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:31.461169 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:31.415759 13552 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:31.457135 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:31.462069 11286 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:31.463403 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:31.447964 13324 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.846s	user 0.010s	sys 0.013s
I20260709 12:10:31.466248 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:31.467758 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.458798 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:31.468231 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:31.477499 11289 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.478639 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:31.450733 13567 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.475970 11288 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:31.483960 11136 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:31.483182 11141 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:31.507793 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.464879 13453 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 12:10:31.508940 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:31.572995 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66409.5us
I20260709 12:10:31.573694 11213 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:31.509790 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 43683.3us
I20260709 12:10:31.387337 13555 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.573982 13608 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.565994 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:31.575083 13632 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:10:31.576638 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:31.577430 11219 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
W20260709 12:10:31.600404 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.568749 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.568899 11142 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.572661 13453 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.459101 13540 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:31.577311 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:31.621206 11858 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
W20260709 12:10:31.622156 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44972.1us
W20260709 12:10:31.688091 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.690474 13540 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.691256 13540 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:31.692878 13624 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.276s
I20260709 12:10:31.694753 13472 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.696187 13472 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.506135 13588 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:31.741559 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.579677 13552 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:31.763689 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.664729 13589 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:10:31.820122 13582 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:31.621301 13418 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:31.900285 11142 raft_consensus.cc:2410] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:31.823149 11214 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
W20260709 12:10:31.903218 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.662864 13566 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:31.904434 13566 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.905089 13566 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.905642 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:31.906558 13549 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:31.906944 13549 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.907269 13549 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:31.914995 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.796809 13552 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:31.924576 13552 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:31.822938 13625 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:10:31.949738 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:31.822685 13585 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.002s
I20260709 12:10:31.820281 13453 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:31.894906 13529 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.935s	user 0.010s	sys 0.002s
I20260709 12:10:31.958000 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:31.902659 13591 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.058s	user 0.006s	sys 0.006s
W20260709 12:10:31.955544 13576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.008s	sys 0.020s
I20260709 12:10:31.893095 13250 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.964047 11219 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:31.977632 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:31.961184 13587 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.029s	user 0.009s	sys 0.004s
I20260709 12:10:31.981163 11217 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:31.978046 13601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.007s	sys 0.027s
W20260709 12:10:31.982722 13601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.008s	sys 0.027s
I20260709 12:10:31.986996 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:31.989042 13552 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:31.965289 13576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.021s
I20260709 12:10:32.004495 11289 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:32.009827 11217 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:31.966285 13591 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:31.991720 13552 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:31.992244 13587 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.967244 13529 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:31.979280 13250 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:32.015372 13293 consensus_meta.cc:287] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 12:10:32.016388 13619 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:32.014003 13586 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:32.031263 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.034245 11217 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:32.106570 11211 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:32.134061 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.116460 13520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.064s	sys 0.062s
I20260709 12:10:32.137149 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:32.106052 13591 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.103555 13552 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:32.145968 11218 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:32.146916 11217 raft_consensus.cc:2376] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5. Re-sending same reply.
I20260709 12:10:32.094971 13619 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.117558 13586 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:32.162757 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.178809 13250 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:32.182888 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 207754us
I20260709 12:10:32.183279 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:32.163632 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.188526 11219 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
W20260709 12:10:32.147778 13520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.064s	sys 0.063s
W20260709 12:10:32.192816 13639 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:32.152803 13591 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.195796 13591 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.197652 13614 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:32.198103 13614 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:32.199046 13614 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.209980 13619 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:32.212790 13244 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.165s	user 0.011s	sys 0.000s
I20260709 12:10:32.213518 11212 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:32.214674 13586 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.216225 13529 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:32.151777 13552 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.213845 13587 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:32.219870 13472 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.002s
W20260709 12:10:32.190371 13642 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:10:32.228327 13655 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.228879 13655 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.142024 13549 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.231431 13289 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:32.231838 13289 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:32.232942 13549 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.232625 13289 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.234206 13552 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.200073 13614 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.227571 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:32.235405 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.237354 11210 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:32.243098 13289 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.249693 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.251327 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:32.251629 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:32.253882 13540 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.255098 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.256479 13655 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:32.260017 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.259943 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:32.261013 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.261111 11291 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:32.265511 11291 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:32.268394 11291 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.272387 11219 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:32.277343 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42804 (request call id 16) took 1406 ms. Trace:
I20260709 12:10:32.277722 13566 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.281258 11136 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8.
I20260709 12:10:32.282927 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.283573 11213 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:32.285035 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1641) took 1397 ms. Trace:
I20260709 12:10:32.285382 11212 rpcz_store.cc:276] 0709 12:10:30.887873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.888436 (+   563us) service_pool.cc:224] Handling call
0709 12:10:32.284865 (+1396429us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002a17d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:32.284962 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885199104}
I20260709 12:10:32.285938 13566 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.291494 13553 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.291926 13553 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:32.277809 11216 rpcz_store.cc:276] 0709 12:10:30.871075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.871249 (+   174us) service_pool.cc:224] Handling call
0709 12:10:32.277120 (+1405871us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000e7ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad5853 00007f9835aa360a 00007f982f0297d4 00007f982f029762 00007f982f029691 00007f982f02960c 00007f982f0288c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:32.277241 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035585920}
I20260709 12:10:32.292802 13553 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.280557 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 282) took 1759 ms. Trace:
I20260709 12:10:32.293769 11215 rpcz_store.cc:276] 0709 12:10:30.521345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.537022 (+ 15677us) service_pool.cc:224] Handling call
0709 12:10:30.537297 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.031712 (+494415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.280306 (+1248594us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54002a1cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:32.280471 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957143808}
I20260709 12:10:32.297780 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.300798 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:32.306963 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.315646 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.319518 11291 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:32.298028 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.321920 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.294008 13553 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.332119 11859 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.324867 11214 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:32.325687 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.343614 11292 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.344311 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.345252 11293 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:32.348577 11288 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.350265 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:32.350656 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:32.351197 11215 raft_consensus.cc:606] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.351503 11215 raft_consensus.cc:614] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:32.352639 11289 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.354773 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.355736 11289 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:32.363742 11288 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.355675 11854 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.368203 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:32.368759 11857 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.364094 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:32.365633 13655 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.371213 13659 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:32.363174 13615 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:32.377699 13615 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:32.379434 11857 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:32.379496 13655 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:32.381613 13655 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.371663 11293 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:32.383407 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.384120 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.385015 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.386435 11856 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:32.373250 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.387993 11852 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:32.388047 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:32.395686 11215 raft_consensus.cc:606] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.396045 11215 raft_consensus.cc:614] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:32.399206 13558 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.371819 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:32.400238 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:32.401495 11857 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.401270 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:32.374821 13659 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.405577 11293 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:32.416955 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.416124  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:32.420536 11857 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:32.423596 11861 raft_consensus.cc:2410] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:32.424944 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:32.425746 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.407200 13576 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.434933 13576 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.435505 13576 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.441164 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.446240 13659 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.422739 13523 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.425100  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:32.447717 13576 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:32.450214 11142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 334) took 1724 ms (client timeout 2191 ms). Trace:
I20260709 12:10:32.383966 13615 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.451366 13615 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.452814 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.453462 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:32.450615 11142 rpcz_store.cc:269] 0709 12:10:30.726262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.726408 (+   146us) service_pool.cc:224] Handling call
0709 12:10:32.450017 (+1723609us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400264b54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:32.450129 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935281408}
I20260709 12:10:32.407707 13558 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.456686 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.459203 11139 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:32.450114 13576 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.458164 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.461169 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.471473 11289 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:32.471174 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:32.461225 11185 connection.cc:256] RPC call timeout handler was delayed by -1.2929072000001725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 12:10:32.472306 11293 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.472816 11287 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:32.457073 13555 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.461640 13614 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:32.473986 13559 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.476260 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.476563 11289 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.477069 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.460047 13418 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:32.447818 13523 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.480335 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.480680 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.461830 13558 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.480124 13289 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.478297 13559 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:32.485222 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.484872 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:32.484547 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.488474 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:32.491554 11293 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:32.492523 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:32.495040 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:32.495062 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:32.496138 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.497072 11287 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:32.496138 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:32.497334 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:32.499104 11292 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:32.479369 13555 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:32.486831 13472 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.487686 13558 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.484182 13551 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.500312 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.493345 13559 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.496783 13611 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:32.494122 13587 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.482299 13614 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.487530 13538 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.492072 13576 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:10:32.519244 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:32.526036 11292 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:32.498346 13594 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.499480 13032 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.485499 13418 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.498607 13244 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:32.524115 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.521123 13250 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.525736 13538 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.529263 13032 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.527022 13611 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:32.581521 13611 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.582958 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1660) took 1278 ms. Trace:
I20260709 12:10:32.583431 11211 rpcz_store.cc:276] 0709 12:10:31.304457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.382786 (+ 78329us) service_pool.cc:224] Handling call
0709 12:10:32.582717 (+1199931us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54002f53d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:32.582886 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601642240}
W20260709 12:10:32.585181 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.551771 13244 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.588883 13244 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.589910 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.567551 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.590654 11142 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:32.591043 13538 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:32.591202 13250 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.577895 13553 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.592177 13553 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.568153 11292 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:32.570050 13523 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:32.595081 13594 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:32.571221 13587 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.596232 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:32.598052 13594 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.598536 13594 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.598357 13244 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.599080 13594 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.601002 13244 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:32.576715 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.565552 13418 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.548372 13609 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:32.605530 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.521183 13555 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.575985 13472 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.570847 13614 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.603771 11825 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8.
I20260709 12:10:32.609282 11825 leader_election.cc:403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:32.594278 13553 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:32.607004 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.580238 13032 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.612530 13610 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8.
I20260709 12:10:32.612131 13472 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.618163 13293 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:32.618762 13293 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.620934 13293 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.621485 13293 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:32.623054 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.624189 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.607436 13418 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.628898 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:32.604578 13609 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.627502 13614 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.627995 13472 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:32.648357 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.652576 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.654997 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:32.655525 11135 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.655776 11140 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.655519 11141 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.657574 11144 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.658903 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:32.660097 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:32.667758 11137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1626) took 1882 ms (client timeout 1785 ms). Trace:
I20260709 12:10:32.639947 13418 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:32.668247 11137 rpcz_store.cc:269] 0709 12:10:30.785072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.785190 (+   118us) service_pool.cc:224] Handling call
0709 12:10:32.667572 (+1882382us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400263c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:32.667682 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738808064}
I20260709 12:10:32.672619 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:32.673233 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.674165 11139 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 1.
I20260709 12:10:32.643404 13542 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:32.676759 13542 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:32.677186 13542 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:32.677295 13587 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.677865 13587 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.679435 11215 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:32.679963 13587 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.680411 13250 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:32.680842 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.680934 13250 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.681711 11138 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:32.681147 11216 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:32.682265 13618 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:32.682626 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.683259 13250 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.684104 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.644160 13614 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.684687 11212 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:32.685941 13614 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:32.686944 11218 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:32.681810 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.682868 13618 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.691308 11286 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:32.692250 11210 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:32.692363 11213 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:32.697192 11140 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:32.670413 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.698637 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:32.745566 11218 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.671753 13418 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:32.678412 13542 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.698521 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.746830 13614 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.716506 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.748430 11141 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:32.749329 11212 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:32.722550 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:32.750803 11219 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:32.751567 11139 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:32.752317 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.690156 13032 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:32.739739 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.686563 13293 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 12:10:32.745987 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 75649.1us
I20260709 12:10:32.757032 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.751617 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.751781 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:32.762686 11210 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:32.766284 13611 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:32.748756 13418 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.767012 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:32.762071 13538 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:32.768864 11213 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:32.770793 13293 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.668427 13655 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:10:32.771409 13622 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:32.772505 13244 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.772893 13244 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:32.773768 13244 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.775094 13244 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.775317 13655 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:32.775379 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.777890 13655 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:32.779284 13569 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.781267 13569 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.782047 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:32.782960 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:32.783691 13614 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:32.783926 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:32.784116 13614 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:32.784636 13614 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:32.784861 13250 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:32.785156 11218 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:32.785346 13250 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:32.785754 13250 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.786881 13609 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.790699 11288 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:32.791266 13530 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.791381 13472 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.791807 13530 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.792237 13472 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:32.792815 13472 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:32.794922 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:32.795746 13587 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:32.796116 13587 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.796439 13587 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.793800 13472 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.807294 11286 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:32.811087 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:32.817798 13250 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.765722 13558 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.819192 13289 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.806825 13559 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:32.819535 13542 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:32.827036 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62479.6us
I20260709 12:10:32.852296 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:32.783319  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:32.882972 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.883312 11136 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:32.887653 11859 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:32.888067 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:32.814368 13418 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.818423 13614 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:32.848299 13293 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:10:32.911859 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.848702 13582 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:32.931205 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:32.934579 13558 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:32.851714 13622 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:10:32.940505 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 185137us
I20260709 12:10:32.856369 13576 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:32.949357 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:32.949788 11288 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.950690 13569 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:32.953420 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:32.954211 11854 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.954432 13611 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.863222 13538 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:10:33.012998 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63740.2us
I20260709 12:10:33.018288 11259 leader_election.cc:400] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:33.018790 11259 leader_election.cc:403] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.015910 13553 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.023658 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 171524us
I20260709 12:10:33.025568 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:33.029003 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 252840us
W20260709 12:10:33.030632 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 142726us
I20260709 12:10:33.036034 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:33.015739 13289 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.062448 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.064266 11259 leader_election.cc:400] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:33.064854 11259 leader_election.cc:403] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.054347 13547 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.056735 13526 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:33.083734 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.090896 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.092156 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.066939 13618 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:33.117635 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.056607 13594 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:33.071841 13520 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.071410 13472 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:33.118587 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 82643.2us
I20260709 12:10:33.070382 13674 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.119776 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.133682 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.130441 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:33.131269 13652 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:33.134893 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:33.075053 13250 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:33.110193 13551 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:33.113265 13609 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.136132 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:33.088500 13530 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:33.131640 13682 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.106789 13615 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:33.138039 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1474688800001331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 12:10:33.128640 13559 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:33.119254 13529 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.136022 13647 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.136206 13522 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.132115 13523 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.136441 13293 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.148126 13418 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:33.149490 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0812599160001355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 12:10:33.108603 13547 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:33.173949 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:33.149384 13681 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.139045 13520 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:33.154002 13594 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:33.151911 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:33.149887 13614 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:33.234082 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0808688800000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 12:10:33.235613 11215 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.153191 13472 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.267472 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:33.268144 11138 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.271413 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:33.271955 11143 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.150472 13530 raft_consensus.cc:2764] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:33.277040 13568 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.277549 13568 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:33.279510 13289 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.279889 13289 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:33.280767 13289 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:33.281950 13289 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.287947 13568 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:33.254957 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0399049730001479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:10:33.291535 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0123278369999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 12:10:33.292292 11110 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.654s (SENT)
I20260709 12:10:33.294086 13530 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.295351 13530 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:33.151235 13683 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:10:33.301265 13530 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:33.290274 11138 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
W20260709 12:10:33.317203 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.320770 11143 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:33.295895 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:33.321990 13587 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:33.323378 13675 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:10:33.326515 13680 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:10:33.235221 13293 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:33.331184 13676 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:10:33.332109 13032 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:33.571349 13683 consensus_queue.cc:1243] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:10:33.571133 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 436283us
I20260709 12:10:33.582728 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.583400 11218 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:33.431304 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:33.333016 13520 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:33.334792 13547 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:33.335636 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.349829 11210 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.355279 11219 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:33.354753 11040 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 4 to 5, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:33.313840 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.364277 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:33.624152 11135 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.364815 11215 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
W20260709 12:10:33.368836 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 216978us
I20260709 12:10:33.369427 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:33.625365 11140 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:33.625607 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:33.584355 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:33.564921 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 185396us
I20260709 12:10:33.375473 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:33.547331 11289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.004s	sys 0.004s
W20260709 12:10:33.629048 11289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.004s	sys 0.005s
W20260709 12:10:33.592180 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 296445us
I20260709 12:10:33.632792 11140 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:33.623577 11211 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:33.635185 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:33.638435 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:33.639518 11211 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:10:33.643186 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58920.9us
I20260709 12:10:33.644249 13553 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.644379 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:33.645035 13553 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:33.645740 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:33.646562 13553 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.646979 13553 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:33.647336 13553 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.649113 13681 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.573582 13692 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.370174 13472 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:33.676123 11216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.016s	sys 0.067s
I20260709 12:10:33.640599 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:33.634443 11854 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.005s
W20260709 12:10:33.680819 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53938.3us
I20260709 12:10:33.683348 11215 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:33.687795 11211 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:33.677891 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:33.689230 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:33.694187 11217 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:33.626791 13633 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.697860 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.698648 11211 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:33.699605 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.700256 11211 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:33.701833 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:33.711653 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.713817 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:33.715492 11215 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:33.716522 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.717952 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.722045 11215 raft_consensus.cc:2376] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4. Re-sending same reply.
W20260709 12:10:33.724328 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46538.4us
I20260709 12:10:33.665817 13687 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:33.686614 13615 raft_consensus.cc:2764] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:33.641963 13696 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.726181 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:33.730366 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.723476 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.742156 11219 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:33.694236 11854 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:33.722976 13681 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:33.749532 11292 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:33.725373 13633 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:33.732337 13588 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.690727 13692 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:33.742626 13542 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.880s	user 0.015s	sys 0.004s
W20260709 12:10:33.743083 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 459404us
I20260709 12:10:33.741386 13707 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.756134 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.762439 11219 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:33.760840 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:33.760980 11286 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:33.764485 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:33.765281 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:33.765985 11286 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.768584 11215 raft_consensus.cc:2368] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:33.769447 11290 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:10:33.751686 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 120655us
I20260709 12:10:33.741838 13687 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:33.744079 13703 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.756373 13681 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:33.779386 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:33.780761 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:33.774871 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:33.790598 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:33.796926 11284 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:33.752992 13588 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:33.791615 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.790634 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:33.798355 11219 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:33.793892 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:33.800833 11286 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:33.793625 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:33.770363 13655 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:33.775348 13696 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.893491 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 114200us
I20260709 12:10:33.895467 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:33.895855 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:33.896243 11142 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:33.896582 11861 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:33.899703 11285 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:33.903141 11284 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:33.901086 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:33.904425 11219 raft_consensus.cc:2368] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:33.801695 13588 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.909586 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:33.906409 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:33.902662 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:33.919667 11859 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:33.768829 13707 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:33.928558 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.829s (SENT) [suppressed 57 similar messages]
I20260709 12:10:33.931695 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:33.932931 11860 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:33.953670 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:33.963310 11142 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:33.968704 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:33.917932 13701 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:10:33.908149 13595 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.969789 11219 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:33.922542 11854 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:33.975754 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:33.977023 13713 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:10:33.977805 13700 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:10:33.978117 13655 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:33.980237 13614 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.024060 11144 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 1.
I20260709 12:10:33.923082 13472 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.028585 11290 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.029377 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:34.031212 13708 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:10:34.031092 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.048098 11219 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.941675 13587 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.038331 13293 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.039016 13681 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.040086 13711 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.041095 13655 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.042886 13692 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:33.917222 13553 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:33.903669 13696 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.087991 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:34.032418 13595 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:34.033061 13472 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.033310 13614 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:34.114872 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 376) took 1410 ms. Trace:
I20260709 12:10:34.117882 11289 rpcz_store.cc:276] 0709 12:10:32.688965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.689165 (+   200us) service_pool.cc:224] Handling call
0709 12:10:32.699201 (+ 10036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.754581 (+ 55380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.754625 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.761252 (+  6627us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.629396 (+868144us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.629435 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.629506 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.099196 (+469690us) raft_consensus.cc:1685] finished
0709 12:10:34.099230 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.099418 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10068,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5875,"thread_start_us":777498,"threads_started":1,"wal-append.queue_time_us":919283}
I20260709 12:10:34.114367 11135 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:34.121021 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.074098 11290 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:34.123035 11210 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.126986 11287 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:34.132854 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.023633 13633 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.135108 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 313) took 1308 ms. Trace:
I20260709 12:10:34.150358 11212 rpcz_store.cc:276] 0709 12:10:32.826921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.827163 (+   242us) service_pool.cc:224] Handling call
0709 12:10:32.856549 (+ 29386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.342850 (+486301us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b18003c5ec0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ad3bfb 00007f9830ade64b
0709 12:10:33.342995 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.343023 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.343580 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.639137 (+295557us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.639177 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.639264 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.134602 (+495338us) raft_consensus.cc:1685] finished
0709 12:10:34.134650 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.135023 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2095,"raft.queue_time_us":159537,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":8894,"spinlock_wait_cycles":10914944,"thread_start_us":455292,"threads_started":2,"wal-append.queue_time_us":454890}
I20260709 12:10:34.098508 13712 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.124346 13472 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.145452 11210 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:34.114917 13692 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.125615 13695 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:34.176826 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.177953 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 310) took 1353 ms. Trace:
I20260709 12:10:34.146783 11219 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:34.125227 13683 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.130929 13032 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.169626 13553 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:34.096798 13711 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.178510 11213 rpcz_store.cc:276] 0709 12:10:32.824603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.824946 (+   343us) service_pool.cc:224] Handling call
0709 12:10:32.856549 (+ 31603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.061618 (+205069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.061652 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.101491 (+ 39839us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.391598 (+290107us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:33.581964 (+190366us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.585194 (+  3230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.585267 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.177650 (+592383us) raft_consensus.cc:1685] finished
0709 12:10:34.177683 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.177866 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4596,"prepare.queue_time_us":186898,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":211528,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":42518,"spinlock_wait_cycles":42624,"thread_start_us":460560,"threads_started":2,"wal-append.queue_time_us":597691}
I20260709 12:10:34.185981 13683 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.186813 13032 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.345129 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:34.283003 13622 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.350077 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.283768 13587 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.160737 13712 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.352595 11213 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:34.282720 13553 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.360369 13553 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:34.362475 11258 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.785s (SENT)
I20260709 12:10:34.363319 13553 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.365085 13601 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.365676 13601 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.366110 13601 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.368185 13032 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.368876 13032 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.369436 13032 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.355434 13622 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.377048 13622 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.383519 13683 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.385435 13711 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.389442 11040 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 4, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 4 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.371027 13588 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.183784 13614 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:34.394805 11110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.030s
W20260709 12:10:34.405952 11110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.030s
W20260709 12:10:34.406590 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 621975us
W20260709 12:10:34.417142 11211 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
I20260709 12:10:34.390574 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:34.391479 11040 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 7, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 7 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } }
I20260709 12:10:34.483943 11211 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:10:34.485293 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 94829.5us
I20260709 12:10:34.399731 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.487373 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.494037 13718 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:34.494787 13718 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:34.495581 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.495798 13718 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.340740 13595 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.422425 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 323) took 1061 ms. Trace:
I20260709 12:10:34.359477 13587 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.427135 13707 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.501592 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.432744 13588 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:34.397269 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.435443 13472 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.439736 13712 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.610064 13707 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:10:34.414893 13683 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.443373 13711 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:34.447674 13032 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.670434 13032 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.671178 13032 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.671577 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:34.672145 11142 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:34.673138 13032 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.674064 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:34.674671 11143 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:34.464066 13601 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.676769 13601 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:34.677934 11138 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:34.680999 13698 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.044s	user 0.030s	sys 0.012s
W20260709 12:10:34.684516 11109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.037s	sys 0.077s
W20260709 12:10:34.686514 11109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.038s	sys 0.077s
I20260709 12:10:34.470734 11860 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:34.688047 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:34.688488 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.688628 11140 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:34.497771 11218 rpcz_store.cc:276] 0709 12:10:33.360823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.584139 (+223316us) service_pool.cc:224] Handling call
0709 12:10:33.584415 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.633909 (+ 49494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.633953 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.696325 (+ 62372us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.111067 (+414742us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.111147 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.111257 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.422009 (+310752us) raft_consensus.cc:1685] finished
0709 12:10:34.422051 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.422321 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4005,"raft.queue_time_us":13049,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":44348,"spinlock_wait_cycles":1699072,"thread_start_us":369808,"threads_started":1,"wal-append.queue_time_us":660898}
I20260709 12:10:34.689409 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 314) took 1640 ms. Trace:
I20260709 12:10:34.690058 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.691643 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.428167 13696 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.507799 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:34.525739 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.026s	sys 0.043s
W20260709 12:10:34.693550 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.026s	sys 0.043s
I20260709 12:10:34.684424 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.694571 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.694983 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:34.695475 11218 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:34.699172 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:34.699456 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.699941 11138 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:34.562135 13547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.011s
I20260709 12:10:34.486316 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:34.607295 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:34.704037 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 217829us
I20260709 12:10:34.609826 11210 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:34.610657 11213 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:34.621376 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.697803 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.706668 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.707384 11290 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:34.707604 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1395) took 1012 ms. Trace:
I20260709 12:10:34.708266 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.708630 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:34.708879 11290 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:34.622918 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.625125 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:34.625443 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.626173 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:34.710918 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 302518us
I20260709 12:10:34.625473 11040 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.626533 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:34.627466 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.628796 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 317) took 1579 ms. Trace:
I20260709 12:10:34.631423 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:34.633016 13551 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.634508 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.716125 11219 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:34.635565 11293 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:34.712492 11217 rpcz_store.cc:276] 0709 12:10:33.049775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.052643 (+  2868us) service_pool.cc:224] Handling call
0709 12:10:33.066296 (+ 13653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.694694 (+628398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.628509 (+933815us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400304dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:34.628735 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416297216}
I20260709 12:10:34.716928 11293 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:34.641425 13704 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.749s	user 0.005s	sys 0.008s
I20260709 12:10:34.643399 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.718636 11211 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:34.719527 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.720082 11211 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:34.720790 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.721278 11211 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:34.646898 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:34.654345 13588 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.654963 13722 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.655736 13683 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.656757 13587 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.601740 13418 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.658517 13472 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.665115 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.461611 13293 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.686601 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:34.396996 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 468444us
I20260709 12:10:34.753594 11143 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:34.748432 13614 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.565203 13695 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:34.701538 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:34.689848 11214 rpcz_store.cc:276] 0709 12:10:33.048741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.048907 (+   166us) service_pool.cc:224] Handling call
0709 12:10:33.059900 (+ 10993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.067669 (+  7769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.067711 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.068328 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.181605 (+113277us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.181656 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.181741 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.509913 (+1328172us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:34.682348 (+172435us) raft_consensus.cc:1685] finished
0709 12:10:34.682367 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.689343 (+  6976us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91686,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":34193664,"thread_start_us":64378,"threads_started":1,"wal-append.queue_time_us":334218}
I20260709 12:10:34.697887 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.709220 11135 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:34.714178 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:34.765712 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67927.5us
I20260709 12:10:34.765841 11218 raft_consensus.cc:2376] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7. Re-sending same reply.
I20260709 12:10:34.715099 11285 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:34.769287 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1390) took 1121 ms. Trace:
I20260709 12:10:34.707978 11210 rpcz_store.cc:276] 0709 12:10:33.695510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.357997 (+662487us) service_pool.cc:224] Handling call
0709 12:10:34.707540 (+349543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.769748 11213 rpcz_store.cc:276] 0709 12:10:33.648491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.487095 (+838604us) service_pool.cc:224] Handling call
0709 12:10:34.769040 (+281945us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:34.769215 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281517440}
I20260709 12:10:34.722832 11287 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:34.722065 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.771368 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1386) took 1134 ms. Trace:
W20260709 12:10:34.696511 13655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.025s	sys 0.077s
I20260709 12:10:34.725502 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:34.771884 11218 rpcz_store.cc:276] 0709 12:10:33.636569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.711550 (+1074981us) service_pool.cc:224] Handling call
0709 12:10:34.766474 (+ 54924us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.772756 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47387.2us
I20260709 12:10:34.773197 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.774080 11218 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:34.702932 13692 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.698730 13696 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.724673 11293 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.735037 11138 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:34.747602 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.707403 13633 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.716034 13716 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:34.756103 11259 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.193s (SENT)
I20260709 12:10:34.467751 13687 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.746887 13724 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:34.757426 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 412450us
I20260709 12:10:34.703554 13289 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:10:34.716279 13712 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:10:34.790732 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.790591 13610 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:10:34.794392 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.812193 11213 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:34.753037 13418 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.813453 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.746153 13722 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.814518 13418 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.814638 13615 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.815124 13695 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.795094 11293 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.817849 11215 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 2: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:34.756922 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.794447 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:34.818861 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62059.5us
I20260709 12:10:34.819868 13683 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.820271 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.820494 13683 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.795763 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.820947 13683 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.821133 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.821355 13683 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.821525 11219 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:34.796627 13716 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:34.725773 13551 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.823283 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.823863 13722 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:34.824476 13722 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.824566 13551 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:34.825023 13722 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:34.728291 13588 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.807108 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.828186 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:34.828735 11210 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.828840 13588 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:34.829702 13594 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:34.789446 13655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.026s	sys 0.078s
I20260709 12:10:34.797533 13547 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.819067 11214 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:34.800384 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.831883 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.832139 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:34.815346 13615 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.834340 13615 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:34.791882 13692 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.834847 13615 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.835001 13692 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.822167 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1389) took 1175 ms. Trace:
I20260709 12:10:34.826813 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.825968 13722 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.792181 13696 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.761670 13293 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.821985 13472 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.835419 13615 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.839643 13293 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.791778 13601 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:34.840397 13601 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.840744 13601 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.835942 11213 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:34.785928 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.843173 11293 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:34.860150 11218 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:34.860522 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:34.861402 11215 raft_consensus.cc:2368] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:34.862802 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:34.863886 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1399) took 1166 ms. Trace:
I20260709 12:10:34.843993 11211 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:34.792443 13633 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.875135 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 315) took 1826 ms. Trace:
I20260709 12:10:34.880288 11040 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:34.879881 11216 rpcz_store.cc:276] 0709 12:10:33.049123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.050555 (+  1432us) service_pool.cc:224] Handling call
0709 12:10:33.051004 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.117819 (+ 66815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.117853 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.133462 (+ 15609us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.687070 (+553608us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.687194 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.687345 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.640674 (+953329us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:34.844724 (+204050us) raft_consensus.cc:1685] finished
0709 12:10:34.844759 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.875026 (+ 30267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4951,"raft.queue_time_us":100287,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":5823360,"thread_start_us":573808,"threads_started":2,"wal-append.queue_time_us":646158}
I20260709 12:10:34.885617 11216 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:34.835994 11219 rpcz_store.cc:276] 0709 12:10:33.647528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.789910 (+1142382us) service_pool.cc:224] Handling call
0709 12:10:34.822094 (+ 32184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:34.837644 13551 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:34.864388 11215 rpcz_store.cc:276] 0709 12:10:33.697063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.862722 (+1165659us) service_pool.cc:224] Handling call
0709 12:10:34.863094 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.863482 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.863523 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.863585 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:34.863629 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.863706 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.863808 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12821}
I20260709 12:10:34.894313 11215 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:34.894817 11040 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 6, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 6 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.902743 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:34.906824 11135 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:34.908500 11219 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:34.906812 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:34.912524 11040 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:10:34.913800 11210 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:34.915397 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.800236 13724 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.837517 13696 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.920089 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:34.922413 11040 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 3, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:34.838703 13472 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.927996 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.945114 11860 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:34.928629 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:34.892591 13551 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:34.858997 13687 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:34.896307 13648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.016s	sys 0.036s
I20260709 12:10:34.933409 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:34.937516 11259 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.829s (SENT)
I20260709 12:10:34.877506 13523 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.875958 13588 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:34.811630 13638 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:10:34.879566 13418 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:34.892761 13633 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.970057 13647 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:34.965793 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 332182us
I20260709 12:10:34.979948 11040 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 4, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 4 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:34.976189 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:34.929607 13615 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:34.929464 13685 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:34.984306 11038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 253) took 12274 ms (client timeout 15000 ms). Trace:
I20260709 12:10:34.927878 13724 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.979305 13648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.017s	sys 0.037s
I20260709 12:10:34.967730 13472 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.997525 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.998173 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.023089 11284 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:35.023128 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:34.998857 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:34.974258 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 199755us
I20260709 12:10:35.001335 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.023999 11293 raft_consensus.cc:2410] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:35.024384 11286 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.024750 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:34.997054 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.025900 11287 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:35.004359 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.026990 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:34.975510 13551 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:34.983068 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.015409 11215 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.016067 11210 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:35.018116 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:35.022439 11288 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:35.034137 11286 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:35.022356 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.001899 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.023412 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:35.006363 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 68899.6us
I20260709 12:10:35.035545 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:35.038612 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 211796us
W20260709 12:10:35.041647 11259 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.863s (SENT)
W20260709 12:10:35.044682 11259 leader_election.cc:336] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.182s (SENT)
W20260709 12:10:35.045605 11259 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.234s (SENT)
I20260709 12:10:35.040371 11289 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:34.993009 13647 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:35.007833 13685 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.007982 13707 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:35.008302 11038 rpcz_store.cc:269] 0709 12:10:22.705496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.706784 (+  1288us) service_pool.cc:224] Handling call
0709 12:10:23.889197 (+1182413us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:10:34.979306 (+11090109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:30.646329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:30.647085 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:30.647140 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:10:30.647158 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:30.960254 (+313096us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:30.960359 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:30.960410 (+    51us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:10:30.962096 (+  1686us) tablet.cc:701] Row locks acquired
0709 12:10:30.962154 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:10:30.962344 (+   190us) write_op.cc:270] Start()
0709 12:10:30.968433 (+  6089us) write_op.cc:276] Timestamp: P: 1783599030962269 usec, L: 0
0709 12:10:30.977291 (+  8858us) op_driver.cc:348] REPLICATION: starting
0709 12:10:31.203210 (+225919us) log.cc:844] Serialized 8274 byte log entry
0709 12:10:32.388473 (+1185263us) op_driver.cc:464] REPLICATION: finished
0709 12:10:32.555114 (+166641us) write_op.cc:301] APPLY: starting
0709 12:10:32.578912 (+ 23798us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:32.579379 (+   467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:32.579503 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:32.583342 (+  3839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:32.583780 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:10:32.583974 (+   194us) write_op.cc:312] APPLY: finished
0709 12:10:32.584777 (+   803us) log.cc:844] Serialized 145 byte log entry
0709 12:10:32.585714 (+   937us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.585938 (+   224us) write_op.cc:454] Released schema lock
0709 12:10:32.586030 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:32.586518 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.586552 (+    34us) write_op.cc:454] Released schema lock
0709 12:10:32.775077 (+188525us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad832a 00007f9830a5df14 00007f9830a5dec3 00007f9830a5de38 00007f9830a5ddf3 00007f9830a5d0dc 00007f9830a86e16 00007f9830a6ecbb 00007f9830a5939d 00007f9830a5cd75
Metrics: {"mutex_wait_us":684929,"reported_tablets":38,"spinlock_wait_cycles":10057600,"child_traces":[["op",{"apply.queue_time_us":132369,"apply.run_cpu_time_us":5548,"apply.run_wall_time_us":56613,"num_ops":21,"prepare.queue_time_us":228928,"prepare.run_cpu_time_us":54761,"prepare.run_wall_time_us":1082276,"raft.queue_time_us":191181,"raft.run_cpu_time_us":32371,"raft.run_wall_time_us":402994,"replication_time_us":1405399,"spinlock_wait_cycles":23905024,"thread_start_us":602133,"threads_started":4,"wal-append.queue_time_us":939173,"wal-append.run_cpu_time_us":35300,"wal-append.run_wall_time_us":1464102}]]}
I20260709 12:10:35.052719 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:34.983244 13523 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:34.980967 13687 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.058827 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.021940 13733 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.065212 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.055060 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.049973 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:34.983598 13588 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:34.999873 13418 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.064955 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 325) took 1121 ms. Trace:
I20260709 12:10:35.060972 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.066859 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:35.069347 11210 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:35.069103 11293 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:35.070283 11290 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:35.070816 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:35.068089 11213 rpcz_store.cc:276] 0709 12:10:33.943402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.876987 (+933585us) service_pool.cc:224] Handling call
0709 12:10:34.931102 (+ 54115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.931340 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:35.012811 (+ 81471us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.064019 (+ 51208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.064636 (+   617us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:35.064689 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.064758 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.064894 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69566,"raft.queue_time_us":21464,"thread_start_us":50270,"threads_started":2}
I20260709 12:10:35.069147 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:35.072414 11215 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:35.073504 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:35.074971 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:35.076987 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.077155 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:35.077970 11285 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 2.
I20260709 12:10:35.078028 13032 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.080047 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.080767 11215 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:35.081257 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.082190 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:35.082842 11215 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.083484 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.048506 13615 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.059402 13685 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.091236 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.092721 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:35.059080 13712 raft_consensus.cc:2764] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:35.094648 13547 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.096635 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.098191 13547 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.098685 13547 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:35.099116 13547 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.061920 13695 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.063724 13690 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.111819 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.066741 13735 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.089135 13553 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.089006 13707 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.115108 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72468.9us
I20260709 12:10:35.117125 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:35.086575 13681 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.086774 13289 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.148849 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:35.149564 11288 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:35.153098 13692 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.110594 13695 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.138746 13711 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:35.138867 13553 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.114073 13712 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:35.110908 13587 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.149477 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:35.153898 13622 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:35.155124 13588 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.157509 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.088524 13729 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.085074 13734 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.108650 13615 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.111128 13293 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:35.077445 13733 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:35.197497 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 115380us
I20260709 12:10:35.260452 11259 leader_election.cc:400] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:35.260876 11259 leader_election.cc:403] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:35.262589 11213 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:10:35.268623 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 111162us
I20260709 12:10:35.269963 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.136458 13735 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:35.251376 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1385) took 1615 ms. Trace:
W20260709 12:10:35.190445 13736 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:35.158771 13738 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:35.193849 13695 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.159075 13707 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:35.205545 13744 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:35.296855 11110 leader_election.cc:400] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:35.317719 11110 leader_election.cc:403] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:35.311545 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51277.1us
I20260709 12:10:35.286998 11218 rpcz_store.cc:276] 0709 12:10:33.636272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.892246 (+1255974us) service_pool.cc:224] Handling call
0709 12:10:34.895949 (+  3703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.896219 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:35.045280 (+149061us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.250416 (+205136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.250634 (+   218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:35.250901 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.251122 (+   221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.251297 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18213,"prepare.queue_time_us":198811,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":298,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19097,"thread_start_us":227378,"threads_started":2}
W20260709 12:10:35.320573 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.316533 11291 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:35.112644 13647 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.282342 13553 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:35.285931 13690 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.328799 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:35.298028 13718 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:35.311643 13523 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.315294 13588 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3.
I20260709 12:10:35.317039 13738 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:35.286090 13755 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.411446 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1705) took 1282 ms. Trace:
I20260709 12:10:35.411172 13755 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:35.412038 13742 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:10:35.411970 11216 rpcz_store.cc:276] 0709 12:10:34.129528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.898009 (+768481us) service_pool.cc:224] Handling call
0709 12:10:34.898348 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.910173 (+ 11825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.910214 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.910854 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.012047 (+101193us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:35.014480 (+  2433us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.035585 (+ 21105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.035677 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.411222 (+375545us) raft_consensus.cc:1685] finished
0709 12:10:35.411244 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.411383 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64481,"prepare.queue_time_us":233213,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":15742,"raft.queue_time_us":16920,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":24390,"thread_start_us":31009,"threads_started":2,"wal-append.queue_time_us":96399}
I20260709 12:10:35.414635 13611 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.415200 13611 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:35.415872 13732 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:10:35.415479 13735 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.417411 13611 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.336915 13717 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7.
I20260709 12:10:35.268419 13683 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.421315 11213 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:35.447857 11213 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:35.422741  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:35.377425 13520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.017s
I20260709 12:10:35.439888 11218 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:35.418319 13614 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.000s
W20260709 12:10:35.423732 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104190us
I20260709 12:10:35.413911 13755 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.299314 13587 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.466707 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.467235 13734 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.467545 13587 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.463581 11212 raft_consensus.cc:2410] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:35.467834 13734 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.468505 13614 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.469646 13737 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:10:35.367002 13553 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.463351 13764 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.469125 13614 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:35.481171 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.471480 13754 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:10:35.456066 13647 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:35.488469 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 295689us
I20260709 12:10:35.469904 13551 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.497239 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:35.498013 13610 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:35.498395 13610 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.498595 13551 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.498811 13610 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.499217 13551 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:35.481626 13520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.017s
I20260709 12:10:35.500466 13551 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:35.491411 11259 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.634s (SENT)
I20260709 12:10:35.446177 13687 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.503865 13551 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.504384 13551 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.504877 13551 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.471161 13712 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.472427 13692 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.476779 13683 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:35.514704 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 430308us
I20260709 12:10:35.482577 13764 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:35.511402 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.004s
I20260709 12:10:35.482671 13755 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.485277 13418 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:35.509043 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 180331us
I20260709 12:10:35.486759 13752 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.470469 13734 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.527865 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:35.529223 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.010s	sys 0.004s
W20260709 12:10:35.529625 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 550534us
I20260709 12:10:35.532388 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.508699 13523 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.535312 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:35.540913 11110 leader_election.cc:400] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:35.544173 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.545612 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 326) took 1601 ms. Trace:
I20260709 12:10:35.546156 11211 rpcz_store.cc:276] 0709 12:10:33.943726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.876687 (+932961us) service_pool.cc:224] Handling call
0709 12:10:34.877088 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.877307 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:35.074561 (+197254us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.545136 (+470575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:35.545213 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:35.545291 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.545384 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.545538 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8326,"prepare.queue_time_us":215638,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"thread_start_us":595357,"threads_started":2}
I20260709 12:10:35.548777 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:35.550570 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:35.552580 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:35.525198 13615 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.528154 13764 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.533687 13711 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.515008 13712 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.538708 13690 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.644954 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:35.516968 13610 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.565487 13588 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.471765 13738 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.656667 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.533789 13755 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.657016 13588 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.628993 13711 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:35.624993 13615 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:35.654749 13704 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:35.541384 13523 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.650812 13716 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:35.532842 13752 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.675777 13610 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.676229 11211 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:35.676352 13712 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:35.667881 13724 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.629s	user 0.005s	sys 0.005s
I20260709 12:10:35.665555 13690 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.663522 13765 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.667157 13551 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.667709 13711 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.669328 13733 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:35.727340 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 174837us
I20260709 12:10:35.728873 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.733904 13588 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:35.735357 13696 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.791s	user 0.007s	sys 0.004s
I20260709 12:10:35.735971 13696 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.705610 13724 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.739530 11217 raft_consensus.cc:2368] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:35.739691 13523 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.740259 11219 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:35.740553 13724 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:35.740777 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1412) took 1722 ms (client timeout 2155 ms). Trace:
W20260709 12:10:35.741215 11217 rpcz_store.cc:269] 0709 12:10:34.018393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.749785 (+731392us) service_pool.cc:224] Handling call
0709 12:10:35.740583 (+990798us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:35.740714 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2141641472}
I20260709 12:10:35.741694 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:35.740823 13696 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.742792 13716 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.746608 13716 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:35.747612 13716 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:35.748684 13601 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.002s
I20260709 12:10:35.749256 13601 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.706147 13712 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.672042 13615 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:35.718991 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 188155us
I20260709 12:10:35.742952 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:35.707666 13765 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:35.763685 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:35.706640 13690 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:35.788595 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:35.789196 11284 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.767530 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:35.776732 13685 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.001s
I20260709 12:10:35.783064 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:35.783094 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:35.782063 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:35.784034 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:35.784842 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:35.786078 11136 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:35.768612 13763 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:35.800427 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:35.802057 13773 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.792445 13690 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.802767 13706 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:35.885630 13706 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.886086 13706 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:35.887034 13706 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:35.888299 13633 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.879s	user 0.010s	sys 0.000s
I20260709 12:10:35.888419 13706 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.804117 13717 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:35.891085 13717 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:35.891515 13717 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:35.809310 13695 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.792694 13735 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:35.769168 13740 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 12:10:35.811051 13758 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:10:35.860242 11143 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
W20260709 12:10:35.860883 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95181.9us
I20260709 12:10:35.864274 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:35.898635 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.870543 13775 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:10:35.871515 13772 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:10:35.873747 13615 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.804378 13601 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.768977 13712 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.857770 13755 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.875488 13773 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:35.879313 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 86398.9us
I20260709 12:10:35.787887 13765 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.787977 13778 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.894363 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:35.917680 11136 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:35.810683 13766 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:10:35.802217 13472 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.003s
I20260709 12:10:35.928468 11143 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:35.928733 13472 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.929600 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:35.930812 11214 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:10:35.931890 13712 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:35.932338 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1695) took 1805 ms. Trace:
I20260709 12:10:35.932732 11214 rpcz_store.cc:276] 0709 12:10:34.126790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.831619 (+704829us) service_pool.cc:224] Handling call
0709 12:10:35.932144 (+1100525us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540035c354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:35.932282 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2525498112}
I20260709 12:10:35.934002 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.939956 13752 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.896097 13735 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:35.940711 13735 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:35.909334 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:35.894479 13547 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.003s
I20260709 12:10:35.946539 13773 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.946907 13547 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.948961 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.926744 13553 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:35.920063 13781 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.950093 13781 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:35.952932 13781 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:35.934142 11212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1404) took 2206 ms (client timeout 1923 ms). Trace:
W20260709 12:10:35.953595 11212 rpcz_store.cc:269] 0709 12:10:33.728287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.153244 (+424957us) service_pool.cc:224] Handling call
0709 12:10:35.933932 (+1780688us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400011dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:35.934065 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2954979200}
I20260709 12:10:35.862223 13685 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.954406 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:35.935192 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.955796 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.956812 11859 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:35.957242 13685 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.937307 13711 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.938042 13472 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.949146 13547 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.960021 11142 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.961715 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:35.961680 11136 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:35.966765 11144 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:35.915867 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53727.3us
I20260709 12:10:35.978614 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:35.980726 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:35.934253 13764 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:35.984251 13780 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:10:35.984923 13783 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:35.986243 13764 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.981266 13712 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:35.895083 13633 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.003664 11293 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:35.994364 11142 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:35.995402 13777 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:10:35.995769 11854 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:35.996001 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.020882 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:36.021474 11136 raft_consensus.cc:2376] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8. Re-sending same reply.
I20260709 12:10:36.022783 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:35.997253 13695 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:35.990242 13778 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.033427 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:36.002250 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 1859) took 1001 ms. Trace:
I20260709 12:10:36.034121 11287 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:36.007113 11284 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:10:36.019527 13633 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.020350 11140 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:36.020650 11143 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:36.003468 13718 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.004s
I20260709 12:10:36.035243 11144 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:36.034317 11285 rpcz_store.cc:276] 0709 12:10:35.000846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.001011 (+   165us) service_pool.cc:224] Handling call
0709 12:10:36.001984 (+1000973us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b540017f2d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:36.002163 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123609472}
I20260709 12:10:36.036474 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:35.917049 13716 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:10:36.039462 11136 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:36.044001 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:36.011932 13647 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.046343 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.051246 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.052618 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.049664 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.060609 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.061416 11143 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:36.041635 13718 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:36.063771 13759 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.062237 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.065258 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.066267 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.067248 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.074165 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.076435 11136 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:36.077378 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:36.077780 13770 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.421s	user 0.004s	sys 0.000s
I20260709 12:10:36.078609 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.079238 11136 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.079521 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.082473 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.082906 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.083832 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.050598 13778 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:36.049916 13647 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.087410 11136 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:36.089896 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 545892us
I20260709 12:10:36.091464 11142 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.091544 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.108032 13768 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.108865 13768 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:36.109231 13768 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:36.109571 13707 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:36.109995 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 314368us
I20260709 12:10:36.095038 13759 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:36.111575 13759 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.118034 11142 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.120376 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.121255 11218 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.030829 13765 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.127629 13647 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:36.105022 13718 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:36.128925 11138 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.130221 13735 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.124292 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.131466 11215 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
W20260709 12:10:36.129191 13789 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:10:36.117226 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.133045 13735 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.132333 11139 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.134064 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.134140 13690 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.135390 11137 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.136534 13690 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.109588 13768 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.128087 13765 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.140823 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.141130 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.142388 11137 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:36.125044 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49004.2us
W20260709 12:10:36.143349 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61566.7us
I20260709 12:10:36.145458 13032 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:36.147722 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:36.147965 13032 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:36.147053 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.149369 13032 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.143901 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:36.149834 13734 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:36.150264 13734 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:36.150381 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:36.150732 13734 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.154299 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.155566 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.128996 13716 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:36.078178 13717 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.085922 13778 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.141723 13696 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.181115 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:36.181563 11218 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:36.163951 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.161695 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.177831 13032 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.157848 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.186834 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
I20260709 12:10:36.143970 13647 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:36.153601 13724 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.188942 11292 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:36.157441 13695 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.199572 13695 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:36.200027 13614 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.200640 13695 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.146085 13293 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:10:36.192673 11143 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.177248 13418 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.153260 13768 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.206694 11216 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.190927 13696 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.209013 13696 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.209111 13647 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:36.209647 11140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 384) took 1303 ms (client timeout 1583 ms). Trace:
I20260709 12:10:36.193786 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:36.210119 11140 rpcz_store.cc:269] 0709 12:10:34.906248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.906508 (+   260us) service_pool.cc:224] Handling call
0709 12:10:36.209393 (+1302885us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540033fed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:36.209571 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2549634816}
I20260709 12:10:36.210846 11288 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:36.195154 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:36.211735 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.195425 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.212502 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:36.212805 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.215293 13767 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:36.189756 13472 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.218438 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:36.218917 13647 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:36.220259 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:36.221057 13725 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.221513 13725 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:36.221637 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.222883 13622 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:36.224225 13622 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:36.224906 13757 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.712s	user 0.000s	sys 0.002s
I20260709 12:10:36.225260 13622 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.157528 13716 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:36.179840 13773 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.198645 11284 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:36.198832 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:36.232908 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69086.5us
I20260709 12:10:36.233163 11285 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:36.210017 13711 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.197723 13752 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:36.228194 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.228307 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.228717 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:36.229187 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.230633 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:36.246891 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:36.245612 11140 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.193849 13032 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.231491 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:36.237391 11284 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:36.248409 11284 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:36.249182 11284 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.206521 13768 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.253535 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:36.238276 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.250672 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:36.221956 13725 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.145707 13610 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:10:36.254443 11291 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:36.247591 11289 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:36.253732 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.250623 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.258939 11218 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.255719 11143 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:36.259033 11292 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.244352 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:36.261830 11285 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:36.264168 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.265254 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.265728 11139 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.267946 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:36.249344 13724 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:36.271116 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:36.271608 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:36.272552 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.273520 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:36.272403 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.276507 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:36.279112 13032 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.245584 13472 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:36.285046 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.227373 13716 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.289562 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.290199 11287 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.263406 13418 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:36.252749 11110 connection.cc:256] RPC call timeout handler was delayed by -1.6925233489998845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:10:36.295514 11110 connection.cc:256] RPC call timeout handler was delayed by -1.6727233489998525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:10:36.295938 11110 connection.cc:256] RPC call timeout handler was delayed by -1.3883233489998474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:10:36.296295 11110 connection.cc:256] RPC call timeout handler was delayed by -1.192123348999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 12:10:36.296226 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 402) took 1138 ms. Trace:
I20260709 12:10:36.296692 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.286746 13472 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:36.245854 13647 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:10:36.298167 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.277063 13755 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.314342 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.315418 13472 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.286274 13734 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.317888 13734 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.318629 13582 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:36.320016 13647 consensus_queue.cc:1243] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:36.320602 13647 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.320797 13582 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.286607 13615 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:36.321270 13582 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:36.321725 13615 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.322181 13615 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.323074 13582 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.326164 13582 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.283371 13761 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:36.289443 13752 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.289207 13773 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:36.328255 13601 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.301870 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.331205 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.308739 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.331887 11291 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.297381 11286 rpcz_store.cc:276] 0709 12:10:35.157685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.158177 (+   492us) service_pool.cc:224] Handling call
0709 12:10:36.002673 (+844496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.002879 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:36.032440 (+ 29561us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.145458 (+113018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.145518 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.145564 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.145626 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.296000 (+150374us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b540017f2d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:36.296156 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45162,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":103,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4239,"spinlock_wait_cycles":1941521792,"thread_start_us":112669,"threads_started":1,"wal-append.queue_time_us":260727}
I20260709 12:10:36.327570 11288 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.333536 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.334029 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.299973 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.314991 11140 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:36.334794 11290 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.335011 11135 raft_consensus.cc:2410] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:36.310372 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.335858 11289 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.336181 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:36.330785 11139 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:10:36.296738 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1795233489999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 12:10:36.344837 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1273233489998802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
W20260709 12:10:36.345530 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1192233489998671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 12:10:36.346030 11110 connection.cc:256] RPC call timeout handler was delayed by -1.101223348999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 12:10:36.348875 13735 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:36.332942 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.356420 11137 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:36.360954 13472 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:36.385967 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.363196 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:36.365972 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:36.365994 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.366797 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.276706 13655 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:10:36.366674 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:36.366307 11292 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:36.412444 11135 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:36.414754 11288 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:36.375020 11287 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:36.374130 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:36.398321 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62244.2us
W20260709 12:10:36.417639 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43619.1us
I20260709 12:10:36.418437 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:36.371529 11290 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:36.416425 11138 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:36.331007 13601 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:36.423780 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:36.438910 13032 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:36.439792 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.440412 11218 raft_consensus.cc:2376] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8. Re-sending same reply.
I20260709 12:10:36.439554 13032 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.443884 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.444617 11218 raft_consensus.cc:2368] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:36.445869 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.446408 11218 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:36.447571 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.448678 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.449272 11215 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:36.450628 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.451327 11289 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:36.385445 13418 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:36.453596 11213 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:36.398877 13761 consensus_queue.cc:1243] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:36.454531 11215 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:36.452199 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.456358 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:36.461632 11219 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:36.462457 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.463009 11219 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.457190 11291 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:36.422477 13768 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:36.422940 13696 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.471930 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.460886 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.467190 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.468536 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:36.473865 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:36.469899 11210 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.427629 13711 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.472837 11217 raft_consensus.cc:2368] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:36.426594 13734 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:36.455703 13717 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:36.442675 13712 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.453285 13547 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:10:36.487282 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.602201 11215 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:36.458981 13735 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 12:10:36.490998 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 217537us
I20260709 12:10:36.555976 11210 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:36.573519 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:36.574680 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 306823us
I20260709 12:10:36.426689 13724 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.523907 11219 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:36.457746 13614 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.480039 13764 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:36.473613 13695 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:36.476648 13790 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:36.539770 13739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.027s	sys 0.058s
W20260709 12:10:36.539731 13722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.341s	user 0.011s	sys 0.017s
I20260709 12:10:36.478608 11211 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:36.459756 13780 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:10:36.460839 13776 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:10:36.485621 13768 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:36.626616 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:36.628240 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:36.632054 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.558128 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:36.637291 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 100395us
I20260709 12:10:36.481252 13696 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:36.819561 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 335284us
I20260709 12:10:36.588735 13783 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.698432 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.576839 13778 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 12:10:36.554692 13734 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:36.605244 13803 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:10:36.695391 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.885596 11210 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:36.885913 13696 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.886652 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.887328 11210 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:36.888139 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.888809 11210 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:36.889510 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:36.890910 13748 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.697s	user 0.003s	sys 0.006s
I20260709 12:10:36.891062 13776 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:36.891654 13776 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.891765 13768 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.894097 13776 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:36.894902 13807 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
W20260709 12:10:36.896297 13799 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:10:36.896462 13032 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.896863 13776 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.897115 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.897588 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.897854 11217 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:36.696713 13764 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:36.630443 13740 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:36.588259 13804 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:36.870839 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 244339us
I20260709 12:10:36.708763 13614 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:36.605623 13717 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 12:10:36.863670 13722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.669s	user 0.011s	sys 0.018s
I20260709 12:10:36.897408 13776 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.646195 13418 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.950910 13776 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.952029 13707 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.898277 11215 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:36.836009 13289 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:36.906526 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.890473 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:36.863886 13739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.027s	sys 0.059s
I20260709 12:10:36.972282 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.920292 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:36.898675 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:36.710876 13695 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:36.886668 13696 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:36.903365 13472 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:36.948244 13582 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.621s	user 0.004s	sys 0.005s
I20260709 12:10:36.871989 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:36.904286 13798 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:10:37.034627 11184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.018s	sys 0.001s
W20260709 12:10:37.284941 11184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.020s	sys 0.001s
I20260709 12:10:37.039888 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:36.901182 13800 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
W20260709 12:10:37.148360 13725 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.000s
I20260709 12:10:37.286412 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.321651 11293 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:37.322016 11293 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:37.322152 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:36.966353 13707 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:37.327030 11293 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.036705 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:37.070343 11213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.001s	sys 0.007s
W20260709 12:10:37.331807 11213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.001s	sys 0.015s
I20260709 12:10:37.333370 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.068382 13812 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.148803 13759 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.134027 13734 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:36.943084 13804 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.291025 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2179) took 1135 ms. Trace:
I20260709 12:10:37.110003 13817 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.292490 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.018788 13289 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.295203 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.295888 11137 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:37.346063 11138 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:37.295895 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.346427 11219 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.297731 13695 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:36.898334 13764 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.298429 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.302512 13816 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:36.904286 13802 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 12:10:37.308518 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 345) took 1185 ms. Trace:
W20260709 12:10:37.101650 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 473436us
I20260709 12:10:37.285135 13696 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:37.277978 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.359580 11212 rpcz_store.cc:276] 0709 12:10:36.122776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.122957 (+   181us) service_pool.cc:224] Handling call
0709 12:10:36.138917 (+ 15960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.139245 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.139271 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.139686 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.449043 (+309357us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.449087 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.449156 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.903702 (+454546us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:37.308232 (+404530us) raft_consensus.cc:1685] finished
0709 12:10:37.308254 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.308459 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":644,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3745,"spinlock_wait_cycles":22479232,"thread_start_us":272124,"threads_started":1,"wal-append.queue_time_us":367473}
W20260709 12:10:37.361052 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.358422 11219 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
W20260709 12:10:37.286369 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 414446us
I20260709 12:10:37.362753 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.363292 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:37.311647 11144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 399) took 1260 ms (client timeout 1644 ms). Trace:
W20260709 12:10:36.952683 13615 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.002s
I20260709 12:10:36.880671 13805 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.186818 13821 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.334124 11213 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:37.337553 11139 rpcz_store.cc:276] 0709 12:10:36.155905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.370106 (+214201us) service_pool.cc:224] Handling call
0709 12:10:36.370395 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.370627 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:36.663909 (+293282us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.290683 (+626774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.290736 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:37.290781 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.290859 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.290971 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137552,"prepare.queue_time_us":457883,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":137759,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"thread_start_us":702647,"threads_started":2,"wal-append.queue_time_us":400516}
I20260709 12:10:37.340982 11293 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:37.373106 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.341369 11210 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.343583 11140 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:37.337570 13724 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.345252 13759 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:37.351711 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 431544us
I20260709 12:10:37.381767 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.357431 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 344) took 1243 ms. Trace:
I20260709 12:10:37.382438 11212 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:37.382634 11216 rpcz_store.cc:276] 0709 12:10:36.113687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.122325 (+  8638us) service_pool.cc:224] Handling call
0709 12:10:36.125923 (+  3598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.207156 (+ 81233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.357187 (+1150031us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54002a0dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:37.357372 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185319680}
I20260709 12:10:37.178910 13614 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.352340 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.352798 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:37.383942 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:37.355257 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 348) took 1202 ms. Trace:
W20260709 12:10:37.355391 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 477425us
W20260709 12:10:37.385739 11110 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.155s (SENT)
W20260709 12:10:37.364120 11144 rpcz_store.cc:269] 0709 12:10:36.051600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.052297 (+   697us) service_pool.cc:224] Handling call
0709 12:10:37.310293 (+1257996us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54002e27d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:37.310475 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935080192}
I20260709 12:10:37.368711 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:37.325830 13725 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.385432 11214 rpcz_store.cc:276] 0709 12:10:36.152865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.153003 (+   138us) service_pool.cc:224] Handling call
0709 12:10:36.153393 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.153753 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.153785 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.177151 (+ 23366us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.471181 (+294030us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.471227 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.471303 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.900652 (+429349us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:37.351374 (+450722us) raft_consensus.cc:1685] finished
0709 12:10:37.351409 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.355182 (+  3773us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":316,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":31523,"spinlock_wait_cycles":8680192,"thread_start_us":258203,"threads_started":1,"wal-append.queue_time_us":387828}
I20260709 12:10:37.376263 13738 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.388692 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.389312 11212 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:37.392694 13472 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.394172 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:37.364195 13696 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.341495 13812 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.397349 11110 leader_election.cc:400] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:37.374634 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.374778 13695 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.400044 11213 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:37.378024 13615 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.345216 13817 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.400682 13472 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.426410 11218 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.364626 13707 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.427534 13790 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:37.431399 13790 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:37.431452 13707 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.432348 13790 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:37.433598 13790 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.434984 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 396) took 1423 ms. Trace:
I20260709 12:10:37.363778 13816 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.435338 11143 rpcz_store.cc:276] 0709 12:10:36.011429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.067050 (+ 55621us) service_pool.cc:224] Handling call
0709 12:10:37.434822 (+1367772us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001252d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:37.434925 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287231872}
I20260709 12:10:37.437101 11211 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:37.430400 11217 raft_consensus.cc:2376] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4. Re-sending same reply.
I20260709 12:10:37.408538 11293 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:37.441462 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1864) took 1204 ms. Trace:
I20260709 12:10:37.403195 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:37.443447 11293 rpcz_store.cc:276] 0709 12:10:36.237274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.237445 (+   171us) service_pool.cc:224] Handling call
0709 12:10:36.253584 (+ 16139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.321563 (+1067979us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b5400199220. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830add1c0 00007f9830ade231 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c
0709 12:10:37.440592 (+119029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.441385 (+   793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155871872}
I20260709 12:10:37.450397 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:37.452183 11290 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.404302 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:37.459163 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60753.1us
I20260709 12:10:37.459522 11289 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:37.396672 13821 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.460819 11289 pending_rounds.cc:85] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 4
I20260709 12:10:37.474560 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:37.476022 11289 pending_rounds.cc:107] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 12:10:37.464222 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59997.6us
I20260709 12:10:37.476583 11289 raft_consensus.cc:2889] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.478186 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:37.429505 13833 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.482712 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:37.428705 13812 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.483613 11210 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:37.485781 13825 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.486297 13765 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:37.428650 13615 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:37.483471 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:37.430419 13817 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.492563 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1723) took 1004 ms. Trace:
I20260709 12:10:37.503018 11210 rpcz_store.cc:276] 0709 12:10:36.488019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.978514 (+490495us) service_pool.cc:224] Handling call
0709 12:10:37.492498 (+513984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.492775 11216 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 12:10:37.446501 13647 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:37.505916 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.480360 13722 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.499378 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.512913 11290 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:37.505004 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:37.516914 13817 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.480387 13717 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.487788 13821 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.517017 11287 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.525624 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:37.525970 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 87607us
I20260709 12:10:37.521386 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.514307 13780 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.522982 13615 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.523492 13722 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:37.498122 13768 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:37.491385 13472 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:37.524829 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.534515 11289 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:37.534607 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.557936 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:37.520342 13804 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:37.495325 13759 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:37.527179 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:37.554216 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.561129 11218 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.527731 13821 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.489293 13815 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:37.460204 13805 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:10:37.526247 11210 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.460011 13830 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:10:37.537016 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.537159 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.573321 11293 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:37.544716 11287 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:37.573766 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.574334 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.574963 11287 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:37.524451 13717 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:37.555383 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.576488 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.559458 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.530777 13817 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.534787 13780 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.586046 11210 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:37.587529 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:37.588474 11210 raft_consensus.cc:2368] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3.
I20260709 12:10:37.589480 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.591094 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.592927 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.535526 13615 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.583211 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.598587 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.562716 13841 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.535472 13833 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:37.566351 13816 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.560725 13289 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.596290 11210 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:37.595456 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:37.607075 11287 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:37.578577 13553 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.608866 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.582617 13717 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.602104 11293 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:37.604058 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:37.605991 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:37.611284 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:37.594919 13823 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.599241 13614 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.583616 13804 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:37.608322 13836 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:37.602962 13418 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:37.612248 13830 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.605924 13812 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.613987 13823 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.663043 13820 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.662453 13812 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.663712 13820 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.664021 13812 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.667733 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:37.618314 13805 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.614029 13289 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.618088 13614 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.676527 13614 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.676664 13837 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:37.677590 13837 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:37.669143 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53226.7us
I20260709 12:10:37.618636 13804 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.679715 13804 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.672107 13776 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.681607 13615 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.682240 13615 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:37.618250 13847 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.601143 13722 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.681267 13776 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.652444 13815 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.622555 11293 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:37.615675 13553 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.661492 13830 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.652664 13761 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.653496 13418 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:37.668867 13823 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.635177 13734 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:37.712687 13725 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.713755 13780 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.714260 13776 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.714944 13817 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.676174 13696 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.717468 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:37.672842 13289 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.720649 13773 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.671442 13820 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.746086 13851 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.719895 13815 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:37.751427 11215 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:37.745846 13418 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.739244 13830 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.750782 13852 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:37.754477 13852 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.754830 13852 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:37.743361 13816 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.749361 13773 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.759986 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1437) took 1278 ms. Trace:
I20260709 12:10:37.748108 13289 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.746850 13780 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:37.760465 11214 rpcz_store.cc:276] 0709 12:10:36.481855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.387437 (+905582us) service_pool.cc:224] Handling call
0709 12:10:37.435657 (+ 48220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.435930 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.435955 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.436447 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.571682 (+135235us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:37.571732 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.571807 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.759712 (+187905us) raft_consensus.cc:1685] finished
0709 12:10:37.759743 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.759915 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":106830,"threads_started":1,"wal-append.queue_time_us":206698}
I20260709 12:10:37.748521 13776 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.762771 13856 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:10:37.763025 13776 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:37.762719 13839 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:10:37.765516 13696 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.766453 13776 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:37.767342 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87280us
I20260709 12:10:37.768414 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:37.775130 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:37.774107 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.777279 11218 raft_consensus.cc:2410] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:37.779241 11110 leader_election.cc:400] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:37.724037 13847 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.781141 11856 raft_consensus.cc:2410] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:37.782253 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:37.783730 11218 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:37.780180 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:37.786146 13850 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:10:37.787202 11289 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:37.790271 13843 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
W20260709 12:10:37.792075 11288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 1870) took 1500 ms (client timeout 1622 ms). Trace:
I20260709 12:10:37.792325 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:37.792625 11288 rpcz_store.cc:269] 0709 12:10:36.286415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.286659 (+   244us) service_pool.cc:224] Handling call
0709 12:10:37.786599 (+1499940us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5400060ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:37.786716 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33061632}
W20260709 12:10:37.796080 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 236697us
I20260709 12:10:37.798038 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1443) took 1311 ms. Trace:
I20260709 12:10:37.798466 11213 rpcz_store.cc:276] 0709 12:10:36.486163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.402078 (+915915us) service_pool.cc:224] Handling call
0709 12:10:37.402581 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.427620 (+ 25039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.427653 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.428210 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.495744 (+ 67534us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:37.495802 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.495902 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.797796 (+301894us) raft_consensus.cc:1685] finished
0709 12:10:37.797822 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.797973 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24443,"raft.queue_time_us":25717,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":67113,"threads_started":1,"wal-append.queue_time_us":168085}
I20260709 12:10:37.800338 13857 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.801254 13857 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:37.802117 13857 consensus_queue.cc:1243] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:37.800369 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:37.771320 13837 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.806770 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:37.807063 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 195842us
I20260709 12:10:37.810230 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:37.811196 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.812999 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.771549 13816 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.781744 13780 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.820896 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.824131 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.824878 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.802727 13855 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:37.790318 13852 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.837036 13855 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.837638 13855 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:37.826790 13615 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.761417 13851 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.846796 13846 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.855638 13707 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.856297 13707 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.856734 13707 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.864216 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1434) took 1408 ms. Trace:
I20260709 12:10:37.864691 11216 rpcz_store.cc:276] 0709 12:10:36.455928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.383661 (+927733us) service_pool.cc:224] Handling call
0709 12:10:37.492498 (+108837us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:37.512977 (+ 20479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.864013 (+351036us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400026cd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:37.864155 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230381824}
I20260709 12:10:37.826398 13815 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.876959 13685 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:37.889132 13815 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.890015 13860 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.848790 13418 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:37.877223 13615 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.894237 11286 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
W20260709 12:10:37.893026 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63703.5us
I20260709 12:10:37.897236 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:37.890609 13860 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:37.902104 13846 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.913785 13846 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:37.897681 13615 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.915007 13846 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:37.915206 13615 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.915606 13846 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:37.896863 13418 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.923679 13418 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.926498 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:37.855088 13764 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.907666 13847 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.884560 13855 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.919400 13860 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.953578 11135 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:37.954418 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 147697us
I20260709 12:10:37.942564 13780 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:37.955698 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.916601 13846 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:37.925269 13804 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:37.964179 13816 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:37.968628 11258 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:37.984411 13860 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:37.987645 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88796.8us
I20260709 12:10:38.009459 13764 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.003159 13816 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.961830 13812 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.022281 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1721) took 1534 ms. Trace:
I20260709 12:10:38.048961 11211 rpcz_store.cc:276] 0709 12:10:36.487575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.018103 (+530528us) service_pool.cc:224] Handling call
0709 12:10:38.022092 (+1003989us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400295ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:38.022224 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346409856}
W20260709 12:10:38.022315 11219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1444) took 1535 ms (client timeout 1763 ms). Trace:
W20260709 12:10:38.023706 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1720) took 1536 ms (client timeout 1994 ms). Trace:
W20260709 12:10:38.049798 11219 rpcz_store.cc:269] 0709 12:10:36.486388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.631385 (+144997us) service_pool.cc:224] Handling call
0709 12:10:38.022191 (+1390806us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540035b954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:38.022268 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092558080}
I20260709 12:10:38.010218 13851 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.009766 13823 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.045849 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:38.049858 11217 rpcz_store.cc:269] 0709 12:10:36.487359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.898411 (+411052us) service_pool.cc:224] Handling call
0709 12:10:38.023555 (+1125144us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000127d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:38.023655 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329876864}
W20260709 12:10:38.045456 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 253208us
I20260709 12:10:38.060058 13812 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.062422 13707 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.065268 13707 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.065840 13707 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.066471 13707 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:38.066906 13707 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:38.067770 13707 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.045053 13865 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.072008 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1438) took 1587 ms. Trace:
I20260709 12:10:38.076978 13553 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.072816 11212 rpcz_store.cc:276] 0709 12:10:36.485007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.389874 (+904867us) service_pool.cc:224] Handling call
0709 12:10:37.390226 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:37.390584 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.390610 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:37.391184 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 12:10:37.491644 (+100460us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:38.026883 (+535239us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b180034f480. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf
0709 12:10:38.045625 (+ 18742us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.052099 (+  6474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.052190 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.052234 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:38.071783 (+ 19549us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.071955 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46586,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":320,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":185,"spinlock_wait_cycles":2963712,"thread_start_us":148514,"threads_started":2,"wal-append.queue_time_us":169040}
I20260709 12:10:38.086248 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:38.087385 11861 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:38.089238 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1725) took 1600 ms. Trace:
I20260709 12:10:38.089344 13614 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.089737 11215 rpcz_store.cc:276] 0709 12:10:36.504294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.321838 (+817544us) service_pool.cc:224] Handling call
0709 12:10:38.089031 (+767193us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540035a554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:38.089168 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985217280}
I20260709 12:10:38.090636 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:38.092124 13812 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.094323 11290 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:38.092839 13812 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.096298 13804 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.096369 13812 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.095510 13601 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.103703 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.094652 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.104674 11215 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.052065 13816 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.113436 13777 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:38.115386 13816 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.115577 13777 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:38.107434 13601 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.106719 13547 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:38.107416 13790 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.009s
W20260709 12:10:38.108688 13821 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.529s	user 0.004s	sys 0.007s
I20260709 12:10:38.109441 13615 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.110383 11210 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:38.123243 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1880) took 1558 ms. Trace:
I20260709 12:10:38.137838 11291 rpcz_store.cc:276] 0709 12:10:36.564681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.566277 (+  1596us) service_pool.cc:224] Handling call
0709 12:10:36.602324 (+ 36047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.352848 (+750524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.352877 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.352918 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:37.352946 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.122260 (+769314us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54000609d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:38.122311 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.122441 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725621632}
I20260709 12:10:38.139211 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.134378 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.140276 11288 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:38.141083 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:38.141659 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.142138 11215 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:38.142899 11259 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.994s (SENT)
I20260709 12:10:38.143312 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:38.148190 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.149219 11212 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.151737 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:38.152527 11291 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.153460 11215 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:38.154843 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.155723 11288 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:38.121169 13821 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.169958 11285 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:38.171778 11110 leader_election.cc:400] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3.
W20260709 12:10:38.169659 11259 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.070s (SENT)
I20260709 12:10:38.173548 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:38.174281 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.174983 11291 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:38.175105 11219 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:38.110325 13823 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.137547 13790 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.180369 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.115922 13777 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:38.172183 11110 leader_election.cc:403] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.152400 13685 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.147428 13712 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.188390 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.047363 13866 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 12:10:38.192672 13647 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.183745 13859 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.218973 11292 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:38.168821 13547 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.154364 13804 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.221568 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:38.222599 11215 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.105479 13289 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.224066 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:38.232060 11211 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:38.232369 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.226537 13860 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.240526 11214 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:38.241465 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.221246 13851 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 2. Current term is 3.
I20260709 12:10:38.222956 13648 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:38.248004 13648 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.224272 13790 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:38.252571 11217 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:38.253858 13717 consensus_meta.cc:287] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
I20260709 12:10:38.254443 13717 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.244112 13472 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.258023 13472 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.258594 13472 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.259582 13615 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.262893 13778 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:38.263470 13778 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:38.266621 13855 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:38.273223 13821 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.220286 13685 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.276162 13685 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.246313 13734 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.279472 13734 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:38.288250 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.292065 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.292549 11143 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:38.296428 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.296572 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.298770 11213 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.302343 11143 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:38.305851 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.306784 11139 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:38.308815 11210 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.309893 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.310694 11210 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:38.311676 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.312980 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.315047 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:38.319298 11210 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.324968 13837 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.325577 13837 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.326036 13837 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.327699 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.328435 11137 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:38.239965 13764 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:38.331566 11216 pending_rounds.cc:85] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 6
I20260709 12:10:38.332036 11216 pending_rounds.cc:107] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:38.332442 11216 raft_consensus.cc:2889] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:38.333127 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.333554 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:38.334303 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 151074us
I20260709 12:10:38.257252 13717 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.295660 13547 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:38.351023 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59017.5us
I20260709 12:10:38.363020 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.373170 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.374095 11142 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:38.304924 13595 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:10:38.381516 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.385468 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2191) took 1087 ms. Trace:
I20260709 12:10:38.347627 13614 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.367766 13734 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.367518 13764 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:38.397826 11137 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:38.398968 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.367336 13869 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.281921 13777 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.366648 13648 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.386090 11135 rpcz_store.cc:276] 0709 12:10:37.298072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.298208 (+   136us) service_pool.cc:224] Handling call
0709 12:10:38.385135 (+1086927us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400263c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:38.385374 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370213632}
I20260709 12:10:38.402235 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:38.378948 13855 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.368680 13866 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.342917 13749 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:38.400434 13823 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:38.418712 13815 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 12:10:38.438697 13855 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.442628 13866 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.445284 13866 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.420423 11139 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:38.442293 13855 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.448539 13764 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.450074 11142 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:38.423568 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.451542 11140 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:38.346926 13594 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:10:38.431425 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:38.371894 13547 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:38.435465 11143 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.435592 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:38.417603 13812 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.456422 11135 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.448982 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.437055 13869 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.421878 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.463567 11141 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:38.453568 13857 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.467077 13857 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.439164 13777 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.475878 13822 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:38.476344 13822 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:38.436641 13289 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.453322 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:38.436803 13830 consensus_meta.cc:287] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.000s
I20260709 12:10:38.480080 11140 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:38.484597 11135 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:38.487877 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:38.491564 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 402) took 2239 ms. Trace:
I20260709 12:10:38.492122 11136 rpcz_store.cc:276] 0709 12:10:36.251672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.419099 (+167427us) service_pool.cc:224] Handling call
0709 12:10:36.419373 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.426515 (+  7142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.426558 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.294189 (+1867631us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b2c000014c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:10:38.294659 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.453374 (+158715us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:38.453411 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.453512 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.481553 (+ 28041us) raft_consensus.cc:1685] finished
0709 12:10:38.481583 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.491470 (+  9887us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6727,"raft.queue_time_us":22339,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8417,"spinlock_wait_cycles":108091264,"thread_start_us":108707,"threads_started":1,"wal-append.queue_time_us":130245}
I20260709 12:10:38.515805 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:38.516732 11291 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.527340 13869 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:38.529582 13877 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:38.531562 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.532541 11290 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.533443 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:38.534050 11290 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.539958 13812 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:38.541944 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.477824 13822 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.543133 13822 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.542949 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.543958 11289 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
W20260709 12:10:38.546782 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.558459 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.558910 11290 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:38.560003 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:38.561542 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.563509 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:38.563661 13815 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:38.564281 11289 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.564172 13815 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.567660 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:38.564039 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.560621 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:38.570211 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:38.490355 13695 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:38.526499 13418 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.566344 13815 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:38.490880 13830 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.580019 13685 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.593632 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.584129 13614 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.615291 11213 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.583899 13695 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.615799 11289 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:38.559084 13837 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.635389 13844 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.635841 13844 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:38.622427 11287 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:38.623607 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.638321 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.590477 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:38.614892 13685 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.629796 11289 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:38.607342 13547 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.643465 11289 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:38.645337 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:38.645946 13690 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.646500 13690 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.640342 13837 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.643863 13685 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.648630 13690 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.648797 11293 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:38.639289 13614 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:38.598289 13418 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:38.661412 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71055.9us
I20260709 12:10:38.398640 11215 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:38.668573 11210 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:38.680341 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.681291 11215 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.681205 11291 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:10:38.682952 11258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.020s	sys 0.047s
W20260709 12:10:38.685509 11258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.020s	sys 0.047s
W20260709 12:10:38.686229 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 717710us
I20260709 12:10:38.687582 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:38.688730 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:38.667225 13690 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.693537 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:38.694770 13821 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:38.696797 13852 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.677484 13812 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.664510 13289 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:38.706635 13830 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.703948 13690 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.637962 13844 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.691118 13846 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.718706 13823 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.704555 13821 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.678020 13614 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.733945 13773 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:38.734278 13844 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:38.747773 13870 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.409s	user 0.002s	sys 0.001s
I20260709 12:10:38.756281 13857 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:38.808075 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.811869 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:38.813561 11136 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:38.813736 11141 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:38.816193 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:38.684509 11212 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
I20260709 12:10:38.843796 11212 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:38.843748 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:38.845518 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 195189us
I20260709 12:10:38.847136 11215 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:38.847563 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:38.848891 11213 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:38.848901 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:38.878978 13812 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.880123 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:38.883015 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.884059 11290 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.884155 11288 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:10:38.884866 13833 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.009s	sys 0.000s
W20260709 12:10:38.885432 13833 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.009s	sys 0.000s
I20260709 12:10:38.889303 13855 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:38.889922 13855 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:38.891067 13857 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:38.899191 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.905915 13712 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:38.907989 13712 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.908982 13418 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.762800 13825 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:38.910360 13825 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:38.912309 13825 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.913801 13859 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.723284 13472 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.916177 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:38.922520 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.924484 13859 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.927057 11218 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:38.929322 11137 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:38.929888 11137 pending_rounds.cc:85] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 2
I20260709 12:10:38.930246 11137 pending_rounds.cc:107] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:38.930836 11137 raft_consensus.cc:2889] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.922894 11217 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:38.923764 13894 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:10:38.923296 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.937593 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:38.939497 11143 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:10:38.947693 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 99019.9us
I20260709 12:10:38.913899 13825 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.970753 13695 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:38.973562 13472 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.976542 13897 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.001946 13897 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:39.003916 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.003711 13897 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.004902 11291 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.978935 13418 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.007645 13418 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:38.979866 13712 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:38.886309 13815 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:10:38.922727 13887 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.984309 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:38.986542 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 69455.6us
I20260709 12:10:39.004212 11290 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:38.977900 13776 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:39.031577 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47602.6us
I20260709 12:10:39.033119 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:39.033818 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.034418 13833 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:39.035583 13833 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.034998 13887 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:39.040755 13776 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.046252 13887 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:39.047245 11219 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.048828 13472 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:39.015775 13857 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:39.067742 13776 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.067503 13857 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.069250 11284 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.076480 11219 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.081540 13905 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:39.085119 11286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1464) took 1635 ms (client timeout 1923 ms). Trace:
W20260709 12:10:39.085587 11286 rpcz_store.cc:269] 0709 12:10:37.449845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.450017 (+   172us) service_pool.cc:224] Handling call
0709 12:10:39.084722 (+1634705us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540015c554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:39.084929 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920818048}
I20260709 12:10:39.082252 13905 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.089953 13812 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:39.091257 13905 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.091985 11210 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:10:39.093662 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:39.095300 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:39.096560 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:39.081343 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:39.118098 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.104578 13857 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.127449 11291 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:39.137672 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.130426 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.143664 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:39.141325 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.151300 11284 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:39.156222 13707 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:39.158529 13716 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:39.154351 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 121445us
I20260709 12:10:39.160835 13724 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:39.161257 13905 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.126848 13855 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.166306 13707 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:39.169972 13761 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.173826 13761 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.174762 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:39.175314 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54797us
I20260709 12:10:39.175745 11285 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:39.176534 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:39.174783 11290 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:39.170557 13823 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.184403 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:39.186900 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:39.170044 13724 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.194268 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.172571 13905 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:39.199774 13707 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.209990 13823 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:39.213397 13768 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.213999 13768 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.194762 13905 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.211324 13776 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:39.185443 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1863) took 2935 ms. Trace:
I20260709 12:10:39.214296 13707 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.215406 13768 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.221691 11284 rpcz_store.cc:276] 0709 12:10:36.236883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.236994 (+   111us) service_pool.cc:224] Handling call
0709 12:10:36.237274 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.431982 (+1194708us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b58002603d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830addb49 00007f9830ade416 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4
0709 12:10:39.067746 (+1635764us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b58005705d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830addb49 00007f9830ade416 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4
0709 12:10:39.164567 (+ 96821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.172176 (+  7609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71061632}
I20260709 12:10:39.212968 13823 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.182113 13778 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.221588 13472 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.250438 13472 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.251077 13472 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.257071 13859 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:39.258095 13859 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.245275 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1469) took 1171 ms. Trace:
I20260709 12:10:39.259479 11287 rpcz_store.cc:276] 0709 12:10:38.073833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.079961 (+  6128us) service_pool.cc:224] Handling call
0709 12:10:38.080308 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.636850 (+556542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.244719 (+607869us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540041a5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:39.245064 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245920640}
I20260709 12:10:39.248186 13695 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.260689 13755 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.261560 13859 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.261492 13755 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.249697 13902 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.262746 13906 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.296758 13906 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.297503 13755 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.297919 13690 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:39.299170 11182 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.440s (SENT) [suppressed 14 similar messages]
I20260709 12:10:39.300722 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.301538 11285 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.301878 13906 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.271366 13780 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.307844 13780 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:39.308622 13418 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.309070 13780 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.279181 11288 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:39.312361 13734 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.283355 11856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 653) took 3052 ms (client timeout 2440 ms). Trace:
I20260709 12:10:39.292384 11287 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:10:39.300835 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.293318 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.312613 13841 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:39.314261 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 99521.5us
I20260709 12:10:39.271145 13778 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:39.248987 13844 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.009s
I20260709 12:10:39.310272 13780 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:39.318563 11856 rpcz_store.cc:269] 0709 12:10:36.230933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.231106 (+   173us) service_pool.cc:224] Handling call
0709 12:10:39.282860 (+3051754us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540020f154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:39.283097 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3508173568}
I20260709 12:10:39.322700 13841 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:39.347167 11290 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:39.348722 13734 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:39.354584 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.354768 13418 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:39.357468 13559 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.357571 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:39.358240 13559 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.359302 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:39.360003 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:39.356559 13734 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.361142 13559 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.362982 13690 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.362880 13825 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:39.363840 13690 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.350021 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.352545 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.364393 13825 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:39.359324 13685 consensus_meta.cc:287] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.710s	user 0.016s	sys 0.007s
I20260709 12:10:39.374800 11856 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:39.375219 11856 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:39.375425 13690 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.375166 13685 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.376567 11856 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.366973 13825 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:39.379428 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1472) took 1297 ms. Trace:
I20260709 12:10:39.379851 13825 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.380005 11292 rpcz_store.cc:276] 0709 12:10:38.081487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.081596 (+   109us) service_pool.cc:224] Handling call
0709 12:10:38.081851 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.228651 (+146800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.378824 (+1150173us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003197d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:39.379183 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314783488}
I20260709 12:10:39.381716 13825 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.382396 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.384227 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:39.385679 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.387400 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.387925 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.388329 11143 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:39.389961 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.390776 11135 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:39.393692 11135 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:39.394236 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1450) took 1621 ms. Trace:
I20260709 12:10:39.394618 11214 rpcz_store.cc:276] 0709 12:10:37.773011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.773140 (+   129us) service_pool.cc:224] Handling call
0709 12:10:38.022277 (+249137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.240946 (+218669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.392915 (+1151969us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400295ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:39.393807 (+   892us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400295ed0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:39.394031 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070376960}
I20260709 12:10:39.398675 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.400740 13765 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.400868 13685 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.401562 13765 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.376579 11219 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:39.404162 13841 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.405874 13841 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.406024 13910 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.177s	user 0.000s	sys 0.004s
I20260709 12:10:39.359336 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:39.407884 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57983.9us
W20260709 12:10:39.408558 13878 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:39.408841 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.410040 13852 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.410857 13869 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.412598 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.410444 13852 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:39.413748 13852 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.414332 13761 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:39.416894 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.417709 11144 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.420679 11287 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.422062 13765 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.423108 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:39.424795 13734 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:39.425673 13685 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.445065 11289 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.446045 11861 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:39.429757 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 364) took 1100 ms. Trace:
I20260709 12:10:39.430459 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:39.444932 13906 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:39.378353 11856 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.414125 13418 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:39.426316 13911 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.291s	user 0.004s	sys 0.000s
I20260709 12:10:39.450758 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.446671 11217 rpcz_store.cc:276] 0709 12:10:38.273183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.286590 (+ 13407us) service_pool.cc:224] Handling call
0709 12:10:38.336137 (+ 49547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.935078 (+598941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.346113 (+411035us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540035be54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:39.372981 (+ 26868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345525504}
I20260709 12:10:39.428567 13768 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.453877 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.450392 13755 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.386425 13905 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.457980 13690 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:39.458613 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.459141 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.459890 11285 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.445245 13685 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:39.464704 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80609.9us
I20260709 12:10:39.469611 13685 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.501370 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.478160 13755 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:39.467283 13765 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:39.509100 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.510751 13897 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:39.511579 13897 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.514673 13906 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:39.514740 13908 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:39.518150 13908 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.518579 13908 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:39.519526 13908 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.520274 13724 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.521059 13908 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.522775 13844 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:39.524024 13765 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.526186 13765 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.506366 13690 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.528131 13472 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.528816 13690 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:39.530719 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.515683 13768 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.516170 13712 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.532657 11290 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:39.539238 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.540699 11144 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:39.541254 11285 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:10:39.545344 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50152.7us
W20260709 12:10:39.545814 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.546129 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:39.548812 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49384.6us
I20260709 12:10:39.552073 13582 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:39.553668 11286 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.536060 13712 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:39.542429 13905 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.570067 11856 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:39.542760 13472 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.530382 13852 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:39.575472 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.531509 13755 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:39.581307 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 282312us
I20260709 12:10:39.584748 13822 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:39.585343 13610 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:39.586679 13610 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.584786 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:39.591214 13914 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.362s	user 0.004s	sys 0.000s
I20260709 12:10:39.602000 11861 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:39.599120 13520 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.604859 13520 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:39.606232 13725 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.606745 13725 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:39.607790 13725 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.609269 13725 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.582185 13724 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.614842 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:39.619055 11856 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:39.606097 13520 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.625433 11139 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:10:39.625823 11139 pending_rounds.cc:85] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:10:39.626032 11139 pending_rounds.cc:107] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:10:39.626273 11139 raft_consensus.cc:2889] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.626163 13520 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.627779 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.600337 13768 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:39.631856 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.638808 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:39.635695 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:39.639516 11860 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.634933 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:39.638391 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.643723 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:39.644496 13905 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.645201 13905 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:39.646322 13905 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.647462 13897 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:39.649000 13902 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.649564 13902 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.650825 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:39.651770 13902 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:39.651913 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.652426 13902 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.653277 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:39.653095 13902 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.655011 11284 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.655679 11215 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.650866 13724 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:39.656994 13724 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.657356 13724 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:39.658018 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:39.658996 11217 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:39.659992 13712 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.661151 11214 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.661412 13712 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.662910 11211 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.640165 11219 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:39.668398 11860 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:39.671748 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:39.675046 13765 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.675577 13780 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.675685 13690 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:39.674974 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59308.9us
W20260709 12:10:39.676756 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 166280us
I20260709 12:10:39.676432 13780 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.677662 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.679584 11293 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:39.675750 13765 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.682667 13858 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.683270 11291 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.631379 13716 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.672506 13855 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:39.695380 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.657372 13790 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.704299 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:39.707756 11291 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:39.669142 13768 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:39.712986 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:39.676473 13690 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.692018 13823 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:39.706830 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.711761 13778 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.730127 11291 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:10:39.750937 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 73377.7us
I20260709 12:10:39.731770 13739 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:39.734071 13685 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.723542 13790 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.757418 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:39.706697 13716 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.764433 11291 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:39.747061 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 279796us
I20260709 12:10:39.725188 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:39.683243 13858 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.713742 13897 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:39.752296 11290 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:39.747836 13778 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.783890 11211 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:39.761183 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:39.728389 13823 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:39.805025 13690 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.805723 13823 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.807932 13716 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.810066 13816 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:39.810684 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.812819 13790 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:39.815341 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.816629 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:39.826274 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 68732.7us
I20260709 12:10:39.722239 13855 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.761372 13780 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.828890 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.836649 13778 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.838847 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.839668 11285 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:39.842552 13685 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.843138 13776 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:39.843382 13685 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:39.846102 13734 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:39.846782 13734 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:39.847290 11856 raft_consensus.cc:2410] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:39.848932 13734 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:39.761976 13894 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 12:10:39.850037 13724 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:39.850971 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.852669 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.852741 13724 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:39.854341 13919 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:10:39.822983 13852 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.822540 13765 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.856933 13855 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.861075 13858 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:39.861869 11825 connection.cc:256] RPC call timeout handler was delayed by -1.2869206380000833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24460000000000004s for a response
I20260709 12:10:39.829924 11290 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
W20260709 12:10:39.872007 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 197674us
I20260709 12:10:39.872430 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:39.873423 11291 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
W20260709 12:10:39.910673 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.914319 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.915350 11141 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:39.921679 11856 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.912300 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.926819 11137 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:39.974159 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.971753 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 407) took 1161 ms. Trace:
I20260709 12:10:39.975661 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:39.982026 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.982391 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.982831 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:39.983157 11135 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.983894 13842 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:39.983995 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.984855 13842 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:39.985015 13765 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:39.985558 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.985733 13765 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.924499 13858 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.986272 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:39.986670 13767 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:39.987061 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:39.986949 13858 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:39.987594 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.988440 11140 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:39.983793 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:39.989276 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.929544 13902 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:39.977699 11139 rpcz_store.cc:276] 0709 12:10:38.799069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.807484 (+  8415us) service_pool.cc:224] Handling call
0709 12:10:38.808487 (+  1003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.678947 (+870460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.959804 (+280857us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400253ad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:39.960130 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857625344}
I20260709 12:10:39.986163 11138 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:39.990168 13852 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.989212 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:40.000674 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.001829 11856 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:40.002974 11140 raft_consensus.cc:2410] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:39.983909 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.990093 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:39.983762 11854 raft_consensus.cc:2368] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:39.972199 13816 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:40.003129 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:40.012898 13289 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.009548 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:40.014842 11859 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.017680 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.018901 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:39.989871 13765 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:39.989321 13858 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:40.019897 11138 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.020731 11142 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:40.018939 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 305964us
I20260709 12:10:39.999310 13852 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:40.041158 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.044548 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:40.017331 13841 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.005s
I20260709 12:10:40.053403 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.050231 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.056921 11287 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.053995 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:40.065531 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:40.046319 13852 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.068854 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.070053 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:40.074942 13816 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.078809 13855 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.079948 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:40.086675 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.087267 11140 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:40.095377 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:39.986146 13842 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.097301 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:40.099280 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 303468us
I20260709 12:10:40.100147 11142 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:40.062119 13289 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.102443 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.105228 11140 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.104791 11138 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:40.110666 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:40.049222 13768 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.124799 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:40.127864 13894 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.128684 13894 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.133888 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:40.134445 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:40.135417 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.134769 11142 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:40.109066 13902 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:40.140291 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.140942 11214 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:40.141772 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.141016 11211 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
W20260709 12:10:40.147820 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.149489 11142 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:40.161547 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.161469 11135 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:40.164291 11135 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.164691 11138 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:40.133436 13536 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:10:40.166364 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.225960 11142 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:40.140311 13855 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:40.238283 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.240324 11135 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:40.246361 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:40.157481 13902 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.140096 13289 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:40.251166 13911 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:40.264438 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:40.250764 13823 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.269316 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:40.279860 11215 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.280599 13559 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.281056 13559 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:40.279907 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.284071 11211 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:40.282033 13559 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.257764 13858 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:40.290619 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.299140 11211 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:40.299274 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.299990 11214 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:40.305053 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.274840 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.316828 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.318651 13852 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.331624 13633 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:40.336117 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:40.337438 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:40.332068 13942 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:10:40.339186 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:40.342173 11140 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:40.289274 13858 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:40.321895 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:40.321146 13852 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:40.328213 13894 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:40.343456 13825 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.328018 13780 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:10:40.395891 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.342868 13755 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.409999 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 88170.1us
I20260709 12:10:40.303283 13823 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.302199 13778 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:10:40.379478 13685 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:40.398965 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59848.4us
I20260709 12:10:40.412001 11857 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:40.379698 13765 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:40.391541 13858 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.416065 13935 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:40.417292 13938 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.418612 13755 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.418862 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:40.420128 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:40.404673 13841 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.427218 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:40.380136 13790 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:40.432698 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:40.419855 13633 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:40.438949 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:40.441982 13945 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:10:40.444073 13289 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:40.445379 13902 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:40.446229 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:40.452507 11215 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:40.463330 11287 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:40.460347 13582 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:40.467150 13582 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.467486 13582 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:40.468456 13582 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.469956 13582 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.470510 13289 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:40.473666 13289 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.450762 13633 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.474793 13633 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.470999 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.450631 13520 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:40.479023 13289 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:40.479418 13520 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:40.479944 13520 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.481734 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:40.471150 13610 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.483239 11138 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:40.483253 13610 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:40.484822 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:40.471417 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.486898 11138 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:40.439646 13472 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.490294 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:40.491811 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:40.428208 13765 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:40.498716 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 72804.5us
I20260709 12:10:40.428223 13825 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:40.529948 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.530141 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44038.9us
I20260709 12:10:40.440032 13841 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.531239 11138 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:40.534107 11138 pending_rounds.cc:85] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:10:40.534354 11138 pending_rounds.cc:107] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:40.534611 11138 raft_consensus.cc:2889] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.531596 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:40.484925 13610 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.519201 13289 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.540755 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:40.543085 11859 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.001s
I20260709 12:10:40.543849 11859 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:40.520632 13776 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.551354 11215 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.552275 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.551393 11213 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:40.550652 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 108743us
I20260709 12:10:40.563905 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.567005 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.571461 11144 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:40.575834 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.576037 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:40.577858 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.579285 11219 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:40.579746 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.578235 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.576546 11290 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:40.582042 11285 raft_consensus.cc:2410] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:40.562839 13936 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.581647 11289 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:40.585013 11214 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:40.569312 13776 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:40.589229 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:40.576575 13712 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.912s	user 0.009s	sys 0.007s
I20260709 12:10:40.598032 11286 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:40.599912 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:40.599978 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.604072 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.606349 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:40.633004 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.658643 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58858.2us
I20260709 12:10:40.657984 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.587831 13610 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.586503 13936 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:40.591054 13780 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.677577 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.681396 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:40.686980 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 137023us
I20260709 12:10:40.662981 13712 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:40.698349 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.665190 13778 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.664338 13816 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.685662 13780 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.683490 13936 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.691128 13897 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.719384 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:40.721467 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 155641us
I20260709 12:10:40.682682 13902 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:40.702046 13712 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:40.703114 13778 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:40.722213 13536 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.736986 13536 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.737107 13958 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:40.738004 13765 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:40.737478 13536 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.724115 13780 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.743105 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:40.753315 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:40.724675 13823 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:40.734596 13712 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.814600 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:40.799456 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56992.4us
I20260709 12:10:40.758885 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:40.755035 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 82035.2us
I20260709 12:10:40.730134 13755 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:40.823158 11218 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.824363 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.754411 13825 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:40.736510 13778 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:40.800973 13953 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:10:40.828564 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.738623 13765 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:10:40.835043 11042 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.739055 13959 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:10:40.818348 13841 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:40.841851 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.843817 13790 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.854583 13852 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.810788 13816 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.859874 13633 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:40.884872 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.865514 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:40.862215 13520 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.805567 13776 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.752276 13897 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.818805 13418 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:40.882346 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.879633 13825 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.884632 13841 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.895457 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.896303 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.896968 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:40.897436 13816 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.874531 13755 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:40.805917 13964 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:10:40.887254 13852 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:40.884138 13790 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:40.913179 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.920132 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.924523 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.924309 13536 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.925748 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:40.907697 13962 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:10:40.926651 13955 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:40.927284 11210 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:40.963270 11217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:40.928318 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:40.964013 11217 raft_consensus.cc:606] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:40.964162 11212 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:40.964370 11217 raft_consensus.cc:614] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:40.966614 11210 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:40.932315 13936 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:40.933516 13823 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:40.933822 13768 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:40.935019 13790 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.908217 13961 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.940081 13957 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:40.941810 13712 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.908301 13801 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:40.944343 13858 consensus_meta.cc:287] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 12:10:40.945688 13536 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:40.946564 13765 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:40.904510 13902 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:10:40.909137 13952 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260709 12:10:40.948813 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.948465 13418 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.913936 13755 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.950103 13852 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.952099 13897 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:40.953110 13633 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:40.956604 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:40.984728 13801 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.911957 13841 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:40.966784 13842 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.930857 13972 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:40.974248 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 177175us
I20260709 12:10:40.905885 13825 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.980160 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:40.978899 13582 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.001s
I20260709 12:10:41.005868 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.022825 11287 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:41.023777 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.046548 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:41.049937 11216 raft_consensus.cc:606] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:41.050369 11216 raft_consensus.cc:614] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.012359 13967 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.994551 13931 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.841s	user 0.000s	sys 0.008s
I20260709 12:10:41.009447 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:41.055522 11285 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:40.993482 13946 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.050s	user 0.003s	sys 0.000s
I20260709 12:10:41.015785 11293 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.016434 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:41.018285 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 124668us
I20260709 12:10:40.983217 13961 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:41.021577 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 285871us
W20260709 12:10:41.006847 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 141930us
W20260709 12:10:41.051452 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45673.2us
I20260709 12:10:41.063303 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:40.993683 13858 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.069492 13559 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.072465 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.021950 13801 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.049244 13790 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.022900 13842 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:41.078532 13975 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.078608 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:41.079831 11293 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:41.080008 13755 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:41.081106 13936 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:41.048947 13778 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.084013 11861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 671) took 1432 ms. Trace:
I20260709 12:10:41.102662 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:41.103875 11288 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.084681 13816 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.082656 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:41.090339 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.051167 13825 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.089210 13520 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:41.101727 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.082528 13712 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.050302 13972 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:41.095218 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.059038 13289 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:41.127765 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.128189 11137 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.076962 13852 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.119951 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.121740 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:41.122758 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:41.064468 13961 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.019757 13765 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.127229 11135 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.122396 11142 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
W20260709 12:10:41.117827 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50369us
I20260709 12:10:41.129402 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2225) took 1205 ms. Trace:
I20260709 12:10:41.139144 11290 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:41.139262 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:41.139182 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:41.101269 13908 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.141549 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.116907 13959 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.102350 11861 rpcz_store.cc:276] 0709 12:10:39.651078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.651244 (+   166us) service_pool.cc:224] Handling call
0709 12:10:39.651606 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.670297 (+ 18691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:39.670341 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:39.699133 (+ 28792us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.930276 (+231143us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:39.930321 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.930402 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.958766 (+1028364us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:41.083683 (+124917us) raft_consensus.cc:1685] finished
0709 12:10:41.083708 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.083930 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25705,"raft.queue_time_us":18885,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":191622528,"thread_start_us":205504,"threads_started":1,"wal-append.queue_time_us":372373}
I20260709 12:10:41.066532 13967 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.151219 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:41.164674 11215 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.151446 11135 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:41.152958 13858 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:41.126325 13972 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.154436 11288 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:41.154670 13974 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.155408 13842 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.156325 13755 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:41.173659 13822 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:41.173664 13755 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.176153 13755 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:41.157466 13765 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:41.157990 13712 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:41.159840 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 105103us
I20260709 12:10:41.137068 11141 rpcz_store.cc:276] 0709 12:10:39.923880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.978391 (+ 54511us) service_pool.cc:224] Handling call
0709 12:10:39.999865 (+ 21474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.007138 (+  7273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.007168 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.039386 (+ 32218us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.142603 (+103217us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:40.165823 (+ 23220us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.166127 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.166214 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.284803 (+118589us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b180036f220. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:40.942917 (+658114us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b180036f220. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:41.129177 (+186260us) raft_consensus.cc:1685] finished
0709 12:10:41.129201 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.129345 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23062,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2891,"raft.queue_time_us":1361,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":28004,"spinlock_wait_cycles":11856512,"thread_start_us":77899,"threads_started":1,"wal-append.queue_time_us":197714}
I20260709 12:10:41.163743 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.172502 11288 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.154175 13978 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:10:41.191648 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.192193 11214 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.198886 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.201903 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.203882 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.204093 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:41.125483 13975 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.211889 11289 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.187882 11215 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:41.189284 13858 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.215322 13982 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.210469 13712 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.201776 13958 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:41.201202 13908 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.210328 13633 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.239123 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:41.239689 13961 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.241077 13778 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.242141 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.255587 11292 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:41.245477 13981 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:41.246335 13841 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:41.222035 13801 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:41.249881 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.255932 11288 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:41.256609 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:41.198060 13974 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:41.261922 11293 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.262866 11289 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:10:41.265252 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.267810 11288 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:41.201705 13959 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:41.256167 13418 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.270040 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:41.197700 13765 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:10:41.273341 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.280956 13768 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.281399 13768 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.281788 13768 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.283797 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.284300 13967 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:41.259730 13981 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:41.284865 13965 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.285689 13981 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.287009 13981 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.255810 13958 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:41.290952 13778 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.291596 13958 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.291672 13778 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.293956 13958 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:41.263696 13908 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.295636 13778 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.296479 13908 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.284539 11861 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:41.298017 13780 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.004s
I20260709 12:10:41.262796 13974 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.298506 13780 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.298933 13974 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:41.300781 13780 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:41.302263 13944 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:41.304889 13971 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:41.292336 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:41.307025 11292 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.308007 13935 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:41.308343 13894 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:41.250617 13536 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.314841 11861 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:41.319687 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.312276 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:41.261484 13978 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:41.323817 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.328253 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:41.329303 13971 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.329797 13971 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.330582 13610 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.331228 13610 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:41.331935 13971 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.332219 13610 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.333027 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.334923 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:41.335304 13822 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:41.337227 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.338368 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.339015 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:41.339541 11856 raft_consensus.cc:2368] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:41.311906 13961 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:41.340873 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.324596 13536 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.348065 11860 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:41.353417 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:41.354080 11291 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:41.356171 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:41.356840 11215 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:41.348824 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:41.357781 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:41.358875 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:41.359866 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:41.360337 11215 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.360481 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:41.361469 11285 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:41.362849 13765 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:41.363422 13765 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:41.364487 13765 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:41.353441 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:41.375905 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.376870 11861 raft_consensus.cc:2368] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:41.377640 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.378422 11856 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:41.282333 13801 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:41.383932 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:41.386158 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62446us
I20260709 12:10:41.391130 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:41.392151 11859 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:41.389015 11182 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:41.380995 13695 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.395622 11214 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:41.397655 11856 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:41.384466 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:41.375587 13965 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.444063 13780 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.444963 13780 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.446976 11852 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:41.449666 13966 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.697s	user 0.003s	sys 0.000s
I20260709 12:10:41.451068 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2238) took 1431 ms. Trace:
I20260709 12:10:41.451426 11140 rpcz_store.cc:276] 0709 12:10:40.019589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.396228 (+376639us) service_pool.cc:224] Handling call
0709 12:10:40.396614 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.546263 (+149649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.546298 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.547480 (+  1182us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.605774 (+ 58294us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:40.605820 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.605940 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.448835 (+842895us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:41.450738 (+  1903us) raft_consensus.cc:1685] finished
0709 12:10:41.450763 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.451006 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14052,"raft.queue_time_us":26700,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3007744,"thread_start_us":154042,"threads_started":2,"wal-append.queue_time_us":128895}
W20260709 12:10:41.456995 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72632.2us
I20260709 12:10:41.398463 13472 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:41.329814 13418 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:10:41.477464 11292 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
W20260709 12:10:41.486178 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.468169 11215 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:41.390125 13816 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:41.478848 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:41.381832 13935 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:10:41.381178 13961 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:10:41.518719 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.381716 13289 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 12:10:41.524169 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.527151 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:41.527979 11137 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.529654 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.350948 13978 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.474367 13897 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.543637 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:41.546938 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 69912.3us
I20260709 12:10:41.509774 13938 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:41.619681 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.751609 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.544257 11861 raft_consensus.cc:2376] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7. Re-sending same reply.
I20260709 12:10:41.522548 13965 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.621644 11143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2229) took 1549 ms (client timeout 1695 ms). Trace:
I20260709 12:10:41.706347 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.550004 13897 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.748286 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.523046 13739 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:41.708142 13955 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:10:41.768702 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:41.760277 11143 rpcz_store.cc:269] 0709 12:10:39.991842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.003732 (+ 11890us) service_pool.cc:224] Handling call
0709 12:10:41.541274 (+1537542us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54001248d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:41.541421 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327635712}
W20260709 12:10:41.704187 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.547451 13967 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:41.815140 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:41.768102 13969 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.568s	user 0.003s	sys 0.005s
I20260709 12:10:41.945274 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:41.942467 11214 raft_consensus.cc:2376] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5. Re-sending same reply.
I20260709 12:10:41.791999 13897 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.539408 13972 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:41.624477 13970 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.326s
I20260709 12:10:41.964102 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:41.964803 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 195516us
I20260709 12:10:41.748569 13902 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:41.623939 13937 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.314s
W20260709 12:10:41.939532 13768 consensus_meta.cc:287] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.005s
I20260709 12:10:41.752561 13938 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:41.983330 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.944522 13841 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.986742 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:41.989609 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.992008 11135 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:41.992937 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.955339 13472 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:41.954383 13755 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.016743 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:42.020056 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.790882 13965 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.025390 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:42.026935 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:42.027621 11141 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.983065 13536 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.029978 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:41.990932 13938 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:42.053668 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.995690 13633 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.994722 13973 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.973135 13967 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:41.991605 13975 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.081245 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1754) took 1611 ms. Trace:
I20260709 12:10:42.028256 11135 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
W20260709 12:10:42.082551 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107500us
I20260709 12:10:42.089267 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:42.097949 11135 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.099184 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:41.991133 13768 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.163858 11861 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:42.297362 11143 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:42.044060 13755 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.168911 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:42.169340 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.170468 13978 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.081282 13973 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.172636 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.174750 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:42.179383 13999 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
W20260709 12:10:42.180227 13996 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
W20260709 12:10:42.181052 13997 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 12:10:42.182018 13991 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:10:42.181623 13897 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.183257 13972 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:42.184309 13995 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
W20260709 12:10:42.184710 13993 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.562s	user 0.001s	sys 0.000s
I20260709 12:10:42.099658 13975 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.019822 13841 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.190084 13956 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.019605 13902 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.083149 13780 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:42.196048 11137 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.000s
I20260709 12:10:42.196632 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:42.335285 11214 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.081704 11211 rpcz_store.cc:276] 0709 12:10:40.469700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.487801 (+ 18101us) service_pool.cc:224] Handling call
0709 12:10:40.526647 (+ 38846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.546352 (+ 19705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.546399 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.575875 (+ 29476us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.723126 (+147251us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:40.723183 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.723262 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.952371 (+229109us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b24000fd8c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2d09d 00007f983065f10e 00007f983067688c 00007f9830675bb6 00007f98306757d8 00007f983067f221
0709 12:10:41.436857 (+484486us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b2000044c78. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830689b91 00007f98306aba19 00007f98306768c3 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169 00007f983067f131 00007f983067e42d 0000000000388634
0709 12:10:42.081026 (+644169us) raft_consensus.cc:1685] finished
0709 12:10:42.081050 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.081185 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10703,"raft.queue_time_us":11279,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":19770,"spinlock_wait_cycles":23802624,"thread_start_us":56818,"threads_started":1,"wal-append.queue_time_us":305128}
I20260709 12:10:42.192663 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1496) took 1100 ms. Trace:
W20260709 12:10:42.200798 13948 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.792s	user 0.000s	sys 0.004s
I20260709 12:10:42.201689 14006 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.202282 13790 consensus_meta.cc:287] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.082s	user 0.011s	sys 0.000s
I20260709 12:10:42.203048 11138 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.204226 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:42.207618 13998 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:10:42.212212 13938 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.213109 13472 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.213459 13971 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:42.199316 13974 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.900s	user 0.010s	sys 0.001s
I20260709 12:10:42.079424 13633 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:42.228540 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.352264 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:42.228221 13536 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.238615 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.236364 13825 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.092s	user 0.005s	sys 0.005s
I20260709 12:10:42.276659 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.271586 14007 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:42.283946 11210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.005s	sys 0.003s
W20260709 12:10:42.286165 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 346699us
W20260709 12:10:42.359710 11210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.005s	sys 0.003s
W20260709 12:10:42.281852 13981 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.994s	user 0.010s	sys 0.002s
I20260709 12:10:42.057049 13855 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.299911 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.300742 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.006s	sys 0.005s
I20260709 12:10:42.366279 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:42.366788 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.006s	sys 0.005s
W20260709 12:10:42.367410 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 909593us
I20260709 12:10:42.367029 11211 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
W20260709 12:10:42.285980 13994 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.247s	user 0.003s	sys 0.000s
I20260709 12:10:42.306582 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.303171 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.285053 13801 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.313167 11216 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:42.316702 13967 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.298589 13965 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.330776 11141 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
W20260709 12:10:42.325891 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.002s	sys 0.011s
W20260709 12:10:42.376001 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.003s	sys 0.012s
W20260709 12:10:42.376575 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 987566us
W20260709 12:10:42.341063 11213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.015s	sys 0.038s
W20260709 12:10:42.395713 11213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.016s	sys 0.038s
I20260709 12:10:42.334794 11137 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:42.296025 13739 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:42.336246 11212 rpcz_store.cc:276] 0709 12:10:41.092319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.092459 (+   140us) service_pool.cc:224] Handling call
0709 12:10:41.092950 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.095976 (+  3026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.096015 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.130388 (+ 34373us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.372191 (+241803us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:41.372234 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.372307 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.192355 (+820048us) raft_consensus.cc:1685] finished
0709 12:10:42.192386 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.192576 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5811,"raft.queue_time_us":8312,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9141,"thread_start_us":221347,"threads_started":1,"wal-append.queue_time_us":930238}
I20260709 12:10:42.399957 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:42.326602 13894 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:42.331319 13956 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:42.342928 11855 raft_consensus.cc:2368] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:42.408480 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:42.353045 11287 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:42.410111 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1969) took 1055 ms. Trace:
I20260709 12:10:42.367424 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1516) took 1294 ms. Trace:
I20260709 12:10:42.368350 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:42.372627 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.373378 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 369) took 2244 ms. Trace:
I20260709 12:10:42.397558 11135 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.400700 11141 raft_consensus.cc:2376] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6. Re-sending same reply.
I20260709 12:10:42.398957 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.404323 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 458) took 1227 ms. Trace:
I20260709 12:10:42.332103 13975 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.406034 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:42.416898 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48696.4us
I20260709 12:10:42.412921 11219 rpcz_store.cc:276] 0709 12:10:40.121028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.121175 (+   147us) service_pool.cc:224] Handling call
0709 12:10:40.141202 (+ 20027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.584342 (+443140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.365317 (+1780975us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540035a554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:42.365487 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000447232}
I20260709 12:10:42.420601 11858 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:42.410634 11285 rpcz_store.cc:276] 0709 12:10:41.354291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.362175 (+  7884us) service_pool.cc:224] Handling call
0709 12:10:41.362592 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.362984 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.363020 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.363630 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.371181 (+  7551us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:41.371240 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.371350 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.409853 (+1038503us) raft_consensus.cc:1685] finished
0709 12:10:42.409881 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.410039 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4662,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":7040,"threads_started":1,"wal-append.queue_time_us":92203}
W20260709 12:10:42.416460 11107 leader_election.cc:336] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.100s (SENT)
I20260709 12:10:42.427580 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:42.356117 13971 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.358209 13974 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.412139 11286 rpcz_store.cc:276] 0709 12:10:41.072530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.072692 (+   162us) service_pool.cc:224] Handling call
0709 12:10:41.105221 (+ 32529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.118055 (+ 12834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.118112 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.119749 (+  1637us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.266433 (+146684us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:41.266602 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.266744 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.367230 (+1100486us) raft_consensus.cc:1685] finished
0709 12:10:42.367252 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.367367 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1141,"raft.queue_time_us":23270,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":27475,"thread_start_us":110830,"threads_started":1,"wal-append.queue_time_us":551015}
I20260709 12:10:42.438966 11212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:42.413985 11290 rpcz_store.cc:276] 0709 12:10:41.176820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.176973 (+   153us) service_pool.cc:224] Handling call
0709 12:10:41.177337 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.177756 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.177796 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.178444 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.204909 (+ 26465us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:41.204953 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.205027 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.404129 (+1199102us) raft_consensus.cc:1685] finished
0709 12:10:42.404146 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.404262 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6495,"raft.queue_time_us":2912,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5389,"spinlock_wait_cycles":16768,"thread_start_us":25946,"threads_started":1,"wal-append.queue_time_us":142244}
I20260709 12:10:42.345186 14006 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.443558 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:42.407341 13981 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:42.441543 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:42.403369 13780 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.445094 11141 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:42.366364 13825 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.361511 13536 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.406705 13967 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:42.441602 11212 raft_consensus.cc:606] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:42.488407 11212 raft_consensus.cc:614] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.442801 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:42.445896 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:42.416500 13823 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.439549 11854 consensus_meta.cc:287] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 1.049s	user 0.009s	sys 0.003s
W20260709 12:10:42.446151 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 92544.2us
I20260709 12:10:42.419878 13894 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.377252 13801 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.428481 13936 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.395358 13855 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.478894 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2227) took 2489 ms. Trace:
I20260709 12:10:42.424137 13289 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.370908 14007 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.479317 13973 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.445241 13755 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.507083 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1763) took 1416 ms. Trace:
I20260709 12:10:42.521968 11219 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:42.522871 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:42.525972 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:42.527532 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 124221us
I20260709 12:10:42.544349 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:42.543156 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:42.544876 11856 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.456472 14015 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:42.532603 11256 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.654s (SENT)
W20260709 12:10:42.540128 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52928.6us
I20260709 12:10:42.552032 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.463120 13981 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.540639 11042 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 1 to 4, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:42.439795 14021 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:10:42.528646 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:42.554610 11287 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.542984 11218 rpcz_store.cc:276] 0709 12:10:41.091115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.091278 (+   163us) service_pool.cc:224] Handling call
0709 12:10:41.121400 (+ 30122us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:41.142929 (+ 21529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.142963 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:41.201459 (+ 58496us) log.cc:844] Serialized 78 byte log entry
0709 12:10:41.383545 (+182086us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:41.384041 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.384137 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.506808 (+1122671us) raft_consensus.cc:1685] finished
0709 12:10:42.506835 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.507017 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":590,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6299,"thread_start_us":133129,"threads_started":1,"wal-append.queue_time_us":600651}
I20260709 12:10:42.440589 14020 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 12:10:42.530259 13936 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.522034 11854 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:42.577435 11856 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:42.532159 11136 rpcz_store.cc:276] 0709 12:10:39.967911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.125156 (+157245us) service_pool.cc:224] Handling call
0709 12:10:40.125608 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.126419 (+   811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.126462 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.127132 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.163975 (+ 36843us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:40.839365 (+675390us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b180017b960. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf
0709 12:10:40.839526 (+   161us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.978785 (+139259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.978902 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.200060 (+1221158us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:42.456805 (+256745us) raft_consensus.cc:1685] finished
0709 12:10:42.456830 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.456968 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1758,"prepare.queue_time_us":87993,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":72099,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":11147,"spinlock_wait_cycles":6397568,"thread_start_us":244841,"threads_started":3,"wal-append.queue_time_us":177771}
I20260709 12:10:42.589543 11292 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:42.579182 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:42.590174 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 494712us
I20260709 12:10:42.579603 11219 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.591195 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.592330 11182 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:42.592754 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.580838 11288 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:42.582610 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:42.584620 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.478601 13780 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.595165 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.566708 13755 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.595139 11290 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.507962 14012 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:10:42.547889 13897 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.650835 11144 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:10:42.651295 11144 pending_rounds.cc:85] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 6
I20260709 12:10:42.651535 11144 pending_rounds.cc:107] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:10:42.651787 11144 raft_consensus.cc:2889] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:42.615552 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:42.605485 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 712) took 1143 ms. Trace:
I20260709 12:10:42.655164 11859 rpcz_store.cc:276] 0709 12:10:41.452301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.510728 (+ 58427us) service_pool.cc:224] Handling call
0709 12:10:42.584427 (+1073699us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:42.595705 (+ 11278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32023936}
I20260709 12:10:42.522694 13823 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.664829 13823 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.489514 13967 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.667733 13967 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.668853 13967 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.581357 13936 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.674671 11285 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.680460 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 705) took 1338 ms. Trace:
I20260709 12:10:42.681063 11855 rpcz_store.cc:276] 0709 12:10:41.342230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.351332 (+  9102us) service_pool.cc:224] Handling call
0709 12:10:42.172412 (+821080us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:42.680129 (+507717us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540050a854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:42.680368 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35452544}
I20260709 12:10:42.568639 14007 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.630125 13776 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:42.682641 14007 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.682670 13776 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.683290 14007 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.685182 13776 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.685287 14007 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.686856 11858 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:42.697963 13992 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.999s	user 0.000s	sys 0.003s
I20260709 12:10:42.700032 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:42.605546 14021 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:42.710824 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:42.716065 11136 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
W20260709 12:10:42.716621 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.605274 14015 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:42.713446 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 180875us
I20260709 12:10:42.547317 13289 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.604820 14023 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.617810 13902 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.649199 13938 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.564334 13739 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:42.694308 13768 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.649362 14029 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.532363 13956 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.741210 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.713949 13841 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.746460 11285 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:42.720873 13776 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:42.713027 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.731942 14023 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.781985 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1956) took 1646 ms. Trace:
I20260709 12:10:42.726387 13970 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:42.730413 13536 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.726889 14021 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:42.797801 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:42.748154 14017 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:10:42.775331 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 159358us
I20260709 12:10:42.782665 11293 rpcz_store.cc:276] 0709 12:10:41.135919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.137018 (+  1099us) service_pool.cc:224] Handling call
0709 12:10:41.155624 (+ 18606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.263045 (+107421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.781635 (+1518590us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000622d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:42.781904 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243582720}
W20260709 12:10:42.785328 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 61417.8us
I20260709 12:10:42.804422 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:42.785472 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 190405us
I20260709 12:10:42.723726 14014 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:10:42.771724 14011 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:42.789876 14022 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:42.790227 13289 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.750167 13633 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.753610 14029 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.741511 13897 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:42.773622 13776 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:42.817294 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.817893 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 384) took 1005 ms. Trace:
I20260709 12:10:42.821621 13902 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:42.786367 13975 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.787487 13956 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.822443 11291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "809626de5a674cba911a83815f1e05ca"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:10:42.844679 11291 raft_consensus.cc:606] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:42.845072 11291 raft_consensus.cc:614] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.783983 14023 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.797586 13768 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.806955 14006 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.837275 11290 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:42.837960 11214 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:42.857146 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 381) took 1157 ms. Trace:
I20260709 12:10:42.802454 13841 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.843884 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:42.832525 11212 rpcz_store.cc:276] 0709 12:10:41.812072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.541013 (+728941us) service_pool.cc:224] Handling call
0709 12:10:42.541338 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.541581 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:42.620344 (+ 78763us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.817313 (+196969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:42.817372 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:42.817623 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.817714 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.817833 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":205501,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":3434,"raft.queue_time_us":8200,"thread_start_us":275080,"threads_started":2}
I20260709 12:10:42.852906 11287 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:42.788587 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:42.857760 11214 rpcz_store.cc:276] 0709 12:10:41.699760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.196354 (+496594us) service_pool.cc:224] Handling call
0709 12:10:42.857056 (+660702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:42.843900 14014 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.844187 13776 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.842957 14007 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.842774 13971 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:42.870258 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64700.7us
I20260709 12:10:42.876012 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.826195 14029 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.846617 13825 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:42.824843 11853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 710) took 1373 ms (client timeout 1614 ms). Trace:
W20260709 12:10:42.883489 11256 leader_election.cc:336] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.614s (SENT)
I20260709 12:10:42.883921 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.875351 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1495) took 1783 ms. Trace:
I20260709 12:10:42.854736 13801 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:42.872728 13894 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:42.880504 14018 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 12:10:42.880873 14037 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.824572 14011 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:42.886900 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83903.4us
I20260709 12:10:42.874274 13981 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:42.871397 13975 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.872972 13855 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:42.911402 11256 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.897s (SENT)
I20260709 12:10:42.951020 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.916054 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 426) took 1212 ms. Trace:
I20260709 12:10:42.871961 14014 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:42.920020 14037 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.885098 11217 rpcz_store.cc:276] 0709 12:10:41.091984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.092133 (+   149us) service_pool.cc:224] Handling call
0709 12:10:41.121333 (+ 29200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.174893 (+ 53560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.174938 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.171866 (+996928us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:10:42.172385 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.368751 (+196366us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.368804 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.368876 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.870234 (+501358us) raft_consensus.cc:1685] finished
0709 12:10:42.870266 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.875252 (+  4986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9326,"raft.queue_time_us":18157,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4462,"spinlock_wait_cycles":14424320,"thread_start_us":195887,"threads_started":1,"wal-append.queue_time_us":284493}
W20260709 12:10:42.882637 11853 rpcz_store.cc:269] 0709 12:10:41.451711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.455107 (+  3396us) service_pool.cc:224] Handling call
0709 12:10:42.564828 (+1109721us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:42.824033 (+259205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59240704}
I20260709 12:10:42.858191 13768 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:42.926995 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51082.4us
I20260709 12:10:42.959344 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.928270 14027 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:42.929481 14031 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:10:42.930294 14032 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:10:42.931159 14030 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:10:42.939647 14026 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:42.940588 13780 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:42.945067 14000 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.879s	user 0.001s	sys 0.001s
W20260709 12:10:42.946694 11854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 700) took 1615 ms (client timeout 1992 ms). Trace:
W20260709 12:10:42.947820 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.951807 11143 rpcz_store.cc:276] 0709 12:10:41.703424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.304705 (+601281us) service_pool.cc:224] Handling call
0709 12:10:42.308636 (+  3931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.308836 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.308863 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.313686 (+  4823us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.455729 (+142043us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:42.455788 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.455896 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.915852 (+459956us) raft_consensus.cc:1685] finished
0709 12:10:42.915871 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.915992 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":140752,"threads_started":1,"wal-append.queue_time_us":252693}
I20260709 12:10:42.953096 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:42.923233 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1502) took 1568 ms. Trace:
I20260709 12:10:42.891314 13841 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:42.889174 14040 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.974241 13972 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.975682 13633 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.977841 14011 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.981045 13974 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.982681 13975 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.886695 14007 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.947346 14021 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:42.984081 14013 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
W20260709 12:10:42.968713 11854 rpcz_store.cc:269] 0709 12:10:41.331430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.338689 (+  7259us) service_pool.cc:224] Handling call
0709 12:10:42.946450 (+1607761us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b54006e0354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:42.946623 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6764928}
I20260709 12:10:43.000669 13633 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.963488 13981 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.985198 14037 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:43.008460 13633 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:42.986096 11215 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.982028 14023 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.010936 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 379) took 1462 ms. Trace:
I20260709 12:10:43.011437 11215 rpcz_store.cc:276] 0709 12:10:41.622615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.685343 (+ 62728us) service_pool.cc:224] Handling call
0709 12:10:41.750162 (+ 64819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.985943 (+1235781us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54003c8aa0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830add1c0 00007f9830ade231 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c
0709 12:10:43.010630 (+ 24687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.010871 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537430272}
I20260709 12:10:42.986393 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1508) took 1629 ms. Trace:
I20260709 12:10:42.969712 11210 rpcz_store.cc:276] 0709 12:10:41.354934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.355069 (+   135us) service_pool.cc:224] Handling call
0709 12:10:41.390432 (+ 35363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.394986 (+  4554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.395019 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.459780 (+ 64761us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.360177 (+900397us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:42.360217 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.360283 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.923026 (+562743us) raft_consensus.cc:1685] finished
0709 12:10:42.923046 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.923175 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4127,"raft.queue_time_us":9629,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4277,"thread_start_us":830910,"threads_started":1,"wal-append.queue_time_us":841444}
W20260709 12:10:42.988756 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 77422.6us
W20260709 12:10:43.013152 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.013645 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.990008 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:42.991433 13841 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:42.964726 14027 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.004647 14007 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:43.005240 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.065193 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.966199 14014 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:42.987329 13768 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:43.066612 14014 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.067209 14027 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:42.993721 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 254882us
I20260709 12:10:43.012674 11213 rpcz_store.cc:276] 0709 12:10:41.356905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.399937 (+ 43032us) service_pool.cc:224] Handling call
0709 12:10:41.400425 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.404318 (+1003893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.404349 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.404815 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.533535 (+128720us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:42.533576 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.533647 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.986195 (+452548us) raft_consensus.cc:1685] finished
0709 12:10:42.986214 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.986338 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157,"raft.queue_time_us":41242,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":58536,"thread_start_us":1030146,"threads_started":2,"wal-append.queue_time_us":202475}
I20260709 12:10:43.041155 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:43.014569 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61500.1us
I20260709 12:10:43.074654 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:43.077164 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.078011 11292 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:42.967494 13936 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.017067 11042 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 5, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 5 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:10:43.062106 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 72175us
I20260709 12:10:43.061885 13765 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:43.102977 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:43.113663 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.104020 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:43.146180 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:43.147451 11292 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.116202 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 428) took 1412 ms. Trace:
W20260709 12:10:43.152431 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61044.2us
I20260709 12:10:43.065068 14037 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.156407 11293 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.063604 13841 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.157796 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:43.150166 11137 rpcz_store.cc:276] 0709 12:10:41.703934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.403573 (+699639us) service_pool.cc:224] Handling call
0709 12:10:42.403913 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.417211 (+ 13298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.417244 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.417845 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.568158 (+150313us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:42.605179 (+ 37021us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.115839 (+510660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.115924 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.115970 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:43.115983 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.116123 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49918,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":218765,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":26105,"thread_start_us":581142,"threads_started":2,"wal-append.queue_time_us":285373}
I20260709 12:10:43.168470 13790 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.065627 14023 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:43.218133 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 114219us
I20260709 12:10:43.064208 14046 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:43.145735 13974 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.117841 13972 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:43.222710 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70614.4us
I20260709 12:10:43.217854 14037 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:43.249544 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 91865.6us
I20260709 12:10:43.275431 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:43.277016 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.117944 14052 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:43.115285 14053 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.257721 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:43.117627 13768 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:10:43.242331 13978 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:43.217693 13780 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.250025 13633 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.112586 13981 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:43.245306 14020 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.247879 13724 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:43.287086 14046 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:43.250455 13938 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:43.334057 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61052us
I20260709 12:10:43.390689 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.392025 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.393095 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:43.340318 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63407.6us
I20260709 12:10:43.395049 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:43.262794 13716 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.289147 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.246675 14012 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.261938 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.167825 13765 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.244943 14007 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 12:10:43.368680 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 111047us
I20260709 12:10:43.367880 14040 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:10:43.372105 14048 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:43.372992 11860 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:43.375236 14045 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:10:43.375684 14035 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.376493 13970 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.333235 13936 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.383891 11292 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
W20260709 12:10:43.454607 11256 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.037s (SENT)
I20260709 12:10:43.454905 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.455061 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.455495 11292 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:43.456492 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:43.383215 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 224300us
I20260709 12:10:43.275213 14021 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:43.305717 14037 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.262974 13790 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.368772 14053 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:43.345316 13961 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:43.484190 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:43.484863 11861 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:43.430471 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.436002 13765 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.436677 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.490773 11293 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:43.426790 13959 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.439021 13938 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:43.288370 14029 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:43.443264 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 707) took 1992 ms. Trace:
I20260709 12:10:43.445757 11289 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:43.415238 13967 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.416234 13716 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.418270 13695 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:43.505496 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:43.498064 14060 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:10:43.425737 14054 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.387193 13780 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.420300 13972 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:43.388404 13981 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.519644 13972 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.520128 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.521092 13981 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:43.463088 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.521194 13938 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:43.441021 13978 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.390759 14020 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.415057 13724 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:43.478649 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.489445 11141 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.494511 11137 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.495198 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.495558 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.463901 13970 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:43.433542 14012 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.498941 11860 rpcz_store.cc:276] 0709 12:10:41.450708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.452991 (+  2283us) service_pool.cc:224] Handling call
0709 12:10:43.372566 (+1919575us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:43.372817 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.442914 (+ 70097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.443190 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47828736}
I20260709 12:10:43.504498 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.418883 13289 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:43.429944 14006 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.447307 14048 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.510012 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.512703 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.553871 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:43.554129 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.514477 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.554828 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 427) took 1851 ms. Trace:
I20260709 12:10:43.555209 11213 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:43.476737 13936 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:10:43.507732 13695 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.482090 14021 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:43.517673 11211 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:43.517606 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.518879 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.540009 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.386507 13633 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.522248 11861 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:43.506017 13716 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.540349 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.542039 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.503357 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.541580 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.565533 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
W20260709 12:10:43.550906 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 157887us
I20260709 12:10:43.566783 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.567096 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.569023 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:43.524461 13967 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.557235 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.558943 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.558939 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.555403 11138 rpcz_store.cc:276] 0709 12:10:41.703666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.340552 (+636886us) service_pool.cc:224] Handling call
0709 12:10:42.354898 (+ 14346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.355170 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:10:42.375226 (+ 20056us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.725052 (+349826us) log.cc:844] Serialized 14 byte log entry
0709 12:10:42.972634 (+247582us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180040c0c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f98349af58f 00007f982d9ee571 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd
0709 12:10:43.373855 (+401221us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180040c0c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:10:43.553617 (+179762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.553761 (+   144us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:43.553832 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.553900 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.554759 (+   859us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39823,"prepare.queue_time_us":163293,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":3250,"raft.queue_time_us":462381,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":23073,"spinlock_wait_cycles":48531456,"thread_start_us":491085,"threads_started":3,"wal-append.queue_time_us":457322}
I20260709 12:10:43.554692 13289 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:43.521808 13972 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.562134 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.562445 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.566103 11211 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.552119 14039 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:43.561476 11217 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:43.575640 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.576576 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:43.579826 11292 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.576728 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.581298 11861 raft_consensus.cc:2368] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:10:43.582124 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.506227 14046 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.593866 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.524137 14054 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:43.565294 13582 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:43.583456 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:43.605407 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:43.598460 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:43.607731 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.605515 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.608798 11141 raft_consensus.cc:2376] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3. Re-sending same reply.
I20260709 12:10:43.598664 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.600459 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.564975 13472 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.602075 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.570848 13978 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:43.606792 11216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 385) took 1781 ms (client timeout 1693 ms). Trace:
I20260709 12:10:43.606681 11143 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:43.610688 11142 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:43.605942 14058 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:10:43.610311 11139 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:43.605126 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.611937 11144 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:43.612417 14054 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:43.613734 11215 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.578286 14006 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:43.618207 14059 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:10:43.617933 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:43.618943 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.619803 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.620061 14048 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.621222 14012 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.621316 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.625887 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.626312 11292 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:43.636207 13724 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:43.636682 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.602398 11293 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
W20260709 12:10:43.635147 11216 rpcz_store.cc:269] 0709 12:10:41.817683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.174387 (+356704us) service_pool.cc:224] Handling call
0709 12:10:43.586852 (+1412465us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b54002a03d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:43.598881 (+ 12029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15906048}
I20260709 12:10:43.566443 14053 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.582561 14064 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:43.662067 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.677591 14020 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.678114 14021 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:43.588009 14039 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.602312 13559 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:10:43.678966 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.904842 11858 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:43.895648 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.698956 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:43.909379 11290 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:43.903286 11212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
W20260709 12:10:43.707718 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 267581us
I20260709 12:10:43.903685 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:43.888025 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 279648us
W20260709 12:10:43.903879 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 356936us
W20260709 12:10:43.749536 11285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1520) took 1309 ms (client timeout 1567 ms). Trace:
I20260709 12:10:43.912364 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:43.732921 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.644469 13739 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:43.913712 11285 rpcz_store.cc:269] 0709 12:10:42.440203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.441218 (+  1015us) service_pool.cc:224] Handling call
0709 12:10:43.749191 (+1307973us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400062cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:43.749438 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504891264}
I20260709 12:10:43.916311 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2255) took 2402 ms. Trace:
I20260709 12:10:43.916764 11140 rpcz_store.cc:276] 0709 12:10:41.514309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.526012 (+ 11703us) service_pool.cc:224] Handling call
0709 12:10:41.526466 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.620733 (+ 94267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.620936 (+   203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.621586 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.015848 (+1394262us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b1800386860. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:10:43.218399 (+202551us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:43.218440 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.219041 (+   601us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.907365 (+688324us) raft_consensus.cc:1685] finished
0709 12:10:43.907387 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.916242 (+  8855us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68625,"raft.queue_time_us":80596,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":84267,"spinlock_wait_cycles":20817664,"thread_start_us":202362,"threads_started":1,"wal-append.queue_time_us":1646549}
I20260709 12:10:43.918124 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.913724 11292 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.915833 11213 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:43.914361 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:43.917215 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.921739 11285 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:43.910080 11212 raft_consensus.cc:606] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:43.922972 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:43.733846 14014 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.001s
I20260709 12:10:43.920518 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:43.915308 14067 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:43.927711 11288 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:43.928131 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.929518 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:43.654083 14006 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:43.932694 11135 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:43.626688 13841 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.934144 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:43.940508 11293 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:43.911099 13978 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:43.935990 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:43.939158 11290 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.939028 11291 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:43.933215 11285 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:43.935930 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:43.920060 14012 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.946388 11292 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:43.951695 11292 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.952579 11285 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:43.811179 13289 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.930647 14070 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:44.008869 11858 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:43.993824 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.994549 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:43.994217 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:44.018656 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85402.5us
I20260709 12:10:44.023887 11142 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:44.022588 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.024976 11135 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:44.016281 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.025758 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.929433 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:43.956166 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.033634 11290 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.938172 14006 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.949791 11855 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:43.937932 13967 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.654275 13472 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.047441 11289 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.049432 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:43.986440 13776 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.068s	user 0.015s	sys 0.000s
W20260709 12:10:43.966523 14055 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.582s	user 0.002s	sys 0.000s
I20260709 12:10:44.054030 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:43.978358 13610 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.009692 14023 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.038908 14070 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:43.699296 13970 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:43.983220 13755 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.017941 14029 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.067116 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:43.995888 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:44.019802 14072 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:44.079403 11854 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:44.079298 14072 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.000422 13780 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.064144 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.080879 11139 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:44.063599 13559 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:44.081701 13559 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.082152 13559 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.081724 14072 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:43.954804 13978 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.084483 13780 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.085013 13780 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.085314 13978 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:43.932013 14064 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.075841 11219 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:43.982623 14067 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.078629 11140 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:44.054062 14048 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.054042 14046 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.070919 14037 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.005s
I20260709 12:10:43.970654 13716 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:44.092290 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67752.9us
I20260709 12:10:44.005615 14012 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.097150 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:44.087742 13695 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 12:10:44.072624 13289 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.066521 13610 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:44.128959 13610 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.121515 11140 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:44.069196 14023 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:44.119439 14037 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.132223 14023 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.133334 14037 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:44.133844 14023 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.124879 13695 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.135915 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.137063 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:44.137275 13695 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.138733 11217 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.138675 13936 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:44.140841 13936 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:44.141207 13936 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.141556 13936 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.142163 13716 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.142525 14020 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.143853 14070 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:44.151969 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:44.067840 13776 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.144604 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:44.125603 13780 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.123198 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:44.138141 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.144027 14039 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:44.172497 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 238657us
I20260709 12:10:44.191044 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.172794 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:44.191521 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53460.5us
I20260709 12:10:44.191963 11140 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:44.120064 14029 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:44.182128 11289 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.188922 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.188817 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.196805 11213 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:44.101231 14048 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.189066 13610 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.206002 11140 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.210125 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:44.210886 11218 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:44.122622 14046 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.212404 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.213254 11139 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:44.202586 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:44.203588 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:44.215621 11214 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.198287 14029 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.196424 14003 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:44.219770 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:44.163621 13559 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.224711 11212 raft_consensus.cc:2376] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4. Re-sending same reply.
I20260709 12:10:44.244717 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:44.247041 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.247687 11142 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:44.249581 11214 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:44.197738 14070 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:10:44.247737 11135 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:44.251415 14070 consensus_queue.cc:1243] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:44.209802 13841 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:44.252096 14070 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.252442 14070 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:44.253226 14070 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.226995 14029 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.255540 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.256367 11135 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:44.257658 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.258436 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:44.260171 13559 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.262372 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.262956 11853 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:44.263126 11218 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:44.263911 14064 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.264446 14064 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:44.265798 14064 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:44.263181 11140 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:44.267720 13842 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:44.270951 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68499.7us
I20260709 12:10:44.272554 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:44.273339 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.208700 14040 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.201239 13739 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:44.271709 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.278514 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:44.254350 14070 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.282125 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.280457 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.283440 11136 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:44.284384 11135 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:44.218310 14039 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.292588 11139 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.274561 11853 pending_rounds.cc:85] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 6
I20260709 12:10:44.288555 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.300529 11135 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:44.308446 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.312458 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:44.308003 14064 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:44.319361 13776 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.320935 14067 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:44.322515 13472 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:44.323021 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:44.324963 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:44.326232 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:44.328297 11137 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:44.328038 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:44.330978 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:44.331947 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:44.332720 11135 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:44.333640 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.337999 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.339787 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:44.274823 14003 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:44.286769 14065 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.307384 11853 pending_rounds.cc:107] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:44.347889 13841 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.337028 14064 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:44.364109 14064 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.366022 14046 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.366873 11855 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:44.334816 14073 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:44.368535 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:44.368860 14073 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.371035 14073 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.356035 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.372177 14048 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.288049 14040 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.335891 14037 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.327994 14039 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.379613 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.351989 13755 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.354995 13978 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.383910 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:44.385351 11215 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:44.357499 11853 raft_consensus.cc:2889] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:44.354949 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:44.390581 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.389072 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:44.373585 13967 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:44.398370 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.395774 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.400110 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:44.401995 11256 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.680s (SENT) [suppressed 28 similar messages]
I20260709 12:10:44.407918 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.409832 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.416800 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:44.419826 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.420140 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.421679 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.359084 14070 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:44.422771 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 510792us
W20260709 12:10:44.424700 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 362269us
I20260709 12:10:44.429602 11140 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.421092 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.431573 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.432703 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.434892 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.387682 14048 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.352691 13472 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:44.459040 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:44.423122 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.382773 14065 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.447512 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.386541 13978 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.447420 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.451023 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.456262 11215 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:44.386014 13755 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:44.467798 13755 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.437664 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:44.472692 11210 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:44.426892 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:44.475708 14054 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:44.476532 14054 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:44.477016 14054 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:44.478363 13755 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.481657 13755 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:44.428445 14046 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.429876 14067 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.422159 13780 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.438580 14070 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.494917 11857 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:44.428750 13716 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:44.475785 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48997.7us
I20260709 12:10:44.444418 14037 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:44.534705 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.493710 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:44.504514 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.604843 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:44.435312 14091 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:44.421352 14073 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:10:44.449438 14048 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.493069 13978 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.551613 13841 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.659801 11140 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:44.610690 14070 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.605007 14046 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.609608 13964 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.666375 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 236760us
I20260709 12:10:44.610426 13716 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.609972 14037 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.428509 13739 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.621805 14091 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.657521 14048 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.649339 14090 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.701561 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:44.707039 11184 connection.cc:256] RPC call timeout handler was delayed by -1.0420130459999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:44.661263 13841 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.498091 14065 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.701483 14012 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:44.669318 14046 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.678058 14037 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.647331 14003 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.664422 13780 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.804565 13780 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.805040 13780 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:44.727303 11285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.011s	sys 0.042s
W20260709 12:10:44.807227 11285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.042s
I20260709 12:10:44.703641 14091 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:44.718118 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 315645us
W20260709 12:10:44.715695 14072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.019s	sys 0.033s
I20260709 12:10:44.761793 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.828012 11143 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:44.669411 13716 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.700430 13964 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.800693 14065 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:44.803452 14087 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:44.713373 14090 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.861178 14090 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.861362 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:44.863240 14112 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:44.840274 13975 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:44.864408 13975 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.865067 14112 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.865504 14112 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:44.865839 14065 raft_consensus.cc:993] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:44.735512 13841 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.866330 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1537) took 1492 ms. Trace:
I20260709 12:10:44.866909 11292 rpcz_store.cc:276] 0709 12:10:43.373552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.954057 (+580505us) service_pool.cc:224] Handling call
0709 12:10:43.954298 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.083099 (+128801us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:44.083480 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.391409 (+307929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.391478 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.391533 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.866050 (+474517us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540017fcd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:44.866099 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.866269 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10786,"prepare.queue_time_us":767,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3445,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15485,"spinlock_wait_cycles":295642496,"thread_start_us":307502,"threads_started":1,"wal-append.queue_time_us":627775}
I20260709 12:10:44.838846 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.869364 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1976) took 1782 ms. Trace:
W20260709 12:10:44.845245 11107 leader_election.cc:336] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.723s (SENT)
W20260709 12:10:44.871018 14093 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:44.872439 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:44.873070 11291 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:10:44.873322 14029 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.000s
I20260709 12:10:44.873718 14029 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.874009 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:44.875347 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:44.875576 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1518) took 1257 ms. Trace:
I20260709 12:10:44.875942 11219 rpcz_store.cc:276] 0709 12:10:43.618176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.618603 (+   427us) service_pool.cc:224] Handling call
0709 12:10:44.875412 (+1256809us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000267d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:44.875518 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965272320}
I20260709 12:10:44.870193 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:44.882809 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1530) took 1729 ms. Trace:
I20260709 12:10:44.883179 14085 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.883687 14073 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.884018 14085 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:44.866374 14065 raft_consensus.cc:1081] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:44.853753 14040 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:44.865878 14112 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:44.888746 11107 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.752s (SENT)
I20260709 12:10:44.889268 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:44.890509 11107 leader_election.cc:336] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.757s (SENT)
I20260709 12:10:44.869765 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:44.891978 11143 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:44.803963 14039 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:44.827611 14072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.019s	sys 0.035s
I20260709 12:10:44.868171 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:44.927901 11856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 309) took 1444 ms. Trace:
I20260709 12:10:44.928432 11856 rpcz_store.cc:276] 0709 12:10:43.483925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.498705 (+ 14780us) service_pool.cc:224] Handling call
0709 12:10:44.867986 (+1369281us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:44.927812 (+ 59826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14522240}
I20260709 12:10:44.873929 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:44.887921 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.886287 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:44.875947 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:44.869731 11284 rpcz_store.cc:276] 0709 12:10:43.087090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.087268 (+   178us) service_pool.cc:224] Handling call
0709 12:10:43.087745 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.104206 (+ 16461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.104252 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.121224 (+ 16972us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.004665 (+883441us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b1800429b80. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:10:44.359030 (+354365us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:44.359078 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.359155 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.869084 (+509929us) raft_consensus.cc:1685] finished
0709 12:10:44.869107 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.869303 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15944,"raft.queue_time_us":70080,"raft.run_cpu_time_us":6146,"raft.run_wall_time_us":64059,"spinlock_wait_cycles":6379904,"thread_start_us":354140,"threads_started":1,"wal-append.queue_time_us":1433363}
I20260709 12:10:44.829281 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1536) took 1555 ms. Trace:
I20260709 12:10:44.899473 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:44.856295 13633 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:44.712042 14080 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 12:10:44.883234 11288 rpcz_store.cc:276] 0709 12:10:43.153665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.937359 (+783694us) service_pool.cc:224] Handling call
0709 12:10:43.944643 (+  7284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.944989 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.945016 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.955365 (+ 10349us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.448272 (+492907us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:44.448330 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.448419 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.882552 (+434133us) raft_consensus.cc:1685] finished
0709 12:10:44.882571 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.882741 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37942,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":378495,"threads_started":1,"wal-append.queue_time_us":832137}
I20260709 12:10:44.946954 11290 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.863545 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:44.932008 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:44.761941 14054 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:44.932461 11285 rpcz_store.cc:276] 0709 12:10:43.273740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.953358 (+679618us) service_pool.cc:224] Handling call
0709 12:10:43.953624 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.953857 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.045823 (+ 91966us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.828890 (+783067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.828961 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:44.829009 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.829075 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.829224 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118140,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":21754,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":50828,"thread_start_us":761444,"threads_started":1}
I20260709 12:10:44.941967 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:44.951653 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 88196.8us
I20260709 12:10:44.952667 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:44.933194 11292 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:44.944439 11852 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:44.954103 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:44.956476 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 351715us
I20260709 12:10:44.957186 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:44.923575 14012 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.923069 13975 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:44.975174 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:44.934438 14085 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:44.985467 11288 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:45.000165 11288 pending_rounds.cc:85] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 7
I20260709 12:10:45.000471 11288 pending_rounds.cc:107] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:45.000790 11288 raft_consensus.cc:2889] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:44.931942 14067 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:44.995142 11289 consensus_meta.cc:287] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.001s
I20260709 12:10:45.003840 11289 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:44.957973 13937 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.923018 14083 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:44.993597 13633 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.009828 14006 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.953s	user 0.010s	sys 0.003s
I20260709 12:10:44.966733 13970 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.966969 14065 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.008503 13937 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.027915 14088 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.984896 14072 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.003960 14035 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:10:44.986722 14090 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:45.040982 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66090.4us
W20260709 12:10:45.004493 11136 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.002s	sys 0.011s
I20260709 12:10:45.048076 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:45.063095 11107 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.921s (SENT)
W20260709 12:10:45.109398 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46376.5us
I20260709 12:10:45.079226 14085 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.090783 13937 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.115644 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67653.1us
I20260709 12:10:44.958104 14101 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:10:45.037148 14083 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:45.092149 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:45.120415 11219 raft_consensus.cc:606] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:45.120828 11219 raft_consensus.cc:614] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:44.990871 14053 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:10:45.052752 14063 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.092940 14006 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.099296 11290 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:45.076572 13970 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:45.127439 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.003s	sys 0.011s
I20260709 12:10:45.114128 14052 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:45.142686 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.003s	sys 0.011s
W20260709 12:10:45.150169 11211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.012s
W20260709 12:10:45.150636 11211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.004s	sys 0.012s
I20260709 12:10:45.081446 13716 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.084854 14065 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.118288 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:45.084308 13633 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:45.111795 11136 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.003s	sys 0.011s
W20260709 12:10:45.147161 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 717473us
W20260709 12:10:45.151703 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 450239us
I20260709 12:10:45.105695 14088 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.159723 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1524) took 1517 ms. Trace:
W20260709 12:10:45.160977 11286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.032s
I20260709 12:10:45.126540 14063 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.165055 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46830.6us
I20260709 12:10:45.167579 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:45.185639 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 390) took 1037 ms. Trace:
I20260709 12:10:45.128333 13790 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.178755 14051 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:45.129209 13894 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 12:10:45.183259 11286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.005s	sys 0.032s
I20260709 12:10:45.184870 14073 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.190632 14063 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.183144 11211 rpcz_store.cc:276] 0709 12:10:43.642235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.674595 (+ 32360us) service_pool.cc:224] Handling call
0709 12:10:43.912771 (+238176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.912965 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.435437 (+522472us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.159313 (+723876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.159376 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.159429 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.159508 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.159658 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8305,"prepare.queue_time_us":66058,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":5178,"thread_start_us":1185440,"threads_started":2}
I20260709 12:10:45.118721 14090 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.130204 14006 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:45.142376 14121 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.118878 14085 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.130205 13970 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.181236 14065 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:45.209875 11293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.008s	sys 0.008s
I20260709 12:10:45.186028 11217 rpcz_store.cc:276] 0709 12:10:44.148544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.154062 (+  5518us) service_pool.cc:224] Handling call
0709 12:10:45.167446 (+1013384us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800004b98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6eee 000000000036eb39 00007f9835a2a1e0 00007f9835af30c4 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:45.185565 (+ 18119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650240}
W20260709 12:10:45.301786 11293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.008s	sys 0.008s
I20260709 12:10:45.174671 11856 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.302189 11856 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:45.205571 14051 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:45.162539 14052 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:45.231086 14105 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 12:10:45.231374 14098 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:10:45.231959 13520 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:45.232061 13559 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:45.152072 14067 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.232539  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:10:45.233608 14114 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:10:45.234179 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:45.326143 11137 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:45.235831 11140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
W20260709 12:10:45.238983 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.328588 11854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.007s	sys 0.015s
W20260709 12:10:45.329047 11854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.007s	sys 0.015s
W20260709 12:10:45.240749 13610 consensus_meta.cc:287] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 1.032s	user 0.005s	sys 0.005s
I20260709 12:10:45.184759 13841 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:45.242899 13978 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
W20260709 12:10:45.311170 14064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.044s
I20260709 12:10:45.249382 14090 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.337000 11861 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
W20260709 12:10:45.226199 14096 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:10:45.264473 14103 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:45.344305 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:45.269311 11142 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:45.347579 13841 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:45.348397 11142 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:45.348601 13937 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:45.279716 11857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 301) took 3490 ms (client timeout 2162 ms). Trace:
W20260709 12:10:45.350054 11857 rpcz_store.cc:269] 0709 12:10:41.789698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.367284 (+577586us) service_pool.cc:224] Handling call
0709 12:10:45.279506 (+2912222us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400361d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:45.279642 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4785800064}
I20260709 12:10:45.280778 14029 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.350792 14133 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:45.286139 14113 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 12:10:45.287498 13936 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.146s	user 0.014s	sys 0.000s
I20260709 12:10:45.288172 11042 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:45.290541 14027 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.297879 11287 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.299089 11292 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
W20260709 12:10:45.251879 14109 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:10:45.227000 14054 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:45.258577 14035 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.310192 11291 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:45.309033 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:45.304914 13289 consensus_meta.cc:287] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.175s	user 0.012s	sys 0.001s
I20260709 12:10:45.303174 14023 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:45.408790 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 207973us
I20260709 12:10:45.411069 11214 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:45.411578 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 102635us
I20260709 12:10:45.412223 11854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 697) took 1193 ms. Trace:
I20260709 12:10:45.324120  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:45.332705 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:45.251451 14112 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.247906 13964 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:45.290351 14037 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.307061 14072 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.336222 13755 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:10:45.340684 14118 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:10:45.342111 14052 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:45.342587 13978 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.343302 11137 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:45.432243 11042 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 6, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 6 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:45.218087 14083 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.441351 11042 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 5, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 5 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:45.345155 14090 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.448542 14090 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:45.349212 11040 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 254) took 15593 ms (client timeout 15000 ms). Trace:
I20260709 12:10:45.346182 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2280) took 1066 ms. Trace:
I20260709 12:10:45.454663 11138 rpcz_store.cc:276] 0709 12:10:44.279741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.279860 (+   119us) service_pool.cc:224] Handling call
0709 12:10:44.307620 (+ 27760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.308001 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.308044 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.350987 (+ 42943us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.755005 (+404018us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:44.755215 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.755344 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.345937 (+590593us) raft_consensus.cc:1685] finished
0709 12:10:45.345964 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.346122 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5538,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":359419,"threads_started":1,"wal-append.queue_time_us":628592}
I20260709 12:10:45.351848 11290 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.270236 13633 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:45.356793 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.374080 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 263919us
I20260709 12:10:45.376585 13936 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:45.408129 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63952.1us
I20260709 12:10:45.267572 14121 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:45.413358 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80781.9us
I20260709 12:10:45.412614 11854 rpcz_store.cc:276] 0709 12:10:44.219267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.219470 (+   203us) service_pool.cc:224] Handling call
0709 12:10:44.250933 (+ 31463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.251146 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:44.663850 (+412704us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.411862 (+748012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.411920 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.411966 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.412028 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.412164 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82363,"prepare.queue_time_us":547416,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"thread_start_us":1075840,"threads_started":2}
I20260709 12:10:45.412385 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.416656 11856 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.417477 13841 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.466017 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2288) took 1175 ms. Trace:
I20260709 12:10:45.418591 13724 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.467541 13724 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.467726 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:45.468073 13724 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.469661 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:45.407856 13842 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.471086 13842 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.471786 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:45.431403  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:45.473448 13842 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.425691 13695 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.474079 13695 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:45.474538 13695 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.475948 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:45.476758 11287 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
W20260709 12:10:45.412341 13780 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260709 12:10:45.435117 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:45.412590 14035 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:45.435158 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 234995us
W20260709 12:10:45.344516 14064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.013s	sys 0.045s
I20260709 12:10:45.408010 14006 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.343761 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.421185 14076 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:45.460928 11107 leader_election.cc:336] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.113s (SENT)
I20260709 12:10:45.461794 11288 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:45.467015 11856 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.427217 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2276) took 1156 ms. Trace:
I20260709 12:10:45.478082 13780 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.481457 11144 rpcz_store.cc:276] 0709 12:10:44.271181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.271366 (+   185us) service_pool.cc:224] Handling call
0709 12:10:44.271713 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.271970 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:44.677271 (+405301us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.421643 (+744372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.421717 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.421779 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.421869 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.427134 (+  5265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14671,"prepare.queue_time_us":441670,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":101632,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":1125693,"threads_started":3,"wal-append.queue_time_us":607343}
I20260709 12:10:45.484105 13780 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.484735 11140 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:45.485229 11140 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.488752 11042 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 5, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 5 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:45.478515 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43622.4us
I20260709 12:10:45.479303 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:45.479543 14150 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.499464 14150 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:45.467749 11136 rpcz_store.cc:276] 0709 12:10:44.290815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.291214 (+   399us) service_pool.cc:224] Handling call
0709 12:10:44.336037 (+ 44823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.336289 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:45.181871 (+845582us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.446667 (+264796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.446821 (+   154us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:45.447133 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.465505 (+ 18372us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.465952 (+   447us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3425,"prepare.queue_time_us":392464,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":3780,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"thread_start_us":1083180,"threads_started":2}
I20260709 12:10:45.351308 14133 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:45.504112 11826 connection.cc:256] RPC call timeout handler was delayed by -1.4168104320001476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 12:10:45.504725 11826 connection.cc:256] RPC call timeout handler was delayed by -1.2391508050000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 12:10:45.480093 14035 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.480608 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.480286 14006 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:45.505468 11826 connection.cc:256] RPC call timeout handler was delayed by -1.2216411699998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 12:10:45.500586 14150 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.506749 13520 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.507310 13520 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:45.507753 13520 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.510798 13695 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.511065 11856 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:45.477897 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:45.517621 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:45.490377 11042 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 5, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 5 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:45.522801 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.527417 13842 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.527508 13724 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.528173 13842 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.529048 11287 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:45.529114 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 412139us
I20260709 12:10:45.531636 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.385092 14027 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.425925 14089 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:45.533155 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.709106 11860 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:45.710214 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.534704 11285 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:45.538450 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.521535 11042 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 4, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 4 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:45.545506 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80512us
I20260709 12:10:45.537842 14037 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:45.550462 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 89559.7us
W20260709 12:10:45.718549 11107 leader_election.cc:336] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.139s (SENT)
I20260709 12:10:45.718938 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:45.545075 13971 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:45.455777 13716 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.539860 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1727) took 1224 ms. Trace:
I20260709 12:10:45.558261 14121 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.442399 14012 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
W20260709 12:10:45.560472 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 148179us
I20260709 12:10:45.560206 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:45.724627 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 164504us
I20260709 12:10:45.724871 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:45.548318 14048 consensus_meta.cc:287] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.003s
I20260709 12:10:45.564381 13582 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:10:45.548573 14116 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:10:45.568126 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:45.553871 14035 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.539682 14088 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.717605 14089 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.578258 13520 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.774727 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.578791 13937 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:45.580539 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 311) took 2079 ms. Trace:
I20260709 12:10:45.778637 11859 rpcz_store.cc:276] 0709 12:10:43.501630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.625668 (+124038us) service_pool.cc:224] Handling call
0709 12:10:45.580315 (+1954647us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540020f154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:45.580480 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3916183296}
W20260709 12:10:45.581094 11861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 717) took 2063 ms (client timeout 2217 ms). Trace:
I20260709 12:10:45.588404 13936 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:45.439941 14051 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.532722 14123 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.547766 13964 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:45.574548 14090 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.777117 14037 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:45.602332 14070 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.003s
I20260709 12:10:45.564937 14064 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.602172 14112 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.574826 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:45.603147 14046 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.796s	user 0.007s	sys 0.004s
I20260709 12:10:45.603197 13970 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.539971 11140 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.608120 14063 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.622768 14085 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:45.829362 14085 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:45.830145 13970 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.834048 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:45.835050 11219 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:45.637691 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1532) took 2411 ms. Trace:
I20260709 12:10:45.588425 14006 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:45.639189 13978 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:45.451853 11040 rpcz_store.cc:269] 0709 12:10:29.805045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.814375 (+  9330us) service_pool.cc:224] Handling call
0709 12:10:45.348906 (+15534531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:35.463301 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:35.463948 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:35.463987 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:35.464007 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:35.465033 (+  1026us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:35.465098 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:35.465126 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:35.465875 (+   749us) tablet.cc:701] Row locks acquired
0709 12:10:35.465895 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:10:35.466054 (+   159us) write_op.cc:270] Start()
0709 12:10:35.466189 (+   135us) write_op.cc:276] Timestamp: P: 1783599035465999 usec, L: 0
0709 12:10:35.466232 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:10:35.524874 (+ 58642us) log.cc:844] Serialized 3738 byte log entry
0709 12:10:36.051145 (+526271us) op_driver.cc:464] REPLICATION: finished
0709 12:10:36.298895 (+247750us) write_op.cc:301] APPLY: starting
0709 12:10:36.328938 (+ 30043us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:36.428539 (+ 99601us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:36.466302 (+ 37763us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:37.031582 (+565280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:37.106270 (+ 74688us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:37.120154 (+ 13884us) write_op.cc:312] APPLY: finished
0709 12:10:37.120525 (+   371us) log.cc:844] Serialized 71 byte log entry
0709 12:10:37.283804 (+163279us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.316832 (+ 33028us) write_op.cc:454] Released schema lock
0709 12:10:37.319754 (+  2922us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:37.343174 (+ 23420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.345344 (+  2170us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1623567,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":235789,"apply.run_cpu_time_us":16056,"apply.run_wall_time_us":1042457,"num_ops":9,"prepare.queue_time_us":292807,"prepare.run_cpu_time_us":97445,"prepare.run_wall_time_us":443731,"raft.queue_time_us":59992,"raft.run_cpu_time_us":26686,"raft.run_wall_time_us":96580,"replication_time_us":584726,"thread_start_us":759870,"threads_started":5,"wal-append.queue_time_us":658463,"wal-append.run_cpu_time_us":22104,"wal-append.run_wall_time_us":2154668}]]}
I20260709 12:10:45.603821 14065 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.648228 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:45.657552 14073 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.668305 14074 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:45.669101 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.671154 14076 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:45.672734 13790 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:45.676872 14023 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:45.680661 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:45.684629 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.853116 11144 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:45.742723 14048 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.686524 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:45.856312 11137 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:10:45.687340 11142 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:45.513463 13695 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.708642 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.719977 11139 rpcz_store.cc:276] 0709 12:10:44.315140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.330843 (+ 15703us) service_pool.cc:224] Handling call
0709 12:10:44.331221 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.348481 (+ 17260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.348520 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.349153 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.649618 (+300465us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:45.127075 (+477457us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.148020 (+ 20945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.148130 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.539565 (+391435us) raft_consensus.cc:1685] finished
0709 12:10:45.539595 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.539784 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20629,"prepare.queue_time_us":197584,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":91365,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":45975,"thread_start_us":711249,"threads_started":2,"wal-append.queue_time_us":703797}
I20260709 12:10:45.816388 14153 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:45.741556 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.578819 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1532) took 1161 ms. Trace:
I20260709 12:10:45.864030 11214 rpcz_store.cc:276] 0709 12:10:44.417315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.461978 (+ 44663us) service_pool.cc:224] Handling call
0709 12:10:44.462376 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.411488 (+949112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.578452 (+166964us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54001dfe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:45.578744 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180764416}
W20260709 12:10:45.790431 11861 rpcz_store.cc:269] 0709 12:10:43.517778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.151629 (+633851us) service_pool.cc:224] Handling call
0709 12:10:45.580938 (+1429309us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005a0d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:45.581037 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2723220224}
W20260709 12:10:45.792984 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74471.9us
W20260709 12:10:45.866528 11107 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.888s (SENT)
I20260709 12:10:45.867185 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:45.722534 13971 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:45.790371 14103 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.739293 14150 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.741711 13894 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.740626 11042 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 5, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 5 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:45.567462 14125 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:45.775214 14003 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:45.822546 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:45.880227 11854 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.880268 11135 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.854633 14076 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.722740 13768 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:10:45.826339 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:45.827745 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:45.827894 11210 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:45.828081 14037 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:45.828372 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:45.828833 14063 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:45.829855 14085 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.845688 14046 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.834578 14070 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:45.640127 14091 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.792s	user 0.012s	sys 0.000s
I20260709 12:10:45.796403 13716 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.836287 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:45.716969 13755 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:45.798830 13937 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:45.835480 11293 rpcz_store.cc:276] 0709 12:10:43.226551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.948481 (+721930us) service_pool.cc:224] Handling call
0709 12:10:43.948823 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.397863 (+449040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.397897 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.434412 (+ 36515us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.302199 (+867787us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.302247 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.302319 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.637422 (+335103us) raft_consensus.cc:1685] finished
0709 12:10:45.637444 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.637613 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36013,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":1170252,"threads_started":2,"wal-append.queue_time_us":1171100}
I20260709 12:10:45.684545 13633 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.854188 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:45.932687 11144 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.686033 14139 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:10:45.855187 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.935519 11856 raft_consensus.cc:2368] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 11.
I20260709 12:10:45.936568 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.937211 11856 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:45.859155 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:45.732261 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:45.859663 11215 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.859931 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:45.860242 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 151692us
I20260709 12:10:45.939746 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.855397 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:45.942579 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 87294.9us
I20260709 12:10:45.943955 11289 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:45.801476 14021 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:10:45.866896 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:45.951280 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
W20260709 12:10:45.869866 11107 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.365s (SENT)
I20260709 12:10:45.952325 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.873713 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.874817 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:45.953639 11288 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.723837 13289 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:10:45.855921 13790 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:45.859447 14090 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.887665 14003 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:45.889294 14161 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.897225 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.908455 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:45.623243 14138 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:45.865970 13978 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:46.034173 14158 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:45.953613 13633 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.034750 13978 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.034935 14158 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.036828 13978 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:45.875996 14073 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:45.911571 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:45.918200 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:46.039710 14046 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.040493 14037 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.875587 14052 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.861290 14023 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.044771 14023 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:45.879874 14006 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:46.045497 14006 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.047626 14006 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:45.931210 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.048265 11138 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.052034 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2000) took 1745 ms. Trace:
I20260709 12:10:46.052444 11284 rpcz_store.cc:276] 0709 12:10:44.306552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.941717 (+635165us) service_pool.cc:224] Handling call
0709 12:10:44.942071 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.942526 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.942557 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.959231 (+ 16674us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.214689 (+255458us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:45.214748 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.214847 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.051745 (+836898us) raft_consensus.cc:1685] finished
0709 12:10:46.051775 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.051967 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":841,"raft.queue_time_us":226,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12871,"thread_start_us":205462,"threads_started":1,"wal-append.queue_time_us":562960}
I20260709 12:10:45.953610 13724 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.054695 14042 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.055784 11284 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:46.057426 14084 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:46.059864 14144 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:46.054311 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.061832 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.062119 14089 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.063486 11857 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.064011 14085 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.066051 14027 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.067299 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.068120 11856 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:45.946873 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:45.938163 11139 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:45.871948 14067 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:46.070477 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:45.870611 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 129260us
I20260709 12:10:45.873121 14153 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.929252 14020 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:45.995638 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47998.4us
I20260709 12:10:46.083124 11137 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:45.995947 11854 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:45.882529 14103 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:45.986652 13971 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.091132 13971 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.037444 14158 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:45.942520 14035 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.071569 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:45.994092 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.096019 11292 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.075178 11287 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:46.072125 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:46.083771 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:46.086869 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 168811us
W20260709 12:10:46.000188 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 130384us
I20260709 12:10:46.083076 14020 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:46.088689 14132 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.468s	user 0.000s	sys 0.003s
I20260709 12:10:46.067152 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.925756 14091 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.111056 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.090292 14023 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.115665 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:45.940407 13755 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.120260 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:45.945526 13937 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.083690 13633 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:46.121743 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50249.5us
I20260709 12:10:46.138590 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.139345 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.127043 11288 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:10:46.139847 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.140470 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:46.141009 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.141059 14003 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.141553 13768 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.141250 11288 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:10:46.142443 14151 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.523s	user 0.001s	sys 0.002s
I20260709 12:10:46.107959 13289 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.142660 13935 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:46.142966 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.143687 11288 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.120316 11144 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:46.144382 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.108743 14084 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.145102 14084 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.145325 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.145663 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 706) took 1193 ms. Trace:
I20260709 12:10:46.114800 11139 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:46.087631 14150 raft_consensus.cc:2764] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:46.140480 11291 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:46.125947 14159 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.147944 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.147853 14159 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.148571 11291 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:46.149405 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.054387 14147 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:10:46.149935 11291 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:46.088088 13978 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:46.146076 11288 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.150457 14147 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.151242 14147 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:46.151304 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.151521 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.152266 11288 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.152058 14147 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.146126 14065 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.145550 14084 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.150771 14020 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.154877 14020 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.155028 13937 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.134810 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:46.135485 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:46.140645 14142 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.537s	user 0.000s	sys 0.002s
I20260709 12:10:46.126302 11138 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:46.153199 14147 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.156430 11284 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:46.139456 14103 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.128160 11293 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:46.145128 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.164562 11144 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.165239 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.157137 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:46.146759 11855 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:46.159988 14121 raft_consensus.cc:2764] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:46.131059 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:46.107496 14067 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:46.157680 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:46.193595 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.135636 14035 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:10:46.202787 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.150761 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.146010 11852 rpcz_store.cc:276] 0709 12:10:44.952572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.138146 (+185574us) service_pool.cc:224] Handling call
0709 12:10:45.140211 (+  2065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.140864 (+   653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.140905 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.143078 (+  2173us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.447661 (+304583us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:45.447715 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.447807 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.092608 (+644801us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:46.145336 (+ 52728us) raft_consensus.cc:1685] finished
0709 12:10:46.145361 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.145606 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":7663,"spinlock_wait_cycles":10510208,"thread_start_us":251717,"threads_started":1,"wal-append.queue_time_us":464336}
I20260709 12:10:46.160662 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:46.147293 14156 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:46.209209 11214 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:46.121731 14161 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.162773 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:46.213056 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82078.3us
I20260709 12:10:46.163043 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.213721 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.171012 11293 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:46.214078 11138 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:46.141801 14003 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:46.135983 13716 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.234119 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.179107 14103 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:46.234804 11141 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:46.235584 14125 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.235746 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.236555 11141 raft_consensus.cc:2368] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:46.236176 14125 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.237480 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.157716 14160 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.150739 13978 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:46.207312 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50216.1us
I20260709 12:10:46.171965 13768 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:10:46.124776 14158 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.212364 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 1980) took 3120 ms. Trace:
I20260709 12:10:46.248190 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.213768 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:46.173971 11144 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:46.216043 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.205089 14046 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.219050 14165 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.254344 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.229048 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.228881 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.229877 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.256738 11211 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:46.190268 14067 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:46.231149 14157 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:46.231840 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.219657 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:46.240073 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 77383.1us
I20260709 12:10:46.266350 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:46.244887 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.248947 11216 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:46.193231 14048 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.248495 11286 rpcz_store.cc:276] 0709 12:10:43.091788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.935256 (+843468us) service_pool.cc:224] Handling call
0709 12:10:43.935580 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.433494 (+497914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.433544 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.434149 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.206339 (+772190us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:45.206381 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.206450 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.795583 (+589133us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:46.212110 (+416527us) raft_consensus.cc:1685] finished
0709 12:10:46.212130 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.212310 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2327,"raft.queue_time_us":6643,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3914,"spinlock_wait_cycles":12942080,"thread_start_us":1067091,"threads_started":2,"wal-append.queue_time_us":923574}
I20260709 12:10:46.208956 13937 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:46.254016 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.257462 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.259991 11284 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.261253 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.277273 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:46.249382 13633 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.281955 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.268992 14125 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.269371 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.258249 13936 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:46.289105 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.290083 11138 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:46.287487 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.292500 11211 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:46.273972 14064 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:46.262667 14067 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.275174 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.267867 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.267875 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.298856 11286 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:46.299333 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.299655 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.300247 11286 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.265539 14153 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.280050 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.300716 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.282657 11144 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:46.308651 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.230340 14119 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:10:46.255558 14027 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:46.293757 14135 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.761s	user 0.004s	sys 0.003s
I20260709 12:10:46.300527 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.301302 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.277364 11291 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:10:46.301460 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.284338 14035 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:46.247803 14160 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:46.258980 14158 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.282433 14046 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.295500 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.314869 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.325546 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.326522 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.327966 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.328128 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.328640 11291 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:46.318198 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.288256 13936 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.321854 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.329830 11210 raft_consensus.cc:2368] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:46.330209 11144 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:46.330790 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.331861 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.331447 11213 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:46.318981 14035 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.320981 14153 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.335477 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:46.335757 13716 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.340322 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.342803 11210 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:46.340550 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.342053 11136 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:46.343334 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.344281 11211 raft_consensus.cc:2410] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:46.324388 14027 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:46.346110 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.347074 11291 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.344909 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:46.348603 11213 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:46.349380 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.333668 14052 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.333321 14048 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.340881 14035 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.337925 14091 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.315920 14133 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.356752 11138 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:46.354310 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:46.357378 11144 pending_rounds.cc:85] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 2
I20260709 12:10:46.394042 11144 pending_rounds.cc:107] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:46.394361 11144 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:46.359108 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2017) took 1051 ms. Trace:
I20260709 12:10:46.396126 11285 rpcz_store.cc:276] 0709 12:10:45.308040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.357903 (+ 49863us) service_pool.cc:224] Handling call
0709 12:10:45.358271 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.711125 (+352854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.358876 (+647751us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540031a6d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:46.359049 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405091584}
I20260709 12:10:46.397296 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.397348 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2016) took 1090 ms. Trace:
I20260709 12:10:46.359230 13964 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:46.397907 11285 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:46.367635 14076 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.341367 13755 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.372095 13842 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.372473 13936 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.346354 14121 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.351761 13716 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.373458 11860 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
W20260709 12:10:46.376444 14162 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:10:46.377120 14133 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.380244 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.380930 11214 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:46.353816 14153 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:46.387753 14159 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.388427 14158 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.389039 14051 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.363521 14083 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:46.369566 13790 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.484185 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.528218 13936 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.529035 11138 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:46.451169 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 593493us
I20260709 12:10:46.530540 13975 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:46.404505 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.531469 13975 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.427577 14027 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.485387 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.533890 11138 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.444607 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.534546 13975 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.476362 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 703) took 1594 ms. Trace:
I20260709 12:10:46.536893 11287 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:46.457688 14064 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:46.430639 14144 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:46.537889 14064 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.538921 14012 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.539382 11138 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:10:46.462838 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.429350 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.540324 11291 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.540689 11138 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:46.541834 11138 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.454914 14091 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.543356 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 189260us
I20260709 12:10:46.543464 14091 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.470245 13978 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.461782 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:46.431445 14129 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.899s	user 0.005s	sys 0.005s
I20260709 12:10:46.405748 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2290) took 1646 ms. Trace:
I20260709 12:10:46.439155 13768 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:46.542866 11143 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:46.559865 14046 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.547158 14076 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.547523 14121 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.473837 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.478745 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.548199 13790 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.545558 14012 raft_consensus.cc:2764] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:46.492396 14161 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.544159 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:46.626973 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:46.627879 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83804.3us
I20260709 12:10:46.627924 11219 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:46.575667 14070 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.424525 11140 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:46.551870 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 171708us
I20260709 12:10:46.632911 11107 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.553169 13716 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.486972 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:46.636204 13716 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.419802 13841 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:46.471551 14073 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:46.397940 11289 rpcz_store.cc:276] 0709 12:10:45.307293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.327365 (+ 20072us) service_pool.cc:224] Handling call
0709 12:10:45.355291 (+ 27926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.944542 (+589251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.396995 (+452453us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540031a1d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:46.397267 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353090304}
I20260709 12:10:46.472291 11284 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.430423 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.499804 14160 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:46.459487 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:46.538328 14144 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:46.539582 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.535990 11853 rpcz_store.cc:276] 0709 12:10:44.881894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.933518 (+ 51624us) service_pool.cc:224] Handling call
0709 12:10:45.023193 (+ 89675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.301169 (+277976us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:45.350563 (+ 49394us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.722722 (+372159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.724870 (+  2148us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.731864 (+  6994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.474796 (+742932us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18003fa3c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419
0709 12:10:46.476042 (+  1246us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400513954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:46.476105 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.476284 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26107,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":11294,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9240,"spinlock_wait_cycles":522652288,"thread_start_us":357554,"threads_started":1,"wal-append.queue_time_us":581157}
I20260709 12:10:46.556406 11286 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
W20260709 12:10:46.573843 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.574443 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 259335us
I20260709 12:10:46.584621 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.591763 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.668900 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.594976 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.671077 11214 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:46.546226 13964 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:46.594286 11135 rpcz_store.cc:276] 0709 12:10:44.759287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.759502 (+   215us) service_pool.cc:224] Handling call
0709 12:10:44.759900 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.880977 (+1121077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.405380 (+524403us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002e22d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:46.405665 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565230976}
I20260709 12:10:46.677650 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.609532 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.678869 11143 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.603968 11288 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:46.586062 14074 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:46.610764 11291 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:46.562275 14067 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.620961 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.624573 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.629076 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.691797 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.420934 13520 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.598172 13768 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.604501 13755 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.637168 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36052 (request call id 2300) took 1402 ms. Trace:
I20260709 12:10:46.619436 14121 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.587577 13610 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:46.644047 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:46.651638 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.639430 13841 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:46.672488 11256 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.533s (SENT)
I20260709 12:10:46.670357 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.666136 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:46.652905 14073 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.683571 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.684508 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.634251 14153 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:46.686372 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 226998us
I20260709 12:10:46.550945 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 723) took 1007 ms. Trace:
I20260709 12:10:46.698318 11140 rpcz_store.cc:276] 0709 12:10:45.234673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.235663 (+   990us) service_pool.cc:224] Handling call
0709 12:10:46.423144 (+1187481us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003403d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad2a3d 00007f9835aa2cd0 00007f982f027254 00007f982f0271e2 00007f982f027111 00007f982f02708c 00007f982f026342 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:46.631962 (+208818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362566912}
I20260709 12:10:46.641741 14012 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:46.701078 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72060.9us
I20260709 12:10:46.702275 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.654026 11293 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.702301 11219 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:46.631551 14084 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.740633 11216 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:46.752345 11141 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10.
I20260709 12:10:46.743978 11861 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:46.757704 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.757587 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:46.755897 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:46.667074 14035 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.742283 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:46.737566 14046 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:46.762897 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 96854us
I20260709 12:10:46.763389 11860 rpcz_store.cc:276] 0709 12:10:45.543812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.709959 (+166147us) service_pool.cc:224] Handling call
0709 12:10:46.550765 (+840806us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54004dba54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:46.550880 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523415936}
I20260709 12:10:46.768716 11143 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:46.770417 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.764573 11293 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:46.765851 11285 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:46.697870 14063 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:46.766776 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 94289.9us
I20260709 12:10:46.767192 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.771685 11211 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.771672 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.770416 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:46.780231 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.787441 11291 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.788565 11258 leader_election.cc:400] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:46.788733 11256 leader_election.cc:400] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 11.
I20260709 12:10:46.788925 11258 leader_election.cc:403] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:46.773727 11137 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:46.790740 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:46.790723 13768 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.791601 14067 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.791772 14158 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.792284 14158 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.792469 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.793215 11211 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:46.792722 14144 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.791795 13768 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.794018 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.794409 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.794709 11211 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:46.795256 11210 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:46.698423 14074 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.796216 11211 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.773679 14020 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:46.792649 14158 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.797887 14074 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.798547 14063 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.799686 14084 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.799546 14063 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:46.800956 14147 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 12:10:46.801858 13975 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:46.802673 14159 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:46.802855 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.803375 14159 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.805061 14158 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.802426 13975 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.806730 14020 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.808370 14020 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.809746 11256 leader_election.cc:403] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:46.812047 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.816004 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:46.817282 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:46.818045 14165 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 11.
I20260709 12:10:46.818786 14165 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:46.819389 14165 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:46.819761 14165 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.826820 14073 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.828006 14073 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.828154 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:46.789182 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:46.703934 13755 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:46.831024 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60685.8us
I20260709 12:10:46.831161 14119 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.831804 14119 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.833130 14035 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:46.818710 14037 raft_consensus.cc:2764] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:46.833925 14164 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.830075 14165 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.835328 11214 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:46.837234 11284 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:46.837528 14164 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.837764 13964 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.838524 14037 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:46.838967 14037 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:46.838987 13964 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:46.840468 14091 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.832728 14119 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.742602 14153 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:46.859871 14116 consensus_queue.cc:1175] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "018d40ceb45d4447aa293f4c1d929bb8" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:46.773686 14128 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.869606 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:46.871483 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.871917 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 43830.8us
I20260709 12:10:46.873510 14046 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:46.873898 14064 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.877351 11291 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:46.769558 14160 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:46.880481 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:46.760267 14048 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:10:46.883625 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.883623 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.864099 14153 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.880847 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:46.774523 14161 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:46.888068 11140 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.888144 11218 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:10:46.889868 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.878692 14070 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:46.883481 13978 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:46.891449 14065 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.914736 13978 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:46.915259 13978 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.914928 14065 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.916404 13755 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.882468 14160 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:46.917146 14160 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.898855 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:46.818941 13841 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.919059 14021 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.919416 13841 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.920315 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:46.921039 13937 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:46.921412 13937 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:46.921782 13937 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:46.883955 14128 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.878170 14052 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:46.924876 14128 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.926146 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2310) took 1096 ms. Trace:
I20260709 12:10:46.926546 13975 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:46.926580 11144 rpcz_store.cc:276] 0709 12:10:45.829278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.350858 (+521580us) service_pool.cc:224] Handling call
0709 12:10:46.351163 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.394914 (+ 43751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.394949 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.395398 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.682285 (+286887us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:46.682341 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.828394 (+146053us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b54003c9e54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:46.828440 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.925806 (+ 97366us) raft_consensus.cc:1685] finished
0709 12:10:46.925829 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.926079 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13769472,"thread_start_us":286390,"threads_started":1,"wal-append.queue_time_us":501464}
I20260709 12:10:46.898506 13936 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:46.929630 13936 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.930042 13936 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.885342 13633 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:10:46.931382 11854 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:46.907256 13685 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:46.932216 13685 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.932581 13685 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:46.912349 11139 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:46.913749 13716 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.930944 11217 raft_consensus.cc:2410] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:46.930857 14165 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:46.906929 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:46.935431 11861 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:46.936079 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:46.945366 11140 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:46.932868 14037 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.950582 13971 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.950853 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:46.953178 13768 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.954353 11214 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:46.963807 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:46.956527 11143 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.957683 11285 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:46.929852 14121 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.930975 13936 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:46.962337 11293 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:46.963692 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:46.968019 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:46.990042 11211 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:10:46.967315 11259 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:47.015749 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48543.2us
I20260709 12:10:47.017841 11182 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:47.018329 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:47.018687 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55008.7us
W20260709 12:10:47.003532 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44647.5us
I20260709 12:10:47.019693 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:46.968803 11213 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:46.992619 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2321) took 1121 ms. Trace:
I20260709 12:10:47.037794 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:47.033241 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:47.020115 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:47.025483 11291 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.039638 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:47.041283 11135 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:46.968061 13975 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:47.031862 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:47.017253 13971 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:46.970649 13755 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:47.032541 14165 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:47.039942 14080 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.014s	sys 0.011s
I20260709 12:10:47.049002 11259 leader_election.cc:400] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:47.074126 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:46.986084 14159 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:47.059872 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.021363 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:47.037983 13768 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:47.082641 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.044157 14074 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.019501 14160 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.083237 13768 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.085794 14160 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:47.089440 14153 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:46.961405 13685 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:47.074195 14080 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.014s	sys 0.012s
I20260709 12:10:47.091097 13685 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.071242 14091 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.091672 14091 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.092021 14091 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.093390 11854 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.047166 13936 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.022215 14164 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:47.074337 11259 leader_election.cc:403] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:47.040289 14161 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.094954 14037 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.042338 14083 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:47.095299 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46477.8us
I20260709 12:10:47.073592 14051 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:47.096441 14051 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:47.096789 14051 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:47.032457 14133 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.097101 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.044395 14064 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.097640 14133 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:46.981873 13937 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.071245 13971 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.098658 14164 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:47.098660 14133 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.099756 14164 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:47.099694 14121 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:47.098313 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.101531 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:47.101588 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.099867 13937 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:47.102850 11137 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:47.102775 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:46.959954 14035 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:10:47.103034 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:47.047107 14012 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.123567 11861 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:47.058625 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 98374.6us
I20260709 12:10:47.074980 13755 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.039314 11141 rpcz_store.cc:276] 0709 12:10:45.871588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.237253 (+365665us) service_pool.cc:224] Handling call
0709 12:10:46.992385 (+755132us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400116cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:46.992546 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182429056}
W20260709 12:10:47.117086 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.127350 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.124692 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:47.125319 14160 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.133066 14160 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:47.133517 14160 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.126538 11858 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.129740 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:47.134809 14183 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:47.130934 14158 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:47.126044 14012 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.135959 14012 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.136415 13755 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:47.186578 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62062.5us
I20260709 12:10:47.122466 14164 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.134745 14165 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:47.083379 14074 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:47.226187 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.193169 13894 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:47.194211 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:47.060211 13975 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.233680 13975 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:47.237344 14160 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.197449 14165 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:47.238891 14165 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:47.243011 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2319) took 1411 ms. Trace:
I20260709 12:10:47.243510 11139 rpcz_store.cc:276] 0709 12:10:45.831858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.536888 (+705030us) service_pool.cc:224] Handling call
0709 12:10:46.537134 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.933299 (+396165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.242751 (+309452us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400263754. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:47.242945 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862211456}
I20260709 12:10:47.246068 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:47.246955 14065 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:47.247594 14065 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:47.097661 14051 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.249675 14051 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.251542 14144 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.257619 14160 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:47.258572 11292 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.265010 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.267069 11135 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
W20260709 12:10:47.267941 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 73831.1us
I20260709 12:10:47.269126 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:47.198966 14073 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:10:47.271955 14153 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:47.275919 14091 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.280994 14064 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.281714 14064 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:47.282809 14064 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.284685 14074 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:47.291533 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.295732 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2019) took 1099 ms. Trace:
I20260709 12:10:47.296264 11292 rpcz_store.cc:276] 0709 12:10:46.196522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.478452 (+281930us) service_pool.cc:224] Handling call
0709 12:10:46.478790 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.259002 (+780212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.295393 (+ 36391us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54000609d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:47.295641 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792800000}
I20260709 12:10:47.191431 13978 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:47.300325 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 401) took 1483 ms (client timeout 1889 ms). Trace:
W20260709 12:10:47.304136 11217 rpcz_store.cc:269] 0709 12:10:45.817155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.820092 (+  2937us) service_pool.cc:224] Handling call
0709 12:10:47.290058 (+1469966us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000122d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:47.300240 (+ 10182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380718976}
I20260709 12:10:47.197643 13937 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:10:47.306316 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:47.284705 14064 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.285813 14037 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:47.346097 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.000s	sys 0.015s
W20260709 12:10:47.347052 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.000s	sys 0.015s
I20260709 12:10:47.300932 14161 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:47.352988 11286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.005s
W20260709 12:10:47.365612 11286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.006s
I20260709 12:10:47.367414 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:47.382957 11110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.012s	sys 0.023s
W20260709 12:10:47.383577 11110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.013s	sys 0.023s
W20260709 12:10:47.384384 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 514841us
I20260709 12:10:47.389490 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:10:47.392313 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.317909 14020 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.409680 14116 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.406477 14165 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.303964 14090 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:10:47.352555 14037 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:47.422564 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.425526 11142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.003s
W20260709 12:10:47.430423 11142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.017s	sys 0.003s
I20260709 12:10:47.386242 14147 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.384030 14161 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:47.433928 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44549.2us
I20260709 12:10:47.437153 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:47.432204 13841 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
W20260709 12:10:47.442510 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.433882 14048 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.429736 14116 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:47.430819 14091 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:47.429380 14020 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:47.417177 14076 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:10:47.434597 14037 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.438349 14161 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.440119 14153 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.451571 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:47.453305 14116 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.466512 13971 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.466619 14186 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:47.488128 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:47.448796 14125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.011s
W20260709 12:10:47.452907 14063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.012s
W20260709 12:10:47.448695 14119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.020s
I20260709 12:10:47.474272 14037 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.447791 14048 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.439465 14147 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.493901 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.496105 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.516673 11135 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:47.518853 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.519234 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.489127 14189 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.490101 13716 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:47.492159 14125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.008s	sys 0.012s
W20260709 12:10:47.495023 14063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.008s	sys 0.012s
W20260709 12:10:47.496802 14119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.000s	sys 0.021s
I20260709 12:10:47.523001 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.494720 13633 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.525769 11139 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.528680 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:47.544409 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 356299us
W20260709 12:10:47.524686 14185 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:10:47.542423 11137 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:47.489205 14186 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:47.521358 14048 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:47.562355 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 374444us
I20260709 12:10:47.567174 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:47.581705 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.591289 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.590464 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:47.579087 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:47.579922 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.604193 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:47.604636 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.605047 11861 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
W20260709 12:10:47.606385 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.607120 11136 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:47.616775 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.617650 11135 raft_consensus.cc:2368] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:47.617889 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.619067 11144 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:47.545890 13978 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:47.624369 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.623117 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:47.625880 11136 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:47.613612 11212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.003s	sys 0.016s
I20260709 12:10:47.496059 14121 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:10:47.643894 14121 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:47.644392 14121 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:47.644699 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:47.607856 14129 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:47.645452 11292 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.646965 13971 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:47.650929 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:47.651391 14188 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:10:47.651973 11287 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:47.532407 14012 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.653092 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:47.654549 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:47.654834 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:47.655296 11285 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:47.657761 13936 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.001s
I20260709 12:10:47.524305 14020 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.659596 14020 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.645453 14121 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:47.663724 14190 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:47.664402 14121 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.607100 14125 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:47.665346 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.666105 11142 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:47.665825 14125 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.668614 14125 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:47.657764 14186 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.670934 14186 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.560931 14091 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:47.675949 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44726.7us
I20260709 12:10:47.682119 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:47.684541 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 278677us
W20260709 12:10:47.631302 11212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.003s	sys 0.016s
I20260709 12:10:47.632282 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.634682 14063 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:47.636788 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.689922 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:47.641062 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.641964 11291 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:47.685638 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.693462 11143 raft_consensus.cc:2376] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10. Re-sending same reply.
I20260709 12:10:47.691613 11292 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
W20260709 12:10:47.699313 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.703373 11136 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:47.689009 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:47.640407 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:47.691852 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55171.7us
I20260709 12:10:47.630187 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.704541 11284 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.704994 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:47.654563 14012 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:47.707511 11285 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:47.708280 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.713627 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:47.734918 11258 leader_election.cc:400] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:47.736245 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.686390 14119 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.720993 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:47.684361 14165 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:47.740795 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 475001us
I20260709 12:10:47.746183 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:47.743764 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:47.710701 13971 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.710822 13978 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.708408 13633 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:47.712200 14189 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:47.787608 11184 leader_election.cc:400] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10.
I20260709 12:10:47.809038 11184 leader_election.cc:403] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:10:47.810031 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48610.9us
I20260709 12:10:47.811690 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:47.788693 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45031.3us
I20260709 12:10:47.684468 14091 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.733892 14160 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.736636 13975 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:47.731984 13841 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.739781 13768 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:47.731886 14070 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:47.818845 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.802667 14165 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.824893 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:47.783679 14125 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:47.802028 14076 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:10:47.755916 14119 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.798528 14083 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.844594 14070 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.824107 14160 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:47.846933 14207 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:47.800715 13971 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:47.883903 14091 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:47.860527 13685 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.888454 13685 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.888873 13685 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.866775 14184 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:47.862023 14119 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.826242 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:47.757668 14051 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 12:10:47.822454 14021 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.895290 14070 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:47.862162 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:47.845701 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:47.896510 11289 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:47.896770 14184 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:47.897578 11285 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.707266 13936 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 12:10:47.859704 14125 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:47.860028 14080 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.800087 14128 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.853080 14037 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:47.842114 14189 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:47.854805 14147 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:47.864637 11284 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:47.905867 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:47.867689 14160 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.911981 11285 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:47.895378 14051 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.921923 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:47.918104 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.936368 11137 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:47.900672 14063 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:47.930585 14208 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:47.918936 14051 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:47.929514 14147 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.981817 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 245618us
I20260709 12:10:47.914456 14184 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:47.934966 14128 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.987967 14208 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.931676 13716 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.990844 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.996639 14207 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:47.996688 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:48.017661 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.026562 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 209691us
I20260709 12:10:47.973069 14090 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:10:48.000277 14064 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
I20260709 12:10:48.031054 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.038079 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:47.942795 14116 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.031688 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.042691 11213 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.032032 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.033363 11214 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:48.033313 11218 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:48.038625 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:47.997288 14208 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.046334 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.046273 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:48.028982 14037 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:48.043692 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:48.035485 14161 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 12:10:48.024945 13768 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:48.085013 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.083427 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.083312 11210 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:48.084627 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 85546us
I20260709 12:10:47.994408 14147 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.052464 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.088894 11214 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.088229 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:48.091359 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.046478 14012 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:48.100785 13971 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.100705 14012 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.101656 13971 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.102190 13971 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.103745 14012 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.104329 14012 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:48.104827 14012 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.105863 14147 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.107151 13768 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.107729 13971 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.107991 14012 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.108546 14012 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:48.109002 14012 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.112525 13936 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.112998 13936 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.114476 13971 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.114886 14217 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.115267 13971 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.115489 14217 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.117674 13971 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.118028 13937 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.027374 14070 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:10:48.001487 14207 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:47.997648 13716 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.046643 13978 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.100628 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.085096 14164 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.147637 11218 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.132992 11214 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
W20260709 12:10:48.046973 14200 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:10:48.153084 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.153429 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:48.095316 14201 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:10:48.083627 11853 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:48.118314 13971 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:48.043192 14144 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:48.166136 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74848.8us
I20260709 12:10:48.144399 14037 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.158933 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.018918 14125 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.187014 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.043577 14091 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:48.092993 13975 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.177217 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.170433 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:48.178471 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:48.164220 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:48.180974 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:48.182240 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 148231us
I20260709 12:10:48.122283 14116 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.208369 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.091591 13841 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:10:48.157513 14164 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:48.266661 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.118616 13937 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.096406 14161 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.088423 14048 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:48.225312 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47027.3us
I20260709 12:10:48.272897 11287 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:48.271489 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.289002 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:48.290088 11289 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:10:48.273443 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 103100us
I20260709 12:10:48.172653 14165 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.285462  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.289060 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:48.291388 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.177850 14210 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.049005 14051 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.291476 11861 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.292769 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.039831 14189 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.207079 14037 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:48.295840 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.275851 14128 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.301992 11290 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.282927 14164 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.309085 11140 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.285823 11217 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:48.309546 11287 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:10:48.290393 13975 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.310933 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:48.318796 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.318950 11141 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:48.290198 13936 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.319712 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.286109 14219 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:48.269616 14091 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:48.304322 14121 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.001s
I20260709 12:10:48.324199 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.226648 14144 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.207965 13971 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.303215 14212 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.328447 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:48.318377 13975 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.347832 11861 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:48.328722 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.351325 11217 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:48.332837 11287 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:10:48.334964 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.335242 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:48.335948 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.296599 14165 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.337785 11141 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:48.303839 14037 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.325233 14219 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.348155 11291 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.347903 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:48.307523 14070 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.365968 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:48.355382 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:48.367134 11138 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:48.361189 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.331130 14012 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.359997 11139 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:48.353701 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.329265 14217 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.310719 14128 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.361393 11141 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:48.367810 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.372670 14207 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.372776 14225 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.363276 14027 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:48.374361 14091 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.371631 14064 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:48.374948 14211 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:10:48.379678 11217 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:48.371310 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:48.549054 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 177814us
W20260709 12:10:48.383070 14218 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:10:48.337499 14121 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.337066 14116 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.387632 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.558097 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.337787 13841 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:48.387128 11287 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:48.564980 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.352475 13975 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.394589 11213 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:48.349361 14210 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:48.408140 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.392324 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.406580 11291 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
W20260709 12:10:48.411514 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 224554us
I20260709 12:10:48.578720 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.579303 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.579537 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.579952 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.364923 14219 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:48.419222 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 242120us
I20260709 12:10:48.546782 14204 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.364531 14226 raft_consensus.cc:2764] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:48.547577 14027 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:48.352257 14212 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.408571 14012 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 12:10:48.581977 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.576221 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.585189 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:48.590047 11293 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:48.591606 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 278749us
W20260709 12:10:48.433593 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.605841 11285 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:48.613088 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.614142 11858 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:48.617123 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 409) took 1666 ms. Trace:
I20260709 12:10:48.617707 11212 rpcz_store.cc:276] 0709 12:10:46.950558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.953794 (+  3236us) service_pool.cc:224] Handling call
0709 12:10:46.969227 (+ 15433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.969674 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:47.690341 (+720667us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.983391 (+293050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.993398 (+ 10007us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.993763 (+   365us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.993814 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.993918 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.616816 (+622898us) raft_consensus.cc:1685] finished
0709 12:10:48.616850 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.617045 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5521,"prepare.queue_time_us":849820,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9118,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":6214,"thread_start_us":908842,"threads_started":2,"wal-append.queue_time_us":351656}
I20260709 12:10:48.620760 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.621878 11212 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:10:48.624898 14184 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.626410 14012 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:48.627110 14012 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.629837 14012 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.632355 14214 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.633005 14214 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.634923 14226 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:48.635759 14226 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.604988 14161 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:48.563489 14237 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.648309 11218 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:48.653635 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.654750 11141 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:48.655505 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43733.9us
I20260709 12:10:48.674935 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.676792 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:48.679301 14232 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:48.678158 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.582376 14228 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.591771 14070 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.571338 14116 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.656876 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:48.700485 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43706.9us
I20260709 12:10:48.701586 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:48.691109 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:48.692727 13685 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.003s
I20260709 12:10:48.692621 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.704509 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:48.705197 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:48.577579 13841 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.642200 14091 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.695731 11285 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:48.699153 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.571637 14121 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.699818 11213 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:48.681871 14161 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:48.707331 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:48.709051 11138 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:48.708940 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.711778 11218 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.692934 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:48.600792 14233 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.716436 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:48.717296 14121 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.718850 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:48.709488 13685 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.703970 13937 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:48.728281 14214 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:48.730062 14021 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.834s	user 0.005s	sys 0.006s
I20260709 12:10:48.696715 14231 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.681331 14048 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.691177 14165 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:48.816431 11861 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.819136 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.820011 11852 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:48.740243 11212 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:48.755178 11854 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:48.589568 14210 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:48.741036 14119 consensus_meta.cc:287] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.000s
I20260709 12:10:48.595564 14204 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.704355 14070 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.742170 14144 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.829897 11218 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:48.894564 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.895824 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.896452 14210 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:48.896940 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:48.831670 13971 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:48.897660 11218 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.897949 13971 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.818631 14021 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10.
I20260709 12:10:48.832974 14233 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.899986 14233 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.902388 14233 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:48.804093 14234 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:48.898401 13971 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.916792 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:48.833599 14213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.021s	sys 0.001s
I20260709 12:10:48.924348 11218 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:48.749913 14161 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.926055 11212 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:48.836158 14214 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.700747 14228 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:48.804303 14121 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
W20260709 12:10:48.935611 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 228324us
I20260709 12:10:48.936750 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:48.908442 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:48.908443 14234 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:48.926368 14160 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.997s	user 0.013s	sys 0.001s
W20260709 12:10:48.938606 11143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.026s	sys 0.031s
I20260709 12:10:48.919674 14241 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.926879 14213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.023s	sys 0.008s
I20260709 12:10:48.937834 11218 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:48.838416 14119 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.928130 14048 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:48.947122 11143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.027s	sys 0.032s
I20260709 12:10:48.925110 14238 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:48.833504 14231 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:48.987767 11212 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 12:10:49.005494 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68281.4us
I20260709 12:10:49.006783 11218 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.940876 14012 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.010936 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:48.823622 14027 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:48.980872 14208 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.935s	user 0.006s	sys 0.013s
I20260709 12:10:48.942900 14144 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.027093 11216 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
W20260709 12:10:48.966401 14037 consensus_meta.cc:287] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:10:48.939507 14244 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:48.978653 14186 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.942196 14214 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.012001 14048 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:48.965870 14160 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.126183 11219 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:49.088817 14144 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.082096 14234 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.142203 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1558) took 1106 ms. Trace:
I20260709 12:10:49.154675 11212 rpcz_store.cc:276] 0709 12:10:48.035477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.941146 (+905669us) service_pool.cc:224] Handling call
0709 12:10:48.987384 (+ 46238us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.140884 (+153500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.142132 (+  1248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.979090 14241 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.172619 11287 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:49.139328 13978 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.001s
I20260709 12:10:49.129318 14212 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.103628 14226 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:49.148335 14248 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:10:49.148319 14080 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 1.239s	user 0.010s	sys 0.002s
I20260709 12:10:49.145249 13685 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:49.212158 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 197970us
I20260709 12:10:49.147387 14144 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.148900 14116 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.128381 14233 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:49.082407 14037 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.237114 14250 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.243750 14037 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.074928 14208 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.246234 14119 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.246374 14208 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:49.147770 14251 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:49.247766 11284 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:49.241209 14080 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:49.249377 11859 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
W20260709 12:10:49.250037 13975 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.002s
I20260709 12:10:49.260231 13975 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.251226 13971 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.252071 14241 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.252565 14161 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.253865 14160 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.170807 14214 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.088500 14186 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.281728 11289 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:49.282401 14186 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.255051 14231 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.229684 13978 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:49.283951 14225 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 12:10:49.167088 14121 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:49.255724 14204 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.284530 14225 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.145934 14228 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.256069 14070 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.284904 14121 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:49.286126 14121 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.256536 14233 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.292354 14233 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:49.257377 14219 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.001s
I20260709 12:10:49.293344 14219 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.293973 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49838 (request call id 500) took 1170 ms. Trace:
I20260709 12:10:49.294684 11291 rpcz_store.cc:276] 0709 12:10:48.123263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.123417 (+   154us) service_pool.cc:224] Handling call
0709 12:10:49.205135 (+1081718us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003f0cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.293884 (+ 88749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439762688}
I20260709 12:10:49.296066 14219 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:49.229291 14243 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
W20260709 12:10:49.242177 14240 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:10:49.242918 14048 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.264245 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2048) took 1102 ms. Trace:
I20260709 12:10:49.243578 14250 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.297746 11292 rpcz_store.cc:276] 0709 12:10:48.161857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.639839 (+477982us) service_pool.cc:224] Handling call
0709 12:10:48.640305 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.640587 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.640622 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.641249 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.804094 (+162845us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:49.070970 (+266876us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.080981 (+ 10011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.081115 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.263997 (+182882us) raft_consensus.cc:1685] finished
0709 12:10:49.264022 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.264179 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1686,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":32430,"thread_start_us":374804,"threads_started":2,"wal-append.queue_time_us":323339}
I20260709 12:10:49.299968 11292 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:49.300243 14250 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.300580 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1585) took 1114 ms. Trace:
I20260709 12:10:49.300931 11292 rpcz_store.cc:276] 0709 12:10:48.186136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.299377 (+1113241us) service_pool.cc:224] Handling call
0709 12:10:49.299756 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.300332 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.300527 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.302131 11292 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.090914 14252 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.227s
I20260709 12:10:49.305478 14252 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.305912 14252 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:49.306859 14252 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:49.308844 11858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.002s	sys 0.007s
I20260709 12:10:49.308811 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2056) took 1003 ms. Trace:
W20260709 12:10:49.309777 11858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.003s	sys 0.007s
I20260709 12:10:49.310910 14252 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:49.260237 14164 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.939s	user 0.008s	sys 0.002s
I20260709 12:10:49.296921 11291 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:49.311743 14164 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.310020 11292 rpcz_store.cc:276] 0709 12:10:48.305075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.301677 (+996602us) service_pool.cc:224] Handling call
0709 12:10:49.301971 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.308468 (+  6497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.308743 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.313342 11292 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.309267 14238 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:49.315025 14238 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.316048 14164 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.312176 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2053) took 1127 ms. Trace:
I20260709 12:10:49.322847 11291 rpcz_store.cc:276] 0709 12:10:48.184717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.296114 (+1111397us) service_pool.cc:224] Handling call
0709 12:10:49.296476 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.311935 (+ 15459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.312126 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.326520 13975 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.328728 11292 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:49.139088 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 128246us
I20260709 12:10:49.379307 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:49.381596 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:49.399322 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2346) took 1097 ms. Trace:
I20260709 12:10:49.399945 11143 rpcz_store.cc:276] 0709 12:10:48.301733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.301855 (+   122us) service_pool.cc:224] Handling call
0709 12:10:48.318360 (+ 16505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.385671 (+ 67311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.385717 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.388193 (+  2476us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.979683 (+591490us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:48.979735 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.979824 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.398761 (+418937us) raft_consensus.cc:1685] finished
0709 12:10:49.398804 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.399085 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105067,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":23128,"thread_start_us":657927,"threads_started":2,"wal-append.queue_time_us":915345}
W20260709 12:10:49.402899 11107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.000s	sys 0.005s
W20260709 12:10:49.403424 11107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.000s	sys 0.005s
W20260709 12:10:49.404028 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 711114us
I20260709 12:10:49.416378 14269 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:49.326256 11291 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.450383 11285 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:49.452853 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2052) took 1272 ms. Trace:
I20260709 12:10:49.453279 11285 rpcz_store.cc:276] 0709 12:10:48.180382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.710902 (+530520us) service_pool.cc:224] Handling call
0709 12:10:49.449594 (+738692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.451023 (+  1429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.452577 (+  1554us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54000f5fd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.452753 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697526528}
I20260709 12:10:49.449195 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1584) took 1263 ms. Trace:
I20260709 12:10:49.454967 11289 rpcz_store.cc:276] 0709 12:10:48.185847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.292547 (+106700us) service_pool.cc:224] Handling call
0709 12:10:49.448636 (+1156089us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54000f5fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.448920 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254313216}
I20260709 12:10:49.455920 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1751) took 1928 ms. Trace:
I20260709 12:10:49.456465 11140 rpcz_store.cc:276] 0709 12:10:47.527094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.527245 (+   151us) service_pool.cc:224] Handling call
0709 12:10:47.527578 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.309460 (+781882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.424680 (+1115220us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54003cb254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:49.455710 (+ 31030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796948352}
I20260709 12:10:49.447664 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 2057) took 1133 ms. Trace:
I20260709 12:10:49.442368 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 2041) took 1282 ms. Trace:
I20260709 12:10:49.419329 11212 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.458550 11284 rpcz_store.cc:276] 0709 12:10:48.159608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.162654 (+  3046us) service_pool.cc:224] Handling call
0709 12:10:49.435676 (+1273022us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b5400319cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.442063 (+  6387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234611584}
I20260709 12:10:49.459192 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1823) took 1336 ms. Trace:
I20260709 12:10:49.459694 11212 rpcz_store.cc:276] 0709 12:10:48.122411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.417365 (+1294954us) service_pool.cc:224] Handling call
0709 12:10:49.418650 (+  1285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.458854 (+ 40204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.459097 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.411546 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.440557 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.461669 11293 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:49.441354 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1556) took 1403 ms. Trace:
I20260709 12:10:49.463181 11219 rpcz_store.cc:276] 0709 12:10:48.034577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.034759 (+   182us) service_pool.cc:224] Handling call
0709 12:10:48.035096 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.138354 (+1103258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.437252 (+298898us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54001dfe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:49.437740 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290688256}
W20260709 12:10:49.463732 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1331285480000588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 12:10:49.441710 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1579) took 1802 ms. Trace:
I20260709 12:10:49.465415 11290 rpcz_store.cc:276] 0709 12:10:47.638550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.638745 (+   195us) service_pool.cc:224] Handling call
0709 12:10:47.639169 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.305371 (+666202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.434387 (+1129016us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54003f1954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:49.441358 (+  6971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523900288}
I20260709 12:10:49.458348 11287 rpcz_store.cc:276] 0709 12:10:48.313875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.564663 (+250788us) service_pool.cc:224] Handling call
0709 12:10:49.432032 (+867369us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540015c554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.447385 (+ 15353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395461888}
I20260709 12:10:49.444839 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:49.446707 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1553) took 1414 ms. Trace:
I20260709 12:10:49.447214 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1824) took 1324 ms. Trace:
I20260709 12:10:49.442762 11292 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.450034 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1563) took 1274 ms. Trace:
I20260709 12:10:49.474376 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.475690 11852 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:49.469408 11216 rpcz_store.cc:276] 0709 12:10:48.031574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.031744 (+   170us) service_pool.cc:224] Handling call
0709 12:10:49.430418 (+1398674us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540035aa54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.446361 (+ 15943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965068032}
I20260709 12:10:49.477785 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.478828 11856 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:49.480433 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.470834 11217 rpcz_store.cc:276] 0709 12:10:48.175380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.448161 (+1272781us) service_pool.cc:224] Handling call
0709 12:10:49.448825 (+   664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.449328 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.449353 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.449431 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.449485 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.449604 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.449771 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.481539 11858 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:49.482044 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:49.483177 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.483850 14121 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:49.484129 11861 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:49.484755 14121 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.469539 11213 rpcz_store.cc:276] 0709 12:10:48.122686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.579016 (+456330us) service_pool.cc:224] Handling call
0709 12:10:49.446667 (+867651us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540035b954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.446959 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275390848}
I20260709 12:10:49.500495 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.505577 14238 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.506731 14238 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.508857 14226 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:49.509790 14238 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.510679 14269 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:49.511313 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.511904 14228 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.513057 14219 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.513285 11135 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:49.513657 13975 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.514200 14048 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.513986 14219 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.514519 13975 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.512820 14228 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:49.505540 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.010s	sys 0.001s
I20260709 12:10:49.517251 14219 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.521878 14241 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.520349 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.519208 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.529115 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:49.533442 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.011s	sys 0.001s
I20260709 12:10:49.522621 14238 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:49.532333 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:49.525982 14003 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.540836 14003 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:49.540527 14238 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.542708 14003 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.543402 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:49.544878 14223 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.518246 14225 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:49.525792 13842 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.545703 14223 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:49.546150 13842 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:49.547586 14223 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.548061 14128 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.532830 14241 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:49.553865 14241 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:49.554433 14187 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.947s	user 0.004s	sys 0.017s
I20260709 12:10:49.545949 14225 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.531584 14074 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.554754 14003 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.555820 14074 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.557191 14225 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.509985 14226 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.544044 14238 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.559366 14074 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.578866 11135 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:49.522557 14269 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.579717 14214 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.580793 13716 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.525900 14228 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.560249 13975 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:49.582623 13841 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.582698 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:49.583400 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:49.560899 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.584988 14228 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.585443 14228 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.585821 14228 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.581095 14219 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:49.587023 14219 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:49.587525 14083 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.587960 14083 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:49.588765 14219 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.589519 14083 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.578876 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.590978 13841 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.591545 11293 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:10:49.592803 14195 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 2.071s	user 0.008s	sys 0.009s
I20260709 12:10:49.562561 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.562860 14121 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.564636 11217 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:49.563413 14226 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.565086 11216 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:49.565620 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:49.566787 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:49.527001 14080 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 12:10:49.566780 14216 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.456s	user 0.002s	sys 0.004s
W20260709 12:10:49.565104 14209 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.454s	user 0.012s	sys 0.011s
I20260709 12:10:49.572018 11290 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:49.572304 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.573866 11854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 723) took 1241 ms. Trace:
I20260709 12:10:49.574163 11287 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:49.576151 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 726) took 1240 ms. Trace:
I20260709 12:10:49.548091 13842 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.577412 11140 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
W20260709 12:10:49.596189 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50405.6us
I20260709 12:10:49.604736 11854 rpcz_store.cc:276] 0709 12:10:48.332734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.332899 (+   165us) service_pool.cc:224] Handling call
0709 12:10:48.358067 (+ 25168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.822253 (+464186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.573208 (+750955us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400361d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:49.573579 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886021376}
I20260709 12:10:49.605445 11859 rpcz_store.cc:276] 0709 12:10:48.335625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.335739 (+   114us) service_pool.cc:224] Handling call
0709 12:10:49.575718 (+1239979us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b5400513954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.575960 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062982400}
I20260709 12:10:49.612507 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.617762 11137 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:49.618093 14208 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.620466 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.621721 11285 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:49.624357 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:49.626732 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.964s (SENT) [suppressed 11 similar messages]
I20260709 12:10:49.627013 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1577) took 1989 ms. Trace:
I20260709 12:10:49.627818 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.629009 11136 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:49.629945 14083 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:49.631255 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 187014us
I20260709 12:10:49.632848 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:49.634099 13975 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.627565 11286 rpcz_store.cc:276] 0709 12:10:47.637925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.642595 (+  4670us) service_pool.cc:224] Handling call
0709 12:10:47.642982 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.643295 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.643336 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.643866 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.967224 (+323358us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.967292 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.967444 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.563944 (+1596500us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:49.626586 (+ 62642us) raft_consensus.cc:1685] finished
0709 12:10:49.626605 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.626860 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29226368,"thread_start_us":322795,"threads_started":1,"wal-append.queue_time_us":466796}
I20260709 12:10:49.635442 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:49.636338 14186 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.643765 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:49.638667 11212 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.638221 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2034) took 2751 ms. Trace:
I20260709 12:10:49.644729 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:49.645828 14219 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.640988 13937 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:10:49.672194 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65298.1us
I20260709 12:10:49.672250 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.675242 11143 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:49.661502 11288 rpcz_store.cc:276] 0709 12:10:46.886676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.944509 (+ 57833us) service_pool.cc:224] Handling call
0709 12:10:46.944836 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.945185 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.945222 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.945631 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.366822 (+421191us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:47.410802 (+ 43980us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.411117 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.413301 (+  2184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.326709 (+913408us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b18000d3000. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:49.591817 (+1265108us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:49.637780 (+ 45963us) raft_consensus.cc:1685] finished
0709 12:10:49.637802 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.638032 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11755,"prepare.queue_time_us":43560,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":10207,"raft.queue_time_us":1833,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":13669,"spinlock_wait_cycles":16968960,"thread_start_us":420805,"threads_started":1,"wal-append.queue_time_us":541321}
I20260709 12:10:49.682930 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:49.683195 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.687465 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:49.688928 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56546.1us
W20260709 12:10:49.691677 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 96434.6us
I20260709 12:10:49.713644 11135 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:49.718686 11137 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
W20260709 12:10:49.714828 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52015.6us
I20260709 12:10:49.723941 11854 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:10:49.735687 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:49.719295 14147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.612s	user 0.019s	sys 0.012s
I20260709 12:10:49.749348 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:49.750618 14091 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:49.751053 14037 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.751899 14037 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.752455 14037 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:49.754232 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.755717 14091 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:49.756155 14091 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:49.757354 14189 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.757225 14091 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.757933 14189 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:49.759323 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:49.760733 11858 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:49.761579 14147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.655s	user 0.020s	sys 0.012s
I20260709 12:10:49.754536 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:49.766800 13842 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.784927 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 149727us
I20260709 12:10:49.788576 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 508) took 1083 ms. Trace:
I20260709 12:10:49.790074 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:49.795249 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.796203 11285 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:49.801378 14244 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.802027 14244 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.802426 14244 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.802817 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:49.789186 14245 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.805284 14245 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.805660 14245 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.807188 14128 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.807711 14128 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:49.809002 14128 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.810981 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.811121 14189 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.813251 14189 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.813457 14234 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.840195 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.843794 11285 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:49.845003 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.845899 11285 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:49.815167 13975 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:49.848088 13975 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.848263 14048 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:49.816605 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 422) took 1663 ms. Trace:
W20260709 12:10:49.819059 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65131.7us
I20260709 12:10:49.849583 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:49.787608 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:49.821532 14235 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:49.823417 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.823446 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.824107 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.825722 11293 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:49.826748 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.827843 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.827983 14020 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:49.834702 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 43748.1us
I20260709 12:10:49.836362 14051 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.783880 14091 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.811784 11290 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:49.848531 13975 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:49.789232 11291 rpcz_store.cc:276] 0709 12:10:48.691069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.453612 (+762543us) service_pool.cc:224] Handling call
0709 12:10:49.454065 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.467697 (+ 13632us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:49.593683 (+125986us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.772730 (+179047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.772804 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.772855 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.772932 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.774088 (+  1156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7099,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":5968,"thread_start_us":225221,"threads_started":2}
W20260709 12:10:49.859941 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80017.9us
W20260709 12:10:49.864673 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.868969 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 127325us
I20260709 12:10:49.869848 11212 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:49.867945 11284 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:49.877313 11287 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:49.886039 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.886916 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:49.888702 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:49.849164 11211 rpcz_store.cc:276] 0709 12:10:48.153235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.443409 (+1290174us) service_pool.cc:224] Handling call
0709 12:10:49.444203 (+   794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.445030 (+   827us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:49.597574 (+152544us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.816021 (+218447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.816096 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.816146 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.816222 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.816390 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70841,"prepare.queue_time_us":293123,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":73451,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"thread_start_us":271610,"threads_started":2}
I20260709 12:10:49.891834 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:49.895272 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:49.884006 14012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.003s	sys 0.039s
I20260709 12:10:49.875200 14020 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:49.900527 14205 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.901609 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.901793 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.902225 14250 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.909300 11140 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:49.909420 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.910177 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.910753 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.910859 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:49.910771 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:49.912160 11291 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.905185 11289 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:49.903232 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:49.914053 14064 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.914636 14064 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.915102 14064 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.915773 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:49.865286 14235 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.918776 14048 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.919433 14277 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:49.921252 14235 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:49.921416 14277 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.922024 14277 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:49.904532 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 114582us
I20260709 12:10:49.905104 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.918323 14144 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:49.923040 14277 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:49.900417 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:49.924808 14277 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.924922 11288 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:49.928721 11290 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:10:49.929911 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.931417 14076 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:49.933322 14205 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.933633 14048 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.933943 14205 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.934644 14125 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.937040 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.937510 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:49.938086 11135 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:49.940810 11142 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:49.942155 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.943382 13633 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.891408 14128 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.950606 14027 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.950660 11142 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:49.951370 14027 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:49.952514 11142 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.952792 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:49.953583 11144 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.953814 14027 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:49.939471 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:49.955358 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 75478us
I20260709 12:10:49.950044 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:49.960655 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 506) took 1349 ms. Trace:
I20260709 12:10:49.964699 11861 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:49.970384 11141 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:49.970659 11287 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:49.972146 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.973600 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.976433 14250 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:49.976711 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.977561 11139 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:49.976995 14250 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.904548 14012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.005s	sys 0.039s
I20260709 12:10:49.982997 14186 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.961345 11292 rpcz_store.cc:276] 0709 12:10:48.610821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.331092 (+720271us) service_pool.cc:224] Handling call
0709 12:10:49.442026 (+110934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.489074 (+ 47048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.960344 (+471270us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400319cd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:49.960562 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253983104}
I20260709 12:10:49.986394 11293 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:49.996462 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.998461 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.014739 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.014737 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.017576 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:49.963367 14125 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:50.022766 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.013465 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:50.025250 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 75360.1us
I20260709 12:10:49.998116 13937 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.033406 11142 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
W20260709 12:10:50.037592 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51430.7us
I20260709 12:10:49.994084 14027 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.026191 14048 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.047410 11143 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:50.050287 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:49.989338 14012 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:10:50.057277 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.025867 14144 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.064586 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:50.064841 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74731.7us
I20260709 12:10:50.067488 14027 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.069918 14027 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:50.072598 13894 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:10:50.064292 11292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:47454
I20260709 12:10:50.075380 11292 raft_consensus.cc:606] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:50.075789 11292 raft_consensus.cc:614] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:50.075897 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.076787 11219 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:50.077791 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.079056 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.080523 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.087082 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.087884 11212 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:50.089741 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:50.076843 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 420) took 1791 ms. Trace:
I20260709 12:10:50.065718 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:50.090781 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:50.048985 14083 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.100653 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.106565 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50786.2us
I20260709 12:10:50.106925 11858 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:50.107568 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.092156 11218 rpcz_store.cc:276] 0709 12:10:48.116205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.082665 (+966460us) service_pool.cc:224] Handling call
0709 12:10:49.104225 (+ 21560us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.129238 (+ 25013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.129272 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.165731 (+ 36459us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.613756 (+448025us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.727610 (+113854us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b540018eaa0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a50dbe 00007f9830a5b930 00007f9830a5b8d8 00007f9830a5b858 00007f9830a5b813 00007f9830a5aa9c 00007f98369462f6 00007f9836940aa8 00007f9830a977cb 00007f9830a9a2c0
0709 12:10:49.770283 (+ 42673us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.875632 (+105349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.882255 (+  6623us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.882337 (+    82us) raft_consensus.cc:1685] finished
0709 12:10:49.886556 (+  4219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.908023 (+ 21467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80129,"prepare.queue_time_us":89478,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":139683,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":28350,"spinlock_wait_cycles":92694784,"thread_start_us":125407,"threads_started":2,"wal-append.queue_time_us":137033}
I20260709 12:10:50.108858 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.112087 13894 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.114794 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.115223 13971 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.115794 13971 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.116143 14116 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.118232 14184 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:50.120381 14278 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:50.120487 13768 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.121469 14080 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.121313 13768 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.121855 14080 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:50.122787 14080 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.124356 14083 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.124626 14186 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.125263 14186 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.125707 14186 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.126462 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 728) took 1392 ms. Trace:
I20260709 12:10:50.126850 11211 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:50.104096 14020 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.128624 14020 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.126868 11860 rpcz_store.cc:276] 0709 12:10:48.733868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.735403 (+  1535us) service_pool.cc:224] Handling call
0709 12:10:48.735713 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.690780 (+955067us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:49.777486 (+ 86706us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.040986 (+263500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.041033 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:50.048130 (+  7097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.126087 (+ 77957us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b540067ff54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:50.126138 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.126305 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8095,"prepare.queue_time_us":97607,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":18197,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":13591,"spinlock_wait_cycles":2195522816,"thread_start_us":240128,"threads_started":2,"wal-append.queue_time_us":343067}
I20260709 12:10:50.114805 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.116153 13971 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.106654 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:50.132928 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80220.6us
I20260709 12:10:50.094594 14048 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.138001 11213 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.139739 11137 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:50.139688 14125 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.110342 14269 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:50.143536 14269 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.053082 13937 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:50.161623 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:10:50.163868 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56408.3us
I20260709 12:10:50.166337 11293 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:10:50.171247 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.186923 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.146682 14083 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.183835 11212 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:50.188872 11214 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:50.136359 11038 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 8 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 9 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.203186 11212 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:50.116799 14116 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:50.203119 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91806.2us
I20260709 12:10:50.197664 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.170022 14290 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.210723 14289 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.211431 14037 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.184671 14027 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.212941 14064 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.215160 11215 raft_consensus.cc:2410] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:50.216720 14244 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:50.219388 14228 consensus_meta.cc:287] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.633s	user 0.019s	sys 0.000s
W20260709 12:10:50.219712 13841 consensus_meta.cc:287] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.009s
I20260709 12:10:50.222657 11211 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:50.189388 14080 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:50.235147 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 169497us
I20260709 12:10:50.236390 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:50.236500 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.323455 11293 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 2.
I20260709 12:10:50.241314 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.241865 14027 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.243453 14065 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.244393 14037 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:50.245184 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.248764 13768 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.249197 13841 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.260735 11038 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 5 to 6, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.270008 11136 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:50.272913 14290 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.262430 14292 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:50.367967 14292 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:50.368481 14292 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.209259 14074 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:50.330214 14234 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.321483 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.205981 13894 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.331240 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:50.220655 14222 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.373025 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.373335 14269 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.373729 11216 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:50.371459 13894 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.374722 13894 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.378724 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.371487 14234 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.325165 11213 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:50.387705 11214 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:50.322351 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.328112 11218 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:50.325923 13716 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:50.357963 14205 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.391245 14116 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:50.327775 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:50.392230 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 162942us
I20260709 12:10:50.392030 11038 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 5 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 8 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:10:50.329293 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.337147 14065 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.340484 13633 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.281484 14012 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:50.346736 11215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1559) took 2294 ms (client timeout 1809 ms). Trace:
I20260709 12:10:50.347952 13768 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:50.348948 11137 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:50.326920 14228 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.354882 11286 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:50.355922 14027 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:50.359545 14064 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.360316 14048 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.361549 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:50.361559 13937 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:50.362887 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:50.364362 14290 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:50.267925 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:50.322055 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.422963 11140 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:50.375358 14091 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:50.321921 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84152.9us
I20260709 12:10:50.391043 13716 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.336789 11290 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:50.393862 11141 raft_consensus.cc:2410] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:10:50.397118 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65982.5us
I20260709 12:10:50.402099 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:50.399628 11215 rpcz_store.cc:269] 0709 12:10:48.035788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.037777 (+  1989us) service_pool.cc:224] Handling call
0709 12:10:50.268066 (+2230289us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003c46d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:50.330583 (+ 62517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5003816192}
I20260709 12:10:50.393200 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.405586 11144 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:50.366046 14250 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.420161 11861 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.421295 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:50.399446 13841 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.393314 14205 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.436439 11038 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 3, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:50.440680 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79241.4us
I20260709 12:10:50.411921 14121 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:50.446455 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:50.446951 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53911.3us
I20260709 12:10:50.453462 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.453774 11214 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:50.453225 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 262485us
I20260709 12:10:50.425554 14074 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.454783 14037 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:50.455217 14037 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:50.455025 14074 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.455617 14037 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:50.455670 14293 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:50.456254 14293 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.456610 14293 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.457190 14074 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.460947 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:50.463320 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:50.464289 14289 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:50.466818 14164 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:50.466615 14121 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.468701 14234 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.469022 14121 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.440225 13937 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.434644 13841 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.480088 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:50.474936 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:50.480734 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:50.488663 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.482424 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.483500 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.483081 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.479393 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.453181 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.484551 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:50.502526 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.503357 11213 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:50.499552 11219 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:50.511780 11218 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:50.462387 14291 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:50.514102 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66000.8us
I20260709 12:10:50.514801 11861 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:50.475796 14290 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.453303 14091 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:50.515060 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.518707 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:50.521052 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71526.9us
I20260709 12:10:50.521199 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:50.522428 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.501421 13841 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.526252 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.533641 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.534073 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:50.534662 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48470.9us
I20260709 12:10:50.534861 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:50.525861 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:50.535836 11860 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:50.529160 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.534130 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.540599 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:50.538136 11211 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:50.515570 14184 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:50.535943 11038 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 4, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.544401 11038 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 5 to 6, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 6 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.559190 11142 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.470383 14293 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.513862 14291 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:50.525821 14290 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.543843 11213 raft_consensus.cc:2376] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6. Re-sending same reply.
I20260709 12:10:50.529256 14205 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.565595 11289 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:50.566186 11287 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.514225 13768 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 12:10:50.567764 14245 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.761s	user 0.016s	sys 0.007s
I20260709 12:10:50.568121 14250 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:50.564510 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.564154 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.478314 13971 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.544703 14121 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.588935 11038 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 4 to 5, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 5 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.542734 14027 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:50.594211 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53122.6us
I20260709 12:10:50.593300 11285 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:50.567646 14184 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:50.600737 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.596418 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:50.559823 14189 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:50.569155 14228 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.608369 11038 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 4 to 5, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 5 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.564401 14133 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:50.564989 13633 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.588047 14205 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.564863 14291 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.614333 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.571998 14290 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.547248 14234 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:50.539778 14186 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.605065 14250 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.610773 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.599193 14235 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.617731 11038 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 4 to 6, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.626680 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:50.608036 14269 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:50.631943 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 250) took 18042 ms (client timeout 15000 ms). Trace:
W20260709 12:10:50.647607 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45740.1us
I20260709 12:10:50.602414 14121 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.648635 11287 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:50.633864 14235 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:50.649997 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.590260 14245 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.625638 14205 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.620334 14027 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:10:50.611629 13975 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.714s	user 0.016s	sys 0.002s
I20260709 12:10:50.535418 14292 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.649542 14222 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:50.613132 14074 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:10:50.659595 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:50.653545 14020 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.661070 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:50.627604 14133 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.633157 14269 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.665345 11038 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 2, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 2 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.690169 11293 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.636322 13716 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.661815 14289 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.621959 14189 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.682471 11216 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:10:50.653635 14228 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.656817 14235 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.631127 13937 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:50.654659 14121 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.624539 13633 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.664230 14293 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.685899 11213 raft_consensus.cc:606] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:50.687888 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:50.658146 14083 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.675359 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.660879 14144 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:50.693922 11291 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:50.692750 14269 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.694111 11287 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:10:50.691052 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 175975us
I20260709 12:10:50.677505 14222 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.690814 11038 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 4, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.676245 13975 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.656236 14250 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.687717 14277 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:50.703781 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 124630us
I20260709 12:10:50.649688 14091 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.686756 14051 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.693805 14289 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.633234 14184 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.698211 14228 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.711635 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53854.4us
I20260709 12:10:50.723181 14228 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.723219 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63686.9us
I20260709 12:10:50.724066 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.725121 14020 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.725538 14020 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.725858 14020 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.701339 13937 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.721912 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:50.722661 14289 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.724170 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.730125 11038 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.710078 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:50.735021 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1589) took 1069 ms. Trace:
I20260709 12:10:50.735476 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:50.714300 14074 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.735776 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.735428 11286 rpcz_store.cc:276] 0709 12:10:49.665330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.789533 (+124203us) service_pool.cc:224] Handling call
0709 12:10:50.733954 (+944421us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540031abd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:50.734956 (+  1002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266817792}
I20260709 12:10:50.736814 11292 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:50.738714 11038 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 4, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:50.750545 14164 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.736930 14277 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.751500 14277 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.751665 13633 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.751965 14277 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.752259 14189 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.753047 14065 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.750981 14164 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:50.755499 14164 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.756212 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:50.721122 14051 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:50.756978 14164 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.757817 14051 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.767232 14051 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.768955 14244 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.772511 14250 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.777644 14189 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:50.778262 14189 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.778594 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:50.779264 11136 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:50.780333 14189 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.781092 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:50.781683 11140 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.781925 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:50.782618 11854 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.783601 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.784806 14245 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.784926 14037 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.785995 11289 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.759589 14133 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.761262 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.761844 14304 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.764642 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:50.843510 11853 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:50.843717 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:50.740568 14074 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.794816 13768 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.839116 11287 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:50.783259 14277 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.732972 13937 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:50.633543 11042 rpcz_store.cc:269] 0709 12:10:32.522341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.527831 (+  5490us) service_pool.cc:224] Handling call
0709 12:10:50.546743 (+18018912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:46.295724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:46.323072 (+ 27348us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:46.333331 (+ 10259us) write_op.cc:435] Acquired schema lock
0709 12:10:46.335099 (+  1768us) tablet.cc:662] Decoding operations
0709 12:10:46.367013 (+ 31914us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:46.367128 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:46.367155 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:46.368032 (+   877us) tablet.cc:701] Row locks acquired
0709 12:10:46.368108 (+    76us) write_op.cc:260] PREPARE: finished
0709 12:10:46.368278 (+   170us) write_op.cc:270] Start()
0709 12:10:46.368437 (+   159us) write_op.cc:276] Timestamp: P: 1783599046368205 usec, L: 0
0709 12:10:46.368480 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:10:46.369165 (+   685us) log.cc:844] Serialized 3999 byte log entry
0709 12:10:47.844784 (+1475619us) op_driver.cc:464] REPLICATION: finished
0709 12:10:48.294447 (+449663us) write_op.cc:301] APPLY: starting
0709 12:10:48.307571 (+ 13124us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:48.351251 (+ 43680us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:48.378459 (+ 27208us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:48.379974 (+  1515us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:48.380349 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:48.380418 (+    69us) write_op.cc:312] APPLY: finished
0709 12:10:48.380820 (+   402us) log.cc:844] Serialized 77 byte log entry
0709 12:10:48.381026 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:48.381234 (+   208us) write_op.cc:454] Released schema lock
0709 12:10:48.381316 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:48.415436 (+ 34120us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:48.415472 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4524951,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":337400,"apply.run_cpu_time_us":4411,"apply.run_wall_time_us":123773,"num_ops":10,"prepare.queue_time_us":61723,"prepare.run_cpu_time_us":27302,"prepare.run_wall_time_us":473966,"raft.queue_time_us":758882,"raft.run_cpu_time_us":29820,"raft.run_wall_time_us":187163,"replication_time_us":1476112,"thread_start_us":1024717,"threads_started":4,"wal-append.queue_time_us":671130,"wal-append.run_cpu_time_us":21716,"wal-append.run_wall_time_us":2443196}]]}
I20260709 12:10:50.842176 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.793154 11140 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:10:50.844391 11860 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.789700 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:50.847267 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.845655 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.848088 11142 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:10:50.849504 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 114185us
W20260709 12:10:50.847319 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57705.8us
W20260709 12:10:50.851832 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 90664.1us
I20260709 12:10:50.846526 11291 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:10:50.852424 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.850353 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:50.848299 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:50.848085 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.844637 14074 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.857514 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:50.863771 11216 raft_consensus.cc:606] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:50.864270 11216 raft_consensus.cc:614] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:50.858119 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:50.865834 11861 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:50.858144 11859 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 4: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:50.868798 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.795022 14083 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.838086 14051 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:50.867821 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.732862 14144 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.854842 14164 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.891031 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.858620 14304 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.857879 14048 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.862771 14219 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.883740 14301 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.174s	user 0.000s	sys 0.006s
I20260709 12:10:50.845150 14293 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:10:50.876012 14244 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.880216 14064 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.846753 14250 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:50.911718 11142 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.912889 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:50.913414 11144 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.918644 11144 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:50.888514 14186 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:50.888399 14300 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.881623 14189 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:10:50.925436 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 206148us
I20260709 12:10:50.928318 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.892614 14164 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.933251 11137 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:50.930325 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50398.3us
I20260709 12:10:50.931614 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:50.882566 13633 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:50.875682 13768 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:50.897943 14304 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:50.903487 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:50.885052 14083 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.890851 14205 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.935804 11144 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.854578 14027 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.906028 14244 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:50.967813 14244 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.939952 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:50.969961 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.896425 14226 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:10:50.929714 14219 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.925805 14245 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.930290 13971 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.973711 14302 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.998050 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.943109 14292 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:50.935173 14164 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.978575 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:50.979478 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.931464 14048 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:50.984490 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:50.985174 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:50.929168 14293 consensus_queue.cc:1243] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:51.020123 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:51.019976 14245 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.022445 14133 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:50.993523 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.984532 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:50.997334 14184 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.998325 11218 raft_consensus.cc:2368] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:50.974977 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:50.975670 11137 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.933990 14300 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.965250 14304 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.011788 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:50.932524 14064 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.015863 14277 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.009792 11141 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:51.023629 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.036278 11142 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.026799 11144 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:51.024884 11859 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.025600 11289 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:51.028548 11139 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:51.037531 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.024636 11286 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:51.022477 14245 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.041100 14184 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.046195 14091 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:51.047150 14091 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:51.047472 14091 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:51.047811 14064 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.023337 14080 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:10:51.042722 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:51.057449 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:51.062698 11854 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:51.055805 11860 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:51.065044 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:51.066664 14292 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.067996 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:51.068630 11293 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.013621 14228 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.070940 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.070675 14234 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:51.071638 11137 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:51.072883 14228 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.073537 11137 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:51.075505 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:50.997632 13975 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.083293 11213 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:51.077379 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:51.078590 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:51.084363 11292 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.050053 14223 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:51.080696 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:51.090925 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:51.091223 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.023123 14133 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:51.080174 11293 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:50.994119 14219 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.094383 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:51.035116 14051 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:51.081125 11142 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:10:51.027941 14300 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.104822 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:51.105543 11860 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
W20260709 12:10:51.106627 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62730.8us
I20260709 12:10:51.090376 14234 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.086076 14064 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.117702 11217 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:51.119903 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.118562 13716 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.122648 13716 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.123009 13716 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.133360 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:51.132611 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 102449us
I20260709 12:10:51.109792 14277 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.145426 11859 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
W20260709 12:10:51.151037 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61324.4us
I20260709 12:10:51.146647 13768 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:51.157183 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52225.9us
I20260709 12:10:51.111460 14189 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:51.117923 13975 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.169761 14304 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.100564 14222 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.177219 11258 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:51.189015 11258 leader_election.cc:403] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:51.171340 11142 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:51.152781 14064 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:51.184650 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:51.198734 14250 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
I20260709 12:10:51.199712 11217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:51.200578 11217 raft_consensus.cc:606] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:51.200994 11217 raft_consensus.cc:614] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:51.202605 14296 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
W20260709 12:10:51.204860 13841 consensus_meta.cc:287] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.001s
I20260709 12:10:51.205295 13841 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.207437 14184 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.207798 14219 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.210374 14091 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.172266 13768 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:51.142822 14290 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.170979 14189 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.174369 13975 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.158003 14277 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.195015 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:51.162833 14186 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:10:51.221131 11291 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:51.218976 11256 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4.
W20260709 12:10:51.223641 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 86128.3us
I20260709 12:10:51.221446 11136 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:51.225435 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.232846 11142 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:51.210075 13716 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.192893 14292 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:51.256731 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:51.261286 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66365.4us
I20260709 12:10:51.262362 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:51.192575 13971 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:51.212767 14083 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.211748 14091 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.239385 13975 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.219471 11853 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:51.269035 14291 consensus_meta.cc:287] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.001s
I20260709 12:10:51.222436 14205 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.274282 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.284889 11142 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:51.285884 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:51.286583 11216 raft_consensus.cc:606] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:51.287040 11216 raft_consensus.cc:614] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:51.275504 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 121306us
I20260709 12:10:51.224066 14189 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.280458 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:51.270694 14250 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:51.271497 14027 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:51.305451 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.302955 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:51.240142 14051 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.210122 14133 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.294756 14048 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.322049 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:51.299901 14320 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:51.338881 14320 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.325908 11139 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:51.326983 14250 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:51.334772 13841 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.320562 14128 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.287158 14291 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:51.377362 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 106635us
I20260709 12:10:51.341137 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:51.357929 14277 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.357765 14250 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.358618 14144 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.358776 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:51.360788 14128 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:51.362196 14020 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.005s
I20260709 12:10:51.321753 14319 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.362339 13716 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.329708 14083 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:51.353940 14076 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.341316 13894 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.964s	user 0.002s	sys 0.012s
I20260709 12:10:51.353881 14325 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.367396 14184 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:51.370898 14290 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.373090 14324 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.299180 14064 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.375670 14116 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:51.291651 14313 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:10:51.388057 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:51.354379 14027 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.394814 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.390347 11216 raft_consensus.cc:606] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:51.386416 14065 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.393159 14319 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.353955 14292 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.422845 11137 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:51.419100 14074 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.003s
I20260709 12:10:51.428821 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.396301 14020 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.415099 14324 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.430756 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:51.417991 14116 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:51.402002 14244 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.410894 14076 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.444087  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:51.428737 14319 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.425680 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:51.468106 14128 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:51.468502 14323 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:10:51.425848 14065 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.430368 14304 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.446986 14164 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.447489 14076 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.437433 14074 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.448797 14020 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.450567 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:51.457535 14328 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:10:51.458129 14317 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.190s	user 0.000s	sys 0.002s
I20260709 12:10:51.405042 13894 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.463351 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:51.442792 14219 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:51.508302 14219 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:51.422279 14027 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.439218 14205 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.479610 11292 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:10:51.440219 14324 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.516119 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:51.498606 11137 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:51.479946 13937 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.583s	user 0.000s	sys 0.012s
I20260709 12:10:51.476696 14065 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.500790  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:51.507297 11212 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:51.516861 11216 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:51.514189 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:51.476864 14223 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:10:51.525421 14318 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.525892 14318 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.526239 14318 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.510469 14219 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.526547 14037 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:51.527127 11290 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:51.529680 14235 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.814s	user 0.009s	sys 0.000s
I20260709 12:10:51.530728 14315 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.531224 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.500438 14116 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:51.590790 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47059.5us
I20260709 12:10:51.534430 14326 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:51.593314 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54182.6us
W20260709 12:10:51.536937 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 148937us
I20260709 12:10:51.518563 14205 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.547168  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:51.548034 14074 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.548482 14027 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.533993 14244 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.594038 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:51.593521 11216 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:10:51.590653 11137 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:10:51.594822 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 187189us
I20260709 12:10:51.523337 13937 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.601989 14065 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.603395 14314 raft_consensus.cc:993] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:51.603937 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:51.604372 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:51.592348 14291 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:51.614666 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.590222 14235 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.615793 14329 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:51.597681 14116 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.617568 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:51.616521 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:51.590371 14315 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.620782 11219 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:51.622753 11137 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.623575 14341 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.625056 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1835) took 1144 ms. Trace:
I20260709 12:10:51.592583 14326 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:51.595904 14320 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.604657 14020 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:51.633268 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:51.636035 11212 rpcz_store.cc:276] 0709 12:10:50.480417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.480525 (+   108us) service_pool.cc:224] Handling call
0709 12:10:51.624868 (+1144343us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002a08d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:51.625001 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2314761472}
I20260709 12:10:51.637012 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.648132 11142 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:51.640851 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.653318 11136 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.627707 14289 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.833s	user 0.013s	sys 0.000s
W20260709 12:10:51.648631 14300 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.003s
I20260709 12:10:51.725224 11293 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:51.634357 14164 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.724817 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:51.730654 14345 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:10:51.654286 13971 raft_consensus.cc:1081] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:10:51.731705 14065 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.731048 11287 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:10:51.733345 14205 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.640341 14319 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.734860 13937 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.735875 14319 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.725998 14300 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.726724 14314 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.738971 14300 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:51.740180 14235 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:51.742878 11143 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:51.746982 14342 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:10:51.748184 14326 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.748972 11290 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:51.749460 14326 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.750108 11142 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.751122 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.639743 14315 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.751700 11142 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:51.724074 14121 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.945s	user 0.009s	sys 0.004s
I20260709 12:10:51.751183 11854 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:51.771421 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 131520us
I20260709 12:10:51.649521 13894 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:51.792718 14269 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.079s	user 0.010s	sys 0.003s
I20260709 12:10:51.796396 11287 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:51.743336 14074 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:51.721602 14051 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:10:51.793164 14269 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.648991 14329 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:10:51.799281 13975 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.007s
I20260709 12:10:51.785811 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:51.725234 14289 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.798910 14164 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:51.803364 14074 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:51.827497 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 233541us
I20260709 12:10:51.830168 14074 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:51.830825 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.828879 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.832149 11139 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.789106 14121 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:51.780496 14189 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.844903 11138 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:51.845235 11142 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:51.829977 14164 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.852424 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:51.852962 11135 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:51.814638 14346 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:51.856091 11141 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:51.858570 14348 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:10:51.859416 14318 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.861678 11137 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:51.866865 14329 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.868109 14121 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:51.890305 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.872736 14222 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.827740 13975 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.883715 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:51.904908 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:51.906041 11137 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:51.884519 11136 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:51.960605 11140 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.962141 11142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:10:51.962848 11142 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:51.963194 11142 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.968683 14351 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.969153 14351 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.969501 14351 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.976100 14189 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:51.979630 14318 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.982578 14341 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:51.985684 14318 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.986092 14318 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:51.987608 14164 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.988545 14318 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:51.992447 14315 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:51.995147 14289 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:51.888554 14324 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:52.000844 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 114905us
I20260709 12:10:52.002146 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:51.990003 13975 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:51.990947 14325 consensus_meta.cc:287] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 12:10:52.006140 11142 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.034224 11139 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:52.040846 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:52.042572 14325 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.004107 14352 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.043200 14080 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:52.043391 11211 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:52.019052 14189 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.044862 14189 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.046186 14121 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.046732 14121 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:52.047041 14189 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.047716 14121 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.049041 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2370) took 1261 ms. Trace:
I20260709 12:10:52.049418 11143 rpcz_store.cc:276] 0709 12:10:50.787432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.788516 (+  1084us) service_pool.cc:224] Handling call
0709 12:10:50.850977 (+ 62461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.780909 (+929932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.048792 (+267883us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54002544d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:52.048979 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831016704}
I20260709 12:10:52.051463 11142 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.043462 14352 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.057806 14352 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.999334 14219 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.002840 14315 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.069631 14351 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.070648 14219 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.076192 14324 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.076985 14351 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.084848 14352 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.087123 14352 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.093837 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1841) took 1609 ms. Trace:
I20260709 12:10:52.094466 11218 rpcz_store.cc:276] 0709 12:10:50.484734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.524251 (+ 39517us) service_pool.cc:224] Handling call
0709 12:10:52.093575 (+1569324us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:52.093754 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041976576}
I20260709 12:10:52.097625 11286 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:52.098549 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.099120 11290 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.099040 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.099861 11293 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.101363 11287 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:10:52.100323 14164 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.107187 14164 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.108544 14351 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.112687 11293 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:52.113168 14074 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.115731 14164 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:52.117192 14074 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:52.120102 14354 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.270s	user 0.003s	sys 0.001s
I20260709 12:10:52.130723 11290 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:52.132884 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.136356 14329 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:52.136960 14329 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:52.126667 14133 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:10:52.143499 14125 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:52.143962 14125 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:52.144843 14125 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.146100 14125 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.155329 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.134472 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.170650 11143 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:10:52.175107 11854 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.176447 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.178992 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:52.179878 11853 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:52.181815 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.197055 14314 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.197578 14314 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.207329 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:52.208907 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.211146 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.198405 14314 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.137918 14329 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.220736 14366 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.229981 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:52.231844 11859 raft_consensus.cc:2410] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:52.233062 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:52.233717 11854 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:52.234833 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 114222us
I20260709 12:10:52.167897 14337 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.235873 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.237996 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.241453 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.241916 11142 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.227486 13841 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:52.245251 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.246574 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.247184 11144 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.243664 14269 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.248155 14244 raft_consensus.cc:2764] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:52.248929 13768 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.248832 13841 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.249577 13768 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.250097 14205 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.250563 14205 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.251312 13841 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:52.251416 14205 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.251940 13768 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:52.251816 14064 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:52.252655 14205 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.253400 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:52.237210 14326 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.252722 14064 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:52.249181 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.254637 14235 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.256834 11140 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.237366 14366 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:52.258044 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:52.260794 11859 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:52.225370 14121 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:10:52.237706 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:52.262342 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.265856 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2379) took 1292 ms. Trace:
I20260709 12:10:52.240828 14314 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.272421 11854 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:10:52.272809 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.273967 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.271274 11138 rpcz_store.cc:276] 0709 12:10:50.973885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.974011 (+   126us) service_pool.cc:224] Handling call
0709 12:10:50.974554 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.847572 (+873018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.265584 (+418012us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54003c9954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:52.265793 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981911296}
W20260709 12:10:52.277570 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66503.2us
W20260709 12:10:52.277846 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.256649 14064 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.287108 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.291581 11217 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.276119 14366 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.297861 11142 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:52.294342 11140 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:52.275995 13971 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.240741 14337 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:52.298944 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 513246us
I20260709 12:10:52.300874 11144 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:52.283856 14313 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.283418 13841 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.314059 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.315883 11212 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.315338 13841 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:52.318090 13841 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.289925 14290 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.285336 14326 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.317421 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.328445 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.329291 11219 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.334270 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2385) took 1223 ms. Trace:
I20260709 12:10:52.334705 11141 rpcz_store.cc:276] 0709 12:10:51.105116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.107407 (+  2291us) service_pool.cc:224] Handling call
0709 12:10:52.328127 (+1220720us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b54001243d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:52.328281 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686345984}
I20260709 12:10:52.343030 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:52.336350 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.347465 11216 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.327411 14313 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:52.359321 14368 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:52.359599 14164 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:52.360281 14164 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.369073 14356 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.371769 14313 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:52.375988 14367 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:10:52.332930 14290 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:52.391925 14290 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.393038 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:52.395861 14337 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:52.396317 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2378) took 1422 ms. Trace:
I20260709 12:10:52.396986 11292 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.396757 11135 rpcz_store.cc:276] 0709 12:10:50.973458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.974632 (+  1174us) service_pool.cc:224] Handling call
0709 12:10:52.396089 (+1421457us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540032f0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:52.396248 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903270272}
I20260709 12:10:52.402314 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.403203 11292 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:52.404698 14064 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.406145 14064 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.414880 11217 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:52.416949 11218 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:10:52.420645 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76538.5us
W20260709 12:10:52.421521 11259 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.170s (SENT)
I20260709 12:10:52.421985 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.418566 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.425020 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.426138 11284 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:52.435262 11212 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:52.435796 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.437188 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.437893 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.440667 14337 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.441167 11859 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:52.441778 14186 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.442399 14186 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:52.443770 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.443725 13937 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:52.395882 14356 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:10:52.452905 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 168536us
I20260709 12:10:52.456584 11216 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:52.431093 14125 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.449041 14326 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:52.473636 11259 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.223s (SENT)
I20260709 12:10:52.474319 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.433230 14133 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:10:52.480552 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1178691750001235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:10:52.483067 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1165162230001897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 12:10:52.496619 11110 connection.cc:256] RPC call timeout handler was delayed by -1.067469175000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 12:10:52.467137 14356 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.502458 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.475150 14125 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:52.505193 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.505756 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.506560 11218 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.505883 11216 raft_consensus.cc:2376] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8. Re-sending same reply.
I20260709 12:10:52.506129 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.505868 11212 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:10:52.507210 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.507241 11284 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.507802 11293 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.508607 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.511775 11217 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:10:52.477557 14164 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:52.514645 11290 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:52.504099 13937 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.507588 11212 pending_rounds.cc:85] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 5
I20260709 12:10:52.517930 11218 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:52.516551 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.520679 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.521071 11219 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:52.522854 11216 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:52.528462 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.532059 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.533448 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.534263 11210 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.535243 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.535167 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.536008 11216 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:52.537077 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.535305 14245 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:52.540848 14245 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.541772 14245 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.505097 14337 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.542930 14245 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.544346 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.544140 14125 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.545148 11211 raft_consensus.cc:2410] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:52.545943 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.546898 13937 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.547525 11135 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:52.548195 11218 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:10:52.518265 11212 pending_rounds.cc:107] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:10:52.549299 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.549609 11212 raft_consensus.cc:2889] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.550194 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.550982 11214 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.551069 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.551846 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.552805 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.553573 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.552028 11212 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.554806 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.554883 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:52.555210 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87108.5us
I20260709 12:10:52.555558 11291 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:52.556372 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.556425 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.557156 11291 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:52.557698 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.552976 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.558221 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.558611 11214 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.559576 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.560613 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.559463 11210 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.557940 13975 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.561188 11289 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.561463 13975 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.561815 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.538259 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.562788 11216 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:52.563570 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.564345 11216 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:52.564635 13975 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:52.566428 14356 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.582870 11212 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.566903 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.457069 14186 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.567552 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.559069 11288 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:52.570734 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:52.558012 11259 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.964s (SENT)
I20260709 12:10:52.536175 11286 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:52.586409 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.585700 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.588200 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.589398 11217 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:10:52.581701 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50937.5us
I20260709 12:10:52.583977 11214 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:10:52.591320 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.581863 11293 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:10:52.592149 11214 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:52.592768 11284 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:52.501307 14235 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:52.581161 11289 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:52.593124 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.595623 11216 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.599725 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.600739 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.601202 11217 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:52.602574 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.603312 11215 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.604094 11291 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:52.606755 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.607582 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.607882 11216 raft_consensus.cc:2368] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:52.607702 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.549319 13937 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:52.610482 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.611299 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.611332 11216 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:52.612756 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.613569 11214 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.614086 11217 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:52.611193 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.615348 14374 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.616679 14318 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.597260 13975 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:52.618793 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.619660 11212 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.623019 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.623847 11215 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.624532 11216 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:52.631053 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 73079.9us
W20260709 12:10:52.631664 11259 leader_election.cc:336] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.986s (SENT)
I20260709 12:10:52.632022 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.634871 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.636096 11213 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:52.629326 11210 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
W20260709 12:10:52.636083 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 105771us
I20260709 12:10:52.639842 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.641816 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.642980 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:52.644622 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.665249 11219 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:52.642606 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:52.645902 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.647411 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.663043 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.665876 11213 raft_consensus.cc:2368] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:52.668617 11215 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:52.669406 11854 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:52.674005 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:52.676520 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.676775 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.677356 11137 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:52.677604 11144 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:52.679580 14372 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.672513 14244 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:52.683230 14371 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.319s	user 0.003s	sys 0.000s
I20260709 12:10:52.686939 13841 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.689064 13841 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:52.664867 14091 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.695236 11855 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:52.698403 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 66752.4us
I20260709 12:10:52.704463 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:52.704932 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.705574 11286 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:52.706622 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.708118 14091 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.708696 14091 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:52.709120 11288 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:52.710263 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.711359 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.711571 14091 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:10:52.711871 11288 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.712529 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.713601 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.714295 11284 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:52.715045 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.714956 14064 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.716378 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.701974 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:52.717815 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.715595 11284 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:52.719429 11287 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:10:52.719892 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.720727 14244 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.721271 14244 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.721755 11286 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:52.725627 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.730929 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.677165 14121 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.733790 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.733824 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.742082 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.742398 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.743232 11291 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.742744 11289 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.744882 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.750670 14290 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:52.751212 14290 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.754233 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.755528 11211 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:52.755731 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.757843 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.758354 11219 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.753944 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.759464 11284 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.762974 14121 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:52.764071 14121 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.766842 14324 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:52.743875 14325 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.768360 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.768565 14324 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.769134 14324 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.769296 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.770229 13937 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.770789 14245 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.771164 13937 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.771360 14245 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.771579 13937 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.772333 14245 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.773730 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.762640 14235 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.774842 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.775341 11216 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:52.775545 11218 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.776608 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.777128 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.777429 11214 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.758880 14372 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:52.779980 14329 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.780717 14341 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:10:52.781913 14222 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:52.783453 11213 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:52.772454 13937 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.776386 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.785576 11215 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.785795 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.776458 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.770354 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:52.791487 11287 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:52.791671 11288 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:52.792531 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:52.793215 11288 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:52.793942 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.797546 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.798256 11144 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:52.798779 11144 pending_rounds.cc:85] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:10:52.799031 11144 pending_rounds.cc:107] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:52.799322 11144 raft_consensus.cc:2889] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.790316 11219 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:52.803968 11211 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:52.812803 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:52.814879 11219 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:52.815068 11213 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:52.818365 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.819231 11144 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.810672 14205 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.820564 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.825395 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:52.825793 11288 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:52.827004 11288 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:52.828353 11288 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:52.828423 14244 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:52.770713 14356 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.820587 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.821147 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.833448 11136 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.822546 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.834568 11284 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.832540 11289 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:52.842931 11144 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:52.844172 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.843744 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:52.848270 11287 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.792218 14325 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.851882 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.852906 11137 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:52.855618 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:52.856623 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.770007 14324 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.865942 11135 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.832762 14091 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.873620 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.874641 11144 raft_consensus.cc:2368] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:52.836427 14205 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.877024 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.857391 13937 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.878675 11144 raft_consensus.cc:2410] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:52.880337 11135 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:52.882752 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.863953 14356 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:52.852111 14290 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:52.858845 13975 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:52.872849 14370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.030s
I20260709 12:10:52.888202 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:52.888486 11136 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:52.870304 14164 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.889333 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.896682 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.897339 11137 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:52.889765 14064 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:52.895042 14370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.014s	sys 0.031s
I20260709 12:10:52.885438 11853 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:52.905647 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:52.906788 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:52.908411 11137 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:52.908749 11259 leader_election.cc:400] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:52.909112 11259 leader_election.cc:403] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.901311 13841 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.915889 11259 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:52.924437 11259 leader_election.cc:403] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.919025 14356 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.900401 14064 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.931576 14064 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:52.932905 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:52.922709 14300 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.934926 11259 leader_election.cc:400] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
I20260709 12:10:52.935256 11259 leader_election.cc:403] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.938838 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:52.941300 11285 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:52.880944 14091 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:52.943015 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:52.947640 14389 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:10:52.954083 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:52.956384 11141 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:52.971993 14404 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.972797 14404 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:52.923535 14164 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.975044 14064 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.945278 14290 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:52.975294 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:52.961261 13975 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:53.078675 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 94862.1us
I20260709 12:10:52.975067 14337 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6.
W20260709 12:10:53.084712 11110 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.667s (SENT)
I20260709 12:10:52.977227 14164 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:52.909998 14325 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:53.087445 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133459us
W20260709 12:10:53.078032 14394 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:10:53.080968 14395 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:10:53.090677 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.974059 14404 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.929246 14205 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:52.975826 13841 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:10:53.079679 13975 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:10:53.095296 11110 leader_election.cc:336] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.809s (SENT)
I20260709 12:10:53.088419 14164 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.101838 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:53.083755 14373 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.980832 14064 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.094617 14386 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.109695 11215 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:53.099536 14337 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.103559 13975 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.119481 11110 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.901s (SENT)
I20260709 12:10:53.113022 14235 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:53.123082 14393 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 12:10:53.123261 14396 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:10:53.125402 14064 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:53.128546 14300 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:53.105836 14373 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.114853 14386 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.145614 14386 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:53.149199 14390 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:10:53.152154 14091 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.121711 14401 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:53.158667 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:53.161155 11855 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:10:53.162966 11854 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:53.167761 14314 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.168566 14314 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.192345 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:53.109102 14313 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:10:53.201610 14407 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.202152 14407 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:53.203217 14407 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.184156 14362 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.324782 14373 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:53.516789 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:53.517491 11137 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:10:53.644336 14164 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:10:53.644975 14164 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.647330 14164 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:53.662314 14164 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.663084 14412 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:53.663071 14164 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.667213 14164 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.677350 14313 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:53.678210 14313 consensus_queue.cc:1243] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:10:53.718622 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.026s	sys 0.033s
W20260709 12:10:53.722481 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.026s	sys 0.033s
W20260709 12:10:53.725036 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 749795us
I20260709 12:10:53.729151 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:53.755151 14164 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:53.771994 14164 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.775704 14164 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.779443 14412 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.780006 14412 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.780428 14412 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.786185 14386 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:53.788224 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 667188us
I20260709 12:10:53.792162 14365 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.792929 14404 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:53.792891 14365 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.793674 14404 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.796119 14404 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:53.798133 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 69119.8us
I20260709 12:10:53.804701 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:53.805712 14164 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.806131 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:53.814002 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:53.789296 14412 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.807253 11292 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:53.808350 14365 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:53.817142 14412 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:53.819177 14404 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.820178 14404 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.822153 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:53.826076 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.826231 14164 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.827517 14164 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:53.832942 13975 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.688s	user 0.013s	sys 0.000s
I20260709 12:10:53.833258 11216 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:53.836076 13975 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.839694 14352 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:53.843780 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:53.846395 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:53.847028 11292 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:10:53.848594 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:53.850718 14352 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.857654 14352 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:53.857903 13975 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:53.858604 14404 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:53.858687 13975 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:53.866194 14404 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:53.850903 14412 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.868306 14404 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:53.866053 14419 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:53.867657 13975 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.884191 13975 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.892688 13975 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.893656 14414 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:53.898880 14414 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.902045 14414 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.904973 14404 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:53.217566 11287 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:53.920517 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1638) took 1131 ms. Trace:
I20260709 12:10:53.920969 11287 rpcz_store.cc:276] 0709 12:10:52.789285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.802781 (+ 13496us) service_pool.cc:224] Handling call
0709 12:10:53.920439 (+1117658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.927958 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:53.934635 11284 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.934803 14324 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.940826 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.941859 14422 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:53.942817 14422 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.946206 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:53.952523 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.960899 14425 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:53.961529 14425 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.965065 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:53.950994 14422 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.967207 14425 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:53.958565 14324 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.978598 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:53.979857 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:53.980428 11213 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:10:53.981653 11213 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:53.981806 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:53.322309 14362 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.983628 14415 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:53.984272 14415 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.984776 14415 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:53.984863 14362 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:53.980283 14324 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:53.988487 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:53.989269 11284 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:10:53.994954 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:53.996279 14362 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:53.996426 11213 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:53.997226 14362 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.997861 14362 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:54.002436 14365 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.004000 14425 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.004760 14425 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.007225 14425 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.007117 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:54.007869 14365 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:54.009370 14362 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.012127 14362 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.013854 14415 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.016999 14415 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.017954 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:54.018410 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:54.018656 11292 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:54.019069 11284 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:54.026940 11284 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:10:54.027215 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.027858 14404 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.027009 11292 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:10:54.028517 14404 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.029449 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:54.033782 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:54.035250 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:54.035979 11218 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:54.042338 14404 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.043864 11217 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.044203 14415 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:10:54.044710 14415 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:54.045601 14415 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.048380 11288 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:54.050990 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1876) took 1276 ms. Trace:
I20260709 12:10:54.051398 11216 rpcz_store.cc:276] 0709 12:10:52.774234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.776219 (+  1985us) service_pool.cc:224] Handling call
0709 12:10:54.041199 (+1264980us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001d3154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:54.050930 (+  9731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405815552}
I20260709 12:10:54.052440 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.053210 11286 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:54.053704 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1628) took 1349 ms. Trace:
I20260709 12:10:54.054029 11286 rpcz_store.cc:276] 0709 12:10:52.704537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.722417 (+ 17880us) service_pool.cc:224] Handling call
0709 12:10:54.052258 (+1329841us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:54.053637 (+  1379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8458624}
W20260709 12:10:54.057943 11258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.033s	sys 0.065s
I20260709 12:10:54.058689 14362 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:54.060068 11259 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.072s (SENT)
I20260709 12:10:54.060850 11218 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
W20260709 12:10:54.058439 11258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.033s	sys 0.066s
W20260709 12:10:54.063812 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 972647us
I20260709 12:10:54.063910 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:54.064788 11258 leader_election.cc:400] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:54.065176 11258 leader_election.cc:403] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:54.068621 14404 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.069200 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:54.065017 14362 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:54.072389 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:54.071241 14412 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.078878 14412 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:54.079932 14290 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.080482 14290 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.080822 14290 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.080886 14362 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:54.068671 13975 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8.
I20260709 12:10:54.082254 14362 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:54.105031 11291 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.344s	user 0.008s	sys 0.009s
I20260709 12:10:54.105538 11291 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
W20260709 12:10:54.106070 11291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1635) took 1399 ms (client timeout 1708 ms). Trace:
W20260709 12:10:54.106340 11291 rpcz_store.cc:269] 0709 12:10:52.739123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.742152 (+  3029us) service_pool.cc:224] Handling call
0709 12:10:54.106018 (+1363866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:54.107802 14404 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.118063 14404 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.120548 14404 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:54.128659 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56365.5us
W20260709 12:10:54.132688 11258 connection.cc:256] RPC call timeout handler was delayed by -1.0333387139999104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:10:54.133752 14186 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.020s	sys 0.019s
W20260709 12:10:54.134794 14186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.020s	sys 0.019s
I20260709 12:10:54.135593 11860 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:10:54.139591 11853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 755) took 1926 ms (client timeout 1980 ms). Trace:
W20260709 12:10:54.140053 11853 rpcz_store.cc:269] 0709 12:10:52.213449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.215377 (+  1928us) service_pool.cc:224] Handling call
0709 12:10:54.139415 (+1924038us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54006e0354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:54.139530 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871934848}
I20260709 12:10:54.140272 14290 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.171903 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 2089) took 1619 ms. Trace:
I20260709 12:10:54.172418 11285 rpcz_store.cc:276] 0709 12:10:52.552895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.559324 (+  6429us) service_pool.cc:224] Handling call
0709 12:10:54.171663 (+1612339us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400060ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:54.171828 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875905920}
I20260709 12:10:54.171939 14345 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.177105 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.182884 14415 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.183637 14415 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.174322 14345 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.191848 11286 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:54.194247 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.190542 11219 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:54.192641 11213 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.205641 11288 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:10:54.186651 14415 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.221361 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:53.371330 14314 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.223354 14417 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:54.167797 14352 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:54.226189 14352 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.229038 14352 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.234555 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.235558 11853 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:54.237402 14290 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:54.237587 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:54.238581 14356 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.238984 14356 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.239336 14356 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.240147 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1874) took 1466 ms. Trace:
I20260709 12:10:54.240531 11217 rpcz_store.cc:276] 0709 12:10:52.773717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.778190 (+  4473us) service_pool.cc:224] Handling call
0709 12:10:52.778465 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.044379 (+1265914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.239910 (+195531us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002a08d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:54.240089 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909719936}
I20260709 12:10:54.229254 14324 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.245000 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.245350 14417 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:54.245831 14417 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.245936 11288 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:54.246196 14417 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.249063 14407 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.257328 14356 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.260648 14235 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:54.261605 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 472231us
W20260709 12:10:54.262208 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 116325us
I20260709 12:10:54.262972 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.264108 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:54.231308 14345 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.276129 14387 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.272902 14290 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:54.284840 14374 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.287274 14372 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.307026 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.272887 14386 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:54.290068 14419 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:54.275784 14235 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.310201 14372 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.313357 14205 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.306780 14362 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:10:54.324779 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 350) took 1679 ms. Trace:
I20260709 12:10:54.325470 11860 rpcz_store.cc:276] 0709 12:10:52.645790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.663120 (+ 17330us) service_pool.cc:224] Handling call
0709 12:10:52.679028 (+ 15908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.136002 (+1456974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.324441 (+188439us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400448ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:54.324672 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3349166464}
I20260709 12:10:54.307600 14290 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.311520 14351 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:54.322196 14372 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.311276 14374 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:54.343940 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.317775 14419 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.351459 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:54.334122 14244 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:54.364475 14374 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.356623 14235 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.368068 11854 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 12:10:54.372593 14428 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:54.357625 14417 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.340068 14373 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:54.330343 14407 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.373728 14428 consensus_queue.cc:1243] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:54.358279 14290 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:54.340337 14387 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:54.373989 14407 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.374456 14428 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:10:54.374969 14428 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:54.351014 14414 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.375667 14414 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.373751 14373 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:54.376251 14407 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:54.376602 11073 debug-util.cc:398] Leaking SignalData structure 0x7b0800109da0 after lost signal to thread 9941
I20260709 12:10:54.377139 14373 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:54.377874 11073 debug-util.cc:398] Leaking SignalData structure 0x7b080033bd20 after lost signal to thread 11076
I20260709 12:10:54.378196 14414 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.340237 14386 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.333779 14401 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:54.323553 14205 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.390262 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:54.394038 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.393946 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:54.402846 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.384358 14205 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.378432 14373 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.378705 14417 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.404554 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:54.382838 14401 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.402935 14449 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.379805 14356 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.397567 14244 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.404978 14446 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.382287 14386 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.403031 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:54.410827 14401 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:54.412598 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1641) took 1595 ms. Trace:
I20260709 12:10:54.414114 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1611) took 1863 ms. Trace:
I20260709 12:10:54.478221 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:54.401558 14428 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.419416 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:54.477845 11210 rpcz_store.cc:276] 0709 12:10:52.550390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.561565 (+ 11175us) service_pool.cc:224] Handling call
0709 12:10:54.413929 (+1852364us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b5400384354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:54.414047 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153891712}
I20260709 12:10:54.419970 14449 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.423761 14419 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:54.424204 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08001b3bc0 after lost signal to thread 11168
I20260709 12:10:54.477694 11290 rpcz_store.cc:276] 0709 12:10:52.817217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.830823 (+ 13606us) service_pool.cc:224] Handling call
0709 12:10:52.831074 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.831266 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:52.912130 (+ 80864us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.412083 (+1499953us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b18000e9f20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287
0709 12:10:54.412204 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:54.412263 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:54.412318 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.412393 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.412531 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14585,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4218,"raft.queue_time_us":120551,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5083,"spinlock_wait_cycles":20848512,"thread_start_us":262171,"threads_started":3,"wal-append.queue_time_us":60929,"wal-append.run_cpu_time_us":1280,"wal-append.run_wall_time_us":1001625}
W20260709 12:10:54.492957 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff760 after lost signal to thread 11243
I20260709 12:10:54.425846 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.429637 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 5 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 8 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.433373 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 752) took 1986 ms. Trace:
I20260709 12:10:54.440517 14189 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.441452 14372 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.483139 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.502359 11142 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:10:54.481606 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.503695 11144 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:54.504833 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.505494 11144 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:54.497457 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:54.495187 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69414.7us
W20260709 12:10:54.496953 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08003c84a0 after lost signal to thread 11317
W20260709 12:10:54.498659 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79321.8us
I20260709 12:10:54.498844 11141 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:10:54.508315 11073 debug-util.cc:398] Leaking SignalData structure 0x7b080037fe60 after lost signal to thread 11318
I20260709 12:10:54.496902 11859 rpcz_store.cc:276] 0709 12:10:52.446685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.446845 (+   160us) service_pool.cc:224] Handling call
0709 12:10:52.447199 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.447646 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:52.602111 (+154465us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.161843 (+1559732us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b180029dac0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b23a
0709 12:10:54.162060 (+   217us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.166859 (+  4799us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.289806 (+122947us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.289868 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.290912 (+  1044us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.432952 (+142040us) raft_consensus.cc:1685] finished
0709 12:10:54.433088 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.433293 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":224563,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1608,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":187,"spinlock_wait_cycles":129877248,"thread_start_us":311640,"threads_started":3,"wal-append.queue_time_us":399543,"wal-append.run_cpu_time_us":2274,"wal-append.run_wall_time_us":1268175}
I20260709 12:10:54.509847 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.508117 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.509608 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.515409 11138 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:54.510556 11139 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:54.517805 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.497988 14452 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:54.459246 14387 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.518934 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.491298 14244 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.459486 14235 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:54.520156 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08002204c0 after lost signal to thread 11885
I20260709 12:10:54.521497 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.513460 11143 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:54.490904 11853 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.551541 11141 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:54.523325 11135 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:54.552464 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:54.544117 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:54.553651 11138 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:54.553800 11293 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:54.542687 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9fc0 after lost signal to thread 11886
W20260709 12:10:54.556310 11073 debug-util.cc:398] Leaking SignalData structure 0x7b0800320760 after lost signal to thread 14133
W20260709 12:10:54.556949 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf8e0 after lost signal to thread 14319
I20260709 12:10:54.524479 11140 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:54.557412 11073 debug-util.cc:398] Leaking SignalData structure 0x7b08003a87e0 after lost signal to thread 14341
W20260709 12:10:54.557946 11073 debug-util.cc:398] Leaking SignalData structure 0x7b080036a220 after lost signal to thread 14366
I20260709 12:10:54.545994 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.523531 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.494266 14205 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.553207 11142 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.558683 11290 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:10:54.459677 14374 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.501667 14189 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:54.617619 11139 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:54.569193 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45729.8us
I20260709 12:10:54.522951 14401 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.595224 11293 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:10:54.629604 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97142.3us
I20260709 12:10:54.518945 14414 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.630646 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:10:54.631500 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79376.1us
I20260709 12:10:54.522902 14450 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.629675 11039 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.508607 14356 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.638989 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.641054 11286 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:54.641499 11286 pending_rounds.cc:85] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 6
I20260709 12:10:54.523044 14324 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.634815 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:54.622712 13971 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.542218 14428 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:54.636245 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.657341 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.641721 11286 pending_rounds.cc:107] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:54.658869 11286 raft_consensus.cc:2889] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.659142 11142 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:54.567590 14064 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.538985 14451 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:54.645160 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.644100 11039 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 6 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 9 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.676172 11291 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:54.624361 14205 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.629403 14245 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.633198 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.634315 14418 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.656177 11288 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.656525 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.695071 11861 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:10:54.656795 11038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 254) took 15035 ms (client timeout 15000 ms). Trace:
I20260709 12:10:54.565996 14447 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:10:54.550920 14449 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:10:54.566576 14235 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.559741 14244 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.551542 14387 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.682036 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:54.692358 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 70614.7us
I20260709 12:10:54.689864 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:54.661316 13971 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.699049 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.731860 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.734055 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.699049 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:54.699806 14290 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.701084 11284 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:10:54.741061 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51327us
I20260709 12:10:54.702021 11289 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.702994 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.742635 11140 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:10:54.743534 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.744215 11140 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 3.
I20260709 12:10:54.745254 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.704252 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:54.746820 11139 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:54.703644 11039 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 5 to 7, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:54.705518 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.705024 14245 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.705078 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.757182 11141 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:54.689615 14205 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.690683 14064 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.709287 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:54.715535 11259 leader_election.cc:336] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.154s (SENT)
I20260709 12:10:54.530282 14452 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.635538 14401 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.632897 14374 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:54.749845 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.754499 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:54.810005 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55657.5us
W20260709 12:10:54.755940 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.813094 14356 raft_consensus.cc:2764] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:10:54.814055 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:54.693886 14407 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:54.711333 14314 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.818655 14418 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:54.712517 14451 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:54.819245 14418 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.819783 14418 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.820031 14451 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:10:54.776126 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60637.2us
I20260709 12:10:54.777391 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:10:54.779913 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 148710us
I20260709 12:10:54.818333 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:54.647507 14450 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.826905 14450 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.811592 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:54.818684 14407 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:54.807497 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55633.1us
I20260709 12:10:54.829926 14460 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.830550 14460 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:54.829216 14314 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:54.831298 14314 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.828465 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:54.831743 14314 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.831638 14460 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.833680 14326 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.834091 14326 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.834460 14326 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.834729 14407 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:54.696065 11038 rpcz_store.cc:269] 0709 12:10:39.605586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.605967 (+   381us) service_pool.cc:224] Handling call
0709 12:10:54.640162 (+15034195us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:51.125409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:51.126109 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:51.126161 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:10:51.126178 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:51.127364 (+  1186us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:51.127462 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:51.127490 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:10:51.128643 (+  1153us) tablet.cc:701] Row locks acquired
0709 12:10:51.128693 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:10:51.128857 (+   164us) write_op.cc:270] Start()
0709 12:10:51.129009 (+   152us) write_op.cc:276] Timestamp: P: 1783599051128786 usec, L: 0
0709 12:10:51.129040 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:10:51.129793 (+   753us) log.cc:844] Serialized 5143 byte log entry
0709 12:10:51.643864 (+514071us) op_driver.cc:464] REPLICATION: finished
0709 12:10:51.862609 (+218745us) write_op.cc:301] APPLY: starting
0709 12:10:51.862734 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:51.863054 (+   320us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:51.863196 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:51.864937 (+  1741us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:51.865328 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:10:51.865393 (+    65us) write_op.cc:312] APPLY: finished
0709 12:10:51.865826 (+   433us) log.cc:844] Serialized 95 byte log entry
0709 12:10:51.866020 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:51.866179 (+   159us) write_op.cc:454] Released schema lock
0709 12:10:51.866248 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:51.901217 (+ 34969us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:51.905639 (+  4422us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":469009,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":127606,"apply.run_cpu_time_us":4144,"apply.run_wall_time_us":30192,"num_ops":13,"prepare.queue_time_us":322502,"prepare.run_cpu_time_us":40600,"prepare.run_wall_time_us":151671,"raft.queue_time_us":127076,"raft.run_cpu_time_us":17014,"raft.run_wall_time_us":176916,"replication_time_us":491871,"thread_start_us":375255,"threads_started":4,"wal-append.queue_time_us":169199,"wal-append.run_cpu_time_us":10938,"wal-append.run_wall_time_us":1563062}]]}
I20260709 12:10:54.827489 14450 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.712844 14446 raft_consensus.cc:2764] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:54.757171 14449 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.768026 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:54.847729 11215 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:10:54.761515 14443 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.760885 14324 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.775720 14372 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:54.870214 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 3.277s (SENT) [suppressed 32 similar messages]
I20260709 12:10:54.853091 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:54.769019 14448 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.808990 11039 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:10:54.773115 14370 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:54.865710 11135 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:54.845791 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.815397 14164 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.876978 11139 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:10:54.764021 14290 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.760912 14458 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 12:10:54.863269 14450 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.898380 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:54.900470 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 136977us
I20260709 12:10:54.906973 14450 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:54.859552 14386 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:54.915150 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84976us
I20260709 12:10:54.861209 14356 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:10:54.897223 14443 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:54.923285 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.933022 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.933995 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:54.869549 14449 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.938886 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:54.915659 14472 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.949002 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.944969 14401 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:54.946442 14449 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:54.939158 14458 consensus_queue.cc:1243] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:54.901176 14448 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:54.947438 14459 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:54.900615 14164 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:54.931422 14345 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.933516 14324 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.972316 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:54.976261 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 130541us
W20260709 12:10:54.972365 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 119393us
I20260709 12:10:54.979537 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:54.980870 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:54.900449 14370 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.970091 14386 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.983968 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:54.978504 14345 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.999388 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:54.982350 14415 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.986086 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:10:55.000311 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92381.6us
I20260709 12:10:54.998306 14470 raft_consensus.cc:2764] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:54.985215 14460 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.981413 14401 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.000103 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.007117 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.010739 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:55.011683 11140 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.222287 11139 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.186573 14374 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:55.002681 14245 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.088205 14478 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:55.188876 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:55.230115 11859 raft_consensus.cc:2376] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7. Re-sending same reply.
I20260709 12:10:55.186249 14452 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.181197 14448 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:55.139132 14469 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:10:55.106478 14324 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.191740 14164 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:55.235008 11853 consensus_meta.cc:287] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
W20260709 12:10:55.132695 14462 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:10:55.110968 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.189407 14290 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:55.150034 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.982038 14407 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:55.098343 14356 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.092638 14480 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:10:55.130678 14326 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:55.099386 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113371us
I20260709 12:10:55.286705 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.000577 14443 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.091521 14189 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.006209 14457 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.968883 14472 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.002609 13971 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:55.141940 14477 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:10:55.008170 14345 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.098695 14064 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.089934 14387 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:55.212803 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 228993us
W20260709 12:10:55.224205 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 213551us
I20260709 12:10:55.318912 14064 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:55.221414 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 221380us
I20260709 12:10:55.234586 14418 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:54.986156 14313 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:55.322140 14345 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.324457 14418 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:55.243791 14370 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:55.326972 11284 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:10:55.328476 11292 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:10:55.329511 14345 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.332235 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.333007 11286 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:55.334026 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.243989 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.336401 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.337517 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.338219 11136 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:55.223960 14401 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.227643 14386 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:55.254712 14428 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.003s
I20260709 12:10:55.259580 14164 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.235505 11853 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:55.266794 14324 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:55.343514 14164 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.345065 14324 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.346951 14164 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:55.266060 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.347944 11138 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:55.208787 14489 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.275315 11140 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:10:55.280562 11210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.040s
I20260709 12:10:55.349310 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.269174 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.351100 11135 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:10:55.352283 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.353742 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.230115 14223 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.354761 14223 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:55.355296 14223 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.357100 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.210405 14314 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.294909 14457 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:55.360523 14457 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.360697 14386 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.360761 14314 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:55.281167 14205 consensus_meta.cc:287] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 12:10:55.361275 14386 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.305716 14478 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.362123 14205 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.348789 14489 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.363447 14386 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:55.305459 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 366939us
I20260709 12:10:55.282183 14470 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.364774 14470 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.365080 14489 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:55.365120 14205 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.293042 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.318944 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:55.366904 14470 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.283763 14356 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:55.367357 11293 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:55.367497 14356 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.283469 14407 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.368893 14244 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:55.287707 14415 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.370010 14407 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:55.329898 14472 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.371978 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:55.373502 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:55.349661 11210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.005s	sys 0.040s
I20260709 12:10:55.374646 14472 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.375037 14472 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.375381 14472 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.378455 14486 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:55.380316 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.381878 14447 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.381763 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.383975 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.385012 11137 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:55.386039 11138 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:55.386341 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.387734 14235 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.390233 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.391881 11854 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.391777 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:55.393739 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:55.303387 11139 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
W20260709 12:10:55.401168 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 108248us
I20260709 12:10:55.403420 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.405861 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:10:55.406461 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 87571.8us
W20260709 12:10:55.407205 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.342249 14401 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:55.409950 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.417742 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.419719 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.420439 11139 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:55.421401 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.422243 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.422724 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.423363 11139 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.415405 14429 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.408080 14407 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.408433 14345 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:55.433028 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.434413 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.435551 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.440559 11139 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:55.417076 14428 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:55.427525 14235 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.415124 14470 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:10:55.463917 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:55.472779 11141 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:10:55.478696 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53797.1us
I20260709 12:10:55.511899 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.460023 14429 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:55.514442 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65036.6us
I20260709 12:10:55.465957 14407 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:55.573967 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.575227 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:55.576061 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 114696us
I20260709 12:10:55.593925 11286 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:55.577553 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.595085 11292 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:55.576406 11291 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:55.579224 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.468528 14415 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:10:55.596597 11290 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:55.582515 11289 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.584172 11288 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:10:55.583803 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.518779 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:55.586884 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.576000 14478 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.470101 14356 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.592010 11287 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:55.588636 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71706.8us
I20260709 12:10:55.592840 11284 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:55.599958 11284 pending_rounds.cc:85] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 4
I20260709 12:10:55.597788 11141 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.602008 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83331.1us
I20260709 12:10:55.607417 11284 pending_rounds.cc:107] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:55.607774 11284 raft_consensus.cc:2889] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:55.583480 14314 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.616291 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.617002 11218 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:55.617812 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.618461 11218 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.618814 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.619201 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.624239 11216 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:55.624626 11217 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:55.626084 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.626859 11217 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.603681 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:55.611821 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:55.614461 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.639231 11215 raft_consensus.cc:2368] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:55.639496 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:55.640429 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.641234 11215 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.614727 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.643344 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.643910 11211 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.615285 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.645118 11219 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:55.646170 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.585546 14480 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:55.646939 11219 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:55.664201 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.658744 11218 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:55.665673 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.665794 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.644304 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:55.666783 11218 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:55.671759 11216 raft_consensus.cc:2368] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:55.672259 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.673772 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.663280 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.675119 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.675266 11219 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:55.607520 14470 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.579183 14479 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:10:55.679967 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:55.689373 11213 raft_consensus.cc:2368] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:55.681677 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.679802 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.685559 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.686476 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.692987 11215 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:55.662905 14443 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:55.698273 14484 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:10:55.642192 14324 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.693307 11216 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:55.757833 14223 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.737913 11211 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:55.642199 14386 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:55.740460 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.647596 14326 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.646620 14373 raft_consensus.cc:2764] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:55.660748 14485 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.748517 11213 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:55.752382 14356 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:55.676839 14235 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 12:10:55.794286 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 154890us
I20260709 12:10:55.603680 14370 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:10:55.663272 14314 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:55.756655 14463 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.818s	user 0.003s	sys 0.000s
I20260709 12:10:55.684260 14387 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.757359 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:55.684679 14480 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.736637 11141 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:55.761834 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.849336 11216 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:55.850505 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.765223 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.764886 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.750052 11217 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
W20260709 12:10:55.744952 14487 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.225s	user 0.000s	sys 0.007s
I20260709 12:10:55.758352 14324 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.737255 14489 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.811841 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 299509us
W20260709 12:10:55.856868 11259 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.722s (SENT)
I20260709 12:10:55.857357 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:55.814754 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.858711 11213 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:55.759101 14443 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.793996 14401 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.865995 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 191951us
W20260709 12:10:55.758600 14488 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.180s	user 0.004s	sys 0.002s
I20260709 12:10:55.859930 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.860090 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:55.864472 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.818722 14386 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.868616 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.867162 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.763473 14458 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:10:55.881875 11216 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:55.679242 14429 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.880026 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:55.835546 14387 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.883061 11218 raft_consensus.cc:2376] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5. Re-sending same reply.
I20260709 12:10:55.882745 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 523) took 1381 ms. Trace:
I20260709 12:10:55.865809 14443 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.834316 14485 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.903767 11143 rpcz_store.cc:276] 0709 12:10:54.500949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.545051 (+ 44102us) service_pool.cc:224] Handling call
0709 12:10:54.622562 (+ 77511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.770167 (+147605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.770219 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.815210 (+ 44991us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.195957 (+380747us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:55.196021 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.870982 (+674961us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003e8d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:55.871053 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.871124 (+    71us) raft_consensus.cc:1685] finished
0709 12:10:55.871145 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.882645 (+ 11500us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122350,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6948,"spinlock_wait_cycles":338342784,"thread_start_us":299517,"threads_started":1,"wal-append.queue_time_us":571120}
I20260709 12:10:55.878592 14386 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:55.917114 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:55.921108 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 473) took 1378 ms. Trace:
I20260709 12:10:55.920437 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.887406 14373 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.915984 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.926093 11216 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:55.906004 14387 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.936625 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.938431 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:55.866096 14489 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.932428 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 767) took 1208 ms. Trace:
I20260709 12:10:55.940601 11858 rpcz_store.cc:276] 0709 12:10:54.723773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.724055 (+   282us) service_pool.cc:224] Handling call
0709 12:10:55.916947 (+1192892us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:10:55.932309 (+ 15362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20600704}
I20260709 12:10:55.942093 11219 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:55.851862 14407 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:55.922892 11210 rpcz_store.cc:276] 0709 12:10:54.543265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.545069 (+  1804us) service_pool.cc:224] Handling call
0709 12:10:54.551523 (+  6454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.650439 (+ 98916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.650475 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.670163 (+ 19688us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.374902 (+704739us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:55.374970 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.375076 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.920866 (+545790us) raft_consensus.cc:1685] finished
0709 12:10:55.920889 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.921045 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8984,"raft.queue_time_us":16072,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":8408,"spinlock_wait_cycles":1134848,"thread_start_us":720075,"threads_started":2,"wal-append.queue_time_us":762653}
I20260709 12:10:55.879555 14401 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.950531 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 522) took 1449 ms. Trace:
I20260709 12:10:55.952229 11144 rpcz_store.cc:276] 0709 12:10:54.500722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.543237 (+ 42515us) service_pool.cc:224] Handling call
0709 12:10:54.543553 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.551289 (+  7736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.551323 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.551887 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.808549 (+256662us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:54.808588 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.808654 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.755974 (+947320us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:55.943587 (+187613us) raft_consensus.cc:1685] finished
0709 12:10:55.943618 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.950424 (+  6806us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8927,"raft.queue_time_us":79484,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4524,"spinlock_wait_cycles":76647680,"thread_start_us":160981,"threads_started":1,"wal-append.queue_time_us":236498}
I20260709 12:10:55.949512 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.920660 14470 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:55.963541 14223 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:55.963456 14470 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.933247 14458 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:55.964609 14458 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:55.965758 14458 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:55.967236 14458 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.948473 14504 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.973536 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:55.973697 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:55.974179 11210 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:55.988622 14520 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:55.989080 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.989446 14520 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.945117 14235 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.992278 11210 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:10:56.000672 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 120782us
W20260709 12:10:56.003130 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 146277us
I20260709 12:10:56.004943 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:56.010576 14520 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:56.012605 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 155617us
I20260709 12:10:56.017810 11210 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:56.020888 11210 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.996547 14474 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.039520 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:56.035225 14493 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:10:55.971024 14504 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.048853 14505 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:56.049942 14244 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.037585 14508 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.058808 14480 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:56.059393 14515 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:10:56.017470 14386 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.062347 14386 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:56.062743 14514 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 12:10:56.042938 14470 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:56.077193 14520 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:56.055491 14244 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:56.051524 14314 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:56.039880 14235 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:10:56.059517 14519 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:56.036954 14452 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:10:56.065976 14508 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.137485 11141 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:10:56.074888 14324 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.137149 14508 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.136343 14520 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.139004 14244 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:56.145555 14503 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:10:56.149888 14518 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:10:56.155133 14457 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.794s	user 0.013s	sys 0.000s
I20260709 12:10:56.088294 14470 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.158403 14448 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:56.183773 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 144343us
I20260709 12:10:56.145263 14489 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:56.209378 11259 leader_election.cc:400] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:56.145975 14504 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.144402 14523 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.140334 14522 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:10:56.213521 14505 consensus_queue.cc:1243] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:56.226177  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:56.199575 14244 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.230963 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1825) took 1332 ms. Trace:
I20260709 12:10:56.212814 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:56.235464 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 193406us
I20260709 12:10:56.237958 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.238519 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.238672 11219 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.235935 11135 rpcz_store.cc:276] 0709 12:10:54.898408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.390961 (+492553us) service_pool.cc:224] Handling call
0709 12:10:55.391399 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:55.391949 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.391991 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:55.392770 (+   779us) log.cc:844] Serialized 52 byte log entry
0709 12:10:55.588960 (+196190us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:55.746536 (+157576us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.760463 (+ 13927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.760553 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.227129 (+466576us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800467620. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:56.230611 (+  3482us) raft_consensus.cc:1685] finished
0709 12:10:56.230726 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.230898 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13398,"prepare.queue_time_us":244847,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":65007,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":20638,"spinlock_wait_cycles":27502848,"thread_start_us":317150,"threads_started":2,"wal-append.queue_time_us":399689}
I20260709 12:10:56.240551 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:56.215262 14472 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.839s	user 0.004s	sys 0.008s
I20260709 12:10:56.241395 11217 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:56.249547 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.250502 11217 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:56.183483 14520 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.245003 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.254171 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.252170 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.255342 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.258245 11219 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:56.258847 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.259290 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.260854 11219 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:56.208046 14457 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.263773 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.266412 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.268749 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.269315 11285 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.211097 14448 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.267344 11291 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:56.272559 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.273540 11291 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.274307 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61607.6us
W20260709 12:10:56.276060 11110 connection.cc:256] RPC call timeout handler was delayed by -1.5988176539999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 12:10:56.276463 11110 connection.cc:256] RPC call timeout handler was delayed by -1.5952176539999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 12:10:56.276337 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:56.279203 11110 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.578s (SENT)
I20260709 12:10:56.278545 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.286779 11259 leader_election.cc:400] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:56.287210 11259 leader_election.cc:403] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:56.288224 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:56.253566 14472 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:56.303407 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.306285 11291 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:56.307472 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.308252 11291 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:56.277237 14522 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:56.312198 14538 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.295850 14523 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.313516 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.318720 11138 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:56.319121 11291 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:10:56.298084 14489 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:56.314311 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.339831 14470 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.340129 14457 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:56.340673 14522 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.341113 14522 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:56.341543 14522 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.347501 14472 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.351325 14448 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.336334 14489 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:56.355537 14489 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.356384 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.356895 11211 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:56.357930 11290 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:56.358995 11217 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.359926 14443 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.362321 14443 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.366137 11285 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:56.367046 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.360726 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.368783 11213 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:56.339197 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.374121 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:10:56.325548 14524 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:56.325641 14520 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:56.319756 14523 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:56.334115 14492 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.479s	user 0.002s	sys 0.000s
I20260709 12:10:56.382192 14526 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:10:56.382506 14520 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.383193 14520 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:56.353003 14508 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.384059 14520 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.382269 14523 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.387270 14508 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:56.388670 14374 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.389297 14374 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:56.354233 14387 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.390453 14374 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.394825 14374 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.391613 11219 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:10:56.395715 11219 pending_rounds.cc:85] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 8
I20260709 12:10:56.395992 11219 pending_rounds.cc:107] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:10:56.396281 11219 raft_consensus.cc:2889] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:56.377254 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97036.7us
I20260709 12:10:56.324146 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.399472 11291 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.400262 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.402907 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.410117 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:56.411201 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.411638 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.414179 14407 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:56.412850 14470 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.407168 14472 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:56.418622 14472 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.421399 14472 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.407424 14370 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.424047 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:56.427527 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.428349 14370 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:56.428918 14370 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:56.429309 14370 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:56.430898 14401 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:56.435427 14387 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:56.436808 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:56.438140 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:56.439114 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.440953 14472 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:56.441097 14407 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.450670 14407 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:56.441767 14470 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.442408 11293 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:56.443065 14474 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:56.443470 11853 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.411029 14508 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:56.413123 14489 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:56.459174 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:56.466197 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:56.481541 11219 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:56.482010 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:56.475056 11291 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:10:56.446777 14458 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.486205 14458 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.486801 14458 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:56.487668 14458 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.485913 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.492020 14452 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:56.492712 14452 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:56.497822 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:56.459254 14474 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.504163 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.469784 14189 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.503244 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.507790 11135 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:56.506220 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.509420 11139 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:10:56.471926 14508 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:56.513341 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.507895 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.453065 14370 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.495179 14387 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.535645 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.521000 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.463855 14486 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:56.532191 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.446321 14523 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.463407 14472 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:10:56.540530 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.536489 11143 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 2.
W20260709 12:10:56.531961 14543 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:10:56.543530 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 107624us
I20260709 12:10:56.568171 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.657099 11210 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.562029 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.591799 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.657907 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:56.638228 11140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 539) took 1932 ms (client timeout 2114 ms). Trace:
I20260709 12:10:56.591048 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:56.661334 11140 rpcz_store.cc:269] 0709 12:10:54.705576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.746276 (+ 40700us) service_pool.cc:224] Handling call
0709 12:10:56.638047 (+1891771us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54001176d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:56.638162 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433984896}
I20260709 12:10:56.662089 11216 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:56.663141 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.658304 11135 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:10:56.658665 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.595444 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.666675 11215 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.667927 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:56.665611 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.564015 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.660398 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.669072 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.661332 11213 raft_consensus.cc:2376] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6. Re-sending same reply.
I20260709 12:10:56.658946 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.671656 11139 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:10:56.672091 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.673177 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.673807 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.674530 11217 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:56.674773 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.675086 11213 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.675406 11291 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:56.675509 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:56.520464 14508 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.677109 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.677706 11291 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:56.678571 11217 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 12:10:56.679047 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:56.679950 11219 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:56.684226 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.685318 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.688472 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.665053 14489 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:56.619155 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:56.690691 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.693792 11291 raft_consensus.cc:2368] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:56.691008 14064 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:56.692651 14553 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:56.706813 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.707520 11291 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
W20260709 12:10:56.711769 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43913.9us
I20260709 12:10:56.714236 11213 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:56.681382 14454 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:10:56.705817 14064 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.597019 14452 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.539259 14407 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.690663 14362 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:56.678013 14512 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:10:56.720616 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:56.761544 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:56.728173 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.728554 11215 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:56.752727 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.764310 11291 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:56.765594 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.766463 11291 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 3.
I20260709 12:10:56.771981 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:56.778453 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:56.779178 11135 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.779579 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:56.781528 11140 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:56.787302 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:56.788975 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.789963 11141 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:56.791261 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.792553 11140 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:10:56.722982 14064 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:10:56.792969 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 120004us
I20260709 12:10:56.792717 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:56.793522 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:56.760586 14362 consensus_queue.cc:1243] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:56.798298 11141 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:56.799588 11140 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:56.775583 14326 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:56.779609 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 101238us
I20260709 12:10:56.816938 11135 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:56.778774 14460 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:56.786617 14356 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.801138 14370 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:56.798810 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:56.810778 14326 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.867100 14313 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.867244 14559 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:56.868914 14528 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.869535 14064 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.780443 14489 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:56.872375 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 542) took 1424 ms. Trace:
I20260709 12:10:56.900403 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:56.899024 11144 rpcz_store.cc:276] 0709 12:10:55.447612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.953943 (+506331us) service_pool.cc:224] Handling call
0709 12:10:55.954299 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.014599 (+ 60300us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:56.023035 (+  8436us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.036400 (+ 13365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.036464 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:56.036518 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.217907 (+181389us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18003f17e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:10:56.872154 (+654247us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54002c0e54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:56.872199 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.872319 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13092,"prepare.queue_time_us":8630,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2186,"raft.queue_time_us":15238,"raft.run_wall_time_us":4258,"spinlock_wait_cycles":146968960}
W20260709 12:10:56.874581 14554 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:10:56.827947 14522 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:56.864566 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85036us
I20260709 12:10:56.882670 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.909948 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:56.873114 14186 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:56.859632 14523 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:56.909075 11140 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:10:56.884263 11256 connection.cc:256] RPC call timeout handler was delayed by -1.2088983640001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 12:10:56.910036 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.911804 11286 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:56.912909 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.913566 11286 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:10:56.920185 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.928910 11286 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:56.891104 14326 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.926921 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:56.908689 14064 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:56.913259 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87260.4us
I20260709 12:10:56.931772 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.934710 11286 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:56.932312 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 132438us
W20260709 12:10:56.933320 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.900022 14370 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:56.903162 14313 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:56.938234 11291 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.936069 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.943058 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.943790 11288 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 2.
I20260709 12:10:56.943953 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.944852 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.946718 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.947980 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:56.899402 14418 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:56.913192 14557 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.949712 11288 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.928478 14164 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:56.955500 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44369.1us
I20260709 12:10:56.955322 11286 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:56.938235 14523 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.967600 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:56.972779 11284 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:56.973325 11286 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:56.948824 14370 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:56.949424 14562 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:10:56.979684 14550 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
W20260709 12:10:56.980890 14374 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 12:10:56.981844 11285 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:56.913867 14548 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:10:56.984439 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.949347 14563 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.951074 14567 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:56.996798 14563 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:56.985904 11285 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:56.999466 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:56.986869 11288 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:57.000471 11290 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.987336 11286 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.991281 11210 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:10:56.953550 14557 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.994719 14475 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.995723 14370 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:57.009683 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 98223.1us
I20260709 12:10:56.951908 14356 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:56.966480 14454 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.011737 11286 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:57.022151 14563 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.045843 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46459us
I20260709 12:10:56.969372 14164 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.055676 14164 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:57.025697 14557 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:57.062922 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119089us
I20260709 12:10:57.034997 14475 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:57.032406 14454 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:57.052548 14356 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.071709 14508 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.176295 14374 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.286027 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 345250us
W20260709 12:10:57.293401 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 257638us
I20260709 12:10:57.176136 14454 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.293458 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:57.254604 14189 consensus_meta.cc:287] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.005s
I20260709 12:10:57.359108 11284 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.232026 14563 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.034162 14313 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:57.410805 14474 consensus_meta.cc:287] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.000s
I20260709 12:10:57.399768 14189 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.398276 14522 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:57.352095 14374 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:57.466859 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133031us
I20260709 12:10:57.463902 14546 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:57.487566 14577 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:10:57.488364 14568 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
W20260709 12:10:57.495172 14576 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:57.499483 14508 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:57.501422 14583 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:57.426277 14578 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:10:57.465548 14189 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.441412 14474 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.421001 14475 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:57.542882 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 248614us
I20260709 12:10:57.567955 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:57.504495 14546 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:57.573007 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:57.585989 11292 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:57.586323 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:57.526504 14472 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:57.601761 14590 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:57.602576 14590 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.603405 14589 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:57.604244 14589 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.605324 14590 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:57.612262 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.617003 11824 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.008s
I20260709 12:10:57.571444 14575 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:57.591570 14472 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.593406 14374 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:57.610674 14572 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.532929 14583 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:57.632176 11137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.008s
W20260709 12:10:57.644054 11137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.008s
W20260709 12:10:57.632347 11824 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.008s
I20260709 12:10:57.618257 14589 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:57.624577 14326 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 12:10:57.625386 14567 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.645763 14470 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.194s	user 0.015s	sys 0.000s
W20260709 12:10:57.655592 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.019s
W20260709 12:10:57.663937 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.020s
W20260709 12:10:57.664239 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 615481us
I20260709 12:10:57.665623 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:57.619839 14546 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.663139 14589 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.664249 14470 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.683545 14567 raft_consensus.cc:2764] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:57.686719 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:57.700908 14589 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:57.705408 14567 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.706377 14589 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:57.708629 14557 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 12:10:57.709036 14557 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.660641 14592 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:57.681809 14474 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:57.684128 14189 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:57.703118 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:57.698284 14546 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.661755 14326 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:57.712002 14599 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:57.712553 14581 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.719327 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 136831us
I20260709 12:10:57.727591 11854 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:57.722460 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 136202us
I20260709 12:10:57.725148 11143 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:57.730075 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:57.732511 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:57.733121 11292 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:10:57.718209 14470 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.726909 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:10:57.738323 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:57.721881 14189 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.744459 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:57.745342 11289 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:10:57.742604 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:57.753921 14563 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:57.729373 14588 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.752179 14567 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.741647 14470 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.758767 14585 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:57.764843 14588 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.752353 14189 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:57.790714 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48377.4us
I20260709 12:10:57.797477 14588 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.773142 14563 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.798206 14567 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:57.815397 11859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:10:57.792150 14589 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:10:57.809546 14591 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.818845 14474 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:57.830220 14591 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.833431 14589 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.834028 14589 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:57.835175 14589 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.836864 14589 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.839648 14326 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:57.813583 14594 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:57.854120 14579 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:10:57.854619 14573 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:57.856163 14593 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:57.856779 14593 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.855001 14573 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:57.868866 11859 raft_consensus.cc:606] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:57.869318 11859 raft_consensus.cc:614] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.795008 14585 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:57.856208 14600 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:10:57.873694 14491 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 2.105s	user 0.019s	sys 0.013s
I20260709 12:10:57.874755 14601 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:57.886428 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:57.887907 11144 raft_consensus.cc:2376] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5. Re-sending same reply.
W20260709 12:10:57.890746 14454 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
W20260709 12:10:57.890961 14064 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.951s	user 0.011s	sys 0.002s
I20260709 12:10:57.896450 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:57.891269 14454 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.923851 14583 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:57.950765 14594 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:57.952260 14594 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.954787 14594 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:57.955778 14555 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.077s	user 0.000s	sys 0.011s
I20260709 12:10:57.876662 14567 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:57.895661 14573 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:57.965031 14573 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:57.938097 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.970849 14454 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:57.968547 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:10:57.987208 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.971737 11853 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.976197 14585 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:57.980736 14613 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:10:57.922469 14609 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 12:10:57.998061 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 182263us
I20260709 12:10:58.024652 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 492) took 1583 ms. Trace:
I20260709 12:10:58.026137 11214 rpcz_store.cc:276] 0709 12:10:56.441630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.441767 (+   137us) service_pool.cc:224] Handling call
0709 12:10:56.442085 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.445887 (+  3802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.445916 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.876565 (+1430649us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:10:57.886744 (+ 10179us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.906957 (+ 20213us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.907001 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.907079 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.990765 (+ 83686us) raft_consensus.cc:1685] finished
0709 12:10:57.990788 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.024540 (+ 33752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3415,"raft.queue_time_us":3775,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":9181,"spinlock_wait_cycles":2678400,"thread_start_us":18067,"threads_started":1,"wal-append.queue_time_us":76951}
I20260709 12:10:58.046304 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:58.024670 14508 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.058096 14508 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.060320 14508 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.057382 14546 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.062722 14546 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.064718 14546 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:58.074857 14563 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.075911 14581 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.066051 14601 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:58.092247 11144 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:10:58.045418 14605 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.104925 11855 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.113215 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 782) took 1548 ms. Trace:
I20260709 12:10:58.113739 11855 rpcz_store.cc:276] 0709 12:10:56.565114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.565298 (+   184us) service_pool.cc:224] Handling call
0709 12:10:58.104321 (+1539023us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:10:58.104646 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.112753 (+  8107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.113120 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123305216}
I20260709 12:10:58.098057 14588 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.133183 14508 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.132956 14546 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.126658 14605 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.153599 14588 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.160774 11143 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:58.163765 14626 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.148178 14546 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.168154 14593 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.168581 14546 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.148546 14508 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.166194 14626 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:58.175117 14490 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 2.364s	user 0.003s	sys 0.010s
I20260709 12:10:58.173909 14631 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:58.226433 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.250061 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.176261 14546 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:10:58.316736 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.294227 14601 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.314260 14508 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.293889 14589 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:58.359784 14485 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.287073 14631 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.361634 14605 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.361152 14601 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.426005 14601 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.292618 14546 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.368709 14589 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:58.458838 11259 leader_election.cc:336] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 3.277s (SENT)
I20260709 12:10:58.458556 14631 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:58.493546 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.455809 14589 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:58.486048 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.596201 14631 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.605304 14575 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.602262 14626 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.648095 14508 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:58.659214 14575 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:10:58.694792 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 475786us
I20260709 12:10:58.701201 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:10:58.705449 14619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.019s
W20260709 12:10:58.705976 14619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.000s	sys 0.019s
I20260709 12:10:58.708539 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2443) took 1931 ms. Trace:
I20260709 12:10:58.710796 14546 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.682133 14508 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:58.722440 14500 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 2.772s	user 0.012s	sys 0.009s
I20260709 12:10:58.709107 11137 rpcz_store.cc:276] 0709 12:10:56.777532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.777690 (+   158us) service_pool.cc:224] Handling call
0709 12:10:56.778035 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.912597 (+134562us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:57.059976 (+147379us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.739943 (+679967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.740022 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.740162 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.708187 (+968025us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540033fed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:58.708256 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.708454 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":490300,"prepare.run_cpu_time_us":164,"prepare.run_wall_time_us":1810,"raft.queue_time_us":76770,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10052,"spinlock_wait_cycles":308723456,"thread_start_us":782677,"threads_started":3,"wal-append.queue_time_us":571827}
I20260709 12:10:58.724004 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2434) took 3304 ms. Trace:
I20260709 12:10:58.724375 11136 rpcz_store.cc:276] 0709 12:10:55.419638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.423867 (+  4229us) service_pool.cc:224] Handling call
0709 12:10:55.424260 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.467292 (+ 43032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.467344 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.518353 (+ 51009us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.793389 (+275036us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:55.793438 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.793513 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.721678 (+2928165us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:58.723695 (+  2017us) raft_consensus.cc:1685] finished
0709 12:10:58.723718 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.723923 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44373,"raft.queue_time_us":40047,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5280,"spinlock_wait_cycles":7287680,"thread_start_us":204667,"threads_started":1,"wal-append.queue_time_us":324630}
I20260709 12:10:58.725468 11292 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:58.726989 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:58.729281 14632 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.729859 14632 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.657387 14631 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.738965 11286 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.739383 11286 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:58.737211 14546 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.743803 14546 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.744544 14557 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:58.745589 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:58.746232 11289 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:58.740250 11286 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.755144 11286 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.755290 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 771) took 1031 ms. Trace:
I20260709 12:10:58.755872 11853 rpcz_store.cc:276] 0709 12:10:57.724238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.726736 (+  2498us) service_pool.cc:224] Handling call
0709 12:10:57.747280 (+ 20544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.023763 (+276483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.755015 (+731252us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540050a854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:58.755217 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503375232}
W20260709 12:10:58.756682 14564 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.888s	user 0.000s	sys 0.027s
W20260709 12:10:58.757699 14611 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.944s	user 0.020s	sys 0.027s
I20260709 12:10:58.758546 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1665) took 1975 ms. Trace:
I20260709 12:10:58.758937 11293 rpcz_store.cc:276] 0709 12:10:56.782695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.784219 (+  1524us) service_pool.cc:224] Handling call
0709 12:10:56.807404 (+ 23185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.819857 (+ 12453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.819889 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.820333 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.864671 (+ 44338us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:56.947679 (+ 83008us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.948607 (+   928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.949594 (+   987us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.756080 (+1806486us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:58.758236 (+  2156us) raft_consensus.cc:1685] finished
0709 12:10:58.758339 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.758456 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81798,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":13951,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":260,"spinlock_wait_cycles":54033664,"thread_start_us":43928,"threads_started":1,"wal-append.queue_time_us":47905}
I20260709 12:10:58.760509 14510 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.760874 14510 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:58.761698 14510 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.762758 14510 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.763381 14486 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:58.763787 14486 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:58.764091 14189 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.764601 14486 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.765798 14486 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.731962 14508 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:10:58.767024 11218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 1905) took 3105 ms (client timeout 3277 ms). Trace:
W20260709 12:10:58.767421 11218 rpcz_store.cc:269] 0709 12:10:55.661129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.674857 (+ 13728us) service_pool.cc:224] Handling call
0709 12:10:58.766851 (+3091994us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000271d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:58.766965 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476554496}
I20260709 12:10:58.768498 11212 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.768729 14575 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:58.771147 11138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2432) took 3352 ms (client timeout 1665 ms). Trace:
W20260709 12:10:58.771560 11138 rpcz_store.cc:269] 0709 12:10:55.418938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.419085 (+   147us) service_pool.cc:224] Handling call
0709 12:10:58.770899 (+3351814us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400263754. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:58.771029 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025240832}
I20260709 12:10:58.781926 14189 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.783834 14189 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.784348 14454 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.781227 14235 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.784974 14454 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.789199 14235 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.790823 14454 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.791687 14235 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.781044 14589 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:58.793604 14235 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.781185 14603 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.794860 14235 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.796725 14608 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.797379 14608 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.794346 14589 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.798902 14235 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.789655 14189 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:58.811964 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.820434 11286 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:10:58.822868 11286 pending_rounds.cc:85] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 8
I20260709 12:10:58.824409 11286 pending_rounds.cc:107] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:10:58.825940 11286 raft_consensus.cc:2889] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:58.829643 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.768527 14632 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:58.840231 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.801249 14589 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.787221 14640 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:58.801450 14472 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:58.845656 14452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.973s	user 0.004s	sys 0.045s
I20260709 12:10:58.841771 14575 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.861274 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2456) took 1048 ms. Trace:
W20260709 12:10:58.862659 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 132420us
I20260709 12:10:58.873689 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:58.898397 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:58.899132 11139 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:10:58.890643 11143 rpcz_store.cc:276] 0709 12:10:57.812721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.650866 (+838145us) service_pool.cc:224] Handling call
0709 12:10:58.651751 (+   885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.652092 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:58.660952 (+  8860us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.855543 (+194591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.855627 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.855735 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.861059 (+  5324us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.861200 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27997,"prepare.queue_time_us":8555,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1801,"raft.queue_time_us":1826,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2553,"thread_start_us":190292,"threads_started":1}
I20260709 12:10:58.795008 14603 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.900436 11855 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:58.902742 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2457) took 1088 ms. Trace:
W20260709 12:10:58.860767 14452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.988s	user 0.004s	sys 0.045s
W20260709 12:10:58.864403 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 150455us
I20260709 12:10:58.905330 11137 rpcz_store.cc:276] 0709 12:10:57.813846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.724429 (+910583us) service_pool.cc:224] Handling call
0709 12:10:58.724741 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.724934 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:58.726843 (+  1909us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.901947 (+175104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.902211 (+   264us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.902257 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.902569 (+   312us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.902683 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1360,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":59,"raft.queue_time_us":117,"thread_start_us":174500,"threads_started":1}
I20260709 12:10:58.909363 14631 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.910605 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:58.910888 14608 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.866976 14546 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:58.927685 14516 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:58.929113 14516 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.930159 14603 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:58.931241 14516 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.937412 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1664) took 2169 ms. Trace:
I20260709 12:10:58.927162 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:58.937938 11291 rpcz_store.cc:276] 0709 12:10:56.767664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.768704 (+  1040us) service_pool.cc:224] Handling call
0709 12:10:56.769099 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.941184 (+172085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.937086 (+1995902us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000f69d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:58.937336 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388444032}
I20260709 12:10:58.893939 14632 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:10:58.863801 14575 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:58.942416 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:58.943286 14516 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.943465 14608 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.945144 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:58.951943 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54745us
I20260709 12:10:58.860671 14640 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:58.959165 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:58.960598 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:58.989035 11110 leader_election.cc:400] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:58.989552 11110 leader_election.cc:403] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.944586 14631 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:58.992261 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:58.987494 14516 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:59.001493 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60259.4us
I20260709 12:10:58.951617 14608 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.005056 14608 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.995213 14589 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.007421 14654 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.004556 14362 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:59.008383 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51122.3us
I20260709 12:10:59.007944 14654 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.009970 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.011719 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:58.994129 14653 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.013824 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:58.995385 14472 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:10:58.995100 14516 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.008481 14362 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:59.014163 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:59.016659 14516 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.017153 14362 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.017777 14419 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.018250 14419 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.018690 14419 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.019106 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.021373 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.021478 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.022980 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.023578 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.019174 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.024006 14575 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:58.994518 14631 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:10:59.015257 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.026803 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:59.023001 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.037135 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.038012 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.038758 11854 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:10:59.039263 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.040529 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.040899 14452 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.036118 11137 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:59.041949 14591 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.042234 14374 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:59.041287 14452 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.042704 14374 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.047394 14374 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:59.048252 14640 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:59.023082 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.052358 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:59.053272 11258 connection.cc:256] RPC call timeout handler was delayed by -2.7475217730000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 12:10:59.055591 11139 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:59.053637 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:59.010735 14654 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:59.058514 11258 connection.cc:256] RPC call timeout handler was delayed by -2.5424800499999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24910000000000002s for a response
I20260709 12:10:59.014353 14589 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:59.059378 11258 connection.cc:256] RPC call timeout handler was delayed by -2.1214878149999095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:10:59.064536 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:59.061897 11258 connection.cc:256] RPC call timeout handler was delayed by -1.9277800499999103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3174s for a response
I20260709 12:10:59.050014 14452 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.065618 14657 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:59.058383 14653 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.066954 14653 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.067348 14653 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.065253 11291 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
W20260709 12:10:59.065135 11258 connection.cc:256] RPC call timeout handler was delayed by -1.8086983299997428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2399s for a response
I20260709 12:10:59.012619 14644 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:10:59.068799 11258 connection.cc:256] RPC call timeout handler was delayed by -1.6186998230000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 12:10:59.026474 14639 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:59.072270 14649 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:10:59.073603 14545 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 2.274s	user 0.001s	sys 0.021s
I20260709 12:10:59.060364 14546 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.076503 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 1.34505e+06us
I20260709 12:10:59.090138 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:10:59.079615 11258 connection.cc:256] RPC call timeout handler was delayed by -1.5943998230000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 12:10:59.065078 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.082785 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:10:59.093294 11258 connection.cc:256] RPC call timeout handler was delayed by -1.5246172899999237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.244s for a response
I20260709 12:10:59.093680 11137 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
W20260709 12:10:59.093706 11258 connection.cc:256] RPC call timeout handler was delayed by -1.3883444279999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 12:10:59.096731 11258 connection.cc:256] RPC call timeout handler was delayed by -1.340644427999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:10:59.097703 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:59.100147 14632 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.085651 14639 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.103184 14639 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.103880 14516 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.102070 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:59.087555 14640 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:59.120851 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 107031us
I20260709 12:10:59.106326 14516 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.122323 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.136519 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:59.137104 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:59.140121 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.135097 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:59.120397 14418 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.121587 14640 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.144587 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:10:59.156764 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.155570 14401 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:59.159210 14617 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.166s	user 0.013s	sys 0.031s
I20260709 12:10:59.160514 14418 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.161021 14418 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.161474 14419 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.162603 11855 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:10:59.162948 14578 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:59.164980 14418 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:59.146162 14644 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.167022 14644 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.167456 14644 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.121902 14567 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:59.120746 14546 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.173314 14546 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:59.120532 14575 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:59.151325 14589 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.110476 14452 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.176275 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:59.177531 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:59.187143 11138 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.189829 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:59.190001 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:59.190413 11292 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:59.182669 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.190464 11293 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.180527 14452 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.157519 14640 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.200134 11292 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:59.200215 11293 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
W20260709 12:10:59.201824 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55685.7us
I20260709 12:10:59.195871 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:59.144078 14660 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.197296 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.219863 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:59.220306 11285 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.195047 14516 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.121622 14631 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.199940 14659 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:59.240094 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.176954 14589 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.230767 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.243799 11289 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:10:59.198347 14401 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:59.178207 14374 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.251400 14374 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.225353 14205 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.252245 14205 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.253768 14460 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:59.200855 14472 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:59.176694 14419 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.230221 14516 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:10:59.242964 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.244882 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.245419 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.244318 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.247253 11213 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.247056 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.244835 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.238878 14665 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:10:59.248558 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.292573 11217 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:59.287921 11215 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:10:59.286873 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.263432 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:59.275760 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.254390 14460 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.263767 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.297106 11291 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:10:59.258841 14418 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:59.254312 14205 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.288997 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.299677 11216 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.300130 11213 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:59.263600 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.300153 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.296299 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.259730 14575 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:10:59.304203 14472 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.304638 14472 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:59.304489 14575 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.305527 14472 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.239291 14660 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:59.306638 14631 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.291078 11214 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:10:59.254142 11138 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:10:59.301517 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.301324 11219 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.295063 11285 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:10:59.303030 11215 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.303604 14418 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.305948 14460 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:10:59.317896 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.322381 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.322755 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:10:59.322367 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.238312 14654 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.284547 14516 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.242185 14659 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.326258 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.284751 14589 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.301769 11210 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:10:59.324743 11214 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:59.327569 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:59.325580 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 128419us
I20260709 12:10:59.324952 11213 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 12:10:59.364037 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.306811 14660 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:59.379335 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.364562 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:10:59.325591 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 136410us
I20260709 12:10:59.353695 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:10:59.390656 11214 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:10:59.306655 14575 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:59.392899 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.385942 11215 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:59.386665 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2137) took 2460 ms. Trace:
I20260709 12:10:59.393985 11288 rpcz_store.cc:276] 0709 12:10:56.926441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.000823 (+ 74382us) service_pool.cc:224] Handling call
0709 12:10:57.001095 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.059366 (+ 58271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.059419 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.059481 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:57.059531 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.386295 (+2326764us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b540020b7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:59.386362 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.386587 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133340032}
I20260709 12:10:59.374962 11216 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:10:59.388935 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.394281 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.389488 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.433732 11215 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:10:59.433795 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44399.8us
I20260709 12:10:59.434787 14640 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.435086 14644 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.436178 11853 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.436178 11856 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:59.437323 14640 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:59.390448 11210 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:10:59.354386 14418 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:59.329563 14659 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:59.298031 14665 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.331386 14653 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.401965 11219 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:10:59.407418 14654 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.408983 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.410105 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.410506 11852 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.411064 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.412851 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.413208 14460 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:10:59.414043 14558 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 2.534s	user 0.000s	sys 0.028s
I20260709 12:10:59.415743 14245 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:59.446080 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.418562 14510 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:59.447520 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.450865 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.448585 14460 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.363178 14374 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.428072 14608 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.395202 14602 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:59.391539 14639 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:59.429953 11144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 554) took 1696 ms (client timeout 2114 ms). Trace:
W20260709 12:10:59.466151 11144 rpcz_store.cc:269] 0709 12:10:57.733256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.896177 (+162921us) service_pool.cc:224] Handling call
0709 12:10:59.429747 (+1533570us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540032fad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:59.429883 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387308800}
I20260709 12:10:59.466620 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:59.467272 11138 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.432320 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.468209 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.472236 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:10:59.474068 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.475660 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.399462 11213 raft_consensus.cc:2410] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:59.395767 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.399008 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.439935 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.440301 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.438292 14244 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.479672 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:10:59.443928 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.445190 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:10:59.443678 11857 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:10:59.438336 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.482023 11219 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:59.328189 14663 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:59.415879 14660 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.485579 14205 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.485774 14504 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.486157 14205 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:10:59.486351 14504 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.486900 14504 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.460089 14374 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.487946 14639 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.463444 14460 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:10:59.477181 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78235.7us
I20260709 12:10:59.477927 11215 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:10:59.465198 14608 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.360895 14472 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.482990 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44830.4us
I20260709 12:10:59.478451 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.483361 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:10:59.480698 11216 raft_consensus.cc:2376] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11. Re-sending same reply.
I20260709 12:10:59.488722 11143 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:10:59.484766 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:10:59.486722 14205 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.485533 14663 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:59.505164 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.482201 14510 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.506467 11210 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:10:59.500653 14324 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.481966 14595 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.479065 14244 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:10:59.515887 14374 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:59.516256 14244 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.513440 14666 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.511140 14639 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:59.517664 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:10:59.518288 14374 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.518690 14374 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:10:59.518865 14595 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:59.519518 14374 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.519702 14663 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.460539 14418 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:10:59.499611 14644 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:59.481216 14575 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.508968 14245 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.528971 14374 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.530552 14418 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.531417 14418 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:59.533365 14418 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.534718 14418 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.535629 14245 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:10:59.536597 14245 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.538197 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50556 (request call id 0) took 1735 ms. Trace:
I20260709 12:10:59.540518 11859 rpcz_store.cc:276] 0709 12:10:57.808322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.811916 (+  3594us) service_pool.cc:224] Handling call
0709 12:10:59.537972 (+1726056us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b54006fe5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad5853 00007f9835aa360a 00007f982f0297d4 00007f982f029762 00007f982f029691 00007f982f02960c 00007f982f0288c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:10:59.538095 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117974272}
I20260709 12:10:59.549763 14470 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.554171 11859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:10:59.555377 11859 raft_consensus.cc:606] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.526248 14510 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:59.550509 14659 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.566987 14665 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.551108 14630 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.568068 14653 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:10:59.570302 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:10:59.577653 11210 raft_consensus.cc:606] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:10:59.578011 11210 raft_consensus.cc:614] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:59.571684 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:10:59.582258 11138 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:10:59.520056 14595 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.576689 14630 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.569787 14205 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.595023 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:10:59.600363 14630 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:10:59.593086 14510 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.602070 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 529) took 4931 ms. Trace:
I20260709 12:10:59.610903 11142 rpcz_store.cc:276] 0709 12:10:54.670932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.671084 (+   152us) service_pool.cc:224] Handling call
0709 12:10:54.671408 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.522072 (+2850664us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:57.522118 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.522178 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.522224 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.601784 (+2079560us) spinlock_profiling.cc:243] Waited 2.71 s on lock 0x7b54002e2cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:59.601837 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.601976 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":223567,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":6227019648,"thread_start_us":140911,"threads_started":1}
I20260709 12:10:59.616200 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:10:59.616983 11135 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:10:59.615921 14630 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.617954 14659 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.618054 14630 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:10:59.623631 14630 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.590247 14516 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:10:59.629015 14516 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:10:59.629767 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 547) took 2840 ms. Trace:
I20260709 12:10:59.630252 11140 rpcz_store.cc:276] 0709 12:10:56.789393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.915347 (+125954us) service_pool.cc:224] Handling call
0709 12:10:56.937534 (+ 22187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.982419 (+ 44885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.982449 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.982509 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:56.982538 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.629500 (+2646962us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b54002c1854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:59.629553 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.629701 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102817664}
W20260709 12:10:59.631732 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.632965 11859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:10:59.633795 11859 raft_consensus.cc:606] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:10:59.638172 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1673) took 2743 ms. Trace:
I20260709 12:10:59.638633 11284 rpcz_store.cc:276] 0709 12:10:56.894999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.973759 (+ 78760us) service_pool.cc:224] Handling call
0709 12:10:56.974270 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.361133 (+386863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.637865 (+2276732us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540041a5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:10:59.638107 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884557696}
I20260709 12:10:59.639914 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.641165 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:10:59.641918 11284 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:10:59.649509 11216 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:59.651834 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 456009us
I20260709 12:10:59.652467 11217 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.653258 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:10:59.709766 11210 pending_rounds.cc:85] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 7
I20260709 12:10:59.710192 11210 pending_rounds.cc:107] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:10:59.710444 11210 raft_consensus.cc:2889] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.715970 11214 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:59.724625 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:10:59.726020 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.655182 14632 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.656893 14418 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.783216 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:10:59.784158 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.741930 14673 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.104s	user 0.000s	sys 0.026s
I20260709 12:10:59.788420 11284 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:10:59.823136 14650 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.823928 14650 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:10:59.781854 14418 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:10:59.840844 14362 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:59.844236 14670 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 12:10:59.838160 14244 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:10:59.999209 14589 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.002s
W20260709 12:10:59.999460 14675 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:11:00.120545 14374 consensus_meta.cc:287] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 12:11:00.108103 14244 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:00.090873 14589 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:00.622606 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:00.837666 11217 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:00.838804 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 507) took 1182 ms. Trace:
W20260709 12:11:00.581202 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.841867 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:00.858104 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.311285 14508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.018s	sys 0.000s
W20260709 12:11:00.860356 14508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.025s	sys 0.001s
I20260709 12:11:00.623817 11219 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:00.624182 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 572) took 1169 ms. Trace:
W20260709 12:11:00.587174 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.633615 11287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.001s	sys 0.013s
W20260709 12:11:00.612027 11210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.006s	sys 0.001s
W20260709 12:11:00.887521 11287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.013s	sys 0.013s
I20260709 12:11:00.889992 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 510) took 1201 ms. Trace:
W20260709 12:11:00.310884 14630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.006s	sys 0.013s
W20260709 12:11:00.896109 11210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.008s	sys 0.012s
W20260709 12:11:00.353935 14504 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.001s
W20260709 12:11:00.902379 11213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 512) took 1191 ms (client timeout 1516 ms). Trace:
W20260709 12:11:00.909319 11213 rpcz_store.cc:269] 0709 12:10:59.708351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.841058 (+1132707us) service_pool.cc:224] Handling call
0709 12:11:00.899449 (+ 58391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.718863 14244 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.850008 11217 rpcz_store.cc:276] 0709 12:10:59.656634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.679122 (+ 22488us) service_pool.cc:224] Handling call
0709 12:11:00.838641 (+1159519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42624}
I20260709 12:11:00.897053 11219 rpcz_store.cc:276] 0709 12:10:59.680209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.680365 (+   156us) service_pool.cc:224] Handling call
0709 12:11:00.622679 (+942314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.876861 (+254182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.881136 (+  4275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55168}
I20260709 12:11:00.862950 14589 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:00.876488 11139 rpcz_store.cc:276] 0709 12:10:59.454580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.456586 (+  2006us) service_pool.cc:224] Handling call
0709 12:10:59.456930 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.457280 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.457298 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.457652 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.592877 (+135225us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:59.749103 (+156226us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.623227 (+874124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.623427 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.623517 (+    90us) raft_consensus.cc:1685] finished
0709 12:11:00.623546 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.623902 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1240071,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":299,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":2898,"thread_start_us":200747,"threads_started":2,"wal-append.queue_time_us":152673}
I20260709 12:11:00.940881 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:00.947294 14460 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.927245 14374 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.955037 14374 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:00.955951 14504 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:00.959049 14546 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.959954 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 624) took 1776 ms. Trace:
W20260709 12:11:00.943303 14630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.007s	sys 0.019s
I20260709 12:11:00.962265 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 499) took 1317 ms. Trace:
I20260709 12:11:00.962915 11210 rpcz_store.cc:276] 0709 12:10:59.644694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.645782 (+  1088us) service_pool.cc:224] Handling call
0709 12:10:59.709543 (+ 63761us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.711110 (+  1567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.711142 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:59.711721 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 12:11:00.939896 (+1228175us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.948764 (+  8868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.961789 (+ 13025us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.961871 (+    82us) raft_consensus.cc:1685] finished
0709 12:11:00.961890 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.962187 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":23824,"thread_start_us":1193342,"threads_started":1,"wal-append.queue_time_us":1122751}
I20260709 12:11:00.965797 14678 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.966636 14678 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:00.967177 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:00.969544 14678 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:00.943316 14567 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.951673 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:00.959818 14546 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:00.965970 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:00.963012 14631 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.927075 14244 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:00.978930 14567 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:00.970804 14575 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:00.993703 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 511) took 1313 ms. Trace:
I20260709 12:11:00.994186 11210 rpcz_store.cc:276] 0709 12:10:59.680687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.965510 (+1284823us) service_pool.cc:224] Handling call
0709 12:11:00.993637 (+ 28127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.004524 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.005570 14589 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:01.006592 14589 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.007045 11213 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:00.984614 14665 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.988801 14666 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.960605 11287 rpcz_store.cc:276] 0709 12:10:59.183849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.184123 (+   274us) service_pool.cc:224] Handling call
0709 12:10:59.184381 (+   258us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.195173 (+ 10792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.195204 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:59.195736 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 12:10:59.356912 (+161176us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:59.394907 (+ 37995us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.948654 (+1553747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.959391 (+ 10737us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.959497 (+   106us) raft_consensus.cc:1685] finished
0709 12:11:00.959517 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.959794 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":741188,"prepare.queue_time_us":38021,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":1568756,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4725,"thread_start_us":1300497,"threads_started":2,"wal-append.queue_time_us":174428,"wal-append.run_cpu_time_us":2688,"wal-append.run_wall_time_us":1002666}
I20260709 12:11:00.986774 14460 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.010924 14374 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:01.052549 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.052000 14504 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.054807 14374 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.088325 14567 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.077778 14692 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.090405 14692 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:01.095412 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.430s (SENT) [suppressed 21 similar messages]
W20260709 12:11:01.096763 11292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.066s	sys 0.058s
W20260709 12:11:01.097291 11292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.067s	sys 0.058s
I20260709 12:11:01.086241 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:01.107895 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.071915 14631 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.111402 14460 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.111517 14631 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.083177 14575 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.115886 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.068286 14666 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.114604 14592 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.121467 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:01.080415 14665 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:01.139061 11858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 772) took 3414 ms (client timeout 2006 ms). Trace:
I20260709 12:11:01.143985 14244 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:01.149475 11858 rpcz_store.cc:269] 0709 12:10:57.724568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.724738 (+   170us) service_pool.cc:224] Handling call
0709 12:11:01.085640 (+3360902us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:11:01.138866 (+ 53226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144064}
I20260709 12:11:01.122677 14374 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.127650 14504 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.159407 14546 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.154222 14374 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:01.135821 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 68299.9us
I20260709 12:11:01.162993 14546 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:01.164218 14698 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:01.165517 14592 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.167006 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1919) took 4478 ms. Trace:
W20260709 12:11:01.167689 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.169243 14592 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:01.166175 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 1.51287e+06us
W20260709 12:11:01.154449 11855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 370) took 2117 ms (client timeout 2060 ms). Trace:
I20260709 12:11:01.171990 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 1898) took 5551 ms. Trace:
I20260709 12:11:01.167469 11211 rpcz_store.cc:276] 0709 12:10:56.666227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.678685 (+ 12458us) service_pool.cc:224] Handling call
0709 12:10:56.678963 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.679305 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.679333 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.685633 (+  6300us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.804877 (+119244us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:56.859595 (+ 54718us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.884814 (+ 25219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.884927 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.087249 (+4202322us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b18003d04e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:01.097554 (+ 10305us) raft_consensus.cc:1685] finished
0709 12:11:01.127773 (+ 30219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.144187 (+ 16414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3509,"prepare.queue_time_us":57506,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":10221,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":2764,"spinlock_wait_cycles":5246464,"thread_start_us":93809,"threads_started":1,"wal-append.queue_time_us":203013}
I20260709 12:11:01.172556 11212 rpcz_store.cc:276] 0709 12:10:55.620250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.756997 (+136747us) service_pool.cc:224] Handling call
0709 12:10:58.768330 (+3011333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.768914 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.171451 (+2402537us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b54000271d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:01.171703 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6924776192}
I20260709 12:11:01.174927 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.176399 11287 raft_consensus.cc:2410] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:01.177680 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.178558 11287 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:01.178985 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2139) took 1975 ms. Trace:
W20260709 12:11:01.170966 11855 rpcz_store.cc:269] 0709 12:10:59.036585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.036784 (+   199us) service_pool.cc:224] Handling call
0709 12:11:01.153952 (+2117168us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54006d01d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:01.154228 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286245632}
I20260709 12:11:01.184549 14401 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.185237 14666 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.185312 14665 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.156328 14504 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:01.178990 14362 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 1.319s	user 0.012s	sys 0.016s
I20260709 12:11:01.187242 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2138) took 1929 ms. Trace:
I20260709 12:11:01.180640 11292 rpcz_store.cc:276] 0709 12:10:59.203919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.208547 (+  4628us) service_pool.cc:224] Handling call
0709 12:10:59.209042 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.786296 (+577254us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:59.786340 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.786937 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.151491 (+1364554us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:01.170855 (+ 19364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.178614 (+  7759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.178710 (+    96us) raft_consensus.cc:1685] finished
0709 12:11:01.178725 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.178923 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1660741,"raft.queue_time_us":479696,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10036,"thread_start_us":1447201,"threads_started":2,"wal-append.queue_time_us":1292530}
I20260709 12:11:01.194630 14666 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.196262 14575 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.186136 14692 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.203320 11857 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:11:01.203143 14546 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:01.204566 14454 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.206574 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:01.207264 14454 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.205667 14504 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.209126 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.210103 11292 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:01.212193 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2157) took 1743 ms. Trace:
I20260709 12:11:01.212615 11292 rpcz_store.cc:276] 0709 12:10:59.469191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.210870 (+1741679us) service_pool.cc:224] Handling call
0709 12:11:01.211371 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.211814 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.211854 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.211895 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:01.211931 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.211998 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.212106 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.213613 14418 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:01.188742 14589 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.214768 11219 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:01.216890 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.188688 11293 rpcz_store.cc:276] 0709 12:10:59.203516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.209815 (+  6299us) service_pool.cc:224] Handling call
0709 12:10:59.228968 (+ 19153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.780736 (+551768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.780780 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.810986 (+ 30206us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.927618 (+1116632us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.933457 (+  5839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.944047 (+ 10590us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.127924 (+183877us) raft_consensus.cc:1685] finished
0709 12:11:01.127952 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.133049 (+  5097us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":425447,"raft.queue_time_us":1732385,"spinlock_wait_cycles":142672640,"thread_start_us":313495,"threads_started":2,"wal-append.queue_time_us":1146236}
I20260709 12:11:01.223141 11292 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:01.222685 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53480.3us
I20260709 12:11:01.226477 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2158) took 1746 ms. Trace:
W20260709 12:11:01.228550 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 107560us
I20260709 12:11:01.227156 11292 rpcz_store.cc:276] 0709 12:10:59.479424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.213731 (+1734307us) service_pool.cc:224] Handling call
0709 12:11:01.214308 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.224547 (+ 10239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.225245 (+   698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.235965 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 628) took 1450 ms. Trace:
I20260709 12:11:01.222704 14244 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.236502 11287 rpcz_store.cc:276] 0709 12:10:59.786029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.234841 (+1448812us) service_pool.cc:224] Handling call
0709 12:11:01.235301 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.235682 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.235703 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.235751 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.235775 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.235817 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.235910 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.237428 14689 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.237308 14244 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.238730 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:01.239706 14244 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.225796 14504 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.240705 14569 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.241386 14569 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.241880 14569 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.235885 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 627) took 1450 ms. Trace:
I20260709 12:11:01.242837 11293 rpcz_store.cc:276] 0709 12:10:59.785670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.234558 (+1448888us) service_pool.cc:224] Handling call
0709 12:11:01.235057 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.235521 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.235548 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.235628 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.235683 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.235738 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.235829 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.222041 14418 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.240762 14504 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.253409 11856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 783) took 1846 ms. Trace:
I20260709 12:11:01.258354 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2148) took 2035 ms. Trace:
I20260709 12:11:01.259748 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:01.261287 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45125.2us
I20260709 12:11:01.258823 14686 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:01.266736 14418 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.255455 11856 rpcz_store.cc:276] 0709 12:10:59.406859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.408143 (+  1284us) service_pool.cc:224] Handling call
0709 12:10:59.408465 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.437259 (+ 28794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.252774 (+1815515us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400361d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:01.253142 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63101696}
I20260709 12:11:01.273702 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 513) took 1555 ms. Trace:
I20260709 12:11:01.275822 14324 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.276396 14324 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.285822 14418 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.286703 14504 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.274011 14546 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.258939 11286 rpcz_store.cc:276] 0709 12:10:59.222927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.725456 (+502529us) service_pool.cc:224] Handling call
0709 12:10:59.725875 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.097663 (+1371788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.099795 (+  2132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.157575 (+ 57780us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.206291 (+ 48716us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b4800042fd8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:11:01.222190 (+ 15899us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.222246 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.222411 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.253728 (+ 31317us) raft_consensus.cc:1685] finished
0709 12:11:01.253754 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.258108 (+  4354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1037440,"raft.queue_time_us":1238947,"raft.run_cpu_time_us":2493,"raft.run_wall_time_us":241235,"spinlock_wait_cycles":120274688,"thread_start_us":330181,"threads_started":2,"wal-append.queue_time_us":68927}
W20260709 12:11:01.301625 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46213.3us
I20260709 12:11:01.301380 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 629) took 1495 ms. Trace:
I20260709 12:11:01.304996 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:01.304817 11293 rpcz_store.cc:276] 0709 12:10:59.804357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.254881 (+1450524us) service_pool.cc:224] Handling call
0709 12:11:01.298757 (+ 43876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.299197 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.299230 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.299343 (+   113us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.299400 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.299459 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.299574 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.274924 11217 rpcz_store.cc:276] 0709 12:10:59.717280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.001796 (+1284516us) service_pool.cc:224] Handling call
0709 12:11:01.055045 (+ 53249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.090372 (+ 35327us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:01.225834 (+135462us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.271819 (+ 45985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.271900 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.271964 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.272148 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.272327 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185892,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":19877,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":192,"thread_start_us":163047,"threads_started":2}
I20260709 12:11:01.316018 14632 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:01.316684 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47052.7us
I20260709 12:11:01.308537 14324 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.318591 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:01.323814 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 631) took 1459 ms. Trace:
I20260709 12:11:01.324616 14632 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.324756 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2151) took 2063 ms. Trace:
I20260709 12:11:01.325305 11284 rpcz_store.cc:276] 0709 12:10:59.240583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.816857 (+576274us) service_pool.cc:224] Handling call
0709 12:10:59.884913 (+ 68056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.950912 (+1065999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.950989 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.951882 (+   893us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.161030 (+209148us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.274892 (+113862us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.275307 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.297816 (+ 22509us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.297888 (+    72us) raft_consensus.cc:1685] finished
0709 12:11:01.297907 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.303887 (+  5980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":857277,"raft.queue_time_us":1079620,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":35006848,"thread_start_us":452805,"threads_started":3,"wal-append.queue_time_us":234078}
I20260709 12:11:01.328440 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 632) took 1441 ms. Trace:
I20260709 12:11:01.328855 11284 rpcz_store.cc:276] 0709 12:10:59.887329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.327365 (+1440036us) service_pool.cc:224] Handling call
0709 12:11:01.327774 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.328114 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.328141 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.328199 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.328233 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.328290 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.328389 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.324319 11286 rpcz_store.cc:276] 0709 12:10:59.864258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.314061 (+1449803us) service_pool.cc:224] Handling call
0709 12:11:01.322078 (+  8017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.323432 (+  1354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.323468 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.323548 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.323580 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.323644 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.323755 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.339737 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.305547 14702 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.342258 11293 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:01.339653 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:01.345897 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:01.347383 14632 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.347949 14632 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.348438 14632 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.351352 14596 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.352129 14596 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.348410 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:01.357398 11142 pending_rounds.cc:85] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:11:01.357836 11142 pending_rounds.cc:107] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:01.358153 11142 raft_consensus.cc:2889] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.358551 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.346119 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 630) took 1541 ms. Trace:
I20260709 12:11:01.360762 11292 rpcz_store.cc:276] 0709 12:10:59.804828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.270083 (+1465255us) service_pool.cc:224] Handling call
0709 12:11:01.312018 (+ 41935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.345740 (+ 33722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.345772 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.345832 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.345867 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.345924 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.346032 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:01.364086 14691 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.273s	user 0.005s	sys 0.000s
I20260709 12:11:01.365245 11138 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:01.365617 14681 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.366156 14681 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.366539 14681 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.319912 14569 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.365296 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:01.370455 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2141) took 2165 ms. Trace:
I20260709 12:11:01.382509 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:01.383275 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56521.1us
I20260709 12:11:01.383819 11288 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:01.384052 11857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 374) took 1869 ms (client timeout 1834 ms). Trace:
I20260709 12:11:01.384505 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:01.384577 11857 rpcz_store.cc:269] 0709 12:10:59.514573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.514793 (+   220us) service_pool.cc:224] Handling call
0709 12:11:01.383753 (+1868960us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540020f154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:01.383946 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3867684224}
I20260709 12:11:01.385826 14401 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:01.374851 14698 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:01.386452 14401 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.386866 14698 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.387332 14698 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:01.388748 14557 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.367070 14702 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.391876 14478 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:01.392331 14478 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:01.395296 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1648) took 2153 ms. Trace:
I20260709 12:11:01.396278 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.391201 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.370977 11290 rpcz_store.cc:276] 0709 12:10:59.204623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.222837 (+ 18214us) service_pool.cc:224] Handling call
0709 12:10:59.223141 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.925434 (+702293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.925477 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.704125 (+778648us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.945298 (+241173us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:00.950298 (+  5000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.976449 (+ 26151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.317434 (+340985us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:01.367126 (+ 49692us) raft_consensus.cc:1685] finished
0709 12:11:01.367150 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.370187 (+  3037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":437180,"raft.queue_time_us":1686739,"raft.run_cpu_time_us":731,"raft.run_wall_time_us":66532,"spinlock_wait_cycles":7629184,"thread_start_us":495670,"threads_started":2,"wal-append.queue_time_us":351224}
I20260709 12:11:01.393822 14478 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.397065 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:01.400425 14478 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.411197 14685 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:11:01.411042 11143 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:11:01.411764 14685 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:01.415156 14685 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:01.382509 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:01.417943 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:01.418478 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.421751 11138 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:01.395675 11218 rpcz_store.cc:276] 0709 12:10:59.242092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.246583 (+  4491us) service_pool.cc:224] Handling call
0709 12:10:59.246894 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.260439 (+ 13545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.260469 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.260879 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.395288 (+134409us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:59.395325 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.375929 (+1980604us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:01.378954 (+  3025us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.394777 (+ 15823us) raft_consensus.cc:1685] finished
0709 12:11:01.394792 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.395096 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14721,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":95,"spinlock_wait_cycles":30349568,"thread_start_us":134032,"threads_started":1,"wal-append.queue_time_us":218627,"wal-append.run_cpu_time_us":3762,"wal-append.run_wall_time_us":1429823}
I20260709 12:11:01.427006 14546 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:01.446764 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64504.2us
I20260709 12:11:01.462900 14546 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:01.463358 14546 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.463924 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:01.464937 14692 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.446449 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 508) took 1767 ms. Trace:
I20260709 12:11:01.466658 11216 rpcz_store.cc:276] 0709 12:10:59.678764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.679320 (+   556us) service_pool.cc:224] Handling call
0709 12:11:01.445151 (+1765831us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800004b98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:11:01.445487 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.445924 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.445956 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.446007 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.446042 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.446107 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.446252 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6487,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":15336320}
W20260709 12:11:01.468667 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.471410 14704 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 12:11:01.472191 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.471426 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:01.473127 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2144) took 2267 ms. Trace:
I20260709 12:11:01.473278 14650 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.462061 14702 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.452188 14686 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:01.474802 14686 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.473695 11285 rpcz_store.cc:276] 0709 12:10:59.205614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.439805 (+234191us) service_pool.cc:224] Handling call
0709 12:10:59.449881 (+ 10076us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:00.878193 (+1428312us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:11:00.878278 (+    85us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:00.958610 (+ 80332us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.161143 (+202533us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:01.161277 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.180759 (+ 19482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.472718 (+291959us) raft_consensus.cc:1685] finished
0709 12:11:01.472741 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.472948 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255632,"raft.queue_time_us":1513586,"spinlock_wait_cycles":47250816,"thread_start_us":445526,"threads_started":2,"wal-append.queue_time_us":261292}
I20260709 12:11:01.475459 11292 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:01.460019 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:01.440490 14454 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.477816 14418 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:01.478220 14418 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.478592 14418 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:01.452163 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.480384 11140 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:01.482851 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:01.483793 11139 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:01.483554 14578 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:01.484889 11138 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.485205 14590 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:01.485708 14590 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:01.435791 14495 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.428951 14557 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:01.431882 14569 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.487975 14324 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.488300 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.489500 14596 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.491526 11293 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:01.493196 11293 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:01.494952 11287 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:01.497525 14707 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 12:11:01.500392 14205 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.500083 14632 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.501694 11286 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.502990 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2152) took 2260 ms. Trace:
I20260709 12:11:01.477041 11292 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:01.487056 14590 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:01.505589 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.507705 11143 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:01.503836 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46868.2us
W20260709 12:11:01.509352 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.486783 14495 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:01.449002 14706 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:11:01.523245 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 118274us
I20260709 12:11:01.447021 14694 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.528559 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:01.487989 14557 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.503396 11291 rpcz_store.cc:276] 0709 12:10:59.242829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.830547 (+587718us) service_pool.cc:224] Handling call
0709 12:10:59.830986 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.102772 (+1271786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.126939 (+ 24167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.150535 (+ 23596us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.195975 (+ 45440us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4800042fd8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:11:01.245671 (+ 49696us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.245753 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.256559 (+ 10806us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.496722 (+240163us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:01.502634 (+  5912us) raft_consensus.cc:1685] finished
0709 12:11:01.502660 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.502814 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1034702,"raft.queue_time_us":1138731,"raft.run_cpu_time_us":2702,"raft.run_wall_time_us":226003,"spinlock_wait_cycles":104948864,"thread_start_us":297102,"threads_started":2,"wal-append.queue_time_us":123082}
I20260709 12:11:01.543768 14508 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.544831 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:01.546599 14324 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.538192 14557 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.555264 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.547235 14590 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.544269 14508 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.563241 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.567001 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.567081 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.523556 14665 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:01.531203 14698 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.567585 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.569489 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.580314 11219 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:01.581919 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.582907 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.569800 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.547935 14694 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:01.585228 11138 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:01.588469 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76364.5us
I20260709 12:11:01.592971 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:01.576936 14508 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.596263 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.559468 14324 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.602475 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.601289 11287 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:01.604283 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.604465 14616 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.605127 14616 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:01.606777 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.607717 11143 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
I20260709 12:11:01.608714 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2154) took 2152 ms. Trace:
I20260709 12:11:01.611366 11857 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:01.612545 11217 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:01.617033 11856 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:01.613365 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.596591 14689 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:01.609117 11289 rpcz_store.cc:276] 0709 12:10:59.456562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.832027 (+375465us) service_pool.cc:224] Handling call
0709 12:10:59.832388 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.933827 (+1101439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.934889 (+  1062us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.051075 (+116186us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.224015 (+172940us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:01.303536 (+ 79521us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.304153 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.312376 (+  8223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.410554 (+ 98178us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4800042fd8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:11:01.608268 (+197714us) raft_consensus.cc:1685] finished
0709 12:11:01.608366 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.608546 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":805371,"prepare.queue_time_us":101214,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":1131534,"raft.run_cpu_time_us":2970,"raft.run_wall_time_us":448776,"spinlock_wait_cycles":15879936,"thread_start_us":384011,"threads_started":3,"wal-append.queue_time_us":211780}
I20260709 12:11:01.628633 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.629416 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.631964 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.633601 14495 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.619932 14683 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.634532 14683 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.635030 14683 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.637470 14689 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.638527 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:01.639840 14689 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.632566 11217 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:11:01.644850 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.642143 11215 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:01.649230 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:01.653013 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.652735 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.630216 14632 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.603111 14681 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.655287 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.655910 14324 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:01.652704 11216 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:01.640828 14694 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.648383 14478 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.662079 11142 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:01.663069 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.663424 11140 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:11:01.667420 11219 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:01.670841 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.647581 14418 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:01.678442 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 89328.8us
I20260709 12:11:01.668154 14679 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.680521 11139 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:11:01.675917 11258 connection.cc:256] RPC call timeout handler was delayed by -1.1456528160001653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 12:11:01.683605 11258 connection.cc:256] RPC call timeout handler was delayed by -1.0493528160000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:11:01.683912 11258 connection.cc:256] RPC call timeout handler was delayed by -1.0205528160001904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 12:11:01.685708 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.686398 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.683018 14679 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.688174 11861 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:11:01.661018 14685 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.678174 14678 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.693300 11217 raft_consensus.cc:2410] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:01.693997 11218 raft_consensus.cc:2368] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:01.695034 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.695636 11143 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:01.701206 14678 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.702965 11139 raft_consensus.cc:2410] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:11:01.705127 14716 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 12:11:01.707615 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:01.708228 11212 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:01.709851 14679 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.709645 14401 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.714359 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:01.714751 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:01.715761 11219 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:01.721160 14557 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.730580 11290 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 2. Current term is 3. Ops: []
W20260709 12:11:01.729004 11258 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.515s (SENT)
W20260709 12:11:01.731618 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44805.4us
W20260709 12:11:01.732173 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.735620 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:01.736981 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.737180 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:01.693912 14698 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.738745 14495 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:01.740582 14722 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:01.736515 14324 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.728461 14616 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.741353 14324 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.743738 14685 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.744045 14324 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.745280 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:01.746802 14678 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.746845 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.758297 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:01.758421 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.759043 11286 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.759387 11140 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:01.760352 11288 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:01.764341 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.765353 11284 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:01.766501 11139 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:01.768234 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:01.768311 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:01.776541 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.777149 11142 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:01.795111 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:01.792862 14698 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:01.813251 11142 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:01.819550 14401 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.823416 11857 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:01.809984 14665 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.827121 14665 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.827597 14665 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.795534 14546 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.832472 14546 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:01.833200 11285 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:01.835503 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.838050 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.796885 14495 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:11:01.840353 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.841456 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:01.805852 14569 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:01.843081 14596 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:01.843658 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.848829 14205 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:01.850793 14485 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.847337 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:01.852118 11858 raft_consensus.cc:606] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:01.852051 14485 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.843629 14596 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:01.855262 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 156762us
I20260709 12:11:01.856423 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:01.868841 11138 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:11:01.869422 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53855.1us
I20260709 12:11:01.871374 11139 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:01.873315 14569 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:01.876624 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.851015 14205 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:01.892839 11289 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:01.890324 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:01.895876 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:01.807392 14592 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:11:01.869153 14596 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.902474 11857 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.886237 14460 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.876119 14698 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:01.913964 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.916211 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.915591 14569 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.889096 14557 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.885958 14495 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:01.928970 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:01.896966 14418 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:01.938817 14723 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:11:01.939522 14590 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:01.939294 14698 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.940927 11140 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:01.945600  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:01.946537 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:01.947934 14478 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.948504 14478 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:01.949599 14478 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.952425 11143 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:11:01.953363 14717 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.294s	user 0.006s	sys 0.009s
I20260709 12:11:01.953814 14692 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:01.943322 14460 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.956326 11142 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:01.968294 14569 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:01.972728 14205 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.980293 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:01.997490 11286 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:01.981684 14686 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:01.982925 14616 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:01.984112 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.984937 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.985592 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:01.985962 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:01.986498 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48224.2us
I20260709 12:11:01.979683 14508 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:01.997313  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:02.015017 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:02.020010 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:02.023288 11288 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.020157 11135 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:02.029091 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:02.033567 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.033866 11286 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:02.009428 14557 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.036170 11144 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:02.039937 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.034358 11286 pending_rounds.cc:85] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 4
I20260709 12:11:02.044695 11286 pending_rounds.cc:107] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:02.045118 11286 raft_consensus.cc:2889] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.015193 14632 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.035950 14418 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.045964 14592 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.059060 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.047034  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:02.069793 11215 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:11:02.050238 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 133) took 19318 ms (client timeout 15000 ms). Trace:
I20260709 12:11:02.050426 11285 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.070922 11857 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:02.050912 11139 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:02.052129 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.052249 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.075706 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.075495 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.081169 11292 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:02.072443 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 196583us
I20260709 12:11:02.082980 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:02.085042 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.085889 11219 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:02.059871 14205 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.079566 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.079545 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:02.091748 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:02.060532 14632 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:02.091143 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.101569 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.109874 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:02.112803 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.113440 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.116003 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.097338 14418 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:02.113510 11214 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:02.116886 11139 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:11:02.116650 11215 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:02.120764 14508 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.121224 11137 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:02.122010 14686 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:02.111258 14362 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.123339 14362 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.123613 14485 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.125298 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:02.126748 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 96776.4us
I20260709 12:11:02.127122 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.127681 11287 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:02.126688 14418 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:02.116622 14681 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.131500 14418 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.123699 14362 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.132834 11258 leader_election.cc:336] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.715s (SENT)
I20260709 12:11:02.063370 14590 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:11:02.134402 11258 leader_election.cc:336] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.806s (SENT)
I20260709 12:11:02.134891 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:02.135190 14324 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:02.135717 14324 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:02.136334 11258 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.810s (SENT)
I20260709 12:11:02.136786 14324 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:02.137619 11258 leader_election.cc:336] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.818s (SENT)
I20260709 12:11:02.138819 14681 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:02.070688 11039 rpcz_store.cc:269] 0709 12:10:42.740511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.784913 (+ 44402us) service_pool.cc:224] Handling call
0709 12:11:02.049852 (+19264939us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:55.305964 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:55.332207 (+ 26243us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:55.332247 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:10:55.332265 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:55.333163 (+   898us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:55.333215 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:55.333247 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:55.333797 (+   550us) tablet.cc:701] Row locks acquired
0709 12:10:55.333813 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:55.333949 (+   136us) write_op.cc:270] Start()
0709 12:10:55.334074 (+   125us) write_op.cc:276] Timestamp: P: 1783599055333901 usec, L: 0
0709 12:10:55.334096 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:55.336894 (+  2798us) log.cc:844] Serialized 2515 byte log entry
0709 12:10:57.871096 (+2534202us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:10:58.094636 (+223540us) op_driver.cc:464] REPLICATION: finished
0709 12:10:58.171529 (+ 76893us) write_op.cc:301] APPLY: starting
0709 12:10:58.175873 (+  4344us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:58.255196 (+ 79323us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:58.255227 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:58.256149 (+   922us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:58.256392 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:58.256436 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:58.256751 (+   315us) log.cc:844] Serialized 53 byte log entry
0709 12:10:58.256953 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:58.257080 (+   127us) write_op.cc:454] Released schema lock
0709 12:10:58.257124 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:58.260946 (+  3822us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:58.291394 (+ 30448us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":287,"mutex_wait_us":1431886,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":66262,"apply.run_cpu_time_us":3069,"apply.run_wall_time_us":92490,"num_ops":6,"prepare.queue_time_us":337862,"prepare.run_cpu_time_us":33625,"prepare.run_wall_time_us":294368,"raft.queue_time_us":217972,"raft.run_cpu_time_us":4377,"raft.run_wall_time_us":53149,"replication_time_us":2760337,"spinlock_wait_cycles":40730496,"thread_start_us":349958,"threads_started":4,"wal-append.queue_time_us":346065,"wal-append.run_cpu_time_us":38320,"wal-append.run_wall_time_us":3569595}]]}
I20260709 12:11:02.143333 14460 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:02.144527 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.127748 11218 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:02.144672 14632 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.145901 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.147145 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.147854 11215 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.152459 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:02.143363 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.138142 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:02.150651 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.071767 14557 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.161945 11213 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:02.163216 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:02.164079 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.138192 14324 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:02.167202 11219 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:02.167642 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78496.5us
W20260709 12:11:02.168140 14683 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.004s
I20260709 12:11:02.168717 11288 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:02.173827 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 159348us
I20260709 12:11:02.174414 14665 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.175590 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.176678 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.179500 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.180220 14557 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.181596 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:02.146374 14632 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.190847 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:02.191039 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53482.9us
I20260709 12:11:02.192487 14681 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.195119 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.224069 11216 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:02.225157 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.195847 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.196520 14362 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.205694 11215 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
W20260709 12:11:02.229228 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47727.6us
I20260709 12:11:02.229960 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.172348 14596 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.215579 11218 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:02.231158 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.231909 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.215855 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:02.234114 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:02.234449 11258 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.861s (SENT)
I20260709 12:11:02.235432 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.236616 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.237358 11219 raft_consensus.cc:2410] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:02.238111 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.240105 14641 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:02.240351 14362 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:02.240610 14641 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.241031 14641 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:02.226563 11213 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:11:02.247071 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:02.243211 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:02.289435 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73687.2us
I20260709 12:11:02.287158 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:02.290915 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60030us
I20260709 12:11:02.290874 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:02.295660 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:02.297394 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:02.297875 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.298246 14692 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.298791 14692 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.299388 14692 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.302667 14508 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.303133 14508 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.303529 14508 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.305162 14698 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.305810 14698 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:02.306277 14698 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.298935 11292 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 3: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:02.324692 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.326398 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.327831 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.334077 11144 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:02.335837 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.328899 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.331247 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.340633 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.344760 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.346731 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.221371 14205 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.109s
W20260709 12:11:02.348356 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59098.2us
I20260709 12:11:02.345981 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.294754 14681 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:02.329524 14569 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:02.241052 14362 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:11:02.360387 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.362118 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.222971 14683 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:02.357669 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.416868 11284 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.365995 11290 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:02.371178 11038 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.417440 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:02.418370 11857 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.419454 11038 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.420806 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.374729 11216 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.348033 14485 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:02.380256 14681 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.424031 14681 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.382412 14596 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.392812 14460 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:11:02.397879 11288 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:11:02.409049 14592 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.410692 14665 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.330525 14590 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:11:02.414781 14569 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:02.428592 11857 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:02.431689 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.434922 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.435879 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.436368 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:02.438123 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:02.439263 11292 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:02.426510 11038 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:02.444056 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.444409 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.446063 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.450773 11292 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:02.453326 11286 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:02.454936 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:02.456751 11284 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.458566 11288 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:02.439899 14596 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:11:02.443583 14495 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:02.461392 11290 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:02.471020 14569 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.455242 14590 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:02.491926 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 252582us
I20260709 12:11:02.464480 14495 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:02.535579 11038 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.494004 14590 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:02.486554 14692 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.491072 14508 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:02.579115 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 224894us
I20260709 12:11:02.576622 11038 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 5, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.585793 11287 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.586413 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:02.542316 14698 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.588339 11038 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 4, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:11:02.598240 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 307431us
I20260709 12:11:02.602154 11857 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:02.599896 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 229167us
I20260709 12:11:02.607422 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:02.608117 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57221.8us
I20260709 12:11:02.616410 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:02.598897 14616 raft_consensus.cc:2764] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:02.619079 11038 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:02.624768 14418 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.630229 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:02.633150 11214 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:11:02.634732 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:02.638057 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.631063 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:02.629046 14418 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.638912 11291 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:11:02.641939 11218 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:02.627409 14590 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.643316 11038 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 8, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.625552 14485 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.610292 14324 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:02.586720 14495 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.655193 14324 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:02.655782 14324 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:02.656796 14324 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.658281 14324 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.661227 14747 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:02.662796 14747 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:02.668255 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.639225 14418 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.639405 14686 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:02.650803 14737 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:02.684489 11212 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.668462 14733 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:11:02.636466 14557 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:11:02.695819 14740 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:11:02.696666 11286 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.697461 14641 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.648834 14746 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:02.694854 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:02.708181 11210 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:02.689873 14742 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.694693 11038 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 8, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:02.727895 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.729012 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:02.734356 14686 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:02.736004 14686 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.704173 14478 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:02.778748 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 189596us
W20260709 12:11:02.756677 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 120587us
W20260709 12:11:02.787104 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.748282 11219 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:11:02.750030 14741 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:11:02.798033 11038 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 5, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:02.800519 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55311.3us
I20260709 12:11:02.715032 14495 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.763976 14683 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.749425 14478 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:02.783584 14692 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:02.792510 14508 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.843976 11038 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 4 to 7, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 7 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:02.852418 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.869498 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:02.884624 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 225380us
I20260709 12:11:02.836262 14205 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.894040 11038 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.897886 11216 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:11:02.874053 14762 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:02.843542 14698 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:02.905642 11038 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 3, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 3 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.819533 14590 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:11:02.915145 14616 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:11:02.837296 14638 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:11:02.937448 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.945785 14616 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:02.893493 14205 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:02.952785 14632 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.001s
I20260709 12:11:02.955193 14641 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:02.946287 14616 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:02.960988 14616 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:02.974730 14478 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.976457 14478 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.917112 14744 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:11:02.904109 14362 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:02.994168 14205 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:02.950330 11038 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:03.035568 11212 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:03.001665 14205 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.036962 14418 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:03.042377 11258 leader_election.cc:336] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.618s (SENT)
W20260709 12:11:03.066114 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 445104us
I20260709 12:11:03.031674 14616 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:03.011029 14681 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.006s
W20260709 12:11:03.096449 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.107342 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:03.047868 14746 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.133400 14746 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:03.137846 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 426081us
W20260709 12:11:03.138840 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 254705us
I20260709 12:11:03.141057 11038 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:03.143795 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:03.086052 14681 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:03.145596 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:03.146150 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 59727.6us
I20260709 12:11:03.141568 14495 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:03.148072 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:03.151700 11038 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 3, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 3 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:03.154093 11038 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.151803 14632 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:03.179095 14362 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:03.179738 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:03.149664 14765 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:03.150331 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:03.196570 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46282.5us
I20260709 12:11:03.189222 14632 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.191862 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:03.192763 11292 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:03.194043 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:03.194178 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:03.195330 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.190903 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 105982us
I20260709 12:11:03.197599 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:03.203068 14418 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:03.194303 14768 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:03.210819 11861 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:03.215986 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:03.218222 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:03.217207 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.224066 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:03.215469 11038 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 2, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 2 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:03.219568 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.190510 14698 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.227044 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:03.228508 11214 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.229562 14457 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:03.227835 14616 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:11:03.231369 14764 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.231863 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:03.232055 14770 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:03.232178 14764 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.232931 14770 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:03.233212 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:03.233652 14745 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:03.234026 14745 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:03.197718 11853 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.215091 14508 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.234784 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:03.248648 11038 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 8, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.239048 11293 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.243786 11219 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:03.236393 11287 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:03.245347 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:03.235586 14616 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.252334 11218 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.252578 14616 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:03.253158 14681 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:03.253523 14616 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.234781 14457 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:03.254792 14616 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.255440 11217 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:03.234988 14745 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.256584 14745 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.257171 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:03.241838 14765 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.258885 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1696) took 1051 ms. Trace:
I20260709 12:11:03.259588 11292 rpcz_store.cc:276] 0709 12:11:02.207255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.460537 (+253282us) service_pool.cc:224] Handling call
0709 12:11:02.460874 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.209911 (+749037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.258668 (+ 48757us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540015c054. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:03.258834 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682630528}
I20260709 12:11:03.259644 14765 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:03.237191 11216 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:11:03.208395 14362 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:03.236554 14692 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.217649 14632 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.239120 14770 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:03.250422 11038 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 7, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:03.283124 11214 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:03.295121 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:03.295748 11214 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.254905 14457 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:03.298273 11218 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:11:03.298969 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104352us
I20260709 12:11:03.234453 14764 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:03.295344 11038 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 7, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 7 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:03.307032 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.864s (SENT)
I20260709 12:11:03.246912 14508 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.272188 14362 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:03.311950 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 88415.3us
I20260709 12:11:03.315770 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:03.314052 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:03.317118 11139 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:03.272459 14698 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.312685 11038 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 8, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.296494 14681 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:03.328507 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:03.303151 14686 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:03.338816 11038 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 12, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:03.340696 11214 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:03.320363 14764 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.346326 11038 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:03.356148 14698 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.350454 11214 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:03.365458 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 73736.2us
I20260709 12:11:03.234908 14448 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:11:03.380899 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:03.335438 14681 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:03.388252 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 72570.6us
I20260709 12:11:03.389041 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:03.370916 14742 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
W20260709 12:11:03.387686 11826 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.516s (SENT)
I20260709 12:11:03.394214 11291 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:03.348439 14692 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.397395 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:03.398077 11214 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.394273 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:03.399075 11286 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.366708 14457 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.342334 14686 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:03.402407 14686 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:03.402983 14686 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:03.414913 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.421065 11826 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.559s (SENT)
I20260709 12:11:03.424950 11139 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:11:03.383134 14761 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:03.431957 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:03.396929 14742 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.350780 14362 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.419827 14754 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.458277 14788 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:03.458536 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:03.459146 11214 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:11:03.466619 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45588.5us
I20260709 12:11:03.428283 14596 raft_consensus.cc:2764] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:11:03.471047 11184 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:03.433611 14485 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:03.473189 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92394.8us
I20260709 12:11:03.471755 11858 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.351337 14770 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.436626 14478 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:03.396330 14508 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:03.544793 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:11:03.519095 11826 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.935s (SENT)
I20260709 12:11:03.487224 11286 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:03.477403 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:03.558370 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 81042.4us
I20260709 12:11:03.436676 14771 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.479076 14742 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.470338 14761 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.561885 14616 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:03.562307 14767 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:11:03.559046 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:03.563153 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104706us
I20260709 12:11:03.499492 14418 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.569403 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:03.528168 14783 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:03.460507 14754 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.483945 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57561.2us
I20260709 12:11:03.507584 14362 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.562688 14742 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.582633 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:03.477298 14753 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:11:03.478170 14495 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.563616 14771 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:03.589562 11258 leader_election.cc:336] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.056s (SENT)
I20260709 12:11:03.488867 14485 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.570842 14418 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:03.530613 14460 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:11:03.607159 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88112.1us
I20260709 12:11:03.584677 14746 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.591876 14742 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.586256 14754 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.506366 14692 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:03.619959 11826 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.935s (SENT)
I20260709 12:11:03.624621 14760 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.602305 14698 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.610548 14418 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.605024 14771 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.635601 14784 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:03.636175 14778 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:11:03.627285 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:03.644776 11826 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.973s (SENT)
I20260709 12:11:03.647207 11293 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:03.649742 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.658916 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.674068 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:03.626794 14788 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:03.680192 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 177890us
I20260709 12:11:03.625159 14766 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.184s
I20260709 12:11:03.620558 14782 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 12:11:03.692667 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65470.3us
W20260709 12:11:03.682333 14774 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:11:03.677006 14698 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:03.686858 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 117535us
I20260709 12:11:03.680653 14788 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.705369 11853 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
W20260709 12:11:03.707409 14779 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.375s	user 0.000s	sys 0.003s
W20260709 12:11:03.711385 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 66649.6us
I20260709 12:11:03.714392 14632 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.715113 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:03.702214 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 325359us
I20260709 12:11:03.742978 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:03.743819 11214 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:03.717782 14641 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.705274 14786 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:03.719183 14788 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.752688 14641 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:03.754115 14766 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:03.759817 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.146s (SENT)
I20260709 12:11:03.735625 14789 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:03.758710 14746 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.777304 14742 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:03.772308 14784 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:03.779270 14745 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.001s
I20260709 12:11:03.782914 14761 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:03.783717 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.790438 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52556.1us
W20260709 12:11:03.805009 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.806440 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:03.806173 14205 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.006s
I20260709 12:11:03.792979 14766 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:03.816800 14794 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:03.813983 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54202.8us
I20260709 12:11:03.818151 14495 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.821182 14784 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.825157 14742 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:03.806391 14485 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:03.830340 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:03.851352 14746 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:03.808058 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.813068 14745 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:11:03.839267 11258 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.146s (SENT)
I20260709 12:11:03.827301 14794 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.893678 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65413.4us
I20260709 12:11:03.812866 14641 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.806808 14698 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:03.863456 14794 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:03.901263 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.891705 14742 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:11:03.882929 14418 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.947908 14782 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.952381 14803 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:11:03.973570 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 143293us
I20260709 12:11:03.909858 14771 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:03.971220 14789 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:03.986989 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 212925us
I20260709 12:11:03.989672 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:03.994141 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:03.965006 14745 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:03.950749 14766 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:11:04.005005 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.017232 14770 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.975417 14782 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.025602 14814 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.036312 14418 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.043097  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:04.031662 14771 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.025257 14742 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:04.033385 14820 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:04.088119 14782 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:04.044519 14745 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.096290 14820 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:04.105862 14794 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.112398 14794 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.109591 14820 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.114106 14820 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.115614 14681 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.082166 14742 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:04.079798 14789 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:04.125010 14789 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.043496 14754 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.128137 14742 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.130858 14788 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.119015 14782 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.136968 14819 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:04.137909 14782 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.139021 14754 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.140470 14782 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:04.150174 11258 leader_election.cc:336] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.622s (SENT)
I20260709 12:11:04.153782 14749 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.154284 14749 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:04.155190 14749 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.156261 14749 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:04.159266 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.150904 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:04.160571 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.654s (SENT)
W20260709 12:11:04.162216 11258 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.783s (SENT)
I20260709 12:11:04.165828 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:04.174809 14784 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:04.175947 14788 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.173895 14753 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:04.181267 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.189714 14324 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.177088 14784 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.190785 14764 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:04.191407 14764 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:04.192773 14784 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.192559 14764 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:04.193563 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 203068us
W20260709 12:11:04.193636 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 512320us
I20260709 12:11:04.181128 14766 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:04.197144 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:04.199654 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.207504 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.209962 14632 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.212769 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.214570 14771 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.215092 14771 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.217175 14771 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.193630 14324 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.219574 14324 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.221366 11859 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:04.229307 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:04.231570 11858 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:04.198541 14478 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.234575 11289 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.238986 11286 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:04.243201 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:04.251478 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54417.6us
I20260709 12:11:04.251726 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.243613 11143 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:04.244392 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82227us
I20260709 12:11:04.252310 11858 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:04.253816 11110 leader_election.cc:400] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:04.254220 11110 leader_election.cc:403] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:04.234977 11826 leader_election.cc:336] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.869s (SENT)
I20260709 12:11:04.256006 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.247057 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:04.261224 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:04.268833 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.250288 14205 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:04.206204 14495 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:11:04.271693 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.272680 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.273666 14788 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.274035 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.287299 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:04.291814 11858 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.256160 14760 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:04.292635 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.292482 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:04.249897 14478 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:04.309880 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 102646us
I20260709 12:11:04.310750 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:04.293619 14362 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.313292 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.295611 14764 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.316941 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:04.328773 14744 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.329218 14478 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:04.329568 14831 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:11:04.329452 14744 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.331897 14744 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.332454 14744 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:04.332773 14744 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.333089 14744 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:04.334844 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 99915.9us
I20260709 12:11:04.314096 14837 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:04.336105 14837 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:04.336488 14837 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.338205 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:04.305971 14457 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:04.357524 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:04.358364 11286 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:04.359597 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:04.363023 14784 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:04.363343 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50132us
I20260709 12:11:04.365955 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.338873 14760 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.294909 14835 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:11:04.367148 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:04.372179 11856 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:04.356545 14681 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:04.373322 14681 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:04.356609 14788 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:04.373847 14681 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.371102 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:04.382804 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60799us
I20260709 12:11:04.383643 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:04.385352 14751 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:04.385764 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.387930 14833 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.388772 14205 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:04.389405 14205 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:04.390550 14820 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.390431 14205 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.391363 14820 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:04.392213 14820 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:04.392877 14820 consensus_queue.cc:1243] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:04.393334 14820 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.393643 14820 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:04.394627 14754 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:04.395057 14754 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:04.396000 14754 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.397331 14754 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.397517 14742 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.399128 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.410751 11858 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:11:04.411095 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.363998 14841 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:04.416332 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.380614 14745 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.419322 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:04.366585 14683 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:04.363759 14749 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:11:04.417994 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.433540 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.383160 14829 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.420871 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.434696 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:04.437131 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:04.438045 11258 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.837s (SENT)
I20260709 12:11:04.438516 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:04.415511 14841 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:04.429615 14478 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.442830 14841 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.444306 14836 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.445811 11142 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:04.446966 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.448123 14324 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.450174 14746 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.451576 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.454070 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.454829 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.455885 11135 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:04.458060 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.459378 14834 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.459685 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.460825 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:04.462734 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.471809 11141 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:04.465058 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.498821 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.485857 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:04.510361 11219 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.463371 11217 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:04.511282 11286 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:04.514876 11258 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.932s (SENT)
I20260709 12:11:04.515450 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:04.522719 11137 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:04.509274 11140 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:04.533613 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.433133 14768 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.433640 14833 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.411767 14809 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 12:11:04.543064 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.544477 11214 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:04.547008 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.550904 11213 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:04.394439 14820 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.437692 14782 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:04.552309 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.568444 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.432677 14745 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.556993 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.569870 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:04.569916 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.572077 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.572741 11138 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:04.561100 11212 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:04.547323 14742 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.576795 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.547798 14760 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.550426 14833 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:04.574935 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.564795 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:04.581740 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.577432 11212 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:04.613046 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.613916 11212 raft_consensus.cc:2368] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10.
I20260709 12:11:04.553808 14784 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:04.599793 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.615715 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:04.617426 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.620139 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.621443 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.622146 11137 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:11:04.625718 14745 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.557860 14768 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.613384 14833 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.629451 14768 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:04.610563 14835 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.630199 14820 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.630432 14835 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.632719 14835 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.634682 14744 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.637228 14744 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:04.636577 14837 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.640271 14837 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.643258 11211 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:04.658697 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:04.676431 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.678795 11856 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:04.688158 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.688949 11138 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:04.689745 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.690301 11212 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:04.691313 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.691833 11212 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:11:04.694597 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.706929 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.708526 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.711019 14841 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.713726 11218 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:04.715955 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:04.463774 14829 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:04.718278 11858 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.729478 11219 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:04.510179 14834 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.738421 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:04.739293 11212 raft_consensus.cc:2368] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10.
W20260709 12:11:04.739346 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.740402 11212 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.762631 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:04.768234 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.730474 11138 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:04.765115 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 244487us
I20260709 12:11:04.618185 14760 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.773300 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:04.777662 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.759335 14834 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.784704 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:04.785600 11212 raft_consensus.cc:2368] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12.
I20260709 12:11:04.785969 11858 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:04.751916 14829 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.763893 14837 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.780426 14448 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.794092 11217 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 4.
I20260709 12:11:04.759157 14782 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:04.803030 14641 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.805291 14821 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.806031 11855 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:04.805840 14821 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.807104 14782 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.777163 14692 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:04.802265 14448 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.812615 14448 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.813971 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:04.814785 14758 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:04.815311 14758 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:04.815801 14821 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.816093 14758 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:04.817553 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:04.817951 14821 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.819808 11212 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:04.801586 14770 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.830888 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 316051us
I20260709 12:11:04.836364 11138 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:04.796463 14837 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:04.907152 11258 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.006s (SENT)
I20260709 12:11:04.907720 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:04.911062 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:04.911803 11138 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:04.915158 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76160.6us
W20260709 12:11:04.915874 11258 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.037s (SENT)
I20260709 12:11:04.916283 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:04.917065 14845 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:11:04.917842 11258 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.110s (SENT)
I20260709 12:11:04.919389 14683 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.920964 14683 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:04.921834 14833 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:04.923672 11108 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40324 dropped due to backpressure: service queue is full with 50 items
I20260709 12:11:04.923985 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.939321 11135 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:04.835716 14205 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:04.925726 14837 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.827351 14821 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.928802 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:04.930049 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.913103 14784 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.947165 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:04.922329 14683 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:04.953266 11210 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.933410 14546 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:04.834666 14770 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.960441 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:04.959438 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.962236 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:04.963423 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.964754 11213 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:04.963744 11138 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:04.952714 14205 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:04.933192 14692 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:11:04.984364 11210 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:04.938884 11108 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40324 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1882)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1877)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2495)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1871)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1878)
I20260709 12:11:04.950455 14485 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:11:04.947155 14754 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:04.986337 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.967545 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:04.955310 14841 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:04.955618 14448 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.981622 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.952555 14768 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:05.000548 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:04.956784 14751 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:05.008503 11213 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:04.975159 14683 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:05.007265 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:05.004671 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:05.016696 11214 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:11:05.016706 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.018723 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:05.025192 11853 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:05.027277 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:05.030364 11137 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:05.032753 11138 raft_consensus.cc:2368] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:05.035336 11213 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:05.036293 11214 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.012204 14683 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:05.015405 14836 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.040190 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.029218 11108 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36052 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1882)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1877)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2495)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1871)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2512)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2514)
I20260709 12:11:05.069437 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:05.014097 14448 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.020887 14760 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:05.024389 14835 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.063661 11210 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:05.066184 11214 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:05.038584 14641 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.068590 14837 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.130164 14837 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.132459 14837 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:05.077107 14418 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:05.133066 14418 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.133450 14418 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.081856 11211 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:05.083127 11135 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.110088 11216 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.123544 11108 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40324 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1877)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2495)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1871)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2512)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2518)
I20260709 12:11:05.110718 11212 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.110863 14833 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.111779 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.143539 11141 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:05.144573 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.145956 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.065783 14834 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:05.115541 14681 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 12:11:05.113279 14829 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.149678 14683 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:05.149920 14681 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:05.151037 11214 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 9. Ops: []
I20260709 12:11:05.151496 14829 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:05.116230 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.139711 14641 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.152344 14641 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.152727 14448 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.154691 11143 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:05.155905 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.156558 11135 raft_consensus.cc:2376] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11. Re-sending same reply.
I20260709 12:11:05.157158 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.157449 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.118911 14821 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.119889 14770 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.040768 14324 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:05.082401 14362 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:05.166683 14362 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:05.167541 14362 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.160223 11143 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.169723 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.170042 14681 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:05.170259 11143 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:05.160368 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:05.171357 11856 raft_consensus.cc:2368] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10.
I20260709 12:11:05.162245 11210 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.174854 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.175544 11140 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:05.183750 11107 leader_election.cc:400] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10.
I20260709 12:11:05.184131 11107 leader_election.cc:403] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.184881 14829 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.187148 14641 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.165699 11135 raft_consensus.cc:2368] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:11:05.151090 14683 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:05.192725 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.205838 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:05.207226 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:05.207842 11860 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
W20260709 12:11:05.211983 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.163990 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.214587 11141 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.217114 14641 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:05.218145 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.218829 11135 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.220141 11856 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.193931 14829 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10.
W20260709 12:11:05.195575 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.249503 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.195827 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.246585 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.253355 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.254237 11144 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.265929 14834 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:05.246097 14754 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.286221 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.288690 11141 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:05.286031 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.252952 11108 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40324 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1877)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1870)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1869)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2495)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1871)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2512)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 632)
I20260709 12:11:05.301165 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:05.305850 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.315548 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.316560 11289 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
W20260709 12:11:05.321769 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 252394us
I20260709 12:11:05.322942 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:05.301108 14754 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.336018 14754 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:05.336050 14797 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:05.358839 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.360193 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.360477 14797 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.361070 11139 raft_consensus.cc:2410] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:11:05.362141 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.362890 14205 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:05.344794 14820 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.004s
I20260709 12:11:05.365671 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:05.352175 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:05.365868 14847 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.598s	user 0.000s	sys 0.009s
I20260709 12:11:05.361038 14797 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:05.348690 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.383760 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.372890 11139 raft_consensus.cc:2368] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
I20260709 12:11:05.380380 11136 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:05.386139 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.395584 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.398205 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.398530 11860 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.398938 11285 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:05.394305 11142 raft_consensus.cc:2376] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7. Re-sending same reply.
I20260709 12:11:05.399221 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.401469 11143 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
I20260709 12:11:05.402055 14324 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:05.402361 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.402596 14324 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.403625 11143 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:05.403604 11854 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:05.407694 11854 pending_rounds.cc:85] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 8
I20260709 12:11:05.408026 11854 pending_rounds.cc:107] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:05.408332 11854 raft_consensus.cc:2889] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.410529 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.411304 11142 raft_consensus.cc:2376] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11. Re-sending same reply.
I20260709 12:11:05.412426 14797 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.413736 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.415089 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.415441 14797 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.415725 11143 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.412515 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.424274 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:05.428143 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.390400 14782 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:05.428951 11142 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.429242 14418 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:05.429793 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.430729 11142 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.431514 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.432572 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.434654 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:05.434684 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.437208 14849 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:05.439399 11860 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:05.439258 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.476084 11136 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.440372 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 814) took 1173 ms. Trace:
I20260709 12:11:05.476660 11142 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.441679 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.327879 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:05.447595 11135 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:05.478027 11138 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.455678 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.458276 11858 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:05.458149 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.479637 11139 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:05.476848 11853 rpcz_store.cc:276] 0709 12:11:04.267253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.273798 (+  6545us) service_pool.cc:224] Handling call
0709 12:11:05.440174 (+1166376us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400436054. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:05.440310 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686626560}
I20260709 12:11:05.461717 11110 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:40324 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 638)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1874)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1879)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2495)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2503)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 620)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 621)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 624)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1871)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1872)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1873)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2512)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 629)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 636)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 639)
I20260709 12:11:05.482803 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.482913 14681 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:05.483529 11286 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.484711 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.485478 11285 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:05.487962 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:05.493285 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 58716.3us
I20260709 12:11:05.494668 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:05.496541 14835 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:05.496971 11143 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:05.497220 14835 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:05.498045 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.496681 11286 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:05.498214 14835 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.500164 14478 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:05.501624 14478 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.502091 14478 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:05.488158 11141 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:05.503538 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:05.445770 14324 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:05.506558 11858 raft_consensus.cc:606] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:05.509536 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.504659 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.506983 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:05.510596 11141 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:05.492274 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.513129 11286 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:11:05.513808 11286 pending_rounds.cc:85] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 2
I20260709 12:11:05.514165 11286 pending_rounds.cc:107] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:11:05.514441 11286 raft_consensus.cc:2889] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.513878 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.515728 11144 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:05.516501 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.517459 11141 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.521668 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.523898 11291 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:05.531370 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.534770 14692 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:05.536468 14692 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:05.537943 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.539937 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.513695 14797 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.540746 14797 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:05.539844 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.541837 14797 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.521242 14698 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:11:05.514637 14784 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:11:05.546677 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.547565 11141 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:05.551498 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.553288 11141 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:05.555334 11292 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:05.565013 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 237245us
I20260709 12:11:05.573685 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.576188 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:05.574064 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:05.578503 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 255631us
I20260709 12:11:05.580309 11143 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:05.585855 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.586732 11142 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:05.590727 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.596262 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.596388 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:05.617256 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.648599 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.738566 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.739064 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.740566 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.572636 14868 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.531445 14632 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:11:05.741482 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.759279 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.752080 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 184825us
I20260709 12:11:05.759649 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.761181 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:05.762411 11143 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.765599 11857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:05.766211 11857 raft_consensus.cc:606] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:05.768213 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.769269 11136 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:05.770866 11141 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:05.771837 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2499) took 1310 ms. Trace:
I20260709 12:11:05.775224 11140 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:05.772290 11141 rpcz_store.cc:276] 0709 12:11:04.460993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.752889 (+1291896us) service_pool.cc:224] Handling call
0709 12:11:05.770384 (+ 17495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.771469 (+  1085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.771758 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.775872 11140 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:05.745711 14820 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:05.802518 14820 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:05.805040 14820 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:05.795471 14833 raft_consensus.cc:2764] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:05.806659 14418 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.808388 14324 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:05.812951 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.813680 11135 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:05.815048 11135 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:05.815315 11211 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.815551 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2501) took 1354 ms. Trace:
I20260709 12:11:05.815871 11135 rpcz_store.cc:276] 0709 12:11:04.461506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.814452 (+1352946us) service_pool.cc:224] Handling call
0709 12:11:05.814751 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.815338 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.815505 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.816809 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.817355 11135 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:11:05.797645 14849 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.799603 11136 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:11:05.754657 14865 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.818282 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.835137 11135 raft_consensus.cc:2376] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12. Re-sending same reply.
I20260709 12:11:05.835815 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.831207 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2500) took 1370 ms. Trace:
I20260709 12:11:05.836129 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.838702 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1862) took 1132 ms. Trace:
I20260709 12:11:05.840261 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.841514 11135 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.832332 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.836650 11136 rpcz_store.cc:276] 0709 12:11:04.461233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.770194 (+1308961us) service_pool.cc:224] Handling call
0709 12:11:05.799356 (+ 29162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.830914 (+ 31558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.831147 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.839269 11137 rpcz_store.cc:276] 0709 12:11:04.706425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.835909 (+1129484us) service_pool.cc:224] Handling call
0709 12:11:05.838612 (+  2703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.834071 11140 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:05.848968 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.849682 11135 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 3: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.850342 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.850852 11135 raft_consensus.cc:2376] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6. Re-sending same reply.
W20260709 12:11:05.852381 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.852649 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.852933 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.854115 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:05.856487 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.857190 11135 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:05.858160 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.858754 11135 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
W20260709 12:11:05.860270 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.861234 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.861461 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.862077 11141 raft_consensus.cc:2410] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:05.863116 11136 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:05.863258 11141 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.863801 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2502) took 1402 ms. Trace:
I20260709 12:11:05.863966 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2503) took 1402 ms. Trace:
I20260709 12:11:05.864404 11141 rpcz_store.cc:276] 0709 12:11:04.462004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.862743 (+1400739us) service_pool.cc:224] Handling call
0709 12:11:05.863076 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.863730 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.863914 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.867395 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.874601 11136 rpcz_store.cc:276] 0709 12:11:04.461753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.862583 (+1400830us) service_pool.cc:224] Handling call
0709 12:11:05.862900 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.863562 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.863744 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.876353 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.876579 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:05.877139 11143 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.878022 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:05.878712 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.834803 14865 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.830768 14849 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:05.880090 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.881795 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.885588 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.887737 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:05.890295 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:05.893416 11141 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:05.897042 11141 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.897624 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1853) took 1275 ms. Trace:
I20260709 12:11:05.897943 11141 rpcz_store.cc:276] 0709 12:11:04.622310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.896529 (+1274219us) service_pool.cc:224] Handling call
0709 12:11:05.896853 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.897409 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.897572 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.901111 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 620) took 1313 ms. Trace:
I20260709 12:11:05.903558 11136 rpcz_store.cc:276] 0709 12:11:04.578859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.888730 (+1309871us) service_pool.cc:224] Handling call
0709 12:11:05.892061 (+  3331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.892295 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.892332 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.892389 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:05.892433 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.892504 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.892630 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.884253 14865 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.908954 11140 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.911017 11141 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.911626 11136 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:05.908782 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 146258us
I20260709 12:11:05.912384 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1854) took 1289 ms. Trace:
I20260709 12:11:05.912895 11141 rpcz_store.cc:276] 0709 12:11:04.644794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.899658 (+1254864us) service_pool.cc:224] Handling call
0709 12:11:05.910810 (+ 11152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.912122 (+  1312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.912326 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.913102 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:05.922004 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1857) took 1218 ms. Trace:
I20260709 12:11:05.922480 11136 rpcz_store.cc:276] 0709 12:11:04.703418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.908781 (+1205363us) service_pool.cc:224] Handling call
0709 12:11:05.911439 (+  2658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.921631 (+ 10192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.921913 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.926515 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 623) took 1185 ms. Trace:
I20260709 12:11:05.926956 11136 rpcz_store.cc:276] 0709 12:11:04.741392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.923418 (+1182026us) service_pool.cc:224] Handling call
0709 12:11:05.925834 (+  2416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.926067 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.926108 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.926168 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.926212 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.926289 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.926428 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.930588 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:05.944981 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 183874us
I20260709 12:11:05.945716 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 621) took 1205 ms. Trace:
I20260709 12:11:05.946372 11141 rpcz_store.cc:276] 0709 12:11:04.740778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.913898 (+1173120us) service_pool.cc:224] Handling call
0709 12:11:05.945025 (+ 31127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.945262 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.945300 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.945358 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:05.945419 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.945492 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.945631 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.947130 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:05.793988 14749 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 4 to 10, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:05.973658 11136 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:11:05.949674 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.974344 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 624) took 1165 ms. Trace:
I20260709 12:11:05.976508 11136 rpcz_store.cc:276] 0709 12:11:04.809316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.929334 (+1120018us) service_pool.cc:224] Handling call
0709 12:11:05.972617 (+ 43283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.974095 (+  1478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.974288 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.947974 14324 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.970980 14418 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.948558 14849 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:05.992398 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 52626.7us
I20260709 12:11:05.992549 11211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:06.003181 11211 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:06.003759 11211 raft_consensus.cc:614] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.008955 11216 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:06.014598 11141 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:11:06.015555 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1871) took 1205 ms. Trace:
I20260709 12:11:06.015976 11141 rpcz_store.cc:276] 0709 12:11:04.810426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.978950 (+1168524us) service_pool.cc:224] Handling call
0709 12:11:05.994971 (+ 16021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.015182 (+ 20211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.015468 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.018953 11217 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:06.023964 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:06.025025 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 78115.6us
W20260709 12:11:06.027592 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47817us
I20260709 12:11:06.027678 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:05.990595 14820 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:06.042048 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:06.042788 11293 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.043040 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:06.043746 11211 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:06.011734 14495 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:06.045264 11218 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:06.045707 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:06.011339 14764 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:11:06.062330 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.070122 11211 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.071082 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:05.991214 14892 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:11:06.072942 11141 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:06.077579 11215 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:06.082700 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.060710 14849 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.049028 14891 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:06.079659 14899 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.119431 11110 connection.cc:256] RPC call timeout handler was delayed by -4.9275011610000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 12:11:06.048853 14820 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:06.089967 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.080780 14889 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:06.152182 14889 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:06.110411 14883 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:11:06.081341 14873 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:11:06.090039 14868 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:06.157471 14868 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.159601 14868 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:06.159996 11211 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:11:06.086963 11293 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
W20260709 12:11:06.125941 14890 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:06.072530 14877 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:11:06.200990 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:06.201689 11860 raft_consensus.cc:606] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:06.130738 14887 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:11:06.102938 14891 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.203631 14891 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:06.204595 14797 raft_consensus.cc:993] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:06.205188 14797 raft_consensus.cc:1081] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
W20260709 12:11:06.206254 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.138718 14885 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 12:11:06.139424 14880 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 12:11:06.143293 14884 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:11:06.144070 14820 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:06.160633 11216 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.087707 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1872) took 1277 ms. Trace:
I20260709 12:11:06.124182 14899 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:06.120533 11110 connection.cc:256] RPC call timeout handler was delayed by -4.9077011609999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 12:11:06.313196 11110 connection.cc:256] RPC call timeout handler was delayed by -4.8744011610001508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:11:06.313678 11110 connection.cc:256] RPC call timeout handler was delayed by -4.829401161000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 12:11:06.314046 11110 connection.cc:256] RPC call timeout handler was delayed by -4.7385011610001584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
I20260709 12:11:06.162799 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2002) took 1227 ms. Trace:
W20260709 12:11:06.314426 11110 connection.cc:256] RPC call timeout handler was delayed by -4.7187011610001264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 12:11:06.314939 11110 connection.cc:256] RPC call timeout handler was delayed by -4.6719011610000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:11:06.315546 11110 connection.cc:256] RPC call timeout handler was delayed by -4.6629011610000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 12:11:06.315938 11110 connection.cc:256] RPC call timeout handler was delayed by -4.6296011609999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:11:06.316357 11110 connection.cc:256] RPC call timeout handler was delayed by -4.6125011609999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 12:11:06.169657 11140 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:11:06.189314 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79907.5us
I20260709 12:11:06.189695 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:06.190006 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:06.318771 11215 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:11:06.291462 11826 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.982s (SENT)
W20260709 12:11:06.190265 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.320672 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.165076 14868 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.200678 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.105453 14835 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:11:06.224588 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.251036 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.196292 14418 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:06.290619 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.292760 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 195698us
I20260709 12:11:06.309517 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:06.310681 11141 rpcz_store.cc:276] 0709 12:11:04.810722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.016979 (+1206257us) service_pool.cc:224] Handling call
0709 12:11:06.072789 (+ 55810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.087424 (+ 14635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.087647 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.164103 14901 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.317045 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.317396 11140 pending_rounds.cc:85] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 3
W20260709 12:11:06.347218 11110 connection.cc:256] RPC call timeout handler was delayed by -4.60980116099995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
I20260709 12:11:06.486931 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:06.377194 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 349588us
I20260709 12:11:06.314868 11210 rpcz_store.cc:276] 0709 12:11:04.935573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.172778 (+237205us) service_pool.cc:224] Handling call
0709 12:11:05.173081 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.200065 (+ 26984us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:05.256664 (+ 56599us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.753917 (+497253us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.981066 (+227149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.996981 (+ 15915us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.997175 (+   194us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.997221 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.997325 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.162570 (+165245us) raft_consensus.cc:1685] finished
0709 12:11:06.162592 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.162725 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111804,"prepare.queue_time_us":48747,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":10297,"raft.queue_time_us":240150,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":3544,"thread_start_us":536409,"threads_started":2,"wal-append.queue_time_us":595355}
W20260709 12:11:06.484068 11144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.013s	sys 0.023s
I20260709 12:11:06.320004 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:06.198675 14865 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.310611 14889 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:06.509922 11140 pending_rounds.cc:107] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:06.549600 11140 raft_consensus.cc:2889] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:06.510612 11211 raft_consensus.cc:2368] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10.
W20260709 12:11:06.513777 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.513931 11110 connection.cc:256] RPC call timeout handler was delayed by -4.5855011610001384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 12:11:06.526400 11216 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:06.551513 11110 connection.cc:256] RPC call timeout handler was delayed by -4.5567011610000918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 12:11:06.556696 11110 connection.cc:256] RPC call timeout handler was delayed by -4.5540011610000874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 12:11:06.557065 11110 connection.cc:256] RPC call timeout handler was delayed by -4.5351011610000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:11:06.557327 11110 connection.cc:256] RPC call timeout handler was delayed by -4.5054011610000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 12:11:06.514178 11144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.013s	sys 0.023s
W20260709 12:11:06.557648 11110 connection.cc:256] RPC call timeout handler was delayed by -4.4739011609999579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 12:11:06.515015 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:06.557950 11110 connection.cc:256] RPC call timeout handler was delayed by -4.4604011610001635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 12:11:06.522245 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 1861) took 1817 ms. Trace:
W20260709 12:11:06.558228 11110 connection.cc:256] RPC call timeout handler was delayed by -4.3749011610000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:11:06.558306 11139 rpcz_store.cc:276] 0709 12:11:04.705458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.309171 (+1603713us) service_pool.cc:224] Handling call
0709 12:11:06.522181 (+213010us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:06.523913 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 232497us
W20260709 12:11:06.543358 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.559384 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.558611 11110 connection.cc:256] RPC call timeout handler was delayed by -4.370401161000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:11:06.559929 11110 connection.cc:256] RPC call timeout handler was delayed by -4.358701160999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 12:11:06.560041 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.560346 11110 connection.cc:256] RPC call timeout handler was delayed by -3.857401161000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27799999999999997s for a response
W20260709 12:11:06.560748 11110 connection.cc:256] RPC call timeout handler was delayed by -3.7116011610000896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2942s for a response
W20260709 12:11:06.561020 11110 connection.cc:256] RPC call timeout handler was delayed by -3.6513011609999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3009s for a response
I20260709 12:11:06.559346 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:06.561385 11110 connection.cc:256] RPC call timeout handler was delayed by -3.457801161000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3224s for a response
I20260709 12:11:06.561932 11139 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 5: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:11:06.562073 11110 connection.cc:256] RPC call timeout handler was delayed by -2.2365011609999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.45810000000000006s for a response
W20260709 12:11:06.562947 11110 connection.cc:256] RPC call timeout handler was delayed by -1.8567011610000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.50030000000000008s for a response
I20260709 12:11:06.565430 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2495) took 2105 ms. Trace:
I20260709 12:11:06.567122 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:06.568101 11139 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:06.569075 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:06.569716 11139 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:06.570474 11826 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.522s (SENT) [suppressed 44 similar messages]
W20260709 12:11:06.506454 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 184379us
I20260709 12:11:06.573997 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2497) took 2113 ms. Trace:
I20260709 12:11:06.574378 11140 rpcz_store.cc:276] 0709 12:11:04.460505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.651582 (+1191077us) service_pool.cc:224] Handling call
0709 12:11:05.761290 (+109708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.573739 (+812449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.573941 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.575383 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:06.575892 11140 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:06.595917 11258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.307s	user 0.002s	sys 0.035s
I20260709 12:11:06.599095 11856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 807) took 1162 ms. Trace:
W20260709 12:11:06.600572 11258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.002s	sys 0.039s
I20260709 12:11:06.596300 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.602368 11210 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:06.601271 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 1.33025e+06us
W20260709 12:11:06.604244 11258 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.430s (SENT)
I20260709 12:11:06.605163 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:06.576696 11141 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:06.581935 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.565855 11142 rpcz_store.cc:276] 0709 12:11:04.459980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.596876 (+1136896us) service_pool.cc:224] Handling call
0709 12:11:05.770520 (+173644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.782158 (+ 11638us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:06.026093 (+243935us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.565039 (+538946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.565100 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.565155 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.565229 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.565369 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312517,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":281377,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":671429,"threads_started":3,"wal-append.queue_time_us":448427}
W20260709 12:11:06.564357 14867 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:06.629794 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:06.623641 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1873) took 1812 ms. Trace:
I20260709 12:11:06.631356 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.600620 11856 rpcz_store.cc:276] 0709 12:11:05.436786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.436913 (+   127us) service_pool.cc:224] Handling call
0709 12:11:05.437203 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.437548 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.437578 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.438023 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.691979 (+253956us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.692038 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.692133 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.598654 (+906521us) raft_consensus.cc:1685] finished
0709 12:11:06.598689 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.598994 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1061,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":253478,"threads_started":1,"wal-append.queue_time_us":437945}
I20260709 12:11:06.631692 11141 rpcz_store.cc:276] 0709 12:11:04.810988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.516906 (+1705918us) service_pool.cc:224] Handling call
0709 12:11:06.574400 (+ 57494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.623310 (+ 48910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.623566 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.513012 14859 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.628278 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:06.537638 14770 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.638861 11854 raft_consensus.cc:606] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.641360 11854 raft_consensus.cc:614] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.644657 11142 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.645928 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.646164 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.646740 11215 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:06.515115 14820 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:06.654155 14891 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.654428 14820 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:06.656505 14891 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:06.657888 14865 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:06.658447 14891 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:06.659039 14891 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:06.660013 14849 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:06.660567 14849 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:06.662118 14891 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:06.652637 14899 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:06.653548 14910 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 12:11:06.522339 14324 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:11:06.522446 14901 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.657567 11141 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:06.662906 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 123508us
I20260709 12:11:06.547111 14764 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:11:06.650883 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1878) took 1838 ms. Trace:
I20260709 12:11:06.667110 11139 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:06.671216 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:06.688549 11142 rpcz_store.cc:276] 0709 12:11:04.812383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.627062 (+1814679us) service_pool.cc:224] Handling call
0709 12:11:06.644364 (+ 17302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.650601 (+  6237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.650825 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.690907 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:06.562938 14632 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:11:06.674364 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:06.695875 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2512) took 1668 ms. Trace:
I20260709 12:11:06.696355 11141 rpcz_store.cc:276] 0709 12:11:05.027219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.633081 (+1605862us) service_pool.cc:224] Handling call
0709 12:11:06.657350 (+ 24269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.693616 (+ 36266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.695818 (+  2202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.695574 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:06.703106 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:06.656611 14820 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:06.614847 14889 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.677325 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:06.682340 14891 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.522573 14744 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:11:06.682651 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:06.521888 14205 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:11:06.691728 11139 raft_consensus.cc:1813] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:06.703517 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:06.620765 14903 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:11:06.715008 11139 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:06.683919 14909 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.536000 14868 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:06.707221 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72469.6us
I20260709 12:11:06.709009 11142 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:06.709622 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.572465 14835 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:06.673605 11140 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:06.693019 14899 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:06.716120 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:06.716213 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:06.725059 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.738055 11141 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:06.737414 11139 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.664170 14859 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:06.743654 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 106621us
I20260709 12:11:06.717888 11210 raft_consensus.cc:2376] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10. Re-sending same reply.
I20260709 12:11:06.713239 14761 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:06.759415 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.770522 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.772653 11215 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:11:06.740613 14749 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.002s
I20260709 12:11:06.703033 14698 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:11:06.801991 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 124779us
W20260709 12:11:06.804334 11258 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.572s (SENT)
I20260709 12:11:06.806090 11139 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:06.773859 11140 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:06.808377 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2514) took 1780 ms. Trace:
I20260709 12:11:06.809010 11140 rpcz_store.cc:276] 0709 12:11:05.027866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.744879 (+1717013us) service_pool.cc:224] Handling call
0709 12:11:06.773685 (+ 28806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.808038 (+ 34353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.808312 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.804919 11258 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:06.827564 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.770434 14849 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:06.856740 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:06.804913 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.857527 11855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:06.803951 14683 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.716465 14889 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.740847 14918 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 12:11:06.867712 14849 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.867993 14889 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:06.706341 14418 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:06.803668 14820 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.719218 14891 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:06.744150 14754 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 12:11:06.860566 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 290096us
I20260709 12:11:06.861963 11855 raft_consensus.cc:606] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.876376 11855 raft_consensus.cc:614] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.861363 11142 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:06.865269 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60445us
I20260709 12:11:06.877506 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.872874 11141 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:06.875872 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 150929us
I20260709 12:11:06.879094 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:06.879978 14908 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:06.880560 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:06.881183 14906 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:11:06.881597 14899 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.882254 14899 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:11:06.883172 14758 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:06.882670 14835 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.884925 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.885946 14899 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.887341 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.888634 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2498) took 2427 ms. Trace:
I20260709 12:11:06.889175 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 628) took 1730 ms. Trace:
I20260709 12:11:06.890342 14495 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:06.890681 14899 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.890857 14495 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:06.892058 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.892738 14899 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:06.892751 11217 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:11:06.894872 14904 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.895109 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.889866 11141 rpcz_store.cc:276] 0709 12:11:05.159180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.888350 (+1729170us) service_pool.cc:224] Handling call
0709 12:11:06.888719 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.888882 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.888908 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.888951 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.888981 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.889027 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.889124 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.897322 14918 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.901280 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 632) took 1651 ms. Trace:
W20260709 12:11:06.903080 14911 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 12:11:06.901837 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.811651 14761 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:06.868873 14912 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:06.902653 11141 rpcz_store.cc:276] 0709 12:11:05.249551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.898319 (+1648768us) service_pool.cc:224] Handling call
0709 12:11:06.899512 (+  1193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.900140 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.900167 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.900491 (+   324us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.900625 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.900780 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.901148 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.895305 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 629) took 1735 ms. Trace:
I20260709 12:11:06.920610 11142 rpcz_store.cc:276] 0709 12:11:05.159451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.894559 (+1735108us) service_pool.cc:224] Handling call
0709 12:11:06.894840 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.895020 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.895047 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.895086 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:06.895114 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.895167 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.895258 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.889060 11144 rpcz_store.cc:276] 0709 12:11:04.460741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.652368 (+1191627us) service_pool.cc:224] Handling call
0709 12:11:05.763048 (+110680us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.779030 (+ 15982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.779080 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:05.836444 (+ 57364us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.557871 (+721427us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:06.557912 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.557980 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.888395 (+330415us) raft_consensus.cc:1685] finished
0709 12:11:06.888421 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.888569 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15078,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10065,"thread_start_us":673376,"threads_started":1,"wal-append.queue_time_us":857464}
I20260709 12:11:06.869768 14324 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.857122 14916 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:06.915777 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.905381 14918 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:11:06.895327 14904 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:06.917950 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:06.957604 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 635) took 1649 ms. Trace:
I20260709 12:11:06.962319 11142 rpcz_store.cc:276] 0709 12:11:05.309585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.931839 (+1622254us) service_pool.cc:224] Handling call
0709 12:11:06.956854 (+ 25015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.957120 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.957159 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.957221 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:06.957267 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.957345 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.957522 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:06.965217 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47334.3us
I20260709 12:11:06.968886 11210 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:11:06.908629 14683 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.974525 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:06.972136 14926 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.973232 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57558.2us
I20260709 12:11:06.938390 14698 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:06.978206 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.915974 14485 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:11:06.976987 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:06.979301 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.984014 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:06.969682 14820 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.973524 14324 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:07.070510 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 93555.7us
W20260709 12:11:07.073753 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.098286 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.099179 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.099704 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 295845us
I20260709 12:11:07.085858 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:07.103811 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119861us
I20260709 12:11:07.104748 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:06.983263 14918 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.107683 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 230270us
I20260709 12:11:06.987249 14901 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.116443 14764 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:07.077766 14751 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.128233 14751 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:07.128921 14751 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.113376 14205 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:07.131127 14205 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:07.132030 14205 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.117110 14683 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:07.110146 14324 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:07.120211 14923 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:07.106551 14904 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.135557 14324 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.985986 14698 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:06.979872 14916 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
W20260709 12:11:07.121793 14925 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:11:07.097622 14835 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:07.149508 11258 connection.cc:256] RPC call timeout handler was delayed by -1.7464606959999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 12:11:07.107142 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:07.156539 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.102727 14744 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.168099 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57785.3us
I20260709 12:11:07.176663 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:11:07.168814 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 264973us
I20260709 12:11:07.112020 14820 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.107815 14754 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:07.173396 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66337.6us
W20260709 12:11:07.173897 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.174304 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64973.1us
I20260709 12:11:06.981490 14926 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.196410 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.196070 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:07.077247 14761 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.171859 14485 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:07.169333 14849 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:07.201308 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.203230 11292 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 4 to 10, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:07.206565 14919 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:07.206929 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:07.219023 11284 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.204674 14918 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:07.207485 14928 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:11:07.225672 14931 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:07.175472 14744 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.177642 14901 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.198227 14859 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:07.198601 14820 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:07.236723 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54571.4us
I20260709 12:11:07.237821 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2013) took 1229 ms. Trace:
I20260709 12:11:07.244751 14930 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.243902 11214 rpcz_store.cc:276] 0709 12:11:06.008640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.010879 (+  2239us) service_pool.cc:224] Handling call
0709 12:11:06.031417 (+ 20538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:06.493457 (+462040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.493495 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.521341 (+ 27846us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.862243 (+340902us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.862283 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.862354 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.237589 (+375235us) raft_consensus.cc:1685] finished
0709 12:11:07.237610 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.237762 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49022,"raft.queue_time_us":72982,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":9292,"thread_start_us":599588,"threads_started":2,"wal-append.queue_time_us":294598}
I20260709 12:11:07.245301 14495 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.246086 14933 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:07.247732 14495 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.236655 14754 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.223987 14849 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.249214 11219 raft_consensus.cc:1217] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[9.6-11.7]   Dedup: 9.6->[11.7-11.7]
I20260709 12:11:07.249809 11219 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:11:07.251027 14849 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.251727 14849 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.222116 14916 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.252846 14916 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.222416 14751 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.254949 14916 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.256340 14916 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.256620 14751 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.256817 14916 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.257311 14751 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.257709 14751 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:07.235975 14934 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:07.259276 14934 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.260025 14698 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:07.260639 14698 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:07.261330 14934 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.261155 14698 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.238991 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:07.203903 14753 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:07.212019 14485 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:07.245198 14930 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:07.269970 11284 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:07.213577 14835 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:07.241328 14891 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.241765 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.280723 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.242537 14418 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:07.252177 14849 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.263922 14820 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.285276 14745 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.288630 14935 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:07.290905 14913 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.693s	user 0.002s	sys 0.000s
I20260709 12:11:07.291846 14835 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.292342 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1694) took 1203 ms. Trace:
I20260709 12:11:07.317690 11216 rpcz_store.cc:276] 0709 12:11:06.089498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.089628 (+   130us) service_pool.cc:224] Handling call
0709 12:11:07.292147 (+1202519us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54002968d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:07.292285 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85146496}
I20260709 12:11:07.274525 14751 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.270933 14495 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:07.281909 14930 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.282442 11258 connection.cc:256] RPC call timeout handler was delayed by -1.7278620039999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2363s for a response
I20260709 12:11:07.295630 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.279131 14868 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.327613 14940 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:07.323936 14485 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.332162 14865 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.332739 14865 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.333374 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.334028 11143 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:07.334829 14485 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.335510 14744 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.337519 14751 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.338186 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.338846 11143 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:07.339838 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.340837 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.341344 11143 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:07.351802 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 627) took 2193 ms. Trace:
I20260709 12:11:07.352305 11140 rpcz_store.cc:276] 0709 12:11:05.158865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.810283 (+1651418us) service_pool.cc:224] Handling call
0709 12:11:06.859393 (+ 49110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.911225 (+ 51832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.911276 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.911342 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.911399 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.351522 (+440123us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b54002549d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:07.351573 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.351730 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118514048}
I20260709 12:11:07.356637 11142 raft_consensus.cc:2955] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 4 to 10, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:07.361523 11144 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:11:07.361974 11144 pending_rounds.cc:85] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 3
I20260709 12:11:07.362239 11144 pending_rounds.cc:107] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:11:07.363377 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 637) took 1927 ms. Trace:
I20260709 12:11:07.363794 11140 rpcz_store.cc:276] 0709 12:11:05.436415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.353444 (+1917029us) service_pool.cc:224] Handling call
0709 12:11:07.362779 (+  9335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.362972 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.363004 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.363062 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:07.363100 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.363157 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.363315 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.365235 11140 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:07.365870 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1898) took 1879 ms. Trace:
I20260709 12:11:07.368782 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1909) took 1552 ms. Trace:
I20260709 12:11:07.369204 11141 rpcz_store.cc:276] 0709 12:11:05.816557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.367759 (+1551202us) service_pool.cc:224] Handling call
0709 12:11:07.368086 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.368451 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.368481 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.368528 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:07.368564 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.368621 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.368724 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.375834 14918 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.376395 14918 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.378036 14478 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.379192 14478 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.380522 14904 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.382581 11144 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.383165 14362 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.383505 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1897) took 1897 ms. Trace:
I20260709 12:11:07.383854 11144 rpcz_store.cc:276] 0709 12:11:05.485833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.360741 (+1874908us) service_pool.cc:224] Handling call
0709 12:11:07.361107 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.383221 (+ 22114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.383445 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.385370 11144 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:07.385671 11144 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:07.386559 11144 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:11:07.295393 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53724.2us
I20260709 12:11:07.318579 14916 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.326156 14926 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.327054 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:07.328249 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2014) took 1301 ms. Trace:
I20260709 12:11:07.328766 11218 raft_consensus.cc:1217] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-8.5]   Dedup: 4.4->[8.5-8.5]
I20260709 12:11:07.274658 14753 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.298934 14418 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:07.387540 11144 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.399142 11858 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:07.414963 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 636) took 1989 ms. Trace:
I20260709 12:11:07.409356 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.451011 11218 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [4.4-8.5]
I20260709 12:11:07.451303 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.394840 11141 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:07.452453 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1917) took 1633 ms. Trace:
W20260709 12:11:07.416162 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.366192 11140 rpcz_store.cc:276] 0709 12:11:05.486164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.364761 (+1878597us) service_pool.cc:224] Handling call
0709 12:11:07.365056 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.365603 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.365815 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.321089 14935 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.297276 14901 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:07.389262 14921 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.513s	user 0.002s	sys 0.000s
I20260709 12:11:07.460110 11140 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.460506 11140 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:07.458006 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 131021us
I20260709 12:11:07.451665 11212 rpcz_store.cc:276] 0709 12:11:06.026436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.026638 (+   202us) service_pool.cc:224] Handling call
0709 12:11:06.048990 (+ 22352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:06.049366 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.049398 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.067446 (+ 18048us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.197199 (+129753us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:06.308304 (+111105us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.308564 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.308646 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.889025 (+580379us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b1800390940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:06.897079 (+  8054us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b1800390940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:07.290218 (+393139us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:07.327991 (+ 37773us) raft_consensus.cc:1685] finished
0709 12:11:07.328018 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.328191 (+   173us) inbound_call.cc:177] Queueing success response
0709 12:11:07.372069 (+ 43878us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b48000030d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
Metrics: {"mutex_wait_us":19884,"prepare.queue_time_us":115467,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":45892,"raft.run_cpu_time_us":12346,"raft.run_wall_time_us":1273867,"spinlock_wait_cycles":338088192,"thread_start_us":93307,"threads_started":1,"wal-append.queue_time_us":227523}
I20260709 12:11:07.449622 11143 rpcz_store.cc:276] 0709 12:11:05.425448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.341921 (+1916473us) service_pool.cc:224] Handling call
0709 12:11:07.342211 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.342397 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.342423 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.414566 (+ 72143us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:07.414680 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.414750 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.414899 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.392769 11139 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:07.462186 11139 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:07.388154 14918 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.395408 14698 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.455770 11141 rpcz_store.cc:276] 0709 12:11:05.819149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.370164 (+1551015us) service_pool.cc:224] Handling call
0709 12:11:07.370451 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.452176 (+ 81725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.452389 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.466661 11141 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:07.467170 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 640) took 1316 ms. Trace:
I20260709 12:11:07.454775 14877 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.471484 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:07.467461 11141 rpcz_store.cc:276] 0709 12:11:06.150717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.465976 (+1315259us) service_pool.cc:224] Handling call
0709 12:11:07.466326 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.466970 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.467119 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.473054 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.473443 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 641) took 1322 ms. Trace:
I20260709 12:11:07.450420 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:07.475895 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 639) took 2035 ms. Trace:
I20260709 12:11:07.463084 11139 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.479265 11213 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:07.480192 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.486065 11217 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:07.485632 11140 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:07.484015 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.485080 11142 rpcz_store.cc:276] 0709 12:11:05.440144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.355928 (+1915784us) service_pool.cc:224] Handling call
0709 12:11:07.356288 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.356512 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:07.414406 (+ 57894us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.475527 (+ 61121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.475593 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:07.475635 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.475707 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.475838 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1600,"thread_start_us":60210,"threads_started":1}
I20260709 12:11:07.482859 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:07.485168 11141 rpcz_store.cc:276] 0709 12:11:06.151063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.472773 (+1321710us) service_pool.cc:224] Handling call
0709 12:11:07.473012 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.473164 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.473188 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.473227 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:07.473256 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.473304 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.473394 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.404072 14495 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.488862 11292 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:07.488361 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 642) took 1337 ms. Trace:
I20260709 12:11:07.489578 11142 rpcz_store.cc:276] 0709 12:11:06.151383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.487251 (+1335868us) service_pool.cc:224] Handling call
0709 12:11:07.487635 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.487921 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.487939 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.487969 (+    30us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:07.488016 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.488188 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.488301 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.461072 14926 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:07.492374 11139 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.495074 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:07.496125 11140 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.469498 14754 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.512602 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:07.519706 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.520910 11213 raft_consensus.cc:2410] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:07.521759 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.523308 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:07.524655 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.475842 14768 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:07.538643 14946 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:11:07.478188 14809 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:07.541663 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.514953 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.544971 11139 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:11:07.545385 11139 pending_rounds.cc:85] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:11:07.545639 11139 pending_rounds.cc:107] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:07.545898 11139 raft_consensus.cc:2889] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.546216 11139 pending_rounds.cc:107] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 12:11:07.528239 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 331141us
I20260709 12:11:07.548673 11140 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:11:07.549088 11140 pending_rounds.cc:85] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:11:07.549360 11140 pending_rounds.cc:107] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:07.549656 11140 raft_consensus.cc:2889] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.546448 11139 raft_consensus.cc:2889] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.551201 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:07.488111 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:11:07.552878 11141 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:07.553333 11141 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.510844 14750 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:11:07.562422 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2518) took 2492 ms. Trace:
I20260709 12:11:07.563488 11139 rpcz_store.cc:276] 0709 12:11:05.068828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.807217 (+1738389us) service_pool.cc:224] Handling call
0709 12:11:06.807623 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.392661 (+585038us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b54001322a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830add1c0 00007f9830ade231 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c
0709 12:11:07.561080 (+168419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.561483 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90952448}
I20260709 12:11:07.511371 14324 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.516534 14901 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.525403 14764 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:07.540591 14835 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.516093 14918 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.567209  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:07.569344 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:07.585297 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.592203 11139 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:07.525708 14926 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:07.527978 14834 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.575465 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1922) took 1721 ms. Trace:
I20260709 12:11:07.482347 14877 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.553972 14205 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:07.595652 11140 rpcz_store.cc:276] 0709 12:11:05.854024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.453692 (+1599668us) service_pool.cc:224] Handling call
0709 12:11:07.454076 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.575073 (+120997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.575391 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.600684 11140 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:11:07.491508 14820 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.603968 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2524) took 1058 ms. Trace:
I20260709 12:11:07.584933 14324 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.605430 14926 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.607448 14324 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.604038 11139 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:07.614303 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2523) took 1069 ms. Trace:
I20260709 12:11:07.587066 14835 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.587033 14764 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.608661 11140 rpcz_store.cc:276] 0709 12:11:06.545085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.599456 (+1054371us) service_pool.cc:224] Handling call
0709 12:11:07.600113 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.602856 (+  2743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.603827 (+   971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.586719 14919 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.632001 11258 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.661s (SENT)
W20260709 12:11:07.633615 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 151235us
I20260709 12:11:07.615097 11139 rpcz_store.cc:276] 0709 12:11:06.544724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.602378 (+1057654us) service_pool.cc:224] Handling call
0709 12:11:07.603500 (+  1122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.613806 (+ 10306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.614176 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.599287 14834 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.559343 14768 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:07.619565 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 104730us
I20260709 12:11:07.601816 14770 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:07.624162 14944 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:11:07.624536 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.539798 14418 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:07.663964 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.626645 14698 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:07.562975 14809 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.640535 11139 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:07.598740 14744 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:07.642884 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.630987 14753 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:07.678309 11143 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:07.640471 11141 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:07.659360 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.586918 14901 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.620509 14835 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.670928 14770 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:07.671178 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.783s (SENT)
I20260709 12:11:07.631368 14764 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.644649 14495 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.645303 14834 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.643693 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.604641 14205 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.685354 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 811) took 2142 ms. Trace:
I20260709 12:11:07.663416 14916 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:07.718997 14849 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:07.677156 14833 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.719614 14916 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.720356 14833 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.709642 11853 rpcz_store.cc:276] 0709 12:11:05.542868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.542989 (+   121us) service_pool.cc:224] Handling call
0709 12:11:05.543325 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.543741 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:05.773488 (+229747us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.940832 (+167344us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.941475 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.941667 (+   192us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.941715 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.941814 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.684259 (+1742445us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b24003042c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2cfb0 00007f98306a3488 00007f98306a3be8 00007f983067b398 00007f983067676a 00007f9830675bb6
0709 12:11:07.684899 (+   640us) raft_consensus.cc:1685] finished
0709 12:11:07.685045 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.685241 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":343694,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":13645,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":24645,"spinlock_wait_cycles":75596032,"thread_start_us":359529,"threads_started":2,"wal-append.queue_time_us":247673}
I20260709 12:11:07.667356 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:07.670691 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2528) took 1050 ms. Trace:
I20260709 12:11:07.695241 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:07.707244 11140 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:07.622149 14324 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:11:07.696897 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.714785 14770 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.715390 14768 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:07.716382 14951 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:07.669041 14940 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:07.716889 14865 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.717005 14809 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.678987 14754 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:07.756922 11138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 638) took 2320 ms (client timeout 1973 ms). Trace:
W20260709 12:11:07.689282 14936 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.430s	user 0.003s	sys 0.000s
W20260709 12:11:07.757333 11138 rpcz_store.cc:269] 0709 12:11:05.439827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.756704 (+2316877us) service_pool.cc:211] Skipping call since client already timed out
0709 12:11:07.756843 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:11:07.758880 14950 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:11:07.764113 14901 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.673274 14698 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:07.766014 11858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 390) took 1577 ms (client timeout 1897 ms). Trace:
W20260709 12:11:07.766597 11858 rpcz_store.cc:269] 0709 12:11:06.189249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.189416 (+   167us) service_pool.cc:224] Handling call
0709 12:11:07.765798 (+1576382us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540062fa54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:07.765939 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052180736}
I20260709 12:11:07.767051 14698 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:07.687840 14820 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.682328 14866 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.157s
W20260709 12:11:07.804766 14955 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:11:07.806981 14935 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.809401 14205 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.811434 14833 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:07.751163 14797 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:07.812620 14797 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.813073 14797 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.750654 14849 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:07.680512 14744 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.821045 14744 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:07.746443 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49643.2us
I20260709 12:11:07.722282 11215 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:11:07.824898 11215 pending_rounds.cc:85] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 9
W20260709 12:11:07.690843 14948 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:11:07.748869 11141 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:07.744218 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 150951us
I20260709 12:11:07.731053 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2522) took 1187 ms. Trace:
I20260709 12:11:07.675578 14771 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:07.748350 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77206us
W20260709 12:11:07.835650 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.834285 11142 rpcz_store.cc:276] 0709 12:11:06.543555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.498274 (+954719us) service_pool.cc:224] Handling call
0709 12:11:07.498608 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.516790 (+ 18182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.516821 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.539651 (+ 22830us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.589173 (+ 49522us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:07.646541 (+ 57368us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.646857 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.646963 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.730415 (+ 83452us) raft_consensus.cc:1685] finished
0709 12:11:07.730446 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.730975 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17828,"raft.queue_time_us":81502,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":4344,"thread_start_us":70796,"threads_started":2,"wal-append.queue_time_us":92761}
I20260709 12:11:07.836719 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1689) took 1773 ms. Trace:
I20260709 12:11:07.751240 11140 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:07.746938 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79670us
I20260709 12:11:07.838264 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.847437 11218 rpcz_store.cc:276] 0709 12:11:06.063612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.063792 (+   180us) service_pool.cc:224] Handling call
0709 12:11:07.328586 (+1264794us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:07.451408 (+122822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.832860 (+381452us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003c41d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:07.836628 (+  3768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907785984}
I20260709 12:11:07.847880 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 644) took 1198 ms. Trace:
I20260709 12:11:07.693105 14932 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:07.748279 14919 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.850756 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:07.867075 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:07.825191 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.825225 11215 pending_rounds.cc:107] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:11:07.868842 11215 raft_consensus.cc:2889] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.834259 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:07.834280 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2526) took 1271 ms. Trace:
I20260709 12:11:07.871246 11143 rpcz_store.cc:276] 0709 12:11:06.563395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.606920 (+1043525us) service_pool.cc:224] Handling call
0709 12:11:07.607234 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.678714 (+ 71480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.833972 (+155258us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b5400264654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:07.834202 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162593152}
I20260709 12:11:07.872799 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:07.835767 11258 connection.cc:256] RPC call timeout handler was delayed by -1.4571897949999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 12:11:07.837829 11142 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:11:07.874997 11258 connection.cc:256] RPC call timeout handler was delayed by -1.4211897949999184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 12:11:07.875355 11258 connection.cc:256] RPC call timeout handler was delayed by -1.3958269749998635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 12:11:07.875648 11258 connection.cc:256] RPC call timeout handler was delayed by -1.3688269749998199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 12:11:07.849521 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40324 (request call id 643) took 1624 ms. Trace:
I20260709 12:11:07.876415 11141 rpcz_store.cc:276] 0709 12:11:06.278627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.488003 (+1209376us) service_pool.cc:224] Handling call
0709 12:11:07.831853 (+343850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.877702 11141 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.849231 11140 rpcz_store.cc:276] 0709 12:11:06.649680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.748516 (+1098836us) service_pool.cc:224] Handling call
0709 12:11:07.750978 (+  2462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.847626 (+ 96648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.847825 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.852721 11144 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:07.882340 11144 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 6
W20260709 12:11:07.876070 11258 connection.cc:256] RPC call timeout handler was delayed by -1.2960897949999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:11:07.882707 11144 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:07.882529 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:07.883164 11144 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.882457  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:07.882728 11258 connection.cc:256] RPC call timeout handler was delayed by -1.2901362239999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33620000000000005s for a response
W20260709 12:11:07.884490 11258 connection.cc:256] RPC call timeout handler was delayed by -1.2329269749998275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 12:11:07.883867 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1921) took 2036 ms. Trace:
W20260709 12:11:07.884907 11258 connection.cc:256] RPC call timeout handler was delayed by -1.1677025849999154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 12:11:07.883482 11143 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.885126 11144 rpcz_store.cc:276] 0709 12:11:05.847818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.384787 (+1536969us) service_pool.cc:224] Handling call
0709 12:11:07.385206 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.883639 (+498433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.883813 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:07.885776  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:07.746536 11139 rpcz_store.cc:276] 0709 12:11:06.620116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.639832 (+1019716us) service_pool.cc:224] Handling call
0709 12:11:07.640205 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.670341 (+ 30136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.670621 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:07.885318 11258 connection.cc:256] RPC call timeout handler was delayed by -1.1659025849999125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
W20260709 12:11:07.900674 11258 connection.cc:256] RPC call timeout handler was delayed by -1.1217525319998458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:11:07.902959 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64803.4us
I20260709 12:11:07.904050 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:07.905560 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 80505.6us
W20260709 12:11:07.919039 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50728.1us
W20260709 12:11:07.919037 11258 connection.cc:256] RPC call timeout handler was delayed by -1.0548465969998233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 12:11:07.927021 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.929260 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.930687 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:07.932433 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.933131 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.935738 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:07.937500 11140 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.901904 14943 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.941187 14943 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:07.942143 11217 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:07.917554 14916 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:07.943527 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:07.944368 11217 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:07.945175 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.946834 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.948020 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.946238 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:07.949209 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:07.950870 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:07.951690 14761 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.952497 14761 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.954037 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:07.955300 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:07.955689 14927 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.956514 14927 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.859501 14932 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:07.959452 14932 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.961279 14761 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.961462 14941 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:07.963816 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:07.962181 14941 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:07.968458 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64531.1us
I20260709 12:11:07.978176 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:07.978770 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.918120 14901 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:07.985136 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:07.924067 14362 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.933866 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.979774 11143 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
W20260709 12:11:07.965027 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.755378 14764 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:07.983752 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:07.974017 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:07.923099 14849 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:07.962064 14761 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:07.992237 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.998255 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64489.1us
I20260709 12:11:07.996249 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.010339 11285 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.992276 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.010532 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.993854 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:07.935107 14754 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:08.005103 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.012240 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:07.963083 14698 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.013168 14698 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.009529 11853 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.859724 14771 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.016924 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:07.980095 14753 raft_consensus.cc:2764] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:08.019860 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:07.982970 14750 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.998790 14904 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.000s
I20260709 12:11:07.934829 14768 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:07.982892 14941 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:08.018445 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:07.990585 14901 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:08.015064 14761 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.988929 14961 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.007982 14919 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.032440 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.023164 14754 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:08.039963 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55638.2us
I20260709 12:11:08.048280 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:08.034663 14930 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.007s
I20260709 12:11:08.030269 14901 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.028182 14863 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:08.015008 14849 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:08.032570 14909 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.030s	sys 0.038s
I20260709 12:11:08.043900 11858 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:08.071127 11143 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:08.127914 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:08.074312 14863 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.131137 14863 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.116250 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.135325 11291 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
W20260709 12:11:08.060449 14909 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.031s	sys 0.038s
W20260709 12:11:08.123459 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 75271.8us
I20260709 12:11:08.146216 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:08.147666 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:08.118705 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1692) took 2041 ms. Trace:
I20260709 12:11:08.149281 11219 rpcz_store.cc:276] 0709 12:11:06.077572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.077737 (+   165us) service_pool.cc:224] Handling call
0709 12:11:07.238114 (+1160377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:07.250158 (+ 12044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.103517 (+853359us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400025dd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:08.118614 (+ 15097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667465472}
I20260709 12:11:08.158052 14764 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:08.124030 14754 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.123850 14632 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.176648 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:08.176672 14877 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.057053 14927 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.187516 14771 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:08.191923 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.197926 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.198822 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.199582 14849 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.199932 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.056711 14930 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.201301 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.202690 14698 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.202858 11290 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:11:08.204133 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.205435 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:08.202570 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54980.8us
I20260709 12:11:08.206749 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.207345 11290 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.210784 11135 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:08.212121 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:08.212989 11135 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:08.212796 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:08.213644 11140 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 4.
I20260709 12:11:08.216491 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 558) took 1604 ms. Trace:
I20260709 12:11:08.217028 11215 rpcz_store.cc:276] 0709 12:11:06.611997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.826331 (+214334us) service_pool.cc:224] Handling call
0709 12:11:06.860250 (+ 33919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.869526 (+1009276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.216202 (+346676us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400012cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:08.216421 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981693824}
I20260709 12:11:08.217643 11143 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:08.214144 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:08.219727 11135 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:08.224867 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.228689 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:08.238071 14418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.021s	sys 0.013s
W20260709 12:11:08.248383 14418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.022s	sys 0.013s
I20260709 12:11:08.250180 11216 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:08.252629 14930 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:08.203384 14698 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.247998 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.230189 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:08.258394 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.264163 14698 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:08.291069 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.353797 14698 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.278923 14932 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.297727 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.356789 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:08.300561 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.306466 11215 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.332284 14919 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:08.363863 14919 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:08.364449 14919 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:08.378695 14797 consensus_meta.cc:287] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.006s
I20260709 12:11:08.379590 14797 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.381997 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.383581 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2534) took 1150 ms. Trace:
I20260709 12:11:08.383724 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:08.383461 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.314276 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.385634 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:08.386444 11141 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.387647 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:08.267015 11210 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.019s	sys 0.018s
W20260709 12:11:08.394042 11210 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.019s	sys 0.018s
W20260709 12:11:08.297812 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.338960 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:08.395457 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.385131 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:08.402948 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:08.405352 11285 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
W20260709 12:11:08.406603 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.411022 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.412117 11285 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.358881 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.388411 11289 raft_consensus.cc:2376] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12. Re-sending same reply.
I20260709 12:11:08.416203 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:08.417907 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.418987 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.420912 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.384639 11138 rpcz_store.cc:276] 0709 12:11:07.233501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.758228 (+524727us) service_pool.cc:224] Handling call
0709 12:11:07.758676 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.759117 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.759158 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.759702 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.996591 (+236889us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:08.018235 (+ 21644us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.260295 (+242060us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b180024b260. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:08.300521 (+ 40226us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b180024b260. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219
0709 12:11:08.302038 (+  1517us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b180024b260. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f98349af58f 00007f982d9ee571 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd
0709 12:11:08.383241 (+ 81203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.383327 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.383375 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:08.383389 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.383517 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12793,"prepare.queue_time_us":25345,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":37252,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":6400,"spinlock_wait_cycles":58479104,"thread_start_us":600419,"threads_started":2,"wal-append.queue_time_us":354748}
W20260709 12:11:08.392226 14749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.006s	sys 0.003s
I20260709 12:11:08.428524 14797 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.430279 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:08.435873 11284 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:08.384596 14849 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.455452 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:08.463358 11286 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:08.476426 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:08.496455 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2511) took 3879 ms. Trace:
I20260709 12:11:08.480604 11141 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
W20260709 12:11:08.487556 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.406477 14753 raft_consensus.cc:2764] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:11:08.497150 11289 raft_consensus.cc:2410] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:08.502307 11853 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:08.419057 14894 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.418808 14903 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:08.514118 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:08.514833 11858 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:08.515224 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2018) took 1039 ms. Trace:
I20260709 12:11:08.419157 14961 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.496879 11137 rpcz_store.cc:276] 0709 12:11:04.561729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.887727 (+1325998us) service_pool.cc:224] Handling call
0709 12:11:05.902216 (+ 14489us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.997411 (+ 95195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.998581 (+  1170us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.021449 (+ 22868us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.189023 (+167574us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.199663 (+ 10640us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.877724 (+1678061us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b18003165a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:11:08.331076 (+453352us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.430113 (+ 99037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.430188 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.441024 (+ 10836us) raft_consensus.cc:1685] finished
0709 12:11:08.441063 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.441291 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3011,"prepare.queue_time_us":10521,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":66388,"raft.queue_time_us":256012,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":156990,"spinlock_wait_cycles":5878528,"thread_start_us":736333,"threads_started":4,"wal-append.queue_time_us":445583,"wal-append.run_cpu_time_us":2414,"wal-append.run_wall_time_us":1002987}
I20260709 12:11:08.511490 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:08.517400 11141 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:08.430373 14899 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.546022 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.547243 11141 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:08.535187 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.515619 11210 rpcz_store.cc:276] 0709 12:11:07.475772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.475886 (+   114us) service_pool.cc:224] Handling call
0709 12:11:07.476189 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:07.476536 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.476563 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:07.477077 (+   514us) log.cc:844] Serialized 52 byte log entry
0709 12:11:07.578916 (+101839us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:08.394455 (+815539us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.514873 (+120418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.514963 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.515009 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:08.515020 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.515162 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120056,"prepare.queue_time_us":79488,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":103,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8985,"thread_start_us":752557,"threads_started":2,"wal-append.queue_time_us":104231}
W20260709 12:11:08.549125 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.549391 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.430691 14960 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.550047 11858 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:11:08.517445 14955 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:08.552018 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.561838 11210 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
W20260709 12:11:08.496215 14749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.626s	user 0.006s	sys 0.009s
I20260709 12:11:08.562865 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.563583 11213 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:08.547528 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:08.550856 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.555601 11291 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:08.556171 11284 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:08.565687 11284 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:08.502841 14835 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.004s
I20260709 12:11:08.479907 14324 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.557330 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:08.568161 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:08.569483 14834 consensus_meta.cc:287] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.004s
I20260709 12:11:08.573875 11135 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.590533 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:08.592514 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45049.2us
I20260709 12:11:08.514613 14956 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:08.566649 11284 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.543354 14943 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:08.542979 14863 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:08.617050 11284 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.636613 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.581382 14418 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:08.647723 11858 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:08.541847 14894 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.644604 14956 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.658456 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:08.673944 11853 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:08.685002 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.661302 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.600957 14771 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.670913 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.671801 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.665066 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.697821 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.553388 14761 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.701930 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.705618 11290 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
W20260709 12:11:08.694041 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.693970 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:08.692862 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.697904 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.693161 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.707464 11854 raft_consensus.cc:2410] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:08.697110 11210 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:11:08.701119 11855 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:08.697059 11857 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:08.712333 11213 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:08.706029 11853 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:08.692821 11214 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:08.551829 14941 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.706637 11212 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
W20260709 12:11:08.716490 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.725054 11861 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:08.685948 14749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50560 (request call id 0) took 5219 ms. Trace:
W20260709 12:11:08.698855 14984 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:11:08.736903 11110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.066s	sys 0.103s
I20260709 12:11:08.731483 11284 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:08.647779 14495 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:11:08.605300 14324 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.597167 14835 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.601807 14834 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.700389 14771 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:08.737699 11110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.066s	sys 0.103s
I20260709 12:11:08.738987 11292 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:08.739014 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 247768us
I20260709 12:11:08.708580 14961 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:08.744364 11286 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:08.747126 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:08.747450 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 727648us
W20260709 12:11:08.748414 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.691586 14903 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:08.672581 14418 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:08.756669 11110 leader_election.cc:400] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10.
I20260709 12:11:08.758632 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:08.759955 11217 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:08.757678 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:08.760852 11218 raft_consensus.cc:2368] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
W20260709 12:11:08.761114 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.749702 14771 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.767416 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:08.759387 14901 consensus_meta.cc:287] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.001s
I20260709 12:11:08.698861 14802 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:11:08.698372 14960 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:11:08.801221 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2539) took 1566 ms. Trace:
I20260709 12:11:08.801743 11142 rpcz_store.cc:276] 0709 12:11:07.235016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.875705 (+640689us) service_pool.cc:224] Handling call
0709 12:11:07.876031 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.925677 (+ 49646us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:08.101483 (+175806us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:11:08.238642 (+137159us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.483265 (+244623us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.484036 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.484222 (+   186us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.494922 (+ 10700us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.508193 (+ 13271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.508347 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.800970 (+292623us) raft_consensus.cc:1685] finished
0709 12:11:08.800992 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.801150 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83076,"prepare.queue_time_us":39974,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":93,"raft.queue_time_us":108819,"raft.run_cpu_time_us":3062,"raft.run_wall_time_us":242552,"spinlock_wait_cycles":35928064,"thread_start_us":487780,"threads_started":2,"wal-append.queue_time_us":326362}
I20260709 12:11:08.804155 14698 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.770696 14967 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.775231 14974 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.808187 14918 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:08.781054 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:08.737378 14940 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:08.784052 14894 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:08.733991 14749 rpcz_store.cc:276] 0709 12:11:03.383499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.383697 (+   198us) service_pool.cc:224] Handling call
0709 12:11:03.542624 (+158927us) log.cc:844] Serialized 501 byte log entry
0709 12:11:04.083585 (+540961us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b540053ee20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a5bb26 00007f9830a5549a 00007f9830a54714 00007f9830a34eaa 00007f9830a3bd53 00007f9830a3bcd9 00007f9830a3bc69 00007f9830a3bc31 00007f9830a3adfd 0000000000388634
0709 12:11:04.085428 (+  1843us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b1800289360. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e3a0a 00007f982f3e3693 00007f982f3e3631
0709 12:11:04.086416 (+   988us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c00012458. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e3a0a 00007f982f3e3693 00007f982f3e3631 00007f9830b17b52 00007f9830b17cf5 00007f9830a54691 00007f9830a34eaa 00007f9830a3bd53 00007f9830a3bcd9 00007f9830a3bc69
0709 12:11:08.603077 (+4516661us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":685,"raft.run_cpu_time_us":16037,"raft.run_wall_time_us":699161,"spinlock_wait_cycles":35701760,"thread_start_us":146719,"threads_started":1,"wal-append.queue_time_us":195085,"wal-append.run_cpu_time_us":3259,"wal-append.run_wall_time_us":1234983}
I20260709 12:11:08.795087 14834 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:08.773288 14835 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:08.870647 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 89694.5us
I20260709 12:11:08.780371 14901 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.869465 14698 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:08.881335 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 444126us
W20260709 12:11:08.882586 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 400098us
I20260709 12:11:08.883883 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:08.887329 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:08.892067 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 143806us
W20260709 12:11:08.891113 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 259699us
I20260709 12:11:08.874339 14918 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:08.903606 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 140250us
I20260709 12:11:08.874857 14979 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.822958 14974 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:08.902853 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:08.870134 14988 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 12:11:08.957258 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56505.7us
I20260709 12:11:08.932508 11860 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:08.936362 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:09.003690 11854 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:08.908382 11026 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ce10840f1d143948ae8836765fb74d1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:09.008121 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:08.888633 14967 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:11:09.019878 11859 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:09.021386 14985 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 12:11:09.022162 14987 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:11:09.023016 14994 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:08.910360 14761 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:08.926359 14771 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:08.906431 14918 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.026888 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2247) took 1056 ms. Trace:
I20260709 12:11:09.248112 11293 rpcz_store.cc:276] 0709 12:11:07.970873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.971055 (+   182us) service_pool.cc:224] Handling call
0709 12:11:07.971509 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.444801 (+473292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.444866 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.501363 (+ 56497us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.876061 (+374698us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.876120 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.876240 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.026587 (+150347us) raft_consensus.cc:1685] finished
0709 12:11:09.026614 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.026814 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354,"raft.queue_time_us":75654,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2276,"thread_start_us":765002,"threads_started":2,"wal-append.queue_time_us":478764}
I20260709 12:11:09.031002 14418 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:09.032840 14901 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:09.033772 11285 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 12:11:09.036790 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 134072us
I20260709 12:11:09.261713 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:08.904076 14894 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.045553 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:09.019822 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 111458us
I20260709 12:11:08.962785 14979 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:09.175654 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 178917us
I20260709 12:11:08.906221 14905 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.336s
I20260709 12:11:08.948797 14941 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:09.257377 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.273952 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.274325 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.268260 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:09.174364 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 290572us
I20260709 12:11:08.908154 14943 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.290s
W20260709 12:11:09.275151 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 342568us
W20260709 12:11:09.277709 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 395464us
I20260709 12:11:09.171736 14997 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.328621 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:09.328689 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44817.8us
W20260709 12:11:09.284735 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.191988 14940 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:09.288542 14988 consensus_queue.cc:1243] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:09.293191 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:09.222643 14994 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:09.355599 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62466.3us
I20260709 12:11:09.272012 14418 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:11:09.357961 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 89760.4us
W20260709 12:11:09.358311 14932 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.004s	user 0.016s	sys 0.000s
I20260709 12:11:09.445078 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2550) took 1235 ms. Trace:
I20260709 12:11:09.446703 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:09.343171 14894 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:09.295665 14495 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:11:09.354840 15006 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.295919 14901 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.377005 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 652) took 1527 ms. Trace:
I20260709 12:11:09.445761 11140 rpcz_store.cc:276] 0709 12:11:08.209560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.214418 (+  4858us) service_pool.cc:224] Handling call
0709 12:11:08.341937 (+127519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.342904 (+   967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.342948 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.343614 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.587841 (+244227us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:08.587902 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.588009 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.444760 (+856751us) raft_consensus.cc:1685] finished
0709 12:11:09.444794 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.444983 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":174,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":194,"thread_start_us":243752,"threads_started":1,"wal-append.queue_time_us":426165}
W20260709 12:11:09.400902 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 355437us
I20260709 12:11:09.483923 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:09.283337 14993 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:11:09.450235 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:09.450759 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 111302us
I20260709 12:11:09.453545 11211 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:09.264659 14989 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 12:11:09.442705 14943 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:09.458153 14974 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.458707 14750 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.448328 14988 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:11:09.459717 14992 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:09.465831 14495 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.466099 14994 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.468050 14918 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.375768 14889 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.355455 14979 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:09.543802 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1703) took 1602 ms (client timeout 1780 ms). Trace:
I20260709 12:11:09.295977 14998 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.165s
W20260709 12:11:09.555761 11859 consensus_meta.cc:287] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 12:11:09.465843 14941 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:11:09.494179 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 146021us
W20260709 12:11:09.447101 14919 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.082s	user 0.008s	sys 0.016s
W20260709 12:11:09.495950 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45796.8us
I20260709 12:11:09.562929 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:09.497850 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:09.469116 15002 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.490264 14967 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.449875 14418 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.500478 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:09.350356 14940 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.530673 14943 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:09.531297 15013 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.538162 14997 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:09.539616 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 162828us
I20260709 12:11:09.582542 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.584578 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:09.585378 11142 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.482649 14894 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:09.544360 11217 rpcz_store.cc:269] 0709 12:11:07.941387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.946015 (+  4628us) service_pool.cc:224] Handling call
0709 12:11:09.543533 (+1597518us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:09.543727 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864079232}
I20260709 12:11:09.549556 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2552) took 1165 ms. Trace:
W20260709 12:11:09.549940 14986 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.846s	user 0.006s	sys 0.010s
I20260709 12:11:09.550094 14994 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.491537 15006 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:09.617412 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.551349 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2255) took 1502 ms. Trace:
I20260709 12:11:09.552062 11287 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:11:09.617784 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 117369us
I20260709 12:11:09.539944 15007 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.557291 11859 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:09.619098 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:09.618235 11292 rpcz_store.cc:276] 0709 12:11:08.048967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.050352 (+  1385us) service_pool.cc:224] Handling call
0709 12:11:08.050772 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.747243 (+696471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.551109 (+803866us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b5400404554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:09.551290 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582181120}
W20260709 12:11:09.556625 14909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.018s	sys 0.036s
I20260709 12:11:09.525961 14750 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:09.540612 15012 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.522847 14901 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.529922 14993 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:11:09.607987 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.608333 11136 rpcz_store.cc:276] 0709 12:11:08.383996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.406893 (+ 22897us) service_pool.cc:224] Handling call
0709 12:11:08.419455 (+ 12562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.419940 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.419982 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.424405 (+  4423us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.889363 (+464958us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.889395 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.889443 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.452112 (+562669us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:11:09.549222 (+ 97110us) raft_consensus.cc:1685] finished
0709 12:11:09.549245 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.549491 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42082,"raft.queue_time_us":3819,"raft.run_cpu_time_us":28602,"raft.run_wall_time_us":1020196,"spinlock_wait_cycles":9792768,"thread_start_us":338277,"threads_started":1,"wal-append.queue_time_us":720594}
I20260709 12:11:09.617650 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:09.485146 11139 rpcz_store.cc:276] 0709 12:11:07.849934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.916742 (+ 66808us) service_pool.cc:224] Handling call
0709 12:11:07.917094 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.930812 (+ 13718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.930845 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.941625 (+ 10780us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.137004 (+195379us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:11:08.257797 (+120793us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b18003d01e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:11:08.553502 (+295705us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:08.553722 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.553965 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.376631 (+822666us) raft_consensus.cc:1685] finished
0709 12:11:09.376679 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.376917 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12832,"raft.queue_time_us":21560,"raft.run_cpu_time_us":1140,"raft.run_wall_time_us":174246,"spinlock_wait_cycles":79913984,"thread_start_us":295139,"threads_started":1,"wal-append.queue_time_us":816556}
I20260709 12:11:09.621661 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.565605 14974 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.566798 14820 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.628149 11143 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:09.628672 14909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.018s	sys 0.036s
I20260709 12:11:09.571498 14418 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:09.629494 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.635185 11140 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.642872 11144 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:09.637940 11142 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:09.621238 14834 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:09.657205 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 96026.8us
I20260709 12:11:09.556778 14979 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.628300 15013 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:09.627534 14771 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:09.571262 14919 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:09.641454 14961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.010s	sys 0.066s
I20260709 12:11:09.637106 14941 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:09.574082 15002 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.639132 15016 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:09.673717 14961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.011s	sys 0.066s
I20260709 12:11:09.574306 14967 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.649890 14918 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.657045 14998 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:09.610095 15003 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:11:09.691298 11140 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:09.630231 15007 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.686151 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:09.711881 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:09.656486 14820 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:09.711534 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 148717us
I20260709 12:11:09.687981 11137 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:09.678604 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:09.714949 11136 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.674917 14834 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:09.719323 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 221315us
I20260709 12:11:09.649524 14974 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.721299 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:09.725353 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:09.677333 14989 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.726562 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:09.727334 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:09.677171 15023 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.687613 14771 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.684193 15006 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:09.684499 14979 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.744745 15031 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.682914 14961 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:09.680634 15022 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:09.681813 15025 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.685286 14967 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.680402 15016 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:09.683512 15002 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.685736 14919 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:09.717152 15003 consensus_queue.cc:1243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:11:09.753381 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 134361us
I20260709 12:11:09.748421 14993 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.699914 14998 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.773111 11182 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:09.685635 14918 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.759828 15026 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:11:09.745522 14997 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:11:09.780563 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.747512 14771 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:09.692045 14894 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.825492 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1719) took 1418 ms. Trace:
I20260709 12:11:09.825930 11287 rpcz_store.cc:276] 0709 12:11:08.407322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.531427 (+124105us) service_pool.cc:224] Handling call
0709 12:11:08.542011 (+ 10584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.551817 (+1009806us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b5400199c20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830add1c0 00007f9830ade231 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c
0709 12:11:09.618632 (+ 66815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.825155 (+206523us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5400199c20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830adea02 00007f9830adadd6 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:11:09.825427 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69632640}
I20260709 12:11:09.755306 14989 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.758600 14979 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:09.775403 14993 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.790266 11136 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:09.677081 14943 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.794175 14495 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.794518 15026 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:09.770433 15017 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:09.795462 14918 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.796121 15024 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:09.796409 14909 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.765632 15022 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.783064 15027 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:09.803504 14863 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.810214 14956 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.810820 14961 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.812992 14997 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.812670 15016 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.815749 14998 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.771888 14967 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.817600 14820 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.818197 14940 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:09.820147 11211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2026) took 1598 ms (client timeout 1939 ms). Trace:
I20260709 12:11:09.821152 14974 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:09.953606 11211 rpcz_store.cc:269] 0709 12:11:08.221789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.290583 (+ 68794us) service_pool.cc:224] Handling call
0709 12:11:09.819956 (+1529373us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400295ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:09.820079 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528200576}
I20260709 12:11:09.821934 14771 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.765347 15025 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.828877 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.958132 11144 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:09.959604 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:09.961082 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.961895 11144 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:09.684628 14750 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.839784 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:09.840358 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:09.963433 11213 raft_consensus.cc:2410] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:11:09.840237 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:09.841632 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:09.848196 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:09.849160 11210 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.851114 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:09.964727 11212 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:09.964782 11214 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:09.857069 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:09.768074 14941 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.966267 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.871089 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.967561 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.967849 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.968216 11140 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:09.968663 11136 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:11:09.969143 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:09.969607 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:09.915884 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.834542 14989 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.971014 14989 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.882102 15034 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.974478 15034 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.977052 15025 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:09.977712 15025 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.980118 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:09.986680 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:09.954630 14967 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.995985 14967 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.947675 14997 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:09.938522 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 212045us
I20260709 12:11:09.883384 14993 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.937548 14863 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.762188 15031 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:09.903429 15032 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
I20260709 12:11:09.790350 14834 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:09.904804 15027 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:09.882149 14979 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:09.936106 14901 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:09.969750 11140 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.980336 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.191234 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.192062 11210 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
W20260709 12:11:10.046475 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.064531 11136 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:10.104569 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:10.199033 11144 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:10.199822 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:10.200567 11144 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:10.201457 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:09.892385 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58897.3us
I20260709 12:11:09.792470 15033 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:10.202405 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:09.749212 15023 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:10.173990 11218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1700) took 2217 ms (client timeout 1897 ms). Trace:
W20260709 12:11:10.207608 11218 rpcz_store.cc:269] 0709 12:11:07.930212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.930387 (+   175us) service_pool.cc:224] Handling call
0709 12:11:10.147777 (+2217390us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b5400239bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:10.147919 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907126656}
I20260709 12:11:10.168983 14997 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.943596 14418 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.184020 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.169656 14956 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.149875 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:09.978217 15025 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.205281 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:10.195690 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:10.206290 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 433251us
I20260709 12:11:10.209148 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.220799 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.221872 11218 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:10.209498 11144 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:10.178479 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.062989 15034 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:09.898670 15026 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.169185 14974 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.168679 14967 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:09.936340 15024 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.207546 15033 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.181227 14820 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.214972 11211 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:10.215458 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.199738 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:09.935663 14909 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.180915 15027 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:10.224345 11182 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:10.224648 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74896.8us
I20260709 12:11:10.224263 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.207463 14918 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.235145 11136 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:10.245000 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:10.238582 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:10.243245 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.247044 15017 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.233531 14967 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.250029 14967 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.251284 14894 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.251745 11182 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:10.246959 15039 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.252503 15039 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:10.253471 14977 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.483s	user 0.004s	sys 0.021s
I20260709 12:11:10.230906 14974 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.256244 14909 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.256573 14974 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.256891 14909 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.257284 14909 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:10.257661 14909 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.258797 14894 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.259171 11293 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:10.246135 15034 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.259507 14894 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.259923 15034 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.262579 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.263327 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:10.264093 11136 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:10.253425 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:10.264951 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2246) took 2331 ms. Trace:
I20260709 12:11:10.266100 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:10.227434 14901 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.246598 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:10.280611 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:10.276914 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:10.282264 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:10.283301 11136 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 4: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:10.265379 11288 rpcz_store.cc:276] 0709 12:11:07.934036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.969195 (+ 35159us) service_pool.cc:224] Handling call
0709 12:11:07.969572 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.969925 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.969956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.970444 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.516378 (+545934us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:08.516413 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.516484 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.252657 (+1736173us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:10.264669 (+ 12012us) raft_consensus.cc:1685] finished
0709 12:11:10.264691 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.264891 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59049,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3567,"spinlock_wait_cycles":93160704,"thread_start_us":495499,"threads_started":1,"wal-append.queue_time_us":736094}
I20260709 12:11:10.287634 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.288551 11210 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:10.290534 11140 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:10.243498 14941 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.235572 15033 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:10.299324 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56718.8us
I20260709 12:11:10.224205 14956 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.300802 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:10.300498 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62059.2us
I20260709 12:11:10.305848 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:10.284819 14901 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.279409 14495 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.287072 15013 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.306918 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:10.398010 11140 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:10.296490 15017 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:10.350025 14994 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.729s	user 0.005s	sys 0.006s
I20260709 12:11:10.305509 14940 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.352118 15026 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:10.353173 14889 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.000s
I20260709 12:11:10.353886 15054 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.308308 15021 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:11:10.354929 15042 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:10.389477 14764 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.360225 14746 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.303372 14632 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:11:10.361757 14989 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.242564 14820 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.411942 14889 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.363054 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:10.465255 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.467382 11211 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:10.468669 15007 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.364899 15039 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.365406 15030 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.366462 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1721) took 1958 ms. Trace:
I20260709 12:11:10.470342 11285 rpcz_store.cc:276] 0709 12:11:08.408007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.543435 (+135428us) service_pool.cc:224] Handling call
0709 12:11:09.033435 (+490000us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:09.260564 (+227129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.366240 (+1105676us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400418cd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:10.366395 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125916928}
I20260709 12:11:10.471669 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.363364 11139 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:10.274144 14974 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.472314 11285 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:10.472451 14974 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.473230 11139 raft_consensus.cc:1217] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-8.5]   Dedup: 5.3->[6.4-8.5]
I20260709 12:11:10.473387 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.473765 11139 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: [5.3-8.5]
I20260709 12:11:10.474642 14974 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.373147 14324 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.272562 14918 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.345168 14901 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.475077 11139 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:11:10.476271 11139 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:10.476786 14918 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.474829 11285 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:10.465853 14863 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:10.482571 11038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 255) took 15582 ms (client timeout 15000 ms). Trace:
I20260709 12:11:10.483691 15031 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.412359 15054 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.484925 15054 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:10.329747 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.309947 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:10.486893 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 177007us
I20260709 12:11:10.489081 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:10.290822 14894 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 12:11:10.393630 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 122574us
I20260709 12:11:10.494192 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:10.494685 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:10.356685 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:10.356734 14771 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.434027 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.434558 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.437060 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.439299 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.439587 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.440366 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.498661 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:10.440472 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.499765 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.500597 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.500995 11290 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:10.445106 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.396885 15034 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.408794 11042 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:10.508119 11042 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:10.362582 15049 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.410326 15013 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:10.455746 14989 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.460196 14820 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.460935 14993 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.468793 11219 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.764815  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:10.309367 14941 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:10.494906 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:10.497074 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:10.517457 11285 raft_consensus.cc:2376] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9. Re-sending same reply.
I20260709 12:11:10.518635 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.497259 11288 raft_consensus.cc:2410] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:10.501909 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.505107 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:10.520058 11287 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.505779 11289 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:10.522053 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:10.483023 11038 rpcz_store.cc:269] 0709 12:10:54.923065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.935346 (+ 12281us) service_pool.cc:224] Handling call
0709 12:11:10.450203 (+15514857us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:03.715367 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:03.860405 (+145038us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:03.885950 (+ 25545us) write_op.cc:435] Acquired schema lock
0709 12:11:03.892357 (+  6407us) tablet.cc:662] Decoding operations
0709 12:11:04.037585 (+145228us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:04.037706 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:04.037733 (+    27us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:11:04.091966 (+ 54233us) tablet.cc:701] Row locks acquired
0709 12:11:04.092032 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:11:04.092218 (+   186us) write_op.cc:270] Start()
0709 12:11:04.092380 (+   162us) write_op.cc:276] Timestamp: P: 1783599064092141 usec, L: 0
0709 12:11:04.092424 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:11:04.131809 (+ 39385us) log.cc:844] Serialized 9401 byte log entry
0709 12:11:04.783896 (+652087us) op_driver.cc:464] REPLICATION: finished
0709 12:11:05.259497 (+475601us) write_op.cc:301] APPLY: starting
0709 12:11:05.287567 (+ 28070us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:05.327375 (+ 39808us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:05.327544 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:05.355955 (+ 28411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:05.356501 (+   546us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:11:05.356589 (+    88us) write_op.cc:312] APPLY: finished
0709 12:11:05.357289 (+   700us) log.cc:844] Serialized 164 byte log entry
0709 12:11:05.357505 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.357752 (+   247us) write_op.cc:454] Released schema lock
0709 12:11:05.357856 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:05.358380 (+   524us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.358416 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":171,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":462780,"apply.run_cpu_time_us":10350,"apply.run_wall_time_us":98839,"num_ops":24,"prepare.queue_time_us":67520,"prepare.run_cpu_time_us":31162,"prepare.run_wall_time_us":493447,"raft.queue_time_us":299481,"raft.run_cpu_time_us":11290,"raft.run_wall_time_us":353460,"replication_time_us":666658,"thread_start_us":432890,"threads_started":4,"wal-append.queue_time_us":73403,"wal-append.run_cpu_time_us":31243,"wal-append.run_wall_time_us":2329972}]]}
I20260709 12:11:10.513691 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.524489 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.525336 11290 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:10.448019 14746 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:10.409389 14940 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.481899 14863 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:10.548405 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53568.6us
I20260709 12:11:10.514969 11042 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 8, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 8 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.552603 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:10.552881 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:10.553182 11042 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:10.548593 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.555451 11284 raft_consensus.cc:2410] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:10.502971 14324 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.551546 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:10.513703 14994 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:10.550638 11219 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.449232 14764 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.560135 11292 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:10.522594 14418 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.562372 11042 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 10, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 10 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:10.564157 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.550056 14746 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.573977 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.575555 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:10.544693 14941 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.483310 14901 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.566313 14994 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.557998 14751 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.556216 15055 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:10.582698 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84111.5us
I20260709 12:11:10.556468 14820 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.556106 15025 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.559983 15049 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.585155 11042 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.590562 11287 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:10.580390 11211 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.502485 14909 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.593942 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:10.568392 14863 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.617110 11218 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.591225 14994 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.566044 14324 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.626763 11042 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 7, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 7 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.633875 11211 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:10.621627 15049 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:10.635622 11042 catalog_manager.cc:5697] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 7, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 7 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.637645 15023 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:10.635299 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76370.9us
I20260709 12:11:10.625062 15025 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.643251 14746 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.649961 14993 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.646942 11215 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:10.656917 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2028) took 2217 ms. Trace:
I20260709 12:11:10.657330 11215 rpcz_store.cc:276] 0709 12:11:08.439813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.440776 (+   963us) service_pool.cc:224] Handling call
0709 12:11:08.532091 (+ 91315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.646769 (+2114678us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54004f1da0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830add1c0 00007f9830ade231 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c
0709 12:11:10.656628 (+  9859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.656850 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43774848}
I20260709 12:11:10.652699 11853 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:11:10.653430 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:10.615123 14820 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:10.654917 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 309990us
I20260709 12:11:10.660741 14746 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.661688 11293 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:10.643307 15049 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.655287 14988 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.698801 14771 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.686837 14324 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.687472 14909 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.688323 14764 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.658998 15025 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.684312 14993 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.622916 15013 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.665741 15027 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:10.697947 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.698850 14988 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.698866 15068 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.684818 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 699) took 2344 ms. Trace:
I20260709 12:11:10.707444 11286 rpcz_store.cc:276] 0709 12:11:08.340502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.518161 (+177659us) service_pool.cc:224] Handling call
0709 12:11:08.518474 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.759727 (+241253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.684545 (+1924818us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400061dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:10.684754 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515683072}
I20260709 12:11:10.684626 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:10.701064 11042 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 7, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 7 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.704326 14993 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.719523 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.720847 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:10.721571 11215 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:10.722373 14749 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:10.723436 14973 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:10.723927 14973 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:10.724050 14749 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:10.724365 14973 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:10.724512 14749 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:10.728679 11288 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.729071 14749 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.734782 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:10.730242 14749 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.709496 14764 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:10.716729 14927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.022s	user 0.015s	sys 0.015s
I20260709 12:11:10.707947 14940 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.658062 14997 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:10.740921 11042 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.763245 15023 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.763499 11042 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 6, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 6 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.764583 15005 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:10.764986 15005 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:10.765782 15005 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.768626 15025 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.768775 14994 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.728614 15033 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.770071 14750 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.763980 15023 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.785923 14988 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:10.788713 14993 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.819644 15023 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:10.743827 14927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.056s	user 0.016s	sys 0.016s
I20260709 12:11:10.791165 15009 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.791630 11286 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:10.728950 14863 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.736702 14901 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.765923 11042 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 5 to 10, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 10 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.741494 14764 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:10.811060 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.777689 15027 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.821784 15005 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:11.069067 14903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.301s	user 0.022s	sys 0.010s
W20260709 12:11:11.070003 14903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.306s	user 0.022s	sys 0.010s
I20260709 12:11:10.899538 14973 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.073068 14973 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.833329 15033 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.818531 15025 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.078918 15025 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.025308 11042 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 3 to 4, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 4 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:11.029331 14784 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.094204 14784 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.096925 14784 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:11.030026 14993 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.097707 14993 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.100453 14993 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:11.030748 14988 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:11.031952 15003 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.049345 14754 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.823961 15009 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:11.101351 14988 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.101661 14754 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:10.831146 14820 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:10.823769 15012 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.239s
I20260709 12:11:11.103235 15070 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:11.103588 15070 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.104071 14754 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.104197 14988 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:11.104480 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.108208 15070 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.109591 15070 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:11.022043 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 280098us
W20260709 12:11:11.119752 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 87234.9us
I20260709 12:11:10.945379 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:11.155423 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44221.7us
I20260709 12:11:11.134374 14745 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:11:11.102133 15009 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.165378 15009 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.141386 14324 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:11:11.171212 14997 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.170781 15068 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.172586 15068 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.182941 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:11.164237 14751 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:10.957261 14994 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:10.951459 15023 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:11.162881 14995 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.928435 14941 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.204372 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:11.207520 11137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2561) took 1588 ms (client timeout 2045 ms). Trace:
W20260709 12:11:11.208010 11137 rpcz_store.cc:269] 0709 12:11:09.616472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.617028 (+   556us) service_pool.cc:224] Handling call
0709 12:11:11.205157 (+1588129us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54001266d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:11.205275 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120833792}
I20260709 12:11:11.205129 14995 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:11.222689 11291 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:11.222563 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:11.218974 15054 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.732s	user 0.014s	sys 0.000s
I20260709 12:11:11.203356 15023 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.233875 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:11.220513 15025 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:11.241092 14749 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.002s
I20260709 12:11:11.240770 14941 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:11.230871 15054 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:11.255131 14978 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.475s	user 0.013s	sys 0.047s
I20260709 12:11:11.253798 14995 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.267431 14995 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.259236 14978 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.482s	user 0.014s	sys 0.048s
I20260709 12:11:11.273048 15023 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.273592 15054 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:11.278102 15049 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 12:11:11.278594 15049 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.280719 15049 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.311031 11042 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 6 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 8 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.343461 11287 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:11.343173 14754 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:11.344858 14754 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:11.347438 14750 consensus_meta.cc:287] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.001s
I20260709 12:11:11.349825 14754 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.351119 14754 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:11.351948 14754 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.355150 14754 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.356146 14764 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.365273 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:11.368490 14905 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:11.369710 14905 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.396754 14905 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.409595 11290 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:11:11.414042 14905 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.415633 14905 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.403417 15039 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.403358 11292 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:11.420990 11292 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 6
I20260709 12:11:11.423802 15039 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.425882 11292 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:11.426317 11292 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.427886 15023 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.429538 15023 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.440860 15024 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.448969 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:11.450559 15035 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.452433 15053 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:11.453203 15053 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:11.441892 15024 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:11.460332 14976 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.461375 14976 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.454207 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:11.473775 11136 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:11.441782 15023 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.481228 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.482740 11136 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:11.482721 11286 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:11.491802 15024 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:11.492436 15024 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:11.425765 15039 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.501113 15024 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.491866 15068 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.525708 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.526321 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.526912 11857 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.528586 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.531486 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.532301 11143 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:11.532519 14976 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:11.561812 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.576475 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:11.540489 15050 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.961s	user 0.012s	sys 0.009s
I20260709 12:11:11.584626 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.585685 11855 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:11.587427 14943 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:11.525759 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:11.559525 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:11.588882 14943 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:11:11.599495 14905 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.601598 14998 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:11.602275 14998 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.547472 14457 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:11.608070 14457 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:11.613109 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.614063 11854 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:11.613596 14457 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:11.615610 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85743.1us
I20260709 12:11:11.559938 14770 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.548445 14698 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.560801 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.616967 15038 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:11.614984 15022 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:11.538441 15076 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.471s	user 0.003s	sys 0.000s
W20260709 12:11:11.540488 15072 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.406s	user 0.003s	sys 0.000s
I20260709 12:11:11.617038 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:11.540865 15053 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.635169 11292 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.631734 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:11.627380 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:11.616979 14457 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:11.603802 14998 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.626441 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:11.639671 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.657099 11216 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:11:11.657498 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:11.658347 11286 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:11.662992 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.663899 11142 raft_consensus.cc:1813] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:11.664717 11142 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:11.665642 11861 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:11.667392 14905 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.668577 14905 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.622542 14698 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:11.643410 14770 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.672252 14905 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.673794 11855 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:11.675674 14770 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.636478 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:11.649811 15038 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.679136 14698 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.682479 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:11.683542 15053 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.684703 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:11.685564 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.687216 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.688366 14905 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:11.688593 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61379.2us
I20260709 12:11:11.689148 14995 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:11.693068 14956 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.710091 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:11.710714 15038 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.712129 11144 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.697446 14979 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.713454 11135 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:11:11.696683 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80136.1us
I20260709 12:11:11.714452 11141 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:11.715126 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:11.715710 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79528.7us
I20260709 12:11:11.716132 14877 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:11.716678 14877 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.716737 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:11.717234 14877 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.697003 14989 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:11.718958 14989 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:11.720304 11142 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:11.707072 14905 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.718899 14638 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:11.709460 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.714747 14995 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.720899 14903 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.724291 14905 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.737797 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:11.739301 14932 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:11.726120 14903 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:11.738505 11286 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:11:11.744808 14932 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.745865 14903 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.749344 11289 raft_consensus.cc:1813] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:11.750595 11289 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:11.720525 14989 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.755497 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.764621 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:11.765980 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:11.766937 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 712) took 1048 ms. Trace:
I20260709 12:11:11.767333 11287 rpcz_store.cc:276] 0709 12:11:10.718239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.718388 (+   149us) service_pool.cc:224] Handling call
0709 12:11:10.718729 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.344280 (+625551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.766645 (+422365us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540017f7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:11.766851 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434668288}
I20260709 12:11:11.768918 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.769639 11287 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:11.771845 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.772403 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.773061 11292 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:11.774106 11284 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:11.775247 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1736) took 1277 ms. Trace:
I20260709 12:11:11.775619 11293 rpcz_store.cc:276] 0709 12:11:10.497821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.501731 (+  3910us) service_pool.cc:224] Handling call
0709 12:11:11.774848 (+1273117us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540031a1d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:11.775023 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326252928}
I20260709 12:11:11.776381 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:11.784168 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.788964 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.789563 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.788789 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.799930 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:11.804709 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.820904 11135 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:11:11.823596 11287 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:11.798580 14770 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:11.825831 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.827986 14641 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.828150 15016 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.828914 14641 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.828047 14770 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.835625 14641 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.835760 14770 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:11.838583 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.841585 11285 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:11.842339 15049 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.842970 15049 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.844334 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:11.846590 11291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1732) took 1404 ms (client timeout 1797 ms). Trace:
I20260709 12:11:11.847446 11854 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:11.846179 11288 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:11.848155 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:11.850347 14979 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.850628 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.850880 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.851039 14979 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:11.847054 11291 rpcz_store.cc:269] 0709 12:11:10.440187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.444845 (+  4658us) service_pool.cc:224] Handling call
0709 12:11:11.844480 (+1399635us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54000f5fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:11.844740 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657861888}
W20260709 12:11:11.853272 11285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1743) took 1339 ms (client timeout 1504 ms). Trace:
I20260709 12:11:11.853360 14979 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.854467 14979 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.854735 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2287) took 1074 ms. Trace:
W20260709 12:11:11.853812 11285 rpcz_store.cc:269] 0709 12:11:10.513894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.518312 (+  4418us) service_pool.cc:224] Handling call
0709 12:11:11.852965 (+1334653us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000609d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:11.853191 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039751552}
I20260709 12:11:11.855299 11288 rpcz_store.cc:276] 0709 12:11:10.780253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.229567 (+449314us) service_pool.cc:224] Handling call
0709 12:11:11.845296 (+615729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.848063 (+  2767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.849789 (+  1726us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000f5fd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:11.854656 (+  4867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414242048}
I20260709 12:11:11.855504 14979 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.859599 14979 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:11.860248 15089 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.122s	user 0.000s	sys 0.003s
I20260709 12:11:11.860765 14979 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.861797 14979 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.862706 14956 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:11.863693 14995 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.863979 14956 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.866338 14956 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:11.863384 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.868666 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:11.869477 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2048) took 1406 ms. Trace:
I20260709 12:11:11.872061 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:11.873180 14956 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.873867 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:11.874049 14979 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.876677 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.877206 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.877445 11857 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:11.878386 11859 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:11.872087 11219 rpcz_store.cc:276] 0709 12:11:10.463333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.546407 (+ 83074us) service_pool.cc:224] Handling call
0709 12:11:10.546768 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.568525 (+ 21757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.869017 (+1300492us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b54002a03d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:11.869307 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8454528}
I20260709 12:11:11.875623 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:11.880890 14979 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:11.881507 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:11.882428 14698 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.882762 15054 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:11.885480 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:11.890342 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:11.891047 14979 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:11.895459 14979 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.895895 14979 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.899179 14932 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.900557 14932 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.901218 14956 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.901702 14956 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.902083 14956 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.902944 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:11.906188 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.909371 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:11.855747 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.912693 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 115236us
I20260709 12:11:11.917922 11142 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:11:11.918844 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:11.919430 11855 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.919173 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:11.926697 11143 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:11.929754 11141 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:11.932641 11142 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:11.952183 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:11.957413 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48126.7us
I20260709 12:11:11.959307 11135 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:11.933306 15048 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.960457 14761 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.964869 14761 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:11.965457 14761 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.969671 14916 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:11.970757 15039 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:11.971204 15039 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.972208 11143 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:11.973673 11143 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:11.972515 15039 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.976121 15039 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:11.977424 11184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.799s (SENT) [suppressed 15 similar messages]
I20260709 12:11:11.978905 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:11.979889 14995 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:11.980590 14995 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.983271 15015 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.983508 14916 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.984257 14916 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.985416 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:11.985939 14834 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.986770 14834 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.987701 15009 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.988162 15009 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:11.988198 14916 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:11.989549 14998 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.989378 15009 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.994267 11144 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:11.994357 14904 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.949467 14764 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:11.995286 14904 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.998049 14904 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.998561 14903 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:11.999436 15023 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:11.993518 14877 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:11.995675 14764 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:11.985536 15049 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:12.008674 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.009302 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.009765 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.011463 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.013232 11213 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:12.013141 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.013998 11144 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:12.007956 15023 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.015635 14995 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:12.015836 15023 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.017274 14834 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.009208 15012 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.018792 15012 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.019227 15012 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.020291 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:12.021797 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.022074 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.022703 11219 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.926090 15024 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:12.022886 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.023254 15014 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:12.024276 15014 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.024588 15014 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.024881 15014 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.025270 15024 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:12.025920 15024 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:12.022921 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:12.027467 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46556.3us
I20260709 12:11:12.027962 14903 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:12.028832 15009 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.030830 14877 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:11.961717 15048 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.032016 15048 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.033269 14764 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.028687 11182 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:12.039050 11143 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:12.049669 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:12.026280 15024 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:12.056095 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53948.3us
I20260709 12:11:12.004170 11855 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:12.062634 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.063796 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.064589 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.064244 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.073256 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:12.074218 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 95625.6us
I20260709 12:11:12.062706 15022 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:12.088737 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 111336us
I20260709 12:11:12.092684 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:12.098573 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.089957 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:12.102353 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.102844 11288 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:12.095928 11144 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:12.075835 14834 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:12.103046 11143 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:12.114363 11219 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:12.115934 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.116504 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.117583 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.094264 15022 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.119086 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.120643 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.122929 11141 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:12.072127 14904 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:12.127218 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.127983 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.125015 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.126365 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:12.126829 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.128248 11216 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:12.124471 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 209623us
I20260709 12:11:12.136621 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.138068 11143 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:12.140022 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.102636 14877 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:12.123109 15022 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:12.144799 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43969.9us
I20260709 12:11:12.149549 11135 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:12.149458 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:12.150796 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 78455.2us
I20260709 12:11:12.152498 14632 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:12.165980 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.168046 11286 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:12.169517 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.146025 14998 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.181043 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:12.192371 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.153609 14905 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.198601 11182 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:12.169066 14989 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:12.201387 14989 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:12.201853 14989 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:12.203023 14989 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.204698 14989 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:12.205595 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.153992 15024 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.206525 11211 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:12.207438 15024 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.208559 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.209744 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.209815 14973 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:12.210783 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.211926 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.212953 11139 raft_consensus.cc:2368] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:11:12.213359 11211 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:12.214056 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:12.231449 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 70562.2us
I20260709 12:11:12.210273 14973 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:12.194305 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.221127 11211 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:12.238637 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46718.4us
I20260709 12:11:12.240973 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:12.241662 11855 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:12.249754 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.256160 11216 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:11:12.256932 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.260232 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.242966 14638 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.267656 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 73611.9us
I20260709 12:11:12.271818 14485 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:12.276083 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.279090 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.280375 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.281472 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.282442 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.287767 14638 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.262326 14943 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.292531 11288 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.290354 14638 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:12.300664 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.301393 11216 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
W20260709 12:11:12.303544 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45663.5us
I20260709 12:11:12.305490 11213 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:12.270468 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:12.315730 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51567.6us
I20260709 12:11:12.323031 15039 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:12.323197 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.323851 14485 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.324141 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.324506 14485 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.325201 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.325950 11286 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:12.318711 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:12.326864 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.327504 11292 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:12.330550 15094 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:12.331743 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:12.265542 14998 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:12.332455 11210 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.332782 14998 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.335150 14698 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.335760 14698 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:12.336158 15107 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:12.336732 14698 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.338136 15107 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:12.325313 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.338699 14632 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:12.339804 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.314744 14973 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.340975 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.341190 14973 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.344633 14943 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:12.345769 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.345687 14943 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:12.350944 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48482.9us
I20260709 12:11:12.351866 11143 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
W20260709 12:11:12.352553 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.355239 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.357820 11142 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:12.360143 11855 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:12.361223 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:12.362186 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.363479 11289 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.365939 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.366008 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.360587 11855 pending_rounds.cc:85] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 8
I20260709 12:11:12.366438 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:12.366957 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.366915 11855 pending_rounds.cc:107] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:12.367726 11855 raft_consensus.cc:2889] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.299260 14761 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.369978 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.416551 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:12.488411 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.367774 14905 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.368934 14998 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:12.514452 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 184476us
W20260709 12:11:12.422066 15053 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.714s	user 0.018s	sys 0.003s
I20260709 12:11:12.372306 14956 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:12.639248 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 334024us
I20260709 12:11:12.691488 11285 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:12.683511 11288 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.648501 11292 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:12.649346 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.302534 14979 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:12.650058 14932 consensus_meta.cc:287] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.749s	user 0.019s	sys 0.011s
I20260709 12:11:12.650547 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:12.650792 15014 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.006s
W20260709 12:11:12.651628 15012 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.632s	user 0.016s	sys 0.001s
I20260709 12:11:12.651551 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:12.653695 15048 consensus_meta.cc:287] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.621s	user 0.017s	sys 0.013s
W20260709 12:11:12.653755 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 289291us
W20260709 12:11:12.655014 14457 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.013s
I20260709 12:11:12.655647 11210 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:12.721021 11138 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.655792 14750 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:12.656649 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:12.657222 11141 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:12.658021 11287 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:12.658569 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:12.660084 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.360617 15038 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:11:12.697563 11291 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:12.698540 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:12.681545 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.690594 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:12.507548 14916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.024s
I20260709 12:11:12.711906 11215 raft_consensus.cc:2410] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:12.711392 11143 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:12.711230 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.704000 14754 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.660156 14903 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:12.721611 11139 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
W20260709 12:11:12.721935 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 365166us
I20260709 12:11:12.722945 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:12.741736 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:12.708142 15023 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.692s	user 0.018s	sys 0.002s
W20260709 12:11:12.717998 15106 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.299s	user 0.001s	sys 0.009s
W20260709 12:11:12.680335 15009 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.651s	user 0.015s	sys 0.006s
I20260709 12:11:12.734891 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:12.703774 14485 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:12.743496 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53016.7us
I20260709 12:11:12.742405 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.749347 11285 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:12.756021 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97538us
W20260709 12:11:12.739799 14916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.002s	sys 0.024s
I20260709 12:11:12.717222 15012 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:12.777062 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.780356 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45270.4us
I20260709 12:11:12.791179 11289 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:12.796940 14638 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:12.797310 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:12.797494 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.798614 15013 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:11:12.799173 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 142598us
I20260709 12:11:12.799892 15013 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.800191 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.800379 15013 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:12.707523 15014 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.729959 15039 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:11:12.733510 15048 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.801836 15013 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.741372 14754 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:12.752895 14764 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:12.812381 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.814165 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2310) took 1153 ms. Trace:
W20260709 12:11:12.856329 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66555.6us
I20260709 12:11:12.806407 11217 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:12.793308 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:12.798336 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:12.802060 11293 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:12.802430 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:12.773792 14457 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.748208 15053 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:12.803982 15022 consensus_meta.cc:287] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.003s
W20260709 12:11:12.829530 15097 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:12.864190 14835 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.805989 15012 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.856778 11284 rpcz_store.cc:276] 0709 12:11:11.660888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.791024 (+130136us) service_pool.cc:224] Handling call
0709 12:11:11.800498 (+  9474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.807497 (+  6999us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:11.858747 (+ 51250us) log.cc:844] Serialized 14 byte log entry
0709 12:11:12.149004 (+290257us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.150588 (+  1584us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.150778 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:12.150825 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.150920 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.813877 (+662957us) raft_consensus.cc:1685] finished
0709 12:11:12.813907 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.814091 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3435,"prepare.queue_time_us":35542,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":4022,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":13210,"thread_start_us":289697,"threads_started":1,"wal-append.queue_time_us":513042}
I20260709 12:11:12.869908 15053 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.870281 15013 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.811125 14932 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.861996 14750 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.817610 14943 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.828418 14979 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.905915 15112 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:12.906149 14979 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:12.752509 15023 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.906975 14834 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:12.907418 14834 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:12.908669 15023 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.908354 14834 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.909571 11144 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
I20260709 12:11:12.909623 14834 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.840333 15009 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.910718 15009 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.911109 15009 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.871927 15014 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.814730 15024 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:12.915181 15024 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.917929 15024 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:12.872350 14956 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.862640 14764 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.918861 14764 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.864549 14457 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.922736 14457 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:12.923666 15072 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.275s	user 0.000s	sys 0.006s
I20260709 12:11:12.874315 14761 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:12.880426 11212 raft_consensus.cc:2368] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:11:12.874877 15022 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.928701 15022 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.929569 11135 raft_consensus.cc:2368] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
W20260709 12:11:12.930521 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.874645 14916 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:12.931370 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.884714 14943 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.885592 15108 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:12.931869 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.932181 15108 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.933290 14943 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.933975 11211 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:12.876806 14835 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.856904 14754 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.934783 14835 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.890707 14750 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:12.940588 14750 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.941474 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.942117 11291 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:12.891168 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97965us
I20260709 12:11:12.940659 11284 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.943570 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:12.944205 11855 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:12.945046 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.945607 11286 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.893059 15048 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.931234 14916 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:12.883618 14932 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.934329 11211 pending_rounds.cc:85] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 8
I20260709 12:11:12.947327 11211 pending_rounds.cc:107] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:12.947660 11211 raft_consensus.cc:2889] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.948117 11211 pending_rounds.cc:107] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:12.948407 11211 raft_consensus.cc:2889] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:12.940848 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.899325 15053 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:12.918668 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:12.962864 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 604113us
I20260709 12:11:12.956455 11285 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:12.962679 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:12.969574 11293 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.974182 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:12.987483 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:12.993081 11857 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:11:12.994202 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 75691.5us
I20260709 12:11:12.906412 15112 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:12.998106 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:12.962538 14916 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.006690 15053 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.007548 15108 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:12.990571 15024 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:13.009805 14764 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:12.994377 14943 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.013558 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.024899 11285 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:13.015918 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:13.018211 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:13.027177 11135 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:13.010865 15112 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.028645 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.037905 15053 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:13.039942 15053 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.031172 15039 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.043007 15039 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.043478 15039 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.043865 15112 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.028558 14750 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.047115 14750 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.049137 11259 leader_election.cc:400] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:11:13.049487 11259 leader_election.cc:403] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:13.049898 14750 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.055699 11287 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:13.058773 11284 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:13.022023 14632 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:13.013499 15022 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:13.024549 14943 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.060689 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.065303 11291 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:13.058135 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:13.085106 15022 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.095528 11286 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:13.089457 11293 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:13.038115 15012 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:13.042218 14457 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.079031 14943 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.079931 14632 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.099617 15116 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:11:13.088362 14485 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:11:13.105024 15022 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.117475 14764 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.102643 14754 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:13.153112 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 355897us
I20260709 12:11:13.155897 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.104223 14835 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.159824 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:13.131443 14998 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.159888 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.131072 15024 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:13.161990 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.162427 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.151037 15012 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.180534 15024 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:13.227404 15024 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.229044 15024 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.184633 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.187134 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:13.188295 14835 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.188952 15120 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.189543 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:13.238641 11857 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.190124 15022 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:13.206410 14916 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.207716 15039 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.214895 14989 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.220165 14754 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.221302 14457 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.162751 14932 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:13.246274 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65125.8us
I20260709 12:11:13.262034 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:13.274062 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 89510.5us
W20260709 12:11:13.275130 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 244710us
I20260709 12:11:13.259318 15047 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.299757 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.303663 11293 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:13.301002 14750 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:13.312381 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48668.6us
I20260709 12:11:13.260531 15118 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.322561 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.257479 15022 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.330907 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.333386 11293 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:13.260835 14989 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.303138 15047 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:13.343174 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 285161us
I20260709 12:11:13.345722 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.344415 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:13.351117 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.351670 14632 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.347085 14641 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 12:11:13.354809 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53221.3us
I20260709 12:11:13.355697 14641 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:13.355757 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:13.356164 14641 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:13.357218 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:13.358644 15123 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.359409 15123 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:13.359763 15123 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:13.360109 15123 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.360466 14956 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.360986 14956 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:13.362152 14750 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:13.362632 14750 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.321646 14754 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:13.366151 14754 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.368335 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.369132 14754 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.372334 15013 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.362015 14956 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.373158 15013 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:13.327338 14998 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.382828 14916 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.383353 14998 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.385340 14932 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.385911 14932 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.385926 15009 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.390756 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.391655 15039 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.392079 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.393080 15118 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.394367 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:13.394461 14989 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.396032 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:13.396617 15039 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:13.396999 15022 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.398061 15038 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:13.351003 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.378686 14641 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.398341 15009 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.416174 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:13.419299 11293 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:13.413887 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.388244 14932 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.424299 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.423815 11857 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:13.426441 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:13.427736 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 367114us
I20260709 12:11:13.429726 11286 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
I20260709 12:11:13.432479 15035 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:13.433120 15035 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:13.434156 15035 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:13.428366 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.436749 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:13.421413 15023 raft_consensus.cc:2764] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:13.446784 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.452577 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.453218 11137 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.454550 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.455135 11139 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.412050 15108 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.462841 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:13.463521 11287 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.463835 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:13.467064 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.470245 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.471185 11143 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:13.435840 14638 raft_consensus.cc:2764] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:13.444947 15112 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.476495 11144 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:13.471853 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:13.477046 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:13.478551 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.478657 11141 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:13.471927 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:13.486626 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 92388.9us
I20260709 12:11:13.497292 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.506265 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.508240 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:13.505890 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54889.9us
I20260709 12:11:13.467770 14932 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:11:13.524302 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:13.528225 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64497.9us
I20260709 12:11:13.467192 14904 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:13.498525 15112 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:13.555656 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:13.556684 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48528.7us
I20260709 12:11:13.555799 11211 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.556784 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.558768 11293 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:13.559561 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:13.506064 14754 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.560550 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.561540 11290 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:13.485599 15013 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:11:13.563023 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:13.564885 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67722.9us
I20260709 12:11:13.567868 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:13.526793 14998 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.521469 14835 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:13.573889 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.572297 14916 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.485422 15047 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.582273 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.587729 11290 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:13.583125 14916 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:13.587427 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.594026 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.578730 15120 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.585142 14750 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:13.615511 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52568.2us
I20260709 12:11:13.617463 14904 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:13.612668 14835 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.618954 14750 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:13.583916 14485 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.609368 15155 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.622819 15125 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:11:13.622923 14835 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.591845 14916 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.626609 11861 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.636888 15112 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.638163 15157 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:13.640781 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 861) took 1276 ms. Trace:
I20260709 12:11:13.621263 15142 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.648075 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:13.643908 11853 rpcz_store.cc:276] 0709 12:11:12.351182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.358480 (+  7298us) service_pool.cc:224] Handling call
0709 12:11:12.369071 (+ 10591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.369292 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.369330 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.377871 (+  8541us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.119625 (+741754us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:13.119686 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.119783 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.627285 (+507502us) raft_consensus.cc:1685] finished
0709 12:11:13.627318 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.627508 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":389016,"threads_started":1,"wal-append.queue_time_us":547879}
I20260709 12:11:13.651777 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.652594 11284 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:13.628369 15120 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.653978 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1957) took 1515 ms. Trace:
I20260709 12:11:13.641548 15047 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.654615 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:13.647818 15146 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:11:13.655453 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133717us
W20260709 12:11:13.660844 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.658371 11290 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:13.665329 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:13.666041 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:13.660570 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44281.5us
I20260709 12:11:13.668236 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:13.669703 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:13.657547 11140 rpcz_store.cc:276] 0709 12:11:12.137047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.699553 (+562506us) service_pool.cc:224] Handling call
0709 12:11:12.707580 (+  8027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.964081 (+256501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.964124 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.014221 (+ 50097us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.301968 (+287747us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:13.473041 (+171073us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.651750 (+178709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.651897 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.651940 (+    43us) raft_consensus.cc:1685] finished
0709 12:11:13.651951 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.652089 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2783,"prepare.queue_time_us":350266,"raft.queue_time_us":198147,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8323,"thread_start_us":814510,"threads_started":4,"wal-append.queue_time_us":318645}
I20260709 12:11:13.671955 11136 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:13.672242 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.630290 14485 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.672317 11293 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:13.674372 11854 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:13.674945 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 145996us
I20260709 12:11:13.673686 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.678028 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:13.653609 15142 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:13.680473 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.686131 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.690143 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:13.690907 11290 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 5: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:13.663597 15108 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:13.674096 15144 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:11:13.693568 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:13.694067 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.694710 11140 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.665691 15013 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:13.695869 15013 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:13.696481 15147 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:11:13.696759 15128 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.698124 15013 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.699864 14485 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.702814 15154 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.703701 15108 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.704602 11287 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:13.705960 15108 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:13.709086 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:13.687585 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:13.710223 11136 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.707103 15035 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.714349 15035 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:13.714680 15148 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:11:13.714792 15035 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.715358 15157 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:13.715770 15157 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.716109 15157 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:13.722800 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 128892us
I20260709 12:11:13.722824 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:13.723738 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:13.723881 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:13.738828 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45346.5us
I20260709 12:11:13.740000 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:13.782068 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73062.8us
I20260709 12:11:13.783388 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:13.743299 11110 connection.cc:256] RPC call timeout handler was delayed by -2.1159477220001008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:11:13.926834 15124 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 12:11:13.930552 15151 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:11:13.993268 14764 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:13.993621 15035 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.994267 14764 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:13.996042 15035 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:13.997169 14764 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.001953 11136 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:13.706619 15142 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:13.949353 15158 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:13.758399 15013 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.003499 15013 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.004166 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.004966 11142 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.004590 15013 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:13.918249 14750 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.008020 14750 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.008492 15154 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.008608 14750 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.009114 15154 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:14.010098 15154 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.011596 14956 raft_consensus.cc:2764] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:13.927798 15159 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.233s
I20260709 12:11:13.783150 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:14.013885 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 230862us
W20260709 12:11:14.008059 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 224720us
I20260709 12:11:14.015298 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.016656 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.017167 11135 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.969008 11139 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.001s
I20260709 12:11:13.977483 11140 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:14.017853 11139 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
W20260709 12:11:14.021991 11137 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.548s	user 0.003s	sys 0.008s
I20260709 12:11:14.022377 11137 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:14.024484 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.024539 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2333) took 1074 ms. Trace:
I20260709 12:11:14.029237 15140 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.035533 11137 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:14.015347 14943 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.888s	user 0.013s	sys 0.002s
I20260709 12:11:14.013309 15108 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.025970 11288 rpcz_store.cc:276] 0709 12:11:12.939415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.962093 (+ 22678us) service_pool.cc:224] Handling call
0709 12:11:12.995290 (+ 33197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.028397 (+ 33107us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:13.287979 (+259582us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.490317 (+202338us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.499938 (+  9621us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.639016 (+139078us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b18003e1ac0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f982d9f0a40 00007f982d9eb4e4 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:11:13.639176 (+   160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.639653 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.639803 (+   150us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:13.639855 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.642506 (+  2651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.013788 (+371282us) raft_consensus.cc:1685] finished
0709 12:11:14.013813 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.013957 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148883,"prepare.queue_time_us":301629,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":5022,"raft.queue_time_us":159330,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":40874,"spinlock_wait_cycles":25584000,"thread_start_us":414372,"threads_started":2,"wal-append.queue_time_us":261372}
W20260709 12:11:14.075383 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.023s	sys 0.052s
I20260709 12:11:14.045568 15140 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.085894 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.086997 11210 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:14.076000 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.023s	sys 0.052s
I20260709 12:11:14.089421 11216 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.090092 11213 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:14.092675 11214 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:14.096761 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.101306 11142 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:14.101912 14932 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:14.103099 14932 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.105602 14932 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.110621 11143 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:14.110946 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:14.115095 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 427053us
I20260709 12:11:14.117121 15140 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.119269 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.077359 15014 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.120615 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.121371 11284 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:14.123483 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.124549 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.125221 11291 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:14.125908 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.127168 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.127897 14457 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.128331 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.128527 14457 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.129549 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.130306 11289 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:14.064366 15108 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.133984 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.120959 15014 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.087921 14485 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.060254 14943 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.132048 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.173098 11292 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.127952 11285 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:14.126000 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:14.092736 15172 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:11:14.177313 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:14.178705 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:14.180682 15108 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.184805 14998 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:14.185693 14750 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:14.150211 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.154201 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.142148 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:14.153731 15009 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:14.157196 11135 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:14.157641 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.149387 11219 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:14.158135 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:14.159080 15171 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:11:14.200788 15012 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.977s	user 0.008s	sys 0.006s
I20260709 12:11:14.206862 15012 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.207078 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.207593 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.208390 11216 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:14.208755 11213 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:14.209105 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.209759 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.209787 11216 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:14.203008 11214 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:14.170006 15047 consensus_meta.cc:287] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 12:11:14.170328 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.215457 11293 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.170943 14485 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.217197 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.186204 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:14.218266 11858 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:11:14.186823 14457 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:14.187407 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.225487 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.226267 11287 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:14.189685 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76071.1us
I20260709 12:11:14.226325 11213 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:14.226919 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:14.158399 15024 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.929s	user 0.015s	sys 0.001s
I20260709 12:11:14.192996 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.194129 11284 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:14.194558 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:14.195252 15009 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.196516 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:14.211642 14916 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.543s	user 0.002s	sys 0.005s
W20260709 12:11:14.202965 15123 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.842s	user 0.011s	sys 0.003s
I20260709 12:11:14.202668 15157 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.204782 14943 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.205369 11215 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:14.211896 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.273303 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.199941 14641 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.228264 11219 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:14.229755 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.230757 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.227777 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:14.278365 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50708.5us
I20260709 12:11:14.279058 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.281258 11211 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:14.247277 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.200011 15014 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:14.267050 11135 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.229678 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.269142 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.191445 15053 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:14.271211 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:14.231442 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:14.273627 11216 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.171231 11144 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:14.301290 11858 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.300391 11213 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:14.294124 11291 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.305747 11288 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:14.311240 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.227066 15164 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:14.314056 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 82716.8us
I20260709 12:11:14.320672 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.327737 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.330984 11218 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:14.321516 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.332729 11140 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:14.320876 11293 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:14.337924 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.339588 11287 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:14.341120 11217 raft_consensus.cc:2368] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:14.343405 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.348688 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.349516 11140 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.275684 14916 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.352084 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.319387 15116 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.319610 15108 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.356127 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.358773 11213 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:14.277938 15123 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.340343 15047 raft_consensus.cc:2764] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:14.359748 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.373889 11287 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:14.372495 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.376632 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.378010 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.378772 11287 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:14.337831 15164 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.385125 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:14.385900 11217 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:14.388825 11287 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.357683 15116 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:14.399160 15116 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.362761 15108 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.401093 15108 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.358347 15053 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:14.403020 15053 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:14.403398 15053 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:14.404443 15053 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.405818 14761 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:14.406805 11861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:14.407754 11861 raft_consensus.cc:606] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:14.395852 11142 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:14.397091 11137 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:11:14.397850 15173 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:14.411936 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.412943 11290 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.412896 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.376011 15009 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:14.417972 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.423141 11137 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:14.417003 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.407683 14761 consensus_queue.cc:1243] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:14.428191 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:14.430154 11140 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:14.397029 15153 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.185s
W20260709 12:11:14.390470 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 374563us
I20260709 12:11:14.431737 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.342046 15135 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:11:14.426993 14943 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.431082 15014 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.441630 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.442448 11291 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:14.445597 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.433421 15012 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.447571 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.448240 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.433009 15009 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:14.452240 11140 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:11:14.437887 14485 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:14.460208 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.440094 14943 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.457553 15014 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.468152 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2612) took 1010 ms. Trace:
I20260709 12:11:14.468623 11136 rpcz_store.cc:276] 0709 12:11:13.457837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.018128 (+560291us) service_pool.cc:224] Handling call
0709 12:11:14.018466 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.023326 (+  4860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.023355 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.047772 (+ 24417us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.357884 (+310112us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:14.357940 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.358689 (+   749us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.467903 (+109214us) raft_consensus.cc:1685] finished
0709 12:11:14.467927 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.468086 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4461,"raft.queue_time_us":6800,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":13974,"spinlock_wait_cycles":36864,"thread_start_us":275847,"threads_started":1,"wal-append.queue_time_us":393445}
I20260709 12:11:14.462016 14904 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.470650 14754 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.470755 14904 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.450402 15049 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:14.471884 14904 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.477854 14764 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:14.478339 14764 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.482573 11292 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:14.483078 11140 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:14.484002 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.451277 14916 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.492048 11861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:14.492996 14485 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.481792 14943 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.495213 11861 raft_consensus.cc:606] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:14.514360 11861 raft_consensus.cc:614] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:14.515815 15142 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.519141 14485 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.468901 15014 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.520164 14485 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.491415 15157 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:14.483229 15164 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.528795 15108 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.530314 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2615) took 1004 ms. Trace:
I20260709 12:11:14.530972 11139 rpcz_store.cc:276] 0709 12:11:13.525508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.020007 (+494499us) service_pool.cc:224] Handling call
0709 12:11:14.020328 (+   321us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:14.042927 (+ 22599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.042967 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:14.043748 (+   781us) log.cc:844] Serialized 78 byte log entry
0709 12:11:14.446802 (+403054us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:14.459771 (+ 12969us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.465017 (+  5246us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.480804 (+ 15787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.480914 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.519661 (+ 38747us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b180043f2a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:14.529957 (+ 10296us) raft_consensus.cc:1685] finished
0709 12:11:14.530003 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.530224 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21257,"prepare.queue_time_us":67649,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":72,"raft.queue_time_us":50283,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":18762,"spinlock_wait_cycles":7798912,"thread_start_us":402636,"threads_started":1,"wal-append.queue_time_us":482779}
I20260709 12:11:14.479269 14764 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.534416 14764 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.540378 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.541286 11286 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:14.541504 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:14.499663 11216 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:14.500854 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.493276 15160 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.510222 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.461251 15009 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:14.557806 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57074.7us
W20260709 12:11:14.558620 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.561508 11144 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:14.578722 11291 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:14.580828 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.548408 15157 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.548629 15160 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.564247 14956 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.592070 15157 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.562063 15009 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:14.602880 15123 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.609613 14457 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:14.617233 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 235337us
I20260709 12:11:14.621016 11290 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:14.621999 15116 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.623167 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:14.624670 11286 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:14.601672 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 590) took 1079 ms. Trace:
I20260709 12:11:14.629280 11854 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:14.588986 14998 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:14.635632 11215 rpcz_store.cc:276] 0709 12:11:13.522647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.543340 (+ 20693us) service_pool.cc:224] Handling call
0709 12:11:14.601310 (+1057970us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540035be54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:14.601539 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464260352}
I20260709 12:11:14.645381 11292 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:14.645918 11292 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:14.648779 11286 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.652700 15116 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:14.622834 15160 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.665725 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.658865 11287 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:14.630309 15049 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.669618 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.667932 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:14.633013 14457 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:14.669080 11292 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:14.680233 11292 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.656412 15108 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.654072 14485 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:14.683916 11287 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:14.691411 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.670960 15123 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.674794 14956 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:14.670861 14998 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.696157 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:14.708877 11292 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:14.676035 15048 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.686022 15167 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.679698 15049 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.713353 15108 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:14.848232 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.712165 15163 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:14.715823 14905 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:11:14.684167 15116 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
W20260709 12:11:14.876709 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 205010us
I20260709 12:11:14.825115 15009 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:14.854188 15177 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:11:14.826241 15048 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:14.881364 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:14.875121 14956 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.889895 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.764674 14485 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.902840 15116 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.903416 15116 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:14.904506 15116 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.892969 14998 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:14.906590 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 210516us
W20260709 12:11:14.907424 15188 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 12:11:14.908449 15189 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:14.909085 11110 leader_election.cc:400] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
W20260709 12:11:14.909332 15190 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:11:14.910529 11110 leader_election.cc:403] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.911175 15108 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:14.912985 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:14.914785 15108 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.915306 15108 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:14.916318 15108 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.921836 11144 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:14.924072 15048 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.924578 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.925361 11139 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:14.929737 15135 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:14.929981 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.948760 11135 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.950433 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:14.951061 11216 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.953320 11214 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.930531 14485 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:14.893942 14956 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:14.931671 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.932361 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:14.887921 15009 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.932592 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.933547 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.964067 11143 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:14.934628 15195 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:14.939893 15049 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:14.941385 15157 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:14.870715 14457 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.873135 15163 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:14.945111 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.982208 11141 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.933647 11144 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:14.930583 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.959499 11136 raft_consensus.cc:2368] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7.
I20260709 12:11:14.917475 14943 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:14.965880 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:14.969250 11258 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.539s (SENT)
I20260709 12:11:14.971909 11216 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:14.976543 11135 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:14.984320 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.985324 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.961102 14956 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.988544 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:14.989074 11258 leader_election.cc:336] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.546s (SENT)
I20260709 12:11:14.989696 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.986019 11135 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:14.991170 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:14.993088 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 103310us
I20260709 12:11:14.993245 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.994130 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:14.995133 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:14.995676 11136 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:15.001368 11110 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Timed out: RequestConsensusVote RPC to 127.9.180.131:41465 timed out after 2.086s (SENT)
I20260709 12:11:15.002015 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.005692 11143 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:15.006933 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.008082 11143 raft_consensus.cc:2368] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:11:14.995172 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:14.980134 14973 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.958278 14905 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:15.010691 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.014235 11136 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
I20260709 12:11:15.015149 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.016242 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.016808 11136 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.010289 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.012605 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.010576 11135 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:15.023185 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.024753 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.010820 15187 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.011416 15198 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.031687 11135 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:15.014052 15199 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.064814 15009 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:15.065510 15009 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:15.068195 15191 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:11:15.072041 15163 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.073748 14943 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.015690 14973 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.076229 14973 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.042879 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.077649 11137 raft_consensus.cc:2410] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:11:15.056782 14764 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:11:15.014721 15049 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:15.021337 15135 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:15.057461 15142 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.002s
I20260709 12:11:15.053385 15187 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.058813 11141 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:15.086968 15187 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:15.052316 15200 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.061087 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69055.8us
I20260709 12:11:15.091074 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.093065 11212 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:15.061901 11135 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.098286 11136 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:15.106235 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.114384 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:15.117652 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 78896.8us
W20260709 12:11:15.117923 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 82616.2us
W20260709 12:11:15.122680 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.123704 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.125046 15199 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:15.125264 15200 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:15.112718 15023 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.136554 15160 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.142151 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.142473 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:15.143275 11857 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:15.143622 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.144107 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.144210 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:15.144979 11858 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:15.160647 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.146694 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.168387 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:15.169463 11290 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:15.171079 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51930.8us
W20260709 12:11:15.172530 11258 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.503s (SENT)
I20260709 12:11:15.174696 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.143669 15160 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.183300 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.186161 11285 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:15.184056 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:15.165916 15023 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.167904 15199 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.164175 15123 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:15.191591 15116 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.200093 15209 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.173609 15049 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.203032 15049 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.205984 15049 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:15.173136 15187 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.183444 15135 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.170617 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:15.218638 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46126us
W20260709 12:11:15.219492 11258 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.614s (SENT)
I20260709 12:11:15.219858 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:15.221712 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51205.5us
W20260709 12:11:15.223503 11258 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.642s (SENT)
I20260709 12:11:15.236763 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.238435 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.224792 14932 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.224090 15123 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.218724 15135 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:15.171624 14956 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.218892 15187 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.245918 14932 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:15.250218 14932 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.251444 14932 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.251667 15187 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:15.227744 15023 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.236466 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.252625 15023 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:15.253504 11258 leader_election.cc:336] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.694s (SENT)
I20260709 12:11:15.253993 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.253654 15023 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.247298 15199 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.254941 15023 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:15.255125 11258 leader_election.cc:336] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.769s (SENT)
I20260709 12:11:15.255327 15199 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.255663 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.223783 15049 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:15.248632 15135 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.246148 15035 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.259275 15035 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.260349 14750 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.261319 15035 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.263094 14956 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.264014 11138 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.264940 15207 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.268605 15049 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:15.273959 15197 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.367s	user 0.000s	sys 0.003s
I20260709 12:11:15.268810 15208 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.281080 15196 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.354s	user 0.000s	sys 0.004s
I20260709 12:11:15.288125 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.288966 11290 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:15.289086 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.288393 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.289656 11286 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:15.289986 11285 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:15.288144 15135 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:15.291458 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.293439 15135 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:15.299973 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.300470 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:15.301062 11286 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.298190 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:15.301239 11185 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.301741 11287 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.299765 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:15.308844 15194 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.408s	user 0.000s	sys 0.002s
I20260709 12:11:15.309758 11285 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.312549 11290 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:15.323551 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.328339 11285 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:15.328167 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.329324 11213 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:15.329864 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:15.329757 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.311443 14905 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:15.331302 11217 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:15.331883 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.329753 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.334012 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:15.339088 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.339311 11135 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:15.340374 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.340950 11141 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.342249 11142 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:15.343425 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.344081 11142 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.346417 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.348410 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:15.341018 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.351035 11135 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:15.352404 11285 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:15.352873 11286 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:15.350219 11141 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:15.354792 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.355545 11144 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:15.355719 15159 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:15.356073 14905 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.356806 14905 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.360011 11219 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:15.360376 14989 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.360737 14989 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:15.327116 15142 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:15.361749 14989 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.362823 11143 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:15.363729 14943 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.364008 11293 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:15.364269 14943 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.366653 11136 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:15.366851 14989 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.334440 11218 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:15.370203 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.357329 11137 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:15.373317 15153 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:15.373981 14750 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:15.374966 15153 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:15.375905 15153 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.366344 14943 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.379058 11293 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.352404 11135 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:15.382808 11287 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:15.384564 14750 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:15.385865 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.387056 15209 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.387909 15161 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:15.388322 15161 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.388621 15161 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.392709 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2080) took 1236 ms. Trace:
I20260709 12:11:15.393121 11212 rpcz_store.cc:276] 0709 12:11:14.156367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.157257 (+   890us) service_pool.cc:224] Handling call
0709 12:11:15.392538 (+1235281us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54000e79d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:15.392651 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047034112}
W20260709 12:11:15.394646 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.394868 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.395656 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.395776 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.397405 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:15.399281 15193 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.521s	user 0.001s	sys 0.000s
W20260709 12:11:15.401134 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.401634 15161 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.403999 15161 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.404825 11292 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:15.412106 14973 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.412606 14973 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:15.412992 14973 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.356159 15159 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.417243 11142 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:15.419550 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:15.420030 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 181700us
I20260709 12:11:15.440534 11135 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:15.440881 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.443101 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.439450 14750 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:15.406330 15053 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.444881 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.449119 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:15.382058 15023 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.449918 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.451213 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.461341 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.442868 15159 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.466264 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:15.439373 15140 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.479498 15140 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.482023 15140 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.456002 15135 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.483002 15135 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.483484 15135 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.444424 14750 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.445538 15157 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:15.472003 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.495141 11292 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:15.470364 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.453905 15120 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.456662 14904 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:15.473258 15009 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.473280 14905 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.476663 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.505232 11287 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:11:15.477397 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.505811 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:15.477931 11854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 419) took 1765 ms (client timeout 2194 ms). Trace:
I20260709 12:11:15.478762 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.478060 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.444867 15209 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:15.506803 11854 rpcz_store.cc:269] 0709 12:11:13.713010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.713165 (+   155us) service_pool.cc:224] Handling call
0709 12:11:15.477725 (+1764560us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54006d01d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:15.477839 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082289920}
I20260709 12:11:15.456154 15213 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:15.489208 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46381.9us
I20260709 12:11:15.446269 14764 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.448982 15048 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.516180 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.497574 11258 leader_election.cc:400] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:11:15.499320 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.516903 11285 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:15.517473 11290 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:15.506320 11293 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:15.493623 14750 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.470348 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:15.510012 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:15.520993 11286 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:15.484968 15143 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.511955 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.516953 11258 leader_election.cc:403] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.468899 11184 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.518568 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.529076 11292 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:15.528954 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.519100 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.522313 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:15.526190 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.530179 11287 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.530472 11136 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:15.504688 15200 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:15.535372 11137 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:11:15.548465 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79643.9us
I20260709 12:11:15.569799 11141 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:15.570547 14485 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:15.570762 15222 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:15.571177 14754 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.571909 14754 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.572474 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:15.573926 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.574290 14754 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.508023 15120 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:15.576786 15120 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:15.505159 15157 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.581090 15157 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:15.588579 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:15.590191 11138 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:15.590543 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.591696 11286 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:15.513882 15014 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:11:15.574142 15200 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:15.595219 15200 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.596468 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:15.597208 11143 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:15.598882 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2351) took 1424 ms. Trace:
I20260709 12:11:15.599315 11289 rpcz_store.cc:276] 0709 12:11:14.174089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.542711 (+368622us) service_pool.cc:224] Handling call
0709 12:11:14.543281 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.560076 (+ 16795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.560117 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.560601 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.330149 (+769548us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b1800358e40. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:11:15.415609 (+ 85460us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:15.415654 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.415719 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.598528 (+182809us) raft_consensus.cc:1685] finished
0709 12:11:15.598554 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.598811 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10277,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6958,"spinlock_wait_cycles":3615616,"thread_start_us":85271,"threads_started":1,"wal-append.queue_time_us":940379}
I20260709 12:11:15.603240 11291 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:15.603785 11292 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:15.605299 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55511us
I20260709 12:11:15.605556 11292 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:15.606994 11292 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:15.611636 11292 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.621261 11214 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:15.626264 11287 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:15.627302 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.631021 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:15.637790 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:15.639063 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141609us
I20260709 12:11:15.640128 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.643325 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:15.636945 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.646894 11284 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:15.532660 15123 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:15.631837 15108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.004s	sys 0.015s
I20260709 12:11:15.665711 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.649603 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:15.669543 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 150515us
I20260709 12:11:15.615721 15024 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.679620 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.680088 11258 leader_election.cc:400] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
I20260709 12:11:15.636447 15157 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.635737 15187 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 4. Current term is 5.
I20260709 12:11:15.647828 15213 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.687645 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.687232 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.588660 14973 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:15.676628 15108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.004s	sys 0.016s
I20260709 12:11:15.670655 15207 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.691375 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:15.667639 15120 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:15.691681 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54831.8us
I20260709 12:11:15.694166 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:15.700925 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:15.739702 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 89320.9us
I20260709 12:11:15.681770 15140 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:15.678964 15208 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:15.744692 11139 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:15.745690 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62697.5us
I20260709 12:11:15.747400 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:11:15.750532 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56413.9us
I20260709 12:11:15.687951 14764 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:15.770196 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78926.2us
I20260709 12:11:15.693392 15039 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.843874 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.776181 11856 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:15.783784 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.675664 15123 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:15.776134 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 328804us
I20260709 12:11:15.742748 15160 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:11:15.692962 15157 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:15.843246 15014 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 12:11:15.918895 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.942338 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 1980) took 1016 ms. Trace:
I20260709 12:11:15.744931 15053 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:15.851260 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71276.9us
I20260709 12:11:15.770995 14904 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.690603 15048 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:11:15.867455 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:16.027606 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 288034us
W20260709 12:11:15.971733 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.876066 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 179610us
I20260709 12:11:16.047359 11110 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:11:16.047668 11110 leader_election.cc:403] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:15.840767 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:15.841933 15024 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:15.840147 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:15.957800 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2353) took 1714 ms. Trace:
I20260709 12:11:15.903321 15023 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.844830 15120 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:15.948063 15155 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.844770 15213 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.842020 14905 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.995337 11139 rpcz_store.cc:276] 0709 12:11:14.926308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.926793 (+   485us) service_pool.cc:224] Handling call
0709 12:11:14.927085 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.745073 (+817988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.942105 (+197032us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540028fad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:15.942280 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879930624}
I20260709 12:11:15.926973 14457 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.864699 15142 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:11:16.003847 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.053303 11291 rpcz_store.cc:276] 0709 12:11:14.243734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.620389 (+376655us) service_pool.cc:224] Handling call
0709 12:11:14.637253 (+ 16864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.603663 (+966410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.957534 (+353871us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400319cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:15.957731 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220674432}
I20260709 12:11:15.847803 15140 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:15.865195 15199 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:16.066238 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.066466 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62724.1us
W20260709 12:11:16.057067 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 189712us
I20260709 12:11:15.968434 11039 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 4 to 9, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 9 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:15.939742 15223 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:15.946542 15123 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:16.059887 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:16.044245 15013 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:11:15.922312 15226 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:15.947041 14485 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:15.935248 15218 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:11:16.067986 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.069058 14904 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:16.070375 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 205434us
I20260709 12:11:16.061245 15053 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:16.058521 15209 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 5. Current term is 6.
I20260709 12:11:15.933568 14750 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.071887 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.060679 14905 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:15.948103 14973 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:16.076526 14904 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.065683 15199 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.058588 15023 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:16.094220 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 254182us
I20260709 12:11:16.098124 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:16.081920 14764 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.951316 15135 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.109441 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:16.112290 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 208604us
I20260709 12:11:16.115372 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:16.091743 14905 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.074165 14485 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.112776 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.062881 15155 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.089368 15039 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:11:16.095574 14904 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.190572 15229 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.183543 14989 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:16.215854 15229 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:16.216312 14989 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.216756 14989 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:16.216850 15229 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.198613 15123 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.192111 15009 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.096100 15213 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:16.196798 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84116.6us
I20260709 12:11:16.237459 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:16.183879 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 68604.4us
I20260709 12:11:16.240366 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:16.089802 15160 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:11:16.092393 15013 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:11:16.212157 11288 raft_consensus.cc:2368] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11.
I20260709 12:11:16.216874 15023 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:16.116626 15208 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.096819 14943 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:11:16.085448 15200 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.185320 15209 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:16.116384 15053 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:16.117026 15014 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:11:16.165261 15207 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:16.247043 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 178973us
I20260709 12:11:16.248073 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:16.251039 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 174102us
I20260709 12:11:16.259388 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:16.265134 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.111052 15120 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.268951 15213 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:16.269408 15213 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:16.269732 15213 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.269950 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.271196 11110 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:16.271463 11110 leader_election.cc:403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:16.271349 15153 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.272859 15153 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:16.273514 15108 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.254041 15047 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:16.253401 15123 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.283882 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.256222 14998 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.192931 15140 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.289611 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.290616 11216 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:16.217702 14989 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.274430 15108 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:16.266322 15024 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:16.294107 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:16.316812 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:16.324116 11211 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:16.331139 11861 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.278404 15053 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:16.282933 15023 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:16.265414 15009 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:11:16.275532 15187 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:16.287204 14641 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:16.316877 15226 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:16.379112 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.379292 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.380211 11219 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:16.380587 11217 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:16.381496 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.274021 15153 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.344705 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:16.301939 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.266624 15209 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:16.397071 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 318133us
W20260709 12:11:16.397753 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133308us
W20260709 12:11:16.340970 15231 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.400s	user 0.006s	sys 0.000s
I20260709 12:11:16.278023 15239 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 12:11:16.284664 15208 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:11:16.410152 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:16.315810 14998 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.334074 15047 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:16.413529 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:16.417328 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.418680 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.419502 11287 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:16.421454 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.422220 11292 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:16.394681 14989 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.374672 15187 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.300486 15225 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:11:16.391618 15207 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.444334 11289 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:16.449352 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:16.425446 15239 consensus_queue.cc:1243] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:16.454387 11292 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:16.438534 15187 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.490545 15226 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.449728 15157 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:16.450218 15135 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:16.499958 15155 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:16.486697 15053 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.515806 15200 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:16.516211 14485 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:16.525074 14998 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:16.466059 15199 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:16.486160 15159 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.988s	user 0.001s	sys 0.012s
W20260709 12:11:16.553570 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 282477us
I20260709 12:11:16.449505 15207 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.436265 15024 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.561239 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:16.550927 15234 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
W20260709 12:11:16.573032 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 162972us
I20260709 12:11:16.574584 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:16.576946 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 127674us
I20260709 12:11:16.577606 11291 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:16.583148 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.567463 15249 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:16.572062 15208 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:16.597069 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.590150 15135 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.566380 15159 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.600010 15249 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:16.598307 15199 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.594363 15245 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:16.571748 15047 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.653460 15023 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:16.653716 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62036.4us
I20260709 12:11:16.654139 15023 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:16.654760 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:16.661232 11858 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:16.620970 15254 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:16.645404 15209 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:16.644942 15249 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.641702 15248 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:16.683988 11039 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.687003 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:16.687924 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:16.834776 11136 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:16.692059 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:16.835712 11139 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:16.711530 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:16.836097 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:16.712177 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:16.715775 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.723752 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:16.726027 15039 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.768882 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.836961 11136 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:16.855250 11214 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:16.856547 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:16.857555 11136 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.857642 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:16.844131 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:16.858507 11858 raft_consensus.cc:606] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:16.858888 11858 raft_consensus.cc:614] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:16.854007 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.859503 11218 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.666282 15108 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.861661 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:16.874858 15247 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:11:16.883095 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.885417 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.886317 11293 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:16.889950 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:16.890635 11139 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:16.879101 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.894241 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.879458 11136 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:11:16.671406 15123 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:16.674842 15245 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.910794 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 187152us
I20260709 12:11:16.900449 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:16.920591 11213 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.906267 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.906987 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.921780 11211 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:16.906559 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:16.836576 15229 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:16.833879 15248 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:16.931744 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.933043 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.938506 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:16.900056 15200 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.875170 15252 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:16.933264 15213 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.006s
I20260709 12:11:16.909101 15235 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:16.917606 14485 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.907953 15251 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.877257 15039 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.033389 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:16.672503 15254 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.031499 15264 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.022643 15248 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:17.060181 15009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.011s	sys 0.046s
I20260709 12:11:16.926115 15123 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.054152 15261 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.059593 15208 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:17.093235 11216 raft_consensus.cc:2376] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10. Re-sending same reply.
W20260709 12:11:17.099427 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 415194us
W20260709 12:11:17.098457 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 367807us
I20260709 12:11:17.023761 15229 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:16.933888 15245 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:17.089896 15009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.011s	sys 0.046s
I20260709 12:11:17.051869 15200 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:17.112914 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.110244 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.088402 15207 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:17.117256 11107 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.219s (SENT) [suppressed 36 similar messages]
I20260709 12:11:17.125162 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.132768 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.099395 15157 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:17.061455 15213 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.147315 11213 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:17.073159 14485 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.143586 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.152421 11856 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:17.098924 15023 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.105800 15274 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:17.142869 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:17.156831 11858 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.075031 15235 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.116911 15250 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.055495 15252 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.177709 11144 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:17.142589 15159 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.143457 15207 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:17.169153 14904 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.003s
I20260709 12:11:17.157541 15009 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:17.192179 11853 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:17.152613 15262 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:17.192866 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79154.2us
I20260709 12:11:17.076292 15251 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.101263 15261 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.091660 15264 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:17.218856 14989 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.000s
I20260709 12:11:17.154641 15157 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.207396 15262 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:17.221102 15157 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.221199 15153 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.159437 15208 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.222167 15262 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:17.180594 15271 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:17.202716 15253 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 12:11:17.285825 14834 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:17.286283 14834 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:17.286942 15254 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.287138 14834 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:17.293516 14905 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.098s	user 0.005s	sys 0.005s
I20260709 12:11:17.293371 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.295264 15123 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.295430 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.296375 15039 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.300252 11825 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:17.241567 15200 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.241932 15235 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.242127 15252 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:17.242755 15256 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 12:11:17.243546 15270 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:17.244606 15135 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:17.245934 15245 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.163396 15274 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.194562 14904 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.369844 15135 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.372777 14904 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:17.246881 15259 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:11:17.248014 15261 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.249320 14485 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.250348 15229 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.218734 15251 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.256368 11218 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:17.256672 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.257862 14989 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.261991 15249 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.265509 15248 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.265224 11039 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:11:17.273079 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 251) took 19358 ms (client timeout 15000 ms). Trace:
W20260709 12:11:17.277081 15263 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.402s	user 0.001s	sys 0.001s
I20260709 12:11:17.273972 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:17.339483 15153 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:17.339802 15187 consensus_meta.cc:287] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.797s	user 0.000s	sys 0.020s
W20260709 12:11:17.340019 14457 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 1.275s	user 0.009s	sys 0.005s
I20260709 12:11:17.342846 11138 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:17.205528 15009 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:17.343698 15269 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:11:17.421731 15248 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.346195 15244 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.422663 15153 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:17.423712 15249 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.422722 15244 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:17.425113 15244 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.426079 11039 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.423771 15153 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.418901 15187 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.426321 15244 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.433394 15187 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.434875 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.436216 11861 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:17.437098 11285 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:17.438064 15222 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.438793 15222 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:17.439776 15108 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 12:11:17.440241 15108 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.348049 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:17.440939 14750 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.441515 11215 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:17.441949 11215 raft_consensus.cc:614] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:17.443195 15135 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:17.393127 11042 rpcz_store.cc:269] 0709 12:10:57.914759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.920102 (+  5343us) service_pool.cc:224] Handling call
0709 12:10:59.424870 (+1504768us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b54000394a8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9836ccd331 00007f9836cc83fc 00007f9836899e84 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:11:17.272912 (+17848042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:11.626380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:11.627383 (+  1003us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:11.627458 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:11:11.627499 (+    41us) tablet.cc:662] Decoding operations
0709 12:11:11.629313 (+  1814us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:11.629427 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:11.629465 (+    38us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:11:11.730735 (+101270us) tablet.cc:701] Row locks acquired
0709 12:11:11.736186 (+  5451us) write_op.cc:260] PREPARE: finished
0709 12:11:11.752742 (+ 16556us) write_op.cc:270] Start()
0709 12:11:11.794911 (+ 42169us) write_op.cc:276] Timestamp: P: 1783599071746371 usec, L: 0
0709 12:11:11.801734 (+  6823us) op_driver.cc:348] REPLICATION: starting
0709 12:11:11.831537 (+ 29803us) log.cc:844] Serialized 5562 byte log entry
0709 12:11:12.839116 (+1007579us) op_driver.cc:464] REPLICATION: finished
0709 12:11:13.423442 (+584326us) write_op.cc:301] APPLY: starting
0709 12:11:13.444639 (+ 21197us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:13.543421 (+ 98782us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:13.577498 (+ 34077us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:13.735950 (+158452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:13.736447 (+   497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:11:13.736514 (+    67us) write_op.cc:312] APPLY: finished
0709 12:11:13.737126 (+   612us) log.cc:844] Serialized 101 byte log entry
0709 12:11:14.026394 (+289268us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.050879 (+ 24485us) write_op.cc:454] Released schema lock
0709 12:11:14.069119 (+ 18240us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:14.133783 (+ 64664us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:14.133814 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3859830,"reported_tablets":48,"spinlock_wait_cycles":12917504,"child_traces":[["op",{"apply.queue_time_us":482859,"apply.run_cpu_time_us":11398,"apply.run_wall_time_us":739845,"num_ops":14,"prepare.queue_time_us":150450,"prepare.run_cpu_time_us":23508,"prepare.run_wall_time_us":471897,"raft.queue_time_us":447136,"raft.run_cpu_time_us":13836,"raft.run_wall_time_us":335107,"replication_time_us":1037123,"thread_start_us":924657,"threads_started":5,"wal-append.queue_time_us":385923,"wal-append.run_cpu_time_us":27660,"wal-append.run_wall_time_us":2825677}]]}
I20260709 12:11:17.446015 15135 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.428906 11039 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 7 to 8, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 8 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:17.349370 14764 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.238s	user 0.007s	sys 0.006s
I20260709 12:11:17.193269 15207 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.349794 15264 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.294162 14905 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.352286 15213 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.353363 15241 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:17.359767 15262 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.299188 15271 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.478185 15271 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.467710 15241 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:17.481135 15241 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.482198 15241 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:17.383307 11136 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.496007 15199 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:17.496486 15199 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.362000 11858 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:17.385174 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.498989 15273 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:17.499648 15273 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.501725 15273 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.501935 11284 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:17.385746 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.386065 11291 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:17.505102 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.505735 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:17.508181 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.508949 11289 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:17.510227 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:17.512147 15275 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:17.512758 15275 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.513789 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.514465 11284 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:17.518563 11136 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:17.395812 11288 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:17.397466 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 123596us
I20260709 12:11:17.383526 14998 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.522089 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:17.415629 11293 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:17.418725 11144 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:17.523090 15281 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:17.523527 15281 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.523860 15281 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:17.522331 14834 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.525712 11144 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:17.394090 14989 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.528110 14989 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.421368 15009 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.346906 11143 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:17.348740 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.521744 14998 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.532191 11139 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:17.533085 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.423822 15274 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.403750 14485 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.459933 11039 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:17.468554 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.472046 15207 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.453212 14764 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:17.534314 14998 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.475549 14905 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.475945 15262 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.534914 11214 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.535612 15275 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.540452 15262 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.453186 15024 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.541519 15024 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.542070 14485 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.469372 15243 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:11:17.542464 14485 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.489866 11138 raft_consensus.cc:1217] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-10.6]   Dedup: 5.3->[6.4-10.6]
I20260709 12:11:17.543740 11138 pending_rounds.cc:85] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 3
I20260709 12:11:17.543994 11138 pending_rounds.cc:107] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:17.544215 11138 raft_consensus.cc:2889] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.545814 14904 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:17.489954 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.492012 11853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:17.547101 11856 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:17.547159 11853 raft_consensus.cc:606] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:17.547851 11853 raft_consensus.cc:614] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:17.378731 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 476578us
I20260709 12:11:17.534250 11139 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:17.553896 11826 leader_election.cc:400] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11.
W20260709 12:11:17.382526 11287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.002s	sys 0.007s
I20260709 12:11:17.555562 11826 leader_election.cc:403] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:11:17.555730 11287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.003s	sys 0.007s
I20260709 12:11:17.557072 11136 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:17.519457 15222 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:17.553344 15024 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.563686 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.564363 15271 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.565021 15280 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.336s	user 0.002s	sys 0.003s
I20260709 12:11:17.565168 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:17.565366 14764 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.565338 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:17.613318 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 48236.2us
I20260709 12:11:17.613457 11856 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:17.567639 11853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:17.614274 11853 raft_consensus.cc:606] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:17.569051 15243 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:17.572389 15237 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11.
I20260709 12:11:17.575081 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.576093 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:17.576996 11039 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 5, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 5 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.578145 15161 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:17.582414 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:17.622638 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 505389us
I20260709 12:11:17.592164 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:17.595461 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.589684 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:17.611871 11184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.040s
I20260709 12:11:17.617746 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:17.625123 11184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.040s
I20260709 12:11:17.619030 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:17.620771 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44759.3us
W20260709 12:11:17.625547 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 685600us
I20260709 12:11:17.627924 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.628686 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:11:17.629071 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.498449 15199 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:17.629770 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.642516 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.656569 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.657159 11136 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.646937 11859 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:17.655843 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:17.660831 11285 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:17.661391 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71781us
I20260709 12:11:17.661566 11141 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:17.661566 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:17.662302 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:17.663815 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:17.671150 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.671550 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.672322 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.671789 11290 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:17.642117 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.679258 11140 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:17.682726 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 2391) took 1266 ms. Trace:
I20260709 12:11:17.672731 11039 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:17.675407 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.672343 11139 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:17.683154 11286 rpcz_store.cc:276] 0709 12:11:16.416383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.417010 (+   627us) service_pool.cc:224] Handling call
0709 12:11:17.682566 (+1265556us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000f5fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:17.682675 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2764224256}
I20260709 12:11:17.675576 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:17.685067 11137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.043s	sys 0.034s
W20260709 12:11:17.686604 11137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.044s	sys 0.034s
I20260709 12:11:17.687454 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:17.614295 15262 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.689641 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:17.654628 15241 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.695510 11141 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.621598 15024 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.699397 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:17.654443 14834 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.704900 11141 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.705412 11039 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 6 to 10, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 10 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.707489 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.676113 15235 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.717849 11039 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:17.672092 15047 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:17.678682 15274 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.716795 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.722388 11039 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 6 to 7, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 7 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:17.672538 15297 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.679566 15261 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.684549 15160 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.709422 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:17.688776 15135 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:17.733376 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.714570 15024 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.715618 14834 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.725983 11039 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 4 to 7, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 7 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:17.617100 15271 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.690591 15237 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:17.696497 15199 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.730334 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:17.700577 15209 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.705514 15241 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.678865 15143 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.678400 15014 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:17.737177 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.629624 14764 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.754567 15024 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.719056 15235 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.708499 15294 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.722556 15278 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.755944 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.755466 11039 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 10 to 11, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 11 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.766506 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.787348 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.730633 15160 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.733855 14905 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:17.773339 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.774464 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.796984 11140 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:17.798020 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.728729 15297 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:17.776017 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:17.714501 15262 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.779008 11135 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:17.779986 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.805559 11858 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:17.753410 11856 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.753788 14834 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.782859 11289 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:17.817212 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.817857 11290 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:17.765424 11136 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:17.781036 11859 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:17.753865 15261 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:17.788600 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:17.788728 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:17.757129 15135 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:17.788051 11141 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:17.835485 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:17.836179 11214 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 7: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:17.771103 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.836486 11136 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:17.792588 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:17.728237 15035 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:17.791432 15235 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.759692 15155 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:17.854900 15295 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:11:17.855124 15155 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.855881 15296 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:17.804628 15297 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.856619 15296 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.859439 15261 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.848320 15294 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:17.861075 15294 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.769234 15237 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.805056 15281 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.851380 15229 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.865927 15229 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.866279 15229 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.866832 15281 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.867448 11860 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:17.801167 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:17.777644 15241 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.729231 15047 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.771790 15209 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:17.885175 15209 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.789702 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:17.731438 15274 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:17.803690 15130 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.199s
I20260709 12:11:17.896322 15130 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:17.834995 15242 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.196s
I20260709 12:11:17.794874 15160 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.899963 15225 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:17.812273 14904 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:17.901580 14904 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.779891 14750 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.904031 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2653) took 1147 ms. Trace:
I20260709 12:11:17.816056 14764 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:17.740262 14932 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:17.907147 14932 consensus_queue.cc:1243] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:17.780210 15143 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.907871 15143 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:17.824640 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50645.4us
I20260709 12:11:17.910585 11210 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:17.910840 15135 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:17.886286 15311 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:11:17.837584 11136 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:17.836257 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:17.936831 11141 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.793074 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:17.851385 11286 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.854611 15153 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.799582 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:17.904510 15292 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:17.872350 11285 pending_rounds.cc:85] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 5
I20260709 12:11:17.947139 11285 pending_rounds.cc:107] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:17.947528 11285 raft_consensus.cc:2889] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.896728 15130 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:17.803369 15278 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.952746 15207 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:17.953478 15207 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.954084 15207 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.955163 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2660) took 1150 ms. Trace:
I20260709 12:11:17.910960 11210 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:17.832912 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:17.852126 15170 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:17.856099 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2395) took 1425 ms. Trace:
I20260709 12:11:17.962841 11287 rpcz_store.cc:276] 0709 12:11:16.438796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.443239 (+  4443us) service_pool.cc:224] Handling call
0709 12:11:16.445057 (+  1818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.565043 (+119986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.565077 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.569801 (+  4724us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.559705 (+989904us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:17.559745 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.559805 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.855909 (+296104us) raft_consensus.cc:1685] finished
0709 12:11:17.855929 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.856044 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18613,"raft.queue_time_us":134884,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":11839,"spinlock_wait_cycles":3328,"thread_start_us":1022846,"threads_started":2,"wal-append.queue_time_us":1076306}
I20260709 12:11:17.957919 11210 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.955606 11143 rpcz_store.cc:276] 0709 12:11:16.804824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.529201 (+724377us) service_pool.cc:224] Handling call
0709 12:11:17.529534 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.529867 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.529898 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.530362 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.668093 (+137731us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:17.668131 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.668193 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.954966 (+286773us) raft_consensus.cc:1685] finished
0709 12:11:17.954987 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.955101 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4127,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":136939,"threads_started":1,"wal-append.queue_time_us":422786}
I20260709 12:11:17.966042 11210 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:17.937041 15250 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:17.968453 15170 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:17.993557 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2657) took 1236 ms. Trace:
I20260709 12:11:17.994006 11138 rpcz_store.cc:276] 0709 12:11:16.757583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.489264 (+731681us) service_pool.cc:224] Handling call
0709 12:11:17.489640 (+   376us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:17.544979 (+ 55339us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:17.545320 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.680987 (+135667us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:17.700946 (+ 19959us) log.cc:844] Serialized 78 byte log entry
0709 12:11:17.701154 (+   208us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:17.759980 (+ 58826us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.760364 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.760575 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.760654 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.902715 (+142061us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18003265c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f9835a04328 00007f98359fb901 00007f98359fb8a7 00007f9835af3288 00007f9835af2f37 00007f9835b0755c 00007f9835b07508
0709 12:11:17.913896 (+ 11181us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003265c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:17.993342 (+ 79446us) raft_consensus.cc:1685] finished
0709 12:11:17.993363 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.993495 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74571,"prepare.queue_time_us":223010,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":136,"raft.queue_time_us":27646,"raft.run_cpu_time_us":2380,"raft.run_wall_time_us":151403,"spinlock_wait_cycles":33640576,"thread_start_us":121742,"threads_started":1,"wal-append.queue_time_us":178600}
I20260709 12:11:17.966265 15199 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:17.823791 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:18.026432 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 202712us
I20260709 12:11:17.799909 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.005288 15009 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.079648 15208 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.045894 15200 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.080309 15208 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.046002 14764 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.084399 14764 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.084882 14764 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.996702 15250 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.096230 15009 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.053211 15130 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:18.147600 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 314772us
I20260709 12:11:18.148509 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:18.153277 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 353762us
I20260709 12:11:17.904414 11137 rpcz_store.cc:276] 0709 12:11:16.756445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.920031 (+163586us) service_pool.cc:224] Handling call
0709 12:11:16.925798 (+  5767us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:16.926655 (+   857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.926754 (+    99us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:17.041346 (+114592us) log.cc:844] Serialized 52 byte log entry
0709 12:11:17.687003 (+645657us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:17.733591 (+ 46588us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.733871 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.733965 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.901291 (+167326us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:17.903671 (+  2380us) raft_consensus.cc:1685] finished
0709 12:11:17.903767 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.903952 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377352,"prepare.queue_time_us":68275,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":185973,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":29397,"spinlock_wait_cycles":25032576,"thread_start_us":601791,"threads_started":1,"wal-append.queue_time_us":785576}
I20260709 12:11:18.152699 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:18.168462 11135 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 12:11:18.171126 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.178185 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.179095 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:18.187562 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:18.189121 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:18.189677 11286 raft_consensus.cc:2410] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:18.189764 11137 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.080672 15200 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.204000 11141 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:18.155324 15255 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.181818 15245 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.170424 15039 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:18.181450 15244 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.209020 15248 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.244311 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:18.235085 11144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.011s	sys 0.014s
I20260709 12:11:18.170584 15249 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.195438 15187 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.209275 15250 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.208920 15275 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:18.252179 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:18.245389 11144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.011s	sys 0.014s
I20260709 12:11:18.207684 15237 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.232471 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:18.214382 15170 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.261260 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.262588 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.263044 11139 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:18.263309 11210 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:18.266175 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.266182 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.266793 11212 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:18.267620 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:18.208566 15213 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:18.269200 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:18.276425 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.221256 15281 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:18.212594 15035 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:11:18.271667 11137 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:18.270294 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.253808 15199 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.280395 11212 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:18.279951 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.285346 11135 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:18.285590 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.251914 15187 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.283902 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.281709 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.287511 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.288586 11211 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:18.292778 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.293349 11212 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
W20260709 12:11:18.273116 14932 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:11:18.239248 15245 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.241274 15255 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.272092 15237 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.243340 15039 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.297854  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:18.319150 11211 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.249012 15244 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.288707 15187 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.285645 15278 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.272753 15047 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.253260 15248 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.273676 15275 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.329312 15275 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.255899 15249 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.334051 15249 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.317569 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.281205 15208 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.302664 15142 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:18.268450 15250 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:18.291968 15274 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.325716 11141 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:18.326316  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:18.326453 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:18.327291 15309 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:11:18.328135 15039 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.328301 15244 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.328661 11219 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:18.359752 11853 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:18.414501 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.321458 14904 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.375097 15296 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.449151 15155 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.449761 15275 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.450608 15245 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.451839 15255 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.453491 15262 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.454814 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2016) took 1331 ms. Trace:
I20260709 12:11:18.434476 15250 consensus_queue.cc:1243] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:18.461179 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:18.430269 14485 consensus_meta.cc:287] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.887s	user 0.016s	sys 0.004s
I20260709 12:11:18.451861 15248 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.468902 11144 rpcz_store.cc:276] 0709 12:11:17.123108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.541175 (+418067us) service_pool.cc:224] Handling call
0709 12:11:17.560090 (+ 18915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.578611 (+ 18521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.578658 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.579304 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.253130 (+673826us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.253179 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.253244 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.454625 (+201381us) raft_consensus.cc:1685] finished
0709 12:11:18.454643 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.454760 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17988,"raft.queue_time_us":18402,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":673387,"threads_started":1,"wal-append.queue_time_us":729480}
I20260709 12:11:18.470304 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.479158  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:18.479470 15243 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:18.479956 15243 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:18.480856 15243 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.483073 15009 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.487561 15271 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.493825 14764 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.495893 15130 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:18.500406 15297 consensus_meta.cc:287] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.643s	user 0.017s	sys 0.000s
I20260709 12:11:18.501799 15244 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:18.502480 15298 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:18.505481 15294 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.003s
I20260709 12:11:18.377187 15142 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.527230 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:18.536643 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 304255us
I20260709 12:11:18.537858 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:18.528584 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 309878us
I20260709 12:11:18.542243 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:18.544472 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:18.529284 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 341775us
I20260709 12:11:18.507793 15245 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.547852 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:18.549743 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.558393 11286 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
W20260709 12:11:18.558830 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 367712us
I20260709 12:11:18.562234 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 711) took 1767 ms. Trace:
I20260709 12:11:18.521970 15244 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:18.527994 15298 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:18.562700 11142 rpcz_store.cc:276] 0709 12:11:16.791603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.508482 (+716879us) service_pool.cc:224] Handling call
0709 12:11:17.508887 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.509319 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.509358 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.509976 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.694727 (+184751us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:17.694777 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.694852 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.559019 (+864167us) raft_consensus.cc:1685] finished
0709 12:11:18.559045 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.559201 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1735,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":184298,"threads_started":1,"wal-append.queue_time_us":542003}
I20260709 12:11:18.516209 14485 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.567459 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:18.562361 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:18.573217 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:18.547181 14750 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.545704 15200 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.548473 15208 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.548314 15243 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:18.577425 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.563369 15275 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.607015 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:18.567209 15199 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.563395 15009 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:18.615382 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73638.9us
I20260709 12:11:18.618358 11210 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.619952 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:18.600265 15024 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.805s	user 0.013s	sys 0.008s
I20260709 12:11:18.528338 15297 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:18.614189 15241 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.745s	user 0.014s	sys 0.004s
I20260709 12:11:18.624643 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:18.605258 15143 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.697s	user 0.019s	sys 0.003s
I20260709 12:11:18.643488 15143 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.646067 15143 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.629283 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:18.631861 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:18.547780 15294 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.632781 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:18.569330 14834 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.722s	user 0.045s	sys 0.037s
I20260709 12:11:18.579830 15213 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:18.633409 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 373339us
I20260709 12:11:18.669587 15241 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.706116 15241 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:18.635151 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61984.8us
I20260709 12:11:18.706949 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:18.622664 15209 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.007s
I20260709 12:11:18.610116 15261 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.646864 11215 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:18.653891 15229 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.011s
I20260709 12:11:18.654645 15249 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.654291 15208 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:18.659308 15298 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.630820 15009 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.564927 15248 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.562747 15245 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.686885 11861 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.687645 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:18.567106 15274 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 12:11:18.698891 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66187.7us
I20260709 12:11:18.712213 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:18.715739 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.723261 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:18.725776 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.766884 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:18.714929 15278 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:11:18.728070 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.729095 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.713168 14834 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.729374 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.729653 15275 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.726155 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.698349 14457 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.732969 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.734311 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:18.714787 15289 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.658s	user 0.005s	sys 0.001s
W20260709 12:11:18.714942 15235 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.847s	user 0.009s	sys 0.012s
I20260709 12:11:18.708195 15225 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.746805 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.702256 15213 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.633570 15199 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.636108 15024 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.731472 15229 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.720835 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:18.743165 15261 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.663090 15244 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.773998 15135 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.768299 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:18.766137 11219 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:18.731983 15338 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.748008 15009 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.774580 11215 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:18.724610 15209 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.777735 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:18.780941 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.781019 11293 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:18.782323 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:18.773814 15339 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:18.767998 15298 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.783254 15225 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.788426 15213 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.795454 11136 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.726752 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.826553 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.795729 11213 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:18.828105 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.747468 15249 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.830931 14764 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:18.832059 15327 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:11:18.726117 15330 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:18.833178 15330 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.833564 15330 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.833889 15330 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.835089 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:18.835322 15326 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:11:18.838119 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.795966 15321 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:18.838768 11139 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:18.839042 15321 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.839668 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:18.840787 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.841564 15321 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.816979 11216 raft_consensus.cc:2368] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11.
I20260709 12:11:18.756705 15248 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.785449 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.843863 14834 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.844204 11218 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:18.845592 15338 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.846202 15338 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.846886 15209 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.847714 11140 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:18.849152 15245 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.849382 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2030) took 1052 ms. Trace:
I20260709 12:11:18.849884 11140 rpcz_store.cc:276] 0709 12:11:17.797486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.797755 (+   269us) service_pool.cc:224] Handling call
0709 12:11:18.849169 (+1051414us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540032f5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:18.849281 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410164608}
I20260709 12:11:18.818787 15142 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.804926 15296 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:18.819409 15271 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:18.821480 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:18.806423 11135 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:18.841457 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:18.852062 15160 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.952s	user 0.013s	sys 0.007s
I20260709 12:11:18.824187 15135 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:18.852807 15294 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.781091 15275 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.823197 15208 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.857048 15297 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.857666 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.858831 14485 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.859339 15024 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:18.860307 15199 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:18.784077 14457 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:18.787803 15235 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:18.861357 15333 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:11:18.861963 11287 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:18.817307 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.939700 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:18.870113 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:18.842028 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.941193 11139 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:18.814339 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 102231us
W20260709 12:11:18.885223 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 116961us
I20260709 12:11:18.798977 15337 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:18.888145 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:18.894652 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.897775 11141 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:18.951531 11141 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.899030 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:18.951817 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.952349 11853 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:18.899149 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.900116 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.905966 11136 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:18.956666 11136 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.910372 15271 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:18.913584 15229 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:18.887280 15207 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.933s	user 0.015s	sys 0.002s
I20260709 12:11:18.918130 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.945369 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:18.932667 15347 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:11:18.969605 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.970603 11218 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:18.933524 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.934744 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:18.943804 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:18.826702 15225 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.960492 11135 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:18.918538 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.972582 11217 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.974642 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:18.963587 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:18.976365 11291 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.910007 11852 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.963703 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.965106 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.963725 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:18.968837 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:18.979264 11858 raft_consensus.cc:2368] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:18.906347 15160 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:18.905966 15321 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:18.991470 11292 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:18.979925 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91882.2us
I20260709 12:11:18.977958 11211 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:18.994146 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:18.980852 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:18.996928 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:18.986161 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:18.998446 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:19.004492 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:19.007170 11141 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:19.007668 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:19.012735 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:19.016803 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:19.018903 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:19.019876 11291 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:19.020569 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:18.919046 15213 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.031083 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 613) took 1239 ms. Trace:
I20260709 12:11:19.032326 11218 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:19.032356 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 614) took 1239 ms. Trace:
I20260709 12:11:19.027081 15255 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.040786 15255 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.041185 15255 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.042362 15249 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:18.975100 15207 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:19.043591 15187 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
I20260709 12:11:19.044072 15187 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.045658 15207 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:19.009745 15297 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:19.027230 15331 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.046958 15297 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:19.047262 15331 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:19.047670 15331 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.047526 15135 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.051887 15271 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.054188 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2419) took 1249 ms. Trace:
I20260709 12:11:19.054610 11289 rpcz_store.cc:276] 0709 12:11:17.804849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.818081 (+ 13232us) service_pool.cc:224] Handling call
0709 12:11:17.854885 (+ 36804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.855289 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.855332 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.148772 (+293440us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.475162 (+326390us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:18.475220 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.475310 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.860649 (+385339us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:19.053893 (+193244us) raft_consensus.cc:1685] finished
0709 12:11:19.053919 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.054127 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12272,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":9485184,"thread_start_us":257861,"threads_started":1,"wal-append.queue_time_us":514205}
I20260709 12:11:19.057009 15160 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:19.058148 15348 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:11:19.059401 15349 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:11:19.059854 14457 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.009780 15209 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.031548 11216 rpcz_store.cc:276] 0709 12:11:17.792175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.792330 (+   155us) service_pool.cc:224] Handling call
0709 12:11:19.030834 (+1238504us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54000e79d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:19.031007 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2252909952}
I20260709 12:11:19.013525 15294 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.069801 11212 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.000174 14998 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.070783 14998 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.071133 14998 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.071653 11142 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:19.075727 11286 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:19.080130 15321 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.080608 15321 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:19.081532 15321 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.083359 15321 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.085983 15213 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:19.047950 15297 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.032922 11213 rpcz_store.cc:276] 0709 12:11:17.792657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.792810 (+   153us) service_pool.cc:224] Handling call
0709 12:11:19.032164 (+1239354us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54001d4054. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:19.032294 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971979136}
I20260709 12:11:19.089046 11290 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:19.094579 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:19.096956 11859 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:18.974773 15355 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.046196 15187 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:19.099150 11852 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:19.099198 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 179843us
I20260709 12:11:19.101176 11107 leader_election.cc:400] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:19.057694 15330 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.106019 11107 leader_election.cc:403] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:19.108827 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:19.109402 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:19.109969 11860 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.024151 15274 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:19.112803 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118787us
I20260709 12:11:19.009310 15245 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.112224 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:19.027805 15262 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:19.111073 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.087361 15244 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:19.120987 15249 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:19.121462 15208 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:19.122826 15187 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.123241 15187 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:19.124038 15187 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.126379 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:19.127874 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:19.130596 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:19.130705 15296 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.131258 15345 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:11:19.114075 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:19.133270 11287 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
W20260709 12:11:19.133692 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 126124us
I20260709 12:11:19.114562 11210 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:19.116233 11853 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:19.131253 11292 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.143288 15345 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:19.146166 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:19.149897 11292 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:19.122063 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 101684us
I20260709 12:11:19.150146 15345 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.155040 15345 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:19.155812 15345 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.113308 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:19.158054 11286 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.166580 11288 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:11:19.167132 11288 pending_rounds.cc:85] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 7
I20260709 12:11:19.167383 11288 pending_rounds.cc:107] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:11:19.167621 11288 raft_consensus.cc:2889] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.151420 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:19.111749 15344 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 12:11:19.103120 15294 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:18.962582 15337 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.185405 11144 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:19.177968 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57729.6us
I20260709 12:11:19.171604 15354 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.180541 15235 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.119352 15160 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.115257 15213 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
W20260709 12:11:19.182513 15353 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:19.173432 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:19.183465 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:19.102139 15355 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:19.184294 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 73329.2us
I20260709 12:11:19.119735 15009 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.196113 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:19.193528 15338 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.245429 15338 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.187907 15296 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.193672 11286 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:19.170463 15345 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.246601 11293 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:19.173521 15262 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:19.178774 15199 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:11:19.197111 15255 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.213107 15294 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.187600 15354 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:19.197111 15225 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.224999 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:19.226933 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.118396 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:19.227564 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:19.220153 14998 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.229180 11860 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:11:19.229571 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46190.8us
I20260709 12:11:19.228607 11214 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:19.231503 15332 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:19.232000 15330 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:19.232335 15289 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:19.232262 15024 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:19.233359 15331 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.236806 15160 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:19.238551 15335 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.240758 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.245491 15009 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:19.174253 15316 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.250295 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54257.9us
I20260709 12:11:19.212111 15275 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.220463 15337 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:19.386839 11291 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:19.388217 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.451004 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:19.241616 15355 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.312695 11031 maintenance_manager.cc:419] P 77709ed97aed432192038c6d22f779bc: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033401
I20260709 12:11:19.251928 15262 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.447958 15047 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:19.253849 15298 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:19.420609 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 195653us
I20260709 12:11:19.428225 11285 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.433153 15330 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:19.434370 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 193719us
I20260709 12:11:19.442745 14485 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.451150 15294 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.389842 15354 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.465132 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:19.470685 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.433012 15338 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:19.431638 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 313453us
I20260709 12:11:19.482105 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:19.482251 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:19.488692 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.364073 15296 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:19.448362 15331 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:19.433166 15335 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:19.546988 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59730us
I20260709 12:11:19.464643 14905 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.445708 15356 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.596437 11138 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:19.586198 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 121138us
I20260709 12:11:19.608049 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:19.598789 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 110187us
I20260709 12:11:19.610136 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.585147 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:19.584172 11291 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:19.584103 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:19.596877 15289 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:19.623003 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.683365 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:19.683365 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:19.477432 15130 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:11:19.683887 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:19.686352 15207 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.686571 15298 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:19.684932 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 100908us
I20260709 12:11:19.685129 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:19.583477 15338 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:19.688920 11143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.041s	sys 0.038s
I20260709 12:11:19.548092 15249 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:11:19.604970 14485 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:11:19.731374 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45379.9us
I20260709 12:11:19.605159 15047 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:19.609485 15364 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:11:19.448966 15160 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.584545 15237 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:11:19.548786 15330 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.611474 15335 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.609884 15356 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:19.718432 11144 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.691747 15142 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:19.723263 11143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.041s	sys 0.038s
I20260709 12:11:19.690670 15294 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:19.610159 15296 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.702605 15278 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.691241 15331 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:19.715394 15309 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.112s	user 0.000s	sys 0.014s
I20260709 12:11:19.710105 15213 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:19.762892 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 140012us
I20260709 12:11:19.780947 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.731045 15332 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.728404 15342 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:11:19.787050 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.786871 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.790675 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:19.744406 15142 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:19.763887 15356 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.777971 15255 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:19.788290 15249 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.783242 15225 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.805505 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:19.797021 15047 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:19.808732 15365 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:11:19.768465 15294 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.782977 15331 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.776168 15278 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.788339 15213 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.811651 15244 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:19.833534 15360 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.770s	user 0.061s	sys 0.052s
I20260709 12:11:19.848879 11135 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:11:19.827536 15255 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:19.785662 15338 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:19.851016 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133388us
I20260709 12:11:19.857501 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:19.883764 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:19.853917 15142 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:19.890002 15331 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:19.891669 15375 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:19.885342 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79935.8us
W20260709 12:11:19.893055 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 286738us
I20260709 12:11:19.893922 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:19.894851 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.895255 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:19.895293 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:19.896274 11288 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.449155 15316 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:19.900738 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2684) took 1171 ms. Trace:
W20260709 12:11:19.884150 15321 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.800s	user 0.007s	sys 0.006s
I20260709 12:11:19.854558 15255 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:19.915757 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:19.993358 11293 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:11:19.963666 15369 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:11:19.856276 15187 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.050103 11139 rpcz_store.cc:276] 0709 12:11:18.729330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.952717 (+223387us) service_pool.cc:224] Handling call
0709 12:11:18.952997 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.953313 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.953339 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.953746 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.120625 (+166879us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:19.120666 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.120727 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.900475 (+779748us) raft_consensus.cc:1685] finished
0709 12:11:19.900506 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.900664 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3372,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"thread_start_us":166605,"threads_started":1,"wal-append.queue_time_us":465277}
I20260709 12:11:19.996639 11288 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:20.053601 11144 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:11:20.025967 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 45031.3us
W20260709 12:11:19.943673 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 208629us
I20260709 12:11:19.876431 15296 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:19.979106 15213 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:19.946096 15366 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:11:19.896409 15338 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:19.858325 15362 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:11:19.901338 15342 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.860654 15337 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:19.897145 15225 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.124858 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 196283us
I20260709 12:11:20.048161 14905 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.941056 15329 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.919142 15024 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.897511 15375 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.092849 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:19.968499 15341 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.894s	user 0.005s	sys 0.018s
W20260709 12:11:20.123980 15274 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.991s	user 0.012s	sys 0.000s
I20260709 12:11:20.158871 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 739) took 1166 ms. Trace:
I20260709 12:11:20.159644 11143 rpcz_store.cc:276] 0709 12:11:18.992852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.069432 (+ 76580us) service_pool.cc:224] Handling call
0709 12:11:19.069757 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.070094 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.070119 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.091608 (+ 21489us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.745344 (+653736us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:19.745419 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.745522 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.158569 (+413047us) raft_consensus.cc:1685] finished
0709 12:11:20.158599 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.158788 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16582,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":95,"thread_start_us":571472,"threads_started":1,"wal-append.queue_time_us":691501}
I20260709 12:11:19.981379 15294 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.902456 14998 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:19.991865 15345 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.106396 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:20.171324 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51411.1us
W20260709 12:11:20.171931 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65626.7us
I20260709 12:11:20.107437 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:20.058377 15248 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:20.172734 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:20.173429 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 66067.8us
I20260709 12:11:20.060827 15255 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.111083 11136 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:19.981770 15371 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:11:20.115192 15379 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:20.117654 15316 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.119616 14834 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:20.121102 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.188606 11142 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.121641 15213 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.089725 15244 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.900991 15331 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
W20260709 12:11:20.084661 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 184808us
I20260709 12:11:20.062299 15330 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.124579 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:20.025308 15047 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.123580 15278 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.205960 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.207549 11288 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:20.207687 11142 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:20.101830 15229 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:20.176851 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:20.164413 15274 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.110455 15354 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.128973 15225 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.122393 15356 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.127486 15337 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:20.188824 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96055.9us
I20260709 12:11:20.222123 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:20.192405 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66465.4us
I20260709 12:11:20.223843 15337 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.139874 15329 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.225867 15329 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:20.226174 15381 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:11:20.227164 15380 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:20.228201 15356 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.213613 15278 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.230252 15278 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.232546 15278 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:20.204154 15213 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.235733 15213 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.204474 15244 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:20.236964 15377 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:11:20.209444 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.239835 11291 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:20.176019 15296 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.168890 15375 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:11:20.216033 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.251912 11292 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
W20260709 12:11:20.222370 15373 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:20.230674 11140 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.241988 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.214391 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.180079 15294 raft_consensus.cc:2764] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:20.245332 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.245216 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.259900 11139 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:20.260229 11286 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:20.180713 15024 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.249894 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.250548 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.260159 11136 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.269354 11291 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:20.253809 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.269801 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.261003 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.267396 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.236965 15244 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.275592 11138 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:20.239363 14750 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.215265 15330 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:20.303593 14932 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:20.214284 15047 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.251322 15213 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.293378 15024 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.303120 15330 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.290545 11136 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:20.309404 15384 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.325565 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.326228 11214 pending_rounds.cc:85] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 10
I20260709 12:11:20.326241 11210 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.326646 11214 pending_rounds.cc:107] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:20.326951 11214 raft_consensus.cc:2889] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.330951 11215 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:20.304119 14932 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:20.332710 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.333272 11213 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.329905 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.265283 15296 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:20.343751 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.331966 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.358016 11216 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:20.361255 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.267567 14457 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:11:20.318005 15225 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.321590 15294 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.321542 14750 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:20.386127 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 209346us
I20260709 12:11:20.324055 15213 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.359947 15024 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:20.335176 15384 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.398898 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.403019 11213 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
W20260709 12:11:20.406312 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 139915us
I20260709 12:11:20.408262 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:20.409132 11210 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:20.409737 11826 leader_election.cc:400] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11.
I20260709 12:11:20.410463 11826 leader_election.cc:403] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.413074 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:20.404404 15335 consensus_meta.cc:287] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.006s
I20260709 12:11:20.389488 15261 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:20.411782 15278 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.417652 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:20.418067 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.415668 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.418848 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.374998 15294 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.419453 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.420563 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.422708 11213 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:20.422854 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.420692 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.423573 11212 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:20.423979 11218 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:20.425297 11211 raft_consensus.cc:2368] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:20.419956 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.426312 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.427714 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.428197 11218 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.432186 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.432884 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.433305 11136 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.427438 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.414830 14457 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.415410 15225 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:20.453534 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2432) took 1428 ms. Trace:
I20260709 12:11:20.468114 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.468788 11216 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:20.467882 11285 rpcz_store.cc:276] 0709 12:11:19.024874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.025027 (+   153us) service_pool.cc:224] Handling call
0709 12:11:19.025323 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.480809 (+455486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.453201 (+972392us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400060ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:20.453447 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926174080}
I20260709 12:11:20.470083 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.470083 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:20.478049 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.434634 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:20.490674 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.496886 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.497993 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.499464 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.500016 11292 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.507289 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.509820 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.511345 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:20.444892 15351 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.395s	user 0.009s	sys 0.016s
I20260709 12:11:20.512226 11288 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
W20260709 12:11:20.463580 15262 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.983s	user 0.007s	sys 0.005s
W20260709 12:11:20.459234 15358 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.384s	user 0.000s	sys 0.012s
I20260709 12:11:20.459646 15009 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.445606 15130 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:20.450598 15386 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.457480 15330 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.465929 15154 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.531909 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:20.420621 15385 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.513296 11213 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:20.532982 11136 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:20.535776 11218 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:20.570452 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.571882 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.573072 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.573699 11218 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.536440 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.575559 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.576862 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.537101 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.580106 11216 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.581671 11216 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.537489 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.451884 15213 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.409730 14932 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.456637 15354 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.455545 15047 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.540243 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.422079 15335 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.506758 15261 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.459250 15024 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.543543 15294 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.434608 15342 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:20.590088 15342 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.493484 15329 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.493213 15337 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:20.595788 15337 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.598019 15337 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.421000 15296 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.435884 14750 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.603614 11218 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:20.538312 15262 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.609257 15262 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:20.492919 15274 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.611004 15274 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.613737 15274 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:20.544939 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 130071us
I20260709 12:11:20.506597 15345 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:20.561129 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76479.4us
I20260709 12:11:20.514430 15271 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:20.585419 11216 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:20.578140 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.424808 15389 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 12:11:20.586464 11142 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.540732 15009 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:20.591367 15329 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:20.493119 15356 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:20.542958 15130 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:20.616765 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 75247.1us
I20260709 12:11:20.644642 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.645780 11285 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 5.
I20260709 12:11:20.628590 11861 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.629987 11854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 436) took 1924 ms. Trace:
W20260709 12:11:20.619361 15395 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:11:20.639550 15154 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:20.587500 15385 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:20.621747 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.649144 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.566227 14998 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:11:20.646665 11854 rpcz_store.cc:276] 0709 12:11:18.705138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.705288 (+   150us) service_pool.cc:224] Handling call
0709 12:11:18.705715 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.706112 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.706143 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.706666 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.805131 (+ 98465us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.805175 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.805268 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.444040 (+1638772us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:20.624838 (+180798us) raft_consensus.cc:1685] finished
0709 12:11:20.624863 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.629905 (+  5042us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1626,"raft.queue_time_us":2579,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9647,"spinlock_wait_cycles":87839616,"thread_start_us":97890,"threads_started":1,"wal-append.queue_time_us":293917}
I20260709 12:11:20.657835 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2050) took 1175 ms. Trace:
I20260709 12:11:20.622682 15274 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:20.658987 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.663884 11290 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.632998 15330 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.661341 11135 rpcz_store.cc:276] 0709 12:11:19.482430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.624946 (+142516us) service_pool.cc:224] Handling call
0709 12:11:20.657650 (+1032704us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003e8854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:20.657774 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316673792}
I20260709 12:11:20.662480 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.664119 11285 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
W20260709 12:11:20.668555 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46981.3us
I20260709 12:11:20.674073 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:20.674798 11285 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.676736 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:20.680049 11289 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:20.680721 15386 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:20.688760 15130 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.689531 15384 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.690236 15130 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.681241 15354 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.654146 15356 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.630818 15271 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.696991 15024 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:20.695418 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.698523 15356 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.698879 11135 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:20.631697 15262 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:11:20.686372 15338 consensus_meta.cc:287] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.001s
I20260709 12:11:20.695138 15354 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.700831 11143 raft_consensus.cc:2410] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:20.629344 15345 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.701733 15354 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.697726 15271 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.699999 15262 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:20.703470 15262 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:20.704430 15262 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.704489 15154 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.705987 15262 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.707854 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.708731 11286 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:20.710048 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.711110 11289 raft_consensus.cc:2410] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:20.711963 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.703359 15345 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.715408 15329 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:20.642799 15261 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:20.716478 15261 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:20.716881 15261 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:20.717548 15024 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.718365 15244 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.720010 11284 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:20.663713 14457 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11.
W20260709 12:11:20.728920 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 197087us
I20260709 12:11:20.672188 15187 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.654282 15389 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:11:20.650800 15200 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:20.678465 15225 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.734684 15009 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:20.735718 15355 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.247s	user 0.012s	sys 0.001s
I20260709 12:11:20.732026 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.720000 15024 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.748977 11285 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:20.672509 15274 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.759475 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:20.758656 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.754294 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:20.759248 15345 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.761775 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:20.766813 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113857us
I20260709 12:11:20.757467 15355 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.734753 15408 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:20.778352 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.779090 11142 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.781373 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.782570 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.783355 11290 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:20.783614 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.784317 11218 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:20.784916 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.785935 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:20.756165 15337 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.792128 15354 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.786726 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.792824 11135 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:20.767735 15009 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.793275 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:20.794319 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:20.750174 15187 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.826844 11144 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:20.794186 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.827219 11219 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.798805 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.793246 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2046) took 1312 ms. Trace:
I20260709 12:11:20.768312 15271 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:20.845059 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51877.8us
I20260709 12:11:20.845839 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:20.849661 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.848634 11137 rpcz_store.cc:276] 0709 12:11:19.481254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.481360 (+   106us) service_pool.cc:224] Handling call
0709 12:11:19.584239 (+102879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.800493 (+216254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.800540 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.801123 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:11:19.993499 (+192376us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:19.993530 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.771344 (+777814us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400263754. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:20.782615 (+ 11271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.782664 (+    49us) raft_consensus.cc:1685] finished
0709 12:11:20.782676 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.793161 (+ 10485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496617216,"thread_start_us":191942,"threads_started":1,"wal-append.queue_time_us":327077}
I20260709 12:11:20.832206 11142 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:20.791569 15408 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.851120 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.851688 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:20.846194 11290 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:20.852121 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.831046 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.855793 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.853564 15408 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.873920 14998 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.874418 14998 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:20.875262 14998 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.875653 15355 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.792322 15413 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:20.866979 15403 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:20.867985 15024 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.869197 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.792521 15335 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:20.828963 15409 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.880183 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:20.799621 15244 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:20.852335 11142 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.826066 15329 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.794381 15354 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.800500 15200 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:20.795529 15274 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.827883 15345 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:20.851096 15235 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.846771 15386 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.890267 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.911636 15354 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.892856 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65149.6us
I20260709 12:11:20.893934 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.878823 15187 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:20.851039 15271 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.854517 15389 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.802841 15337 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.913844 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.911979 15200 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:20.902601 14905 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.917806 15409 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:20.918668 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.986668 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:20.986868 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:20.920481 15392 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:20.921512 15154 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.768919 15385 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:20.930998 11137 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.933523 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.984302 11213 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:20.989209 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:20.990674 11142 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:20.994963 11853 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:20.995036 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:20.996824 11219 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
W20260709 12:11:20.998780 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65330.1us
W20260709 12:11:20.999275 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.000427 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:20.987059 15255 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.804s	user 0.010s	sys 0.003s
I20260709 12:11:21.002362 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.003029 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.003276 11859 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:21.004120 11218 raft_consensus.cc:2410] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:21.001395 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:20.949616 15200 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:20.963021 15413 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.942790 15244 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:21.027889 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:20.940510 15405 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.033143 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.034910 15187 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:21.035388 15397 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.434s	user 0.002s	sys 0.002s
I20260709 12:11:21.035816 15187 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.037334 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.038473 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.039749 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.040468 11217 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:21.041155 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.041446 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2045) took 1560 ms. Trace:
I20260709 12:11:20.926424 15408 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.006767 11110 leader_election.cc:400] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:21.006640 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:21.006693 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:20.934603 15271 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:20.948287 15225 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:21.005318 15274 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.019987 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:21.020292 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.020547 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.023950 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.360210 11212 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:21.360476 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.360486 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:21.361181 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.361826 11215 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:21.361784 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.362560 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.362951 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.362862 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.363807 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:21.242408 15421 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:21.203738 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.079816 15244 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.365875 11215 raft_consensus.cc:2376] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13. Re-sending same reply.
I20260709 12:11:21.367347 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:21.368316 15244 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.369199 15244 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.369771 15244 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.016331 15261 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.276901 11292 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:21.231900 15354 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.324680 15337 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.210655 15200 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.272822 15248 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.160202 11856 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:20.927222 15345 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.025170 15338 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:21.137121 15417 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.113s	user 0.000s	sys 0.005s
I20260709 12:11:21.125315 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:20.998343 15392 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:20.985944 15130 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:21.144830 11852 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:21.175765 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.440944 11217 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:21.134378 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:21.156666 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 208074us
I20260709 12:11:21.041990 11140 rpcz_store.cc:276] 0709 12:11:19.480957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.484553 (+  3596us) service_pool.cc:224] Handling call
0709 12:11:19.485633 (+  1080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.265067 (+779434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.041103 (+776036us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54002544d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:21.041348 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712893312}
I20260709 12:11:21.125759 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:21.060362 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.166950 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:21.445492 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 278668us
I20260709 12:11:21.446719 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:20.936388 15329 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.007743 15255 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.078320 15413 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.477476 15413 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.291996 15331 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.478227 15331 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:21.479321 15331 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.480778 15331 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.481824 11211 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:21.305431 15342 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.296237 15009 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.484967 15389 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:21.485734 15009 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.488273 15009 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:21.334131 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.489267 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.490753 11143 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:21.173146 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.492044 15345 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.492342 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.209379 15355 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.493309 11143 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:21.494052 15329 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.493803 15355 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.273464 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.001134 15154 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.173152 15297 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.339344 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:21.340366 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 333723us
I20260709 12:11:21.343437 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:21.348758 11144 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:21.505250 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:21.358060 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:21.294691 15408 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.365203 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:21.203137 15330 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:21.370923 15225 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.373914 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:21.356666 15296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.017s	sys 0.002s
I20260709 12:11:21.426884 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.426589 15248 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.436245 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.449976 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.452098 11135 raft_consensus.cc:2410] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:11:21.452620 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 327026us
I20260709 12:11:21.520181 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.332790 15405 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.455021 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:21.525339 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:21.526180 11286 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.461709 15429 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:21.469274 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.470125 15426 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:11:21.472041 11140 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:21.533797 11140 pending_rounds.cc:85] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:11:21.534106 11140 pending_rounds.cc:107] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:11:21.534406 11140 raft_consensus.cc:2889] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.472967 11137 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:21.488284 15255 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.537205 11137 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.474763 15135 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:21.474929 14998 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:21.275921 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:21.515321 15330 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.495502 11292 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:21.547657 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:21.548314 11213 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.549007 11292 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.488507 11287 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:21.502028 11141 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:11:21.550556 11141 pending_rounds.cc:85] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:11:21.550845 11141 pending_rounds.cc:107] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:21.551151 11141 raft_consensus.cc:2889] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.506546 11219 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:11:21.508087 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 142911us
I20260709 12:11:21.504829 11138 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:21.511711 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:21.555943 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44367.1us
I20260709 12:11:21.514637 11144 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.459631 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:21.529413 11858 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:21.507484 15009 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.518931 15338 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.535712 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:21.530179 11289 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:21.507308 15297 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:21.519110 15296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.017s	sys 0.002s
I20260709 12:11:21.522257 15274 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.539490 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.563719 11211 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:21.531860 15235 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.569722 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:21.597108 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:21.597818 11284 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:21.571969 11292 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:21.569084 11140 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:21.556962 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:21.579599 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:21.580749 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49492.7us
I20260709 12:11:21.600039 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:21.586938 11289 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:21.601406 11289 pending_rounds.cc:85] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 5
I20260709 12:11:21.601687 11289 pending_rounds.cc:107] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:21.601913 11289 raft_consensus.cc:2889] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.587427 11286 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
W20260709 12:11:21.591285 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53542.7us
I20260709 12:11:21.603624 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:21.604772 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.547071 15419 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.595372 11288 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:11:21.546923 14998 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.610468 11213 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:21.562215 15329 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.529307 15408 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:11:21.568650 15338 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:21.568274 15229 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:21.611327 15255 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.621234 15296 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:21.616904 15429 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:21.647900 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85532.9us
I20260709 12:11:21.657444 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.621971 14998 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.580318 15009 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.623823 15345 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:21.662444 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.577507 15427 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:11:21.672788 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:21.621034 15047 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:11:21.676591 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71888.7us
I20260709 12:11:21.636354 15338 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.624912 15337 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:21.615515 15316 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:11:21.704977 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 156528us
I20260709 12:11:21.675105 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.696375 15248 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.645632 15412 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.700436 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.701882 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:21.625571 15274 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:21.709054 15355 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.710237 11855 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:21.710858 15337 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:21.625082 15431 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:11:21.688943 15329 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.687331 14750 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.656441 14905 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:11:21.712352 15271 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.721237 15423 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.713932 15412 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:21.720336 15244 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:21.715062 15354 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.743322 15423 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:21.752094 15392 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:21.759485 15412 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.760860 15405 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.758215 15429 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:21.765084 15429 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.768337 15423 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.769860 15423 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.813594 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:20.670241  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:21.677258 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78517.7us
W20260709 12:11:21.823887 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 223250us
I20260709 12:11:21.828816 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:21.829447 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2062) took 1049 ms. Trace:
I20260709 12:11:21.836464 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1773) took 1421 ms. Trace:
I20260709 12:11:21.837014 11210 rpcz_store.cc:276] 0709 12:11:20.415071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.415355 (+   284us) service_pool.cc:224] Handling call
0709 12:11:21.835858 (+1420503us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54003c41d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:21.836169 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153508608}
I20260709 12:11:21.834750 11135 rpcz_store.cc:276] 0709 12:11:20.779570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.827115 (+ 47545us) service_pool.cc:224] Handling call
0709 12:11:21.828868 (+1001753us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54001176d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:21.829182 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359747328}
I20260709 12:11:21.831050 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 741) took 1722 ms. Trace:
I20260709 12:11:21.840059 11139 rpcz_store.cc:276] 0709 12:11:20.107991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.108868 (+   877us) service_pool.cc:224] Handling call
0709 12:11:20.109239 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.260422 (+151183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.830360 (+1569938us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002c1854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:21.830816 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345953664}
W20260709 12:11:21.851995 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.860493 11293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1812) took 1654 ms (client timeout 1816 ms). Trace:
W20260709 12:11:21.861114 11293 rpcz_store.cc:269] 0709 12:11:20.205513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.205692 (+   179us) service_pool.cc:224] Handling call
0709 12:11:21.859867 (+1654175us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54004191d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:21.860211 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3191707520}
W20260709 12:11:21.865183 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 164702us
I20260709 12:11:21.875108 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.875510 11861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 923) took 1894 ms. Trace:
I20260709 12:11:21.875941 11861 rpcz_store.cc:276] 0709 12:11:19.980450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.981062 (+   612us) service_pool.cc:224] Handling call
0709 12:11:19.981450 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.646400 (+664950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.874883 (+1228483us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400463054. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:21.875262 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487884032}
I20260709 12:11:21.880714 15009 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:21.737664 14750 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:21.882764 15298 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:21.883397 14750 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.884608 15160 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:21.883035 15154 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.887097 15244 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.888538 15244 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:21.891737 15225 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.728199 15274 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.896309 14905 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:21.889648 15244 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.897607 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:21.703486 15297 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:21.898633 15316 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:21.899144 15316 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:21.900144 15244 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.901094 15244 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.900938 15316 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.886439 15160 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:21.908449 15271 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:21.917588 15135 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.923074 15335 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:21.927448 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:21.751179 15337 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:21.880822 14485 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:21.897843 15274 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:21.917403 15330 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:22.019937 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 191579us
I20260709 12:11:22.003273 15274 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.025081 15422 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.495s	user 0.000s	sys 0.003s
W20260709 12:11:22.025614 15434 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:11:22.026110 15394 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.330s	user 0.005s	sys 0.003s
W20260709 12:11:22.041581 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.043519 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.043586 15235 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:22.065941 15316 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:22.073503 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.075692 15453 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:22.076210 15454 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:22.076736 15453 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.077102 15454 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:22.079178 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 348493us
I20260709 12:11:22.080181 15135 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:22.081107 15135 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:11:22.073387 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 175997us
I20260709 12:11:22.082876 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:22.084154 15464 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.085719 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:22.053702 15235 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:22.087747 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 261253us
I20260709 12:11:22.091612 15274 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.079108 15271 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:11:22.110352 15135 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:22.110946 15445 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.111450 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:22.113461 15392 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:22.114250 15384 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.114779 15376 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.114956 15384 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:22.115242 15376 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:22.116745 15384 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.120590 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 623) took 1794 ms. Trace:
I20260709 12:11:22.121022 14932 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.122572 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:22.123613 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63646.3us
I20260709 12:11:22.124210 14485 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:22.124949 14485 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.125440 14485 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.114281 15392 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:22.126931 15460 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:22.127707 15392 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.121348 11214 rpcz_store.cc:276] 0709 12:11:20.325490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.325720 (+   230us) service_pool.cc:224] Handling call
0709 12:11:20.326036 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.327437 (+  1401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.327458 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.327949 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.431937 (+103988us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:20.431993 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.432107 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.013884 (+581777us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:21.762628 (+748744us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b24000fd958. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2d09d 00007f983065f10e 00007f983067688c 00007f9830675bb6 00007f98306757d8 00007f983067f221
0709 12:11:22.119955 (+357327us) raft_consensus.cc:1685] finished
0709 12:11:22.120026 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.120299 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81894016,"thread_start_us":103648,"threads_started":1,"wal-append.queue_time_us":275606}
I20260709 12:11:22.055636 14750 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.127118 15446 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:22.132225 14750 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:22.132359 15345 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:22.134609 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.135775 15296 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:22.136296 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50841.5us
I20260709 12:11:22.137564 15330 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.139845 15338 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.116870 15376 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.143085 15345 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.146683 15296 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:22.151057 15298 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.151165 15454 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:22.155620 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.946s (SENT) [suppressed 15 similar messages]
I20260709 12:11:22.099624 15464 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:22.158704 15298 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:22.151785 15200 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:22.163453 15384 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.183542 15458 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:11:22.185922 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.187636 15153 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.188166 15153 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:22.183362 15296 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:22.189949 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.001s	sys 0.023s
I20260709 12:11:22.178881 14998 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.197593 14998 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:22.198593 15331 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.681s	user 0.017s	sys 0.009s
W20260709 12:11:22.199122 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.174124 15454 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.202610 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.002s	sys 0.023s
I20260709 12:11:22.208654 15296 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.210784 15297 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:22.204322 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 475517us
I20260709 12:11:22.218142 11292 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:11:22.223204 15465 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:11:22.225435 15345 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.229022 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:22.218003 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:22.233193 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 796) took 2009 ms. Trace:
I20260709 12:11:22.233637 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:22.236132 15427 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:22.236588 15427 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:22.236968 15427 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.237187 11861 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.238241 15261 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.239192 15453 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.239898 15453 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.221037 14998 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:22.242110 15274 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.247989 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.249329 11292 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:22.233649 11287 rpcz_store.cc:276] 0709 12:11:20.223742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.224261 (+   519us) service_pool.cc:224] Handling call
0709 12:11:20.224546 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.550068 (+1325522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.232577 (+682509us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540017f2d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:22.232921 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906405632}
I20260709 12:11:22.254819 15298 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.255803 14485 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.256702 15298 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.262794 15458 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.262897 15338 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.265304 15458 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.266805 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.267889 15458 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.244228 15153 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.271997 14485 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.272799 11285 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:22.274118 11291 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:22.261240 15454 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.274642 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:22.278549 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:22.278811 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:22.285413 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:22.295696 15467 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:11:22.296478 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62932.4us
I20260709 12:11:22.297461 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:22.302922 15331 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.303133 15009 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.303411 15331 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.303990 15331 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.304742 15456 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.306927 11287 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:22.216204 15429 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 12:11:22.310891 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:22.304255 15009 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.314007 15009 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:22.314714 15321 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.315287 15321 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.317579 15321 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.319419 14905 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.320160 14905 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.320865 15458 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:22.322707 15316 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.323202 15316 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:22.328346 15454 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:22.259894 15335 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:11:22.335552 15329 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.007s
I20260709 12:11:22.326591 14905 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.336225 15329 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.337278 15461 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.341172 11143 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.341147 15456 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.322319 15024 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:22.343322 15456 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.344331 15024 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.344775 15024 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:22.348425 11144 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:22.344013 15456 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:22.352685 15469 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:11:22.306192 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:22.338092 15461 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:22.362988 15456 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.366987 11135 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.365072 14457 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.394851 15409 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.395013 14457 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:22.395637 15409 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.396261 14457 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.397886 14457 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.398358 15431 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.401950 11135 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:22.371552 11136 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:22.403040 15431 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:22.403474 15431 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:22.404593 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.380364 15459 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:11:22.377807 15316 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.403324 15411 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:22.397861 15409 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.408697 15316 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.408751 15411 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.409283 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:22.410254 11136 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:22.384964 15376 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:22.410566 15423 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.640s	user 0.000s	sys 0.016s
I20260709 12:11:22.411764 15411 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.412030 15235 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.386763 15153 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:22.387120 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 97067.6us
I20260709 12:11:22.389212 15412 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:22.420055 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.421383 14750 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:22.422070 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:22.390668 15321 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.392903 15331 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:22.394248 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.404588 15431 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.390093 15413 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:22.423242 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:22.423136 15237 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.424055 14750 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:22.424278 11285 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:22.424672 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:22.478650 11285 pending_rounds.cc:85] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 6
I20260709 12:11:22.478919 11135 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.478967 11285 pending_rounds.cc:107] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:22.479444 11285 raft_consensus.cc:2889] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.480508 15427 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.426522 11858 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:22.482827 15427 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:22.484249 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.485010 11852 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
W20260709 12:11:22.427033 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.486081 11040 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 8 to 9, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 9 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.486958 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:22.487835 15376 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.488205 15376 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.488551 15376 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.429025 11136 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:22.491246 11292 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:22.491438 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.492039 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.492444 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:22.346050 15024 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:22.450418 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.490945 11040 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 8 to 10, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 10 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.466995 15456 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:22.470706 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 164644us
I20260709 12:11:22.473333 15331 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.473060 15321 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.474153 11143 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:22.492552 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:22.392830 15461 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.492898 11858 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:22.493227 11292 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:22.414369 15235 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.469250 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:22.503350 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.390111 15298 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:22.523468 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.493381 15445 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.526799 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:22.532090 15345 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:22.532608 15345 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:22.533556 15345 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.527814 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:22.502642 15297 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:22.539674 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.542766 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.548121 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79912.6us
I20260709 12:11:22.527172 15154 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.556634 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.527652 15456 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:22.568178 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:22.569830 11135 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:22.572012 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:22.572744 11292 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:22.574280 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.574867 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.575537 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.561467 11040 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 7 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 8 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.541913 15297 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:22.587085 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.527410 15413 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.580204 15431 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.609850 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.617115 11291 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:22.618444 15278 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:22.618854 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.620007 11211 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:22.618920 15278 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:22.619091 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:22.622216 11289 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:22.622319 15278 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:22.625713 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:22.626340 11284 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.627199 15237 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:22.628552 15130 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.628969 15130 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:22.630074 15130 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.631265 15130 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:22.631798 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 255) took 19944 ms (client timeout 15000 ms). Trace:
I20260709 12:11:22.635243 11040 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.638900 15456 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:22.647743 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.652531 15321 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.655581 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:22.580865 15298 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.648880 11040 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 6 to 7, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.580912 15154 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.666700 11852 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:22.668335 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:22.669606 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85647.4us
W20260709 12:11:22.632251 11039 rpcz_store.cc:269] 0709 12:11:02.687590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.692756 (+  5166us) service_pool.cc:224] Handling call
0709 12:11:22.631507 (+19938751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:18.528451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:18.659091 (+130640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:18.659132 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:11:18.659149 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:18.660388 (+  1239us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:18.660468 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:18.660495 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:18.661631 (+  1136us) tablet.cc:701] Row locks acquired
0709 12:11:18.661648 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:18.661827 (+   179us) write_op.cc:270] Start()
0709 12:11:18.661954 (+   127us) write_op.cc:276] Timestamp: P: 1783599078661770 usec, L: 0
0709 12:11:18.661969 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:11:18.732427 (+ 70458us) log.cc:844] Serialized 5227 byte log entry
0709 12:11:19.892984 (+1160557us) op_driver.cc:464] REPLICATION: finished
0709 12:11:20.237665 (+344681us) write_op.cc:301] APPLY: starting
0709 12:11:20.237750 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:20.238928 (+  1178us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:20.253929 (+ 15001us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:20.376044 (+122115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:20.376403 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 12:11:20.376470 (+    67us) write_op.cc:312] APPLY: finished
0709 12:11:20.376900 (+   430us) log.cc:844] Serialized 95 byte log entry
0709 12:11:20.377133 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:20.377334 (+   201us) write_op.cc:454] Released schema lock
0709 12:11:20.377406 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:20.377870 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:20.377911 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1531331,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":317282,"apply.run_cpu_time_us":5788,"apply.run_wall_time_us":140157,"num_ops":13,"prepare.queue_time_us":651084,"prepare.run_cpu_time_us":14680,"prepare.run_wall_time_us":311830,"raft.queue_time_us":594534,"raft.run_cpu_time_us":59114,"raft.run_wall_time_us":298987,"replication_time_us":1189499,"thread_start_us":1166243,"threads_started":4,"wal-append.queue_time_us":238640,"wal-append.run_cpu_time_us":237790,"wal-append.run_wall_time_us":2431633}]]}
I20260709 12:11:22.594028 15297 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.539243 15445 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.678402 15298 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.680325 15445 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.681234 11287 raft_consensus.cc:2410] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:22.590489 15461 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.656304 11215 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.688701 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:22.689882 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:22.673360 11040 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 12 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 13 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.649901 15376 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.700310 11284 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:22.684620 15278 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.702976 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.704700 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:22.708822 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:22.709484 11291 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:22.704933 15274 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.705080 15278 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.718861 15298 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.719697 15298 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:22.721001 15472 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:11:22.724411 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.725211 11211 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:22.725482 11214 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:22.727147 11216 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:22.727625 11213 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:22.729107 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.728746 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:22.704752 15413 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.722184 15298 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.666349 15154 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.728788 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.722466 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.729830 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.748175 11211 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:22.752444 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.753461 11040 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 8 to 9, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 9 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.755455 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:22.750550 15329 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.773814 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.778296 11211 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:22.778343 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:22.783155 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.784107 11219 raft_consensus.cc:2410] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:11:22.787333 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 59488.8us
W20260709 12:11:22.791431 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.762434 15405 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.792908 11215 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:22.793824 11291 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:22.794709 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:22.766155 15445 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.798275 11852 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:22.799391 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.801915 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:22.804054 11210 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
W20260709 12:11:22.810074 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.816535 11855 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:22.821954 15024 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.823187 11856 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:22.831820 15445 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.835892 15445 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:22.838641 11284 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:22.796049 15405 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.843472 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.806540 15331 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:22.844242 11219 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:22.849311 11211 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:22.846329 15331 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.847057 15405 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:22.868858 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60597.3us
W20260709 12:11:22.871095 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.871327 15386 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:22.876091 15386 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:22.877530 15386 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.860147 11040 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 5 to 6, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 6 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:22.888010 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.888741 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:22.889653 11219 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:22.890396 11218 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:22.896796 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:22.899930 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:22.902025 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:22.902626 11856 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.906327 11040 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.908109 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:22.908869 11218 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
I20260709 12:11:22.911470 15457 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.919260 11210 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.903218 15376 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:22.925649 15411 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:22.926338 15411 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:22.928521 15411 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:22.934370 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:22.951524 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:22.952423 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:22.953293 15461 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.953626 15445 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.954170 15445 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.954564 15445 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.953696 15461 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:22.965672 11219 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:22.968354 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.969429 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.913246 15297 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:22.941818 15392 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.975739 11217 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:22.963562 15461 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.991381 11861 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.969233 15457 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.997238 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:22.980296 15376 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:23.007066 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:22.996205 15457 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:22.972277 15345 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:11:22.993134 15411 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.010435 15456 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.025039 14932 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:23.027392 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.033088 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.033901 15298 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.012616 15457 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.034246 15413 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.034788 15413 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.035166 15413 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.042863 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.043442 11213 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:22.983542 15392 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:23.050508 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55500.1us
W20260709 12:11:23.059962 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.070818 11856 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:23.019553 15316 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:11:23.011965 15376 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.034415 15298 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:23.077477 15476 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.296s	user 0.000s	sys 0.006s
I20260709 12:11:23.077814 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:23.079355 15456 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.079779 15456 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:23.080137 15456 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:23.084824 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.087764 15331 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:23.091063 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:23.092847 15384 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.093289 15384 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:23.094255 15384 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.095467 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.096294 11142 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:23.097735 11135 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.099324 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:23.100193 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.100922 11139 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:23.101040 15274 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.022979 15411 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.104344 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.120132 11284 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:23.098475 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.105772 11217 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:11:23.121598 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55746.8us
I20260709 12:11:23.133710 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.133306 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.137194 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.113426 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.146948 11142 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:23.136390 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.138957 11144 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
W20260709 12:11:23.150879 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.152630 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.147668 11293 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:11:23.106427 15411 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:23.124130 15474 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.241s	user 0.001s	sys 0.002s
I20260709 12:11:23.157861 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:23.110652 15331 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:23.118633 15298 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.107749 15392 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.158732 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:23.164229 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.124361 15329 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.162340 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:23.163231 11143 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:23.104080 15278 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:23.174297 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:23.168658 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.148214 15423 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.168684 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.165462 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.178695 15130 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:23.102464 15461 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.128388 15316 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:11:23.181138 11139 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:23.186832 11287 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:23.126750 15457 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.199095 11144 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:23.200657 11291 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:23.149785 15464 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:23.138178 15405 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.205789 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:23.208010 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:23.207510 11142 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 3.
I20260709 12:11:23.184841 15130 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:23.184705 14457 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:23.217034 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.152333 15456 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.170397 15331 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.223769 11285 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:23.228143 15338 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:23.228639 15338 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:23.229002 15461 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:23.218246 15154 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.230090 15154 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.230512 15154 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.232348 15024 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.232523 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.232839 15024 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:23.224332 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:23.234755 11287 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:23.236728 11140 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:23.229671 15338 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:23.236110 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77911.2us
I20260709 12:11:23.221046 15130 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.268800 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:23.237603 15297 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.234561 14457 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:23.293606 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119420us
I20260709 12:11:23.295423 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:23.295500 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.296371 11290 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:23.280884 15431 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.610s	user 0.000s	sys 0.012s
I20260709 12:11:23.246237 15392 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:23.333336 11861 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:23.278034 15316 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.291704 15338 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:23.336979 11853 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
W20260709 12:11:23.349433 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 136737us
W20260709 12:11:23.354499 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.338797 15376 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:23.377429 11290 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:23.393627 11210 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:23.395627 11218 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:23.397684 11138 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:23.389925 15274 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.422513 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.334934 15024 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.377264 15316 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.397199 15376 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:23.443495 15461 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:23.449079 15488 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.449888 15488 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.452181 15488 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.427316 15498 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:23.458541 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.436321 15405 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:23.440438 15457 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.438802 15423 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:23.483418 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 140131us
I20260709 12:11:23.428778 15445 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.455585 15456 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:23.430049 15274 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.511899 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:23.516319 11293 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 12: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:23.515362 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 219937us
I20260709 12:11:23.519881 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:23.495018 15490 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:11:23.543305 11211 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:23.509220 14750 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.510169 15331 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:23.550447 15513 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.490933 15413 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.518640 14457 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:23.521080 15498 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.594244 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:23.548003 15494 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:11:23.573122 15316 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.573659 15515 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.574580 15298 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.573138 15274 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.637323 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:23.640094 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.640940 11218 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:23.579773 15411 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:23.584245 15384 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.584745 15409 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:23.586822 15522 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.544802 15423 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.587972 15505 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.563982 14750 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.588902 15413 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.578147 14932 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:23.608207 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.607908 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:23.564018 15376 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.634629 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:23.681460 11216 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:23.635054 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.635643 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:23.635910 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.637006 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:23.564728 15513 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:23.683773 11212 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:23.576534 15331 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:23.659873 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.661005 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:23.680013 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:23.666267 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:23.687294 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:23.673071 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:23.672940 11110 connection.cc:256] RPC call timeout handler was delayed by -1.4889969139999266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23650000000000004s for a response
I20260709 12:11:23.679071 11210 raft_consensus.cc:2368] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
W20260709 12:11:23.688122 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0749986739999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 12:11:23.679782 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.685940 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:23.605551 15495 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.607010 15511 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:23.697199 11853 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:23.694020 11214 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:23.616071 15498 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.699256 15431 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.699443 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:23.700224 11860 raft_consensus.cc:606] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:23.699853 15495 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.700379 14457 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:23.700888 14457 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:23.701710 14457 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.662967 15456 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:11:23.700642 11860 raft_consensus.cc:614] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:23.680984 15376 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:23.689734 14932 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:23.677410 15522 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.724947 15413 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:23.722281 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.690222 15153 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.723162 11217 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:23.720721 15509 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.721488 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.736601 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:23.690776 15511 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.743700 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:23.744993 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.681627 15384 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:23.744267 15154 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.001s
I20260709 12:11:23.749709 15154 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.751205 15508 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.751724 15508 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.752058 15508 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.752744 11142 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:23.724915 14932 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.754832 15522 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.678360 15505 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.759007 11211 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:23.681763 15411 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.678997 15525 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:11:23.725970 15457 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.727027 15501 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:23.771865 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 252061us
I20260709 12:11:23.773397 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.781088 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.782536 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.781121 11143 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:23.786358 11136 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:23.759866 15511 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.769809 14457 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.760737 15515 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:23.809777 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:23.810580 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.811574 11142 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:23.817560 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:23.819298 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59812.7us
I20260709 12:11:23.789295 15457 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.831517 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.805625 15519 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:23.836407 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:23.850692 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.771581 15513 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.854651 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.855433 11135 raft_consensus.cc:2376] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13. Re-sending same reply.
W20260709 12:11:23.853271 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 177364us
I20260709 12:11:23.794301 15376 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.874115 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.875411 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.887476 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.860452 15527 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.857744 15519 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:23.860926 15409 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:23.892935 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:23.901747 15456 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:23.902653 11136 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:23.908455 15456 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:23.914362 11259 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
I20260709 12:11:23.914752 11259 leader_election.cc:403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:23.890110 15529 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.894522 15515 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:23.907321 15527 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.907526 15376 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.907785 15500 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:23.934720 15542 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
W20260709 12:11:23.935583 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43544.2us
I20260709 12:11:23.947897 15456 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:23.950798 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.951133 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.951722 11141 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9.
I20260709 12:11:23.952042 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:23.952600 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.952672 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.953542 11137 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:23.953807 11141 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:23.954578 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.954684 11139 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:23.954792 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.955462 11141 raft_consensus.cc:2376] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8. Re-sending same reply.
I20260709 12:11:23.955801 15488 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:23.953707 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.956333 15488 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:23.956811 15488 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.956741 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:23.912287 15423 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:11:23.958871 15519 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:23.960434 15423 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:23.943629 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:23.920370 15513 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.968746 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.969043 11143 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:23.969570 11141 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:23.970125 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.920703 15529 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.906931 15517 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:23.973342 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:23.974553 11140 raft_consensus.cc:2410] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:23.975754 11143 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.991540 11853 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:24.008738 11137 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.988632 11217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:24.009291 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:23.988862 15533 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:11:23.928036 15527 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.014056 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.021014 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.021838 11142 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:24.016646 15535 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.025810 15535 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.026182 15535 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.028704 11286 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:24.031596 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.032218 11290 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.974970 15500 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:24.033836 15500 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:24.034535 15538 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:11:23.969770 15534 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:11:24.009685 11217 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.014134 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:24.014199 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.041743 11135 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.015239 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.042035 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.018767 11139 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:11:24.003922 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60358.2us
I20260709 12:11:24.043330 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:24.046010 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47088.4us
I20260709 12:11:24.031838 15506 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:23.976022 15529 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.046303 11290 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:24.011920 15495 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:24.042747 11140 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:24.049422 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:23.961326 15423 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:24.073849 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:24.075088 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.094866 15517 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.079010 15515 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.081758 15024 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.086426 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.041509 15509 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:24.048107 14750 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:24.073591 15523 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
I20260709 12:11:24.097856 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.139191 11137 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.102542 11143 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.075949 15457 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.076879 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.122577 11135 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:24.123579 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:24.126085 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52349us
W20260709 12:11:24.127017 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 121135us
I20260709 12:11:24.125483 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:24.130733 15153 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.134974 15225 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.123265 15423 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:24.118647 15456 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.148141 11139 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:24.153671 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 110481us
I20260709 12:11:24.136977 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.159381 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.140492 15545 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.141498 15515 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:24.124809 15506 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.140496 15509 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.165524 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:24.135758 15517 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:24.195458 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.198374 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44825.9us
I20260709 12:11:24.171870 15500 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.170028 15457 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:24.203648 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.170277 15456 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:24.155484 15512 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 12:11:24.200825 15130 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.923s	user 0.016s	sys 0.004s
I20260709 12:11:24.214675 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:24.218752 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50857.6us
I20260709 12:11:24.224886 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:24.228376 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:24.198947 15554 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.200489 15551 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.210084 15549 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.254526 15549 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.256866 15549 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.257598 15499 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.258235 15499 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.260507 15499 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:24.225620 11216 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:24.261730 15506 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.204331 15225 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:24.237237 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.263033 15456 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.263602 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.264758 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.240259 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.265934 15225 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.266929 11285 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:24.268200 11285 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:24.241487 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.242189 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.242830 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.242887 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.270046 15535 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.243070 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.243469 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.243853 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.244892 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.246345 15550 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.247406 15524 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.251830 15517 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.252605 15515 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.170644 15545 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.276674 11288 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.226899 15493 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.783s	user 0.001s	sys 0.015s
W20260709 12:11:24.282867 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54549.9us
I20260709 12:11:24.298115 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.283370 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.223837 15457 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:24.285244 11137 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:24.219449 15130 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.210834 15500 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.306128 14457 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.307318 14457 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.307693 14457 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.274716 15535 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.314437 14457 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.311343 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.315846 11287 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:24.290612 15554 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:24.296345 15464 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.321586 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.302819 15457 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.289450 15550 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.365240 11143 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:24.371948 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.341881 14457 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.324380 11856 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:24.343921 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:24.325663 11855 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:24.422636 11216 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.326648 11290 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:24.420892 11292 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:24.361590 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:24.321779 15338 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.980s	user 0.012s	sys 0.003s
I20260709 12:11:24.433471 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.434365 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.437114 11142 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:24.343506 15535 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.277820 15551 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.436299 11140 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:24.441135 11144 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:24.423682 15457 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:24.443289 15498 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.445550 15505 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:24.477247 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 141691us
I20260709 12:11:24.478097 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.487553 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.448091 15507 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:24.488294 15507 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:24.489442 15511 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.002s
I20260709 12:11:24.490061 15338 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.363685 15445 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:24.423682 15509 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.492511 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.481442 15545 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.489135 15507 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.495066 15274 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.495476 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.490011 15511 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:24.497803 15513 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.524s	user 0.003s	sys 0.005s
I20260709 12:11:24.498229 15511 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.493067 15338 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.499218 15338 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.479561 15500 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.494232 15507 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:24.493278 15488 consensus_meta.cc:287] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.004s
I20260709 12:11:24.502765 15488 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.503722 11135 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:24.506095 15130 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.508293 15551 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:24.508627 15488 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.509315 15488 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:24.509505 15529 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.511185 11291 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:24.511729 15423 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.514207 15423 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.478668 15550 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.516470 15529 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.515986 11288 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:24.446236 15384 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:24.524560 11215 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:24.523505 11284 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:24.518903 15274 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.476266 15456 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:24.522094 15376 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 12:11:24.535295 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e660be03b734102a4ad43c954498a96"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:24.535970 11858 raft_consensus.cc:606] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:24.541486 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:24.543933 11860 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:24.519765 15535 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.545390 11861 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:24.552878 11853 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:24.550303 15130 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.530326 15554 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:24.564576 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69172.6us
W20260709 12:11:24.592983 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 231497us
I20260709 12:11:24.594399 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.594911 15522 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.595341 15522 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.595477 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.595716 15522 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.596251 15535 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.596679 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:24.564420 15551 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:24.591426 15411 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.597829 15551 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.598029 15411 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.598220 15551 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:24.599417 15551 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.600347 15513 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.600800 15513 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.601135 15551 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.601738 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.564404 15456 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:24.603229 15456 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.603587 15456 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:24.604363 15456 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.605552 15456 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.606395 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:24.607381 15274 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:24.607884 15274 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:24.608251 15384 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:24.608757 15384 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.601132 15513 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.570375 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:24.618222 15546 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.402s	user 0.004s	sys 0.000s
W20260709 12:11:24.586288 15527 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.554s	user 0.001s	sys 0.007s
I20260709 12:11:24.557268 15335 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.557428 15464 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.624958 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.626130 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:24.626579 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:24.627302 15411 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:24.628536 15411 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.627579 11857 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:24.608770 15274 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.639434 11219 raft_consensus.cc:606] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:24.639987 11219 raft_consensus.cc:614] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:24.641470 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.578320 15130 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.646762 14932 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.647382 14932 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:24.648453 15508 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.896s	user 0.013s	sys 0.006s
I20260709 12:11:24.648362 14932 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.648953 15508 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:24.650883 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49435.2us
I20260709 12:11:24.651808 15384 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:24.653606 15457 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.654871 11141 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:24.656035 15457 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.656693 11854 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:24.658149 15527 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.658800 15298 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.660470 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:24.660936 15335 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.666865 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.668236 11216 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:24.571416 15408 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.665469 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.699623 11139 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:11:24.699630 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74801.7us
I20260709 12:11:24.702417 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:24.706784 11219 raft_consensus.cc:606] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:24.703941 11258 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.689s (SENT)
I20260709 12:11:24.707567 11137 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:24.710193 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.712894 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.718715 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.702338 15278 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:11:24.660503 15527 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.646380 15130 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.707803 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:24.723585 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:24.698693 15529 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:24.726778 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.699684 15457 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.732609 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.732090 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.732120 11182 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:24.740141 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.726477 15550 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.743382 15298 raft_consensus.cc:2764] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:24.746819 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:24.749823 15130 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.750051 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.750226 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.727404 15338 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:24.753093 11137 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.753960 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:24.750864 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.757436 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:24.758754 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54846.1us
I20260709 12:11:24.762660 15298 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.762779 15521 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:24.763274 15298 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.763731 15298 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.764657 15024 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.765105 15024 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:24.750401 15130 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:24.766089 15024 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.766780 15130 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.767488 15024 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.769389 15532 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.769937 15532 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.772257 15532 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:24.777709 15505 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:24.780085 15505 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:24.782620 15535 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.783463 15376 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.783427 15535 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.783795 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:24.785121 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.785298 15526 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.786315 15499 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.786901 15499 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.789340 15499 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:24.787202 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55156.2us
I20260709 12:11:24.699878 15464 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.792196 11859 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:24.791393 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:24.793588 15464 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.796030 15376 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.796792 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.797627 11289 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:24.798933 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:24.799109 15298 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.799680 11214 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:24.800046 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:24.803702 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.626s (SENT)
I20260709 12:11:24.813345 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:24.814102 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.808791 11137 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:24.712226 15408 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.752173 15527 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.823885 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:24.817432 11184 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:24.730232 15529 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:24.802999 15535 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:24.835229 11258 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.940s (SENT)
I20260709 12:11:24.828877 15527 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.838776 15527 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.838871 15335 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.827956 15524 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.839859 15524 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:24.842067 15524 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.843803 11143 raft_consensus.cc:2410] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:24.831847 15499 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.845067 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:24.846577 15508 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.831727 15495 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.722719 15569 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:11:24.850641 11137 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.883280 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:24.836122 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 82237.8us
I20260709 12:11:24.826536 15526 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:24.887187 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.824155 15457 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.889963 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.895531 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:24.812546 15376 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:24.903398 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.902377 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.901641 11214 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:24.908381 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.923426 11217 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:24.924916 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.925424 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:24.883905 15499 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:24.926631 11137 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:24.926117 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:24.888338 15521 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.928460 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:24.929979 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:24.888464 15526 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.888543 15495 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:24.932742 11139 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:11:24.932909 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97720.7us
W20260709 12:11:24.965803 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.946s (SENT)
I20260709 12:11:24.966193 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:24.934871 11853 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:24.896703 15154 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.936658 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.937031 15298 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.937564 15130 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:24.939167 15331 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:24.939599 11216 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.940019 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 466) took 1215 ms. Trace:
I20260709 12:11:24.940915 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:24.989972 11138 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.941479 15225 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.996194 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:24.943197 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.944895 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:24.952221 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.000309 11293 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:24.953555 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:24.939186 15408 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:24.957701 15513 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.004539 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.022429 11292 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:25.023483 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.023731 11216 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:11:24.989143 11855 rpcz_store.cc:276] 0709 12:11:23.724777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.725239 (+   462us) service_pool.cc:224] Handling call
0709 12:11:23.974046 (+248807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.423777 (+449731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.939781 (+516004us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540020f154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:24.939957 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808042880}
I20260709 12:11:24.963819 15526 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.027917 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.033306 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:24.931668 15457 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:25.034708 11293 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.037225 11285 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:25.037744 11285 pending_rounds.cc:85] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 9
I20260709 12:11:25.049692 11285 pending_rounds.cc:107] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:25.050117 11285 raft_consensus.cc:2889] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.972548 15331 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:24.995584 15535 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.014604 15225 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.995052 15411 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.130638  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:25.131749 15578 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:11:25.132632 15574 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 12:11:25.138964 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 173176us
W20260709 12:11:25.140887 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.224746 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.224728 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 178595us
I20260709 12:11:25.225934 11138 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:25.226679 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.205787 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.227744 11292 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:25.048532 15508 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:25.139789 15457 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.027086 15521 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.141769 15495 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.138718 15584 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.932188 15499 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.228812 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.210553  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:25.026525 15570 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:25.265862 15570 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.230773 15525 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:25.253423 11286 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.270341 15525 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.272115 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 1844) took 1031 ms. Trace:
I20260709 12:11:25.269353 15570 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.272655 11286 rpcz_store.cc:276] 0709 12:11:24.240824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.243592 (+  2768us) service_pool.cc:224] Handling call
0709 12:11:25.271823 (+1028231us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b540017e3d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:25.272031 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246604032}
I20260709 12:11:25.238440 15508 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.274710 15570 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.276304 15508 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:25.276710 15571 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.705s	user 0.003s	sys 0.000s
W20260709 12:11:25.257229 15576 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
W20260709 12:11:25.233877 11258 leader_election.cc:336] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.155s (SENT)
I20260709 12:11:25.279565 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:25.280459 15542 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:25.266460 15575 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.271s	user 0.004s	sys 0.003s
I20260709 12:11:25.267868  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:25.265787 15456 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.280543 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56819.8us
I20260709 12:11:25.284072 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.268561 11292 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:25.249329 15274 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:25.238021 15569 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:25.230986 15411 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.294780 15569 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:25.295279 15569 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:25.284766 11292 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 7
I20260709 12:11:25.296275 11292 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:25.296743 11292 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.212913 15225 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.283767 11285 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:25.292773 15456 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:25.239272 15551 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.004s
W20260709 12:11:25.238848 15583 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.204s	user 0.002s	sys 0.002s
I20260709 12:11:25.304117 15569 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.327952 11289 raft_consensus.cc:2410] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:25.330034 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 648) took 1231 ms. Trace:
I20260709 12:11:25.330192 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.305698 15527 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.301398 15521 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:25.301165 15274 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.311834 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 69968.5us
I20260709 12:11:25.301584 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:25.324430 11293 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:25.337353 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.325191 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.338245 11288 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:25.330538 11215 rpcz_store.cc:276] 0709 12:11:24.098262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.098615 (+   353us) service_pool.cc:224] Handling call
0709 12:11:25.329857 (+1231242us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540035be54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:25.329964 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859248000}
W20260709 12:11:25.346573 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45089us
I20260709 12:11:25.348510 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:25.351649 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.353953 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.356289 11142 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:25.295691 15542 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:25.336076 15376 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.349614 15573 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.310300 15526 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.375063 15549 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.375481 15569 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.376238 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.376752 15529 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.377346 15527 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.378202 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.409153 11285 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.379454 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:25.380316 11853 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:25.378851 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.380466 15456 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.386794 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.387480 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.412230 11141 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:25.388172 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.412750 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:25.389006 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.413482 11854 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:25.388911 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.389459 15573 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.389472 15513 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.392220 11859 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:25.392292 15540 raft_consensus.cc:993] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:11:25.393002 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.395179 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.396099 11215 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.415596 11213 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.402921 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:25.300690 15584 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.417299 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:25.418033 11142 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.415549 11218 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.397333 15376 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.419061 15540 raft_consensus.cc:1081] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:11:25.421398 11219 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:25.421648 15584 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.424357 15526 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.343896 15331 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.409518 15549 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.419145 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.433086 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:25.435827 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.403721 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:25.362995 15532 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.445926 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.411022 11292 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.382309 15542 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:25.373777 15274 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.412317 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:25.454178 11143 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.454909 11215 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:25.444079 11285 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:25.456499 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.442058 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.459317 11137 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:25.453877 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.453220 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:25.461318 11211 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:25.463574 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.465225 11141 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:25.466744 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.445253 15456 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.451300 15409 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.469507 15409 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.469928 15409 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.470160 15386 raft_consensus.cc:993] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:25.483951 11213 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:25.485328 11215 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 7.
I20260709 12:11:25.489892 14457 raft_consensus.cc:1081] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:25.487758 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.469985 15527 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.513592 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44854.8us
W20260709 12:11:25.492281 15522 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.896s	user 0.014s	sys 0.000s
I20260709 12:11:25.463784 15532 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:25.493167 15408 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:25.503062 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55980.4us
I20260709 12:11:25.484784 15456 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.506331 11143 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:25.514349 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.491171 15549 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.444367 15521 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.514422 15335 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:25.543094 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:25.523466 15456 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:25.591367 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 236790us
W20260709 12:11:25.526355 15554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.016s	sys 0.020s
W20260709 12:11:25.594585 15554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.017s	sys 0.020s
W20260709 12:11:25.596401 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.597915 11143 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:25.599251 11143 pending_rounds.cc:85] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:11:25.599459 11143 pending_rounds.cc:107] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:25.599661 11143 raft_consensus.cc:2889] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.529436 15411 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.593357 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:25.531754 15527 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.529778 15408 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:25.518347 15522 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:25.610992 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 273698us
I20260709 12:11:25.613202 11110 leader_election.cc:400] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:25.613559 11110 leader_election.cc:403] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:25.608592 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65585.4us
I20260709 12:11:25.618542 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.594530 11139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e660be03b734102a4ad43c954498a96"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:11:25.619609 11139 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:25.620100 11139 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.592952 15499 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:25.548928 15549 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:25.630837 15411 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:25.606935 15298 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.589210 15274 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:25.642824 11212 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:25.639735 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46507.8us
I20260709 12:11:25.636569 15225 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.647125 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:25.647377 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.589097 15531 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:11:25.650964 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 147154us
I20260709 12:11:25.655485 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:25.665843 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.666749 11215 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
W20260709 12:11:25.669591 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57120.9us
I20260709 12:11:25.670708 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.672499 11211 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.672896 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.673506 11285 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.644855 15499 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:25.644562 15298 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.676863 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.644558 15508 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:11:25.691668 11285 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:25.647570 15591 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:25.653123 15573 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.694456 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:25.702867 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:25.706895 15570 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.691452 11289 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:25.707458 15570 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:25.696825 15408 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.677160 15515 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.718411 11210 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:25.716683 11211 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.703783 15590 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.695998 15298 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.697082 15592 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:25.737498 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.720225 15584 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.694058 15154 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:11:25.739616 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45234.8us
I20260709 12:11:25.718856 15586 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:25.720057 15499 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:25.750593 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.725627 15551 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.679883 15411 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.759655 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.771710 11211 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:25.762581 11142 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:25.763017 11292 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:25.715430 15570 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.779944 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.778720 15529 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.786806 15338 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.787333 15529 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:25.789224 15596 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:11:25.790882 15597 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:11:25.792272 15589 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:11:25.790923 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2783) took 1002 ms. Trace:
I20260709 12:11:25.794538 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.795184 11215 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.790118 15529 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:25.769156 15590 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.760867 15592 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.812474 15592 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:25.805205 15515 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.815394 15499 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.793749 11144 rpcz_store.cc:276] 0709 12:11:24.788573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.788709 (+   136us) service_pool.cc:224] Handling call
0709 12:11:24.789069 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.826196 (+ 37127us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:24.882573 (+ 56377us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.472079 (+589506us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b18002bb3a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b23a 00007f9830ae5a2a
0709 12:11:25.653143 (+181064us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.666647 (+ 13504us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.666920 (+   273us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:25.666980 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.667084 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.790557 (+123473us) raft_consensus.cc:1685] finished
0709 12:11:25.790683 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.790854 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26498,"prepare.queue_time_us":56363,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":5236,"raft.queue_time_us":41819,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":17463,"spinlock_wait_cycles":17968384,"thread_start_us":180750,"threads_started":1,"wal-append.queue_time_us":783463}
I20260709 12:11:25.822304 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.823607 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:25.824173 11137 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.825749 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.826500 11141 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.829535 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.830263 11211 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:25.837468 11215 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:25.847754 11137 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:25.782959 15274 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:25.852114 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.856225 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.859510 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.862033 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.826901 15411 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.864547 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.833572 15331 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.871179 11144 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:25.869205 11211 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.834077 15225 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.865697 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.843626 15592 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:25.815424 15515 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:25.881098 15606 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:25.884642 15515 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:25.886335 15601 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:11:25.888433 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.889642 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:25.891083 15594 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:25.892061 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:25.893009 11140 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.893945 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.894773 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.895612 11211 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.906390 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.910174 15525 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:25.911522 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.912305 11293 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.870056 15522 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.928833 15298 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:25.930948 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:25.931319 15409 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.932360 15592 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.933607 15409 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.934633 15592 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:25.929077 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:25.937297 11213 raft_consensus.cc:2368] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:25.931816 11141 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:25.938814 15531 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:25.939103 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:25.939392 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:25.940073 11219 raft_consensus.cc:2376] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12. Re-sending same reply.
I20260709 12:11:25.941061 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.942029 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.937515 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 795) took 1191 ms. Trace:
I20260709 12:11:25.938849 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.943854 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:25.943217 11136 rpcz_store.cc:276] 0709 12:11:24.745765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.750018 (+  4253us) service_pool.cc:224] Handling call
0709 12:11:24.750418 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.790054 (+ 39636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.790088 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.790131 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.790161 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.937302 (+1147141us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54002c0454. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:25.937347 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.937462 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90680448}
I20260709 12:11:25.939987 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:25.945994 15376 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.946622 15376 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.940222 15522 raft_consensus.cc:993] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:25.947057 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.948151 15522 raft_consensus.cc:1081] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:25.948226 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.945533 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.949455 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:25.949657 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.950054 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.950315 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.951048 11215 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:25.951247 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.951516 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.952009 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.950049 11144 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.945478 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.956223 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:25.956593 11136 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:25.956859 11218 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:25.957808 11136 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.962630 11140 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:25.963407 11210 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:25.939304 15531 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.965728 15531 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:25.967514 15569 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 12:11:25.968291 15298 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:25.950348 11141 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.971052 11144 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:25.975615 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.976400 11141 raft_consensus.cc:2376] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12. Re-sending same reply.
I20260709 12:11:25.957841 11218 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:25.929075 11139 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:25.977654 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.972018 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:25.985273 11144 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:25.994515 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:25.995275 11292 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.995853 11293 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:25.947081 15376 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:26.003080 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.006197 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:26.042178 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.017424 11285 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.044337 11259 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:26.071470 11259 leader_election.cc:403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.077421 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 657) took 1365 ms. Trace:
W20260709 12:11:26.077945 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.026575 14457 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.079193 14457 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.079505 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:26.027551 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45609.8us
I20260709 12:11:26.036319 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.081578 11214 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:26.077844 11216 rpcz_store.cc:276] 0709 12:11:24.711800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.721716 (+  9916us) service_pool.cc:224] Handling call
0709 12:11:26.077231 (+1355515us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400304dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:26.077355 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494918528}
I20260709 12:11:26.032948 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:26.017441 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.066041 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:26.074105 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 68022.7us
I20260709 12:11:26.041450 11284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:11:26.018081 11290 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:26.084960 11286 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:26.037256 11139 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.032382 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:26.085664 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:26.086843 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:26.035466 11293 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:11:26.013554 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0548647860000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 12:11:26.002400 11292 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
W20260709 12:11:26.090827 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.092672 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.041716 11287 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:26.040990 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:26.027383 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:26.078822 11141 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:26.094903 11137 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [8.5-11.7]
W20260709 12:11:26.094990 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67719.8us
I20260709 12:11:26.096321 11137 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:11:26.219611 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.105459 11291 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:26.095695 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:26.220547 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.222713 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 135991us
I20260709 12:11:26.223165 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.224833 11211 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:26.226392 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:26.235859 11136 raft_consensus.cc:2376] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13. Re-sending same reply.
I20260709 12:11:26.236413 11137 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:26.078598 15542 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.025051 15409 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:11:26.228571 14457 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:26.029140 15540 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 12:11:26.090610 15535 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:26.239270 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:26.162701 15592 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.244601 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:26.245223 11857 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:26.246019 11855 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.245905 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:26.239652 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.162007 15598 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.241941 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 146303us
I20260709 12:11:26.250968 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:26.251200 11136 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:26.245564 11857 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:26.232295 15384 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.252542 11857 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.255096 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:26.249753 15456 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.653s	user 0.005s	sys 0.014s
W20260709 12:11:26.327476 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 72467.1us
I20260709 12:11:26.328521 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:26.329509 11284 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:26.329978 11284 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.317281 15557 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.330879 15495 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.331244 15557 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.331455 15495 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:26.331629 15557 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.332388 15495 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.254643 15411 raft_consensus.cc:2764] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:26.325349 15522 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.335366 15522 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.253216 15592 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:26.337316 15592 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.337852 15522 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.338697 15613 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.339172 15613 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:26.339552 15613 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.341737 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 249914us
I20260709 12:11:26.342581 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:26.344313 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:26.345577 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:26.322734 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79891.8us
I20260709 12:11:26.324982 11857 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:26.349484 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:26.246634 15525 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:11:26.349009 11284 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.252444 15376 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:26.353634 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 109940us
I20260709 12:11:26.362411 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:26.355122 15488 raft_consensus.cc:2764] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:26.364904 15590 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.320632 15515 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:11:26.327572 15457 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:26.369453 15522 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.370630 15298 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:26.372033 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:26.350131 15542 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.265084 15531 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.380463 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1827) took 1012 ms. Trace:
I20260709 12:11:26.348754 15529 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.366811 15409 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.347038 15456 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.385180 11258 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:26.391896 11214 rpcz_store.cc:276] 0709 12:11:25.368471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.368606 (+   135us) service_pool.cc:224] Handling call
0709 12:11:26.078453 (+709847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.086018 (+  7565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.380200 (+294182us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400304dd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:26.380377 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574774528}
W20260709 12:11:26.444674 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52261.5us
I20260709 12:11:26.469242 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:26.460825 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.478979 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:26.388108 15590 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.558053 11219 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:26.444293 15540 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.465373 15515 consensus_queue.cc:1243] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:26.473768 15409 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:26.575629 15542 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.566970 15590 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.560089 15521 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.648290 15540 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:26.676417 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 425491us
I20260709 12:11:26.561314 15619 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:26.467043 15527 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.183s
I20260709 12:11:26.465988 15457 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.666343 11857 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:26.665011 15515 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.649641 15598 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:26.676680 15540 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.704101 11107 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:26.699730 15521 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:26.708029 15515 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.705181 15569 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.739522 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 260582us
I20260709 12:11:26.712487 15521 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.739464 15515 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.738996 15598 consensus_queue.cc:1243] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:11:26.760833 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 375860us
W20260709 12:11:26.757700 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 413422us
I20260709 12:11:26.764010 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:26.758653 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:26.697827 15619 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.763108 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:26.771978 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2196) took 1049 ms. Trace:
I20260709 12:11:26.766319 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:26.772634 11213 rpcz_store.cc:276] 0709 12:11:25.722287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.722425 (+   138us) service_pool.cc:224] Handling call
0709 12:11:26.771690 (+1049265us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540035af54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:26.771897 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450482560}
I20260709 12:11:26.785780 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:26.790089 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:26.791622 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:26.792223 11211 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.748152 15569 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:26.783193 15620 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.210s	user 0.001s	sys 0.001s
I20260709 12:11:26.809892 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:26.799674 15549 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:26.819203 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:26.820139 11857 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.771629 15542 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.750195 15409 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.815557 11211 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:26.817502 11213 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:26.806988 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:26.788620 15531 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:26.798035 15598 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.789842 15456 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.843632 11857 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:26.822642 15632 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.863294 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:26.830960 15525 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:26.837792 15499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.005s	sys 0.021s
W20260709 12:11:26.878034 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.836563 15542 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:11:26.872684 15499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.005s	sys 0.022s
W20260709 12:11:26.880868 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 90883.5us
I20260709 12:11:26.835134 15631 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:26.827345 15549 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.882365 15456 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.882129 15633 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:26.882651 15457 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.885389 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:26.868619 15525 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:26.877856 15632 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.896251 15529 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.898033 15529 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:26.898975 15628 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:11:26.899123 15529 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.900684 15529 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.900573 15636 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:26.904978 15631 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.905474 15631 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.908443 15549 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.911092 15619 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:26.911660 15619 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.912266 15619 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.912683 15619 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:26.915263 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.891396 15376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.019s
W20260709 12:11:26.919166 15376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.007s	sys 0.019s
I20260709 12:11:26.897086 15457 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:26.920176 15457 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.892599 15525 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.922971 15641 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.923492 15641 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:26.914371 15625 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:11:26.917728 15630 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:11:26.917810 15225 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:26.925858 15641 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:26.922355 15457 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:26.896130 15598 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:26.939895 15225 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.940382 15631 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.933993 15515 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.988445 15515 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:26.944219 15613 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.004s
I20260709 12:11:26.989188 15613 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.990890 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:26.992640 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:26.993245 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2207) took 1104 ms. Trace:
I20260709 12:11:26.993835 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:26.995453 15643 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:26.996075 15643 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.996758 15225 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:26.950678 15602 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:26.997731 15602 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:26.998435 15643 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:26.999922 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.944391 15607 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.067s	user 0.003s	sys 0.010s
I20260709 12:11:26.913435 15619 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.002741 15602 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:26.951897 15590 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:26.959722 15376 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.005102 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:26.960125 15557 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.006s
W20260709 12:11:27.005908 15611 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.068s	user 0.000s	sys 0.010s
I20260709 12:11:27.006059 15557 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.005160 15376 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.008680 15557 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:27.009578 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 813) took 1340 ms. Trace:
I20260709 12:11:27.009660 15376 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:26.967644 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:26.968938 11214 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.010427 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:27.011152 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:27.010023 11143 rpcz_store.cc:276] 0709 12:11:25.669595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.669784 (+   189us) service_pool.cc:224] Handling call
0709 12:11:25.697765 (+ 27981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.702818 (+  5053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.702858 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.716991 (+ 14133us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.822749 (+105758us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:25.822785 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.822849 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.005209 (+1182360us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:27.009298 (+  4089us) raft_consensus.cc:1685] finished
0709 12:11:27.009318 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.009521 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9486208,"thread_start_us":85445,"threads_started":1,"wal-append.queue_time_us":157243}
I20260709 12:11:27.012295 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:27.013315 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:26.970479 15639 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.993676 11219 rpcz_store.cc:276] 0709 12:11:25.888612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.952178 (+ 63566us) service_pool.cc:224] Handling call
0709 12:11:25.952457 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.647357 (+694900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.992985 (+345628us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000262d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:26.993178 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377079680}
I20260709 12:11:27.011345 11291 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:26.969758 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:27.025242 11210 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:27.025300 11219 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.991245 15613 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:27.015424 11857 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:27.018959 11214 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:27.021445 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:27.020888 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 214018us
I20260709 12:11:27.025705 11216 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:27.014102 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:27.040735 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:27.042246 11290 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.027114 11219 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:27.036901 11258 leader_election.cc:336] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.515s (SENT)
I20260709 12:11:26.950137 15540 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.006603 15590 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:27.040957 11211 raft_consensus.cc:2368] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:27.045533 11292 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:27.035687 15639 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.065603 15639 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.032836 15643 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:27.066520 15643 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:27.053083 15647 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.055408 15598 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.056248 15525 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.057961 15540 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:27.043536 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:27.063234 11218 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.066733 15457 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:27.063800 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:27.051301 15376 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.091648 11290 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:27.097950 11213 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.101598 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.102947 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:27.103607 11292 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.105641 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.105581 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.092566 15633 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:27.117851 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 805) took 1848 ms. Trace:
I20260709 12:11:27.117964 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:27.118319 11289 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:27.119632 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.066398 15456 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:11:27.123351 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 1.69113e+06us
I20260709 12:11:27.118716 11135 rpcz_store.cc:276] 0709 12:11:25.269243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.269404 (+   161us) service_pool.cc:224] Handling call
0709 12:11:25.269783 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.422664 (+152881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.422713 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.423326 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.609546 (+186220us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.609620 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.099984 (+1490364us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002c0954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:27.100038 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.100084 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:27.100096 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.117762 (+ 17666us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10386,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":15406,"spinlock_wait_cycles":350620416,"thread_start_us":185756,"threads_started":1,"wal-append.queue_time_us":254196,"wal-append.run_cpu_time_us":2281,"wal-append.run_wall_time_us":1116918}
W20260709 12:11:27.092955 15570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.013s	sys 0.017s
I20260709 12:11:27.126379 11292 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:27.091248 15643 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:27.130410 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:27.131669 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.133140 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:27.133471 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.133806 11139 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.133960 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:27.108214 15616 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.450s	user 0.002s	sys 0.002s
I20260709 12:11:27.103410 15613 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:27.160023 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:27.134690 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.160888 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:27.146067 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.145759 15633 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.146682 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:27.146836 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:27.147293 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.150943 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:27.127900 15376 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.153349 15632 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:27.154076 15644 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.100869 15515 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.156842 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.157263 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:27.108125 15535 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.145375 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:27.207931 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 73300.9us
I20260709 12:11:27.161109 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:27.134891 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.163141 15648 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.166759 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.211035 11860 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 12:11:27.168744 15609 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.233s	user 0.006s	sys 0.004s
I20260709 12:11:27.169354 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.171247 11143 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:27.177630 11136 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.177425 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.210022 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.215840 11856 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:27.216344 11135 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:27.130918 15636 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:27.130347 15570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.013s	sys 0.017s
I20260709 12:11:27.090763 15647 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.130726 15646 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.214394 11139 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:27.129889 15529 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:27.211205 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50407.7us
I20260709 12:11:27.156129 15619 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:27.216851 15632 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:27.221748 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 86960.1us
I20260709 12:11:27.232123 15647 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.227494 15631 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:27.233006 15525 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:27.233553 15510 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:27.234102 15510 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:27.223306 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:27.216970 15457 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.235152 15510 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.222314 15635 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:27.236438 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 888) took 1565 ms. Trace:
I20260709 12:11:27.239099 15635 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.239966 15376 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.239007 11859 rpcz_store.cc:276] 0709 12:11:25.670658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.670942 (+   284us) service_pool.cc:224] Handling call
0709 12:11:25.689713 (+ 18771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.690095 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.690124 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.703781 (+ 13657us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.782353 (+ 78572us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.782400 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.782478 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.168114 (+1385636us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:27.236083 (+ 67969us) raft_consensus.cc:1685] finished
0709 12:11:27.236111 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.236368 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":17668,"spinlock_wait_cycles":14629760,"thread_start_us":67328,"threads_started":1,"wal-append.queue_time_us":220641}
I20260709 12:11:27.237061 15457 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:27.241339 15457 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:27.242321 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.242445 15457 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.241411 15635 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.242384 15510 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:27.238212 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:27.159173 15542 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:27.248126 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.249984 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:27.254094 11284 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:27.255730 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.257591 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.257181 11861 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:27.260342 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.262271 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2192) took 1615 ms. Trace:
I20260709 12:11:27.255368 15298 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.261776 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.265226 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45930 (request call id 2531) took 1240 ms. Trace:
I20260709 12:11:27.215168 15515 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.269222 15456 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:27.268014 15298 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.259501 15535 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.268266 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.276511 11858 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:27.257912 15647 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.271633 11284 rpcz_store.cc:276] 0709 12:11:26.026269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.026432 (+   163us) service_pool.cc:224] Handling call
0709 12:11:27.246152 (+1219720us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540015ca54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad2a3d 00007f9835aa2cd0 00007f982f027254 00007f982f0271e2 00007f982f027111 00007f982f02708c 00007f982f026342 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:27.257040 (+ 10888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561651584}
I20260709 12:11:27.270193 15649 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.278849 15535 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.263012 11217 rpcz_store.cc:276] 0709 12:11:25.647013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.647658 (+   645us) service_pool.cc:224] Handling call
0709 12:11:25.671263 (+ 23605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.705410 (+ 34147us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:25.705446 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.720126 (+ 14680us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.228529 (+508403us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:26.228575 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.228650 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.059610 (+830960us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:27.258286 (+198676us) raft_consensus.cc:1685] finished
0709 12:11:27.258316 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.262209 (+  3893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1693,"raft.queue_time_us":5643,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":14770,"spinlock_wait_cycles":10317568,"thread_start_us":467077,"threads_started":1,"wal-append.queue_time_us":638172}
I20260709 12:11:27.283826 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.265308 15648 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.319417 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:27.320366 11143 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:27.321259 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.322155 11135 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:27.282716 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:27.325273 15631 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.326069 15647 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:27.260998 15636 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:11:27.256722 15619 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.299854 15590 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:27.319586 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:27.432886 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 175355us
I20260709 12:11:27.341140 11140 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:27.347039 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:27.432415 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.340392 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.441838 11855 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:11:27.334682 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67726us
I20260709 12:11:27.443871 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:27.339138 15384 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:27.331383 15636 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:27.318638 15633 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:27.449729 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:11:27.326474 15647 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.453639 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:27.332307 15569 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.329344 15515 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.333142 15619 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:27.331058 15644 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.440891 11137 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.329908 15649 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:27.442830 15542 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.458645 11144 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:27.459590 11136 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:27.474990 11136 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.337344 15298 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:27.439697 15338 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.456466 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:27.448107 15521 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.338850 15525 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:11:27.338555 15535 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.446880 15632 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.335295 15648 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:27.453541 15384 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.454703 15636 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:27.461200 15647 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:27.540585 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84431.3us
I20260709 12:11:27.540117 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.457698 15658 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.457227 15613 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:27.604393 15623 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.890s	user 0.000s	sys 0.003s
I20260709 12:11:27.600013 15658 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.606074 15636 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.611495 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.656306 11861 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.484341 15338 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.625205 15499 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:27.335065 15590 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.478647 15619 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.473331 15569 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:11:27.661505 11137 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:27.659183 11136 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.656019 15456 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.517454 15515 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:27.466080 15633 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.723332 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:27.727341 15653 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:27.730726 11135 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:27.602627 15632 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.650215 15613 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.479103 15649 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:27.739490 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.659149 15658 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.478139 15644 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.759588 11136 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:27.761204 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 167083us
I20260709 12:11:27.720115 15499 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:27.723831 15598 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:11:27.728555 15636 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.577638 15521 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.777014 11861 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:27.669893 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.779696 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2206) took 1891 ms. Trace:
W20260709 12:11:27.784950 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.792791 11215 rpcz_store.cc:276] 0709 12:11:25.888289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.951745 (+ 63456us) service_pool.cc:224] Handling call
0709 12:11:27.779384 (+1827639us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54002959d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:27.779607 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240638848}
I20260709 12:11:27.723650 15535 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:27.767553 15610 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.892s	user 0.000s	sys 0.015s
I20260709 12:11:27.782924 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:27.767088 15635 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.752786 15456 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.761272 15515 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.651165 15648 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.740841 15619 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:27.801070 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 356382us
I20260709 12:11:27.802404 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.830658 11136 raft_consensus.cc:1813] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:27.831588 11136 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 12:11:27.831846 11110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.515s (SENT) [suppressed 21 similar messages]
I20260709 12:11:27.781906 15457 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:11:27.851303 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.797317 15535 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.861984 11144 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:27.877324 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.866834 15535 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:27.882643 15610 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:11:27.828491 15635 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:27.927114 11142 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:27.928438 15622 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.224s	user 0.007s	sys 0.001s
I20260709 12:11:27.930925 15675 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:27.931408 15617 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.263s	user 0.000s	sys 0.013s
I20260709 12:11:27.930992 15670 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:27.935310 15613 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.941504 15532 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.942459 15592 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:27.943410 15674 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:11:27.873274 15499 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.953047 15639 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.956082 15515 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:27.956826 15686 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:11:27.864775  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:27.998615 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 166786us
I20260709 12:11:27.965591 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:27.895609 15668 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.020304 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:27.993430 15457 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.034858 15643 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.038692 15581 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.038929 15686 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:28.039309 15590 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.039426 15686 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:28.039192 15668 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.039353 15581 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.040695 15686 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.041564 11144 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:28.012615 15592 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:28.039136 15643 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.036563 15338 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.043342 15592 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.961632 15535 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.044381 15643 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.042475 15581 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.027771 15639 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:27.991403 15532 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:28.021229 15675 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:28.042428 15668 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:27.963676 15649 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:28.052124 15644 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.051034 15675 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.055050 15619 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.053290 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.055944 15633 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.059798 15619 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.060295 15619 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.060925 15535 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.062366 15619 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.063691 15635 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.070282 15651 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:28.070782 15651 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:28.071631 15651 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.072784 15651 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.073721 11142 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.074628 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.075567 11139 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
W20260709 12:11:28.076845 15671 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:11:28.077382 11135 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.078074 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:28.078547 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.078935 11140 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:28.082211 15666 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
W20260709 12:11:28.068219 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 285362us
I20260709 12:11:28.044829 15592 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.048458 15639 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:28.092129 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 234776us
I20260709 12:11:28.095638 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.097749 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.093856 15686 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.101629 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.104000 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.105283 11293 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:28.104071 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:28.107343 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.108382 11287 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.109050 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:28.109422 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.109815 11285 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.104071 11290 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: [8.4-9.5]
I20260709 12:11:28.113569 11855 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:11:28.122187 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.124608 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.125370 11293 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:27.991732 15670 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.047748 15532 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.131613 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.064908 15457 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.140420 11852 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:28.141992 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.142828 15689 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.132395 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.145994 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.104768 15409 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.119601 15632 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.167922 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:28.134081 15521 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:28.171016 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.175283 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.184684 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.159417 15677 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.172425 15639 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:28.175581 15532 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.205385 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.204694 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.200662 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:28.210526 11285 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:28.214478 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.215155 11826 connection.cc:256] RPC call timeout handler was delayed by -1.6912135420000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 12:11:28.217504 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.208792 15675 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.222846 14457 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:28.235597 15457 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.224854 11859 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.223011 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.237263 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:28.225610 15529 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.238636 14457 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:28.239287 14457 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:28.239603 14457 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.240024 15154 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:28.240505 15154 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:28.241334 15154 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.244153 15641 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:28.244892 15542 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.003s
I20260709 12:11:28.245394 15542 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.238361 15529 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.257566 15529 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:28.257845 15621 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.575s	user 0.000s	sys 0.003s
W20260709 12:11:28.258141 15693 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:11:28.229275 15647 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.002s
I20260709 12:11:28.258788 15690 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.258980 15647 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.259452 15690 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.253000 15670 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.262064 15647 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.265144 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 954) took 2833 ms. Trace:
W20260709 12:11:28.266969 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.267138 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.254932 14457 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.272147 11140 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:28.272555 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.265594 11853 rpcz_store.cc:276] 0709 12:11:25.431459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.443475 (+ 12016us) service_pool.cc:224] Handling call
0709 12:11:25.464748 (+ 21273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.650696 (+185948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.650728 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.041448 (+390720us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c00012458. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:11:26.062087 (+ 20639us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.254920 (+192833us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:26.254955 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.255025 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.256999 (+2001974us) spinlock_profiling.cc:243] Waited 993 us on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:28.264890 (+  7891us) raft_consensus.cc:1685] finished
0709 12:11:28.264915 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.265053 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21421,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5466,"spinlock_wait_cycles":5309056,"thread_start_us":357243,"threads_started":2,"wal-append.queue_time_us":489769}
I20260709 12:11:28.238406 15639 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.276000 11861 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.287847 15639 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:28.291082 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.291797 15690 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.295315 15510 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.295943 15510 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.252738 15675 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:28.290230 11040 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 134) took 26199 ms (client timeout 15000 ms). Trace:
W20260709 12:11:28.276505 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 167407us
I20260709 12:11:28.276572 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.278179 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.279093 15682 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.279268 15456 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:28.284694 15384 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
W20260709 12:11:28.275435 15678 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 12:11:28.300961 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:28.345885 14457 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:28.314536 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 156785us
W20260709 12:11:28.353647 11259 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.978s (SENT)
I20260709 12:11:28.354408 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:28.356606 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:28.298254 11040 rpcz_store.cc:269] 0709 12:11:02.122664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.122937 (+   273us) service_pool.cc:224] Handling call
0709 12:11:02.175624 (+ 52687us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b5400101210. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b70b2 00007f9836930759 00007f98368c8a76 00007f9836899d58 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc
0709 12:11:28.290151 (+26114527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:23.453069 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:23.453915 (+   846us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:23.453982 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:11:23.454009 (+    27us) tablet.cc:662] Decoding operations
0709 12:11:23.530403 (+ 76394us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:23.530645 (+   242us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:23.530674 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:23.531593 (+   919us) tablet.cc:701] Row locks acquired
0709 12:11:23.531649 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:11:23.531842 (+   193us) write_op.cc:270] Start()
0709 12:11:23.531994 (+   152us) write_op.cc:276] Timestamp: P: 1783599083531768 usec, L: 0
0709 12:11:23.532046 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:11:23.532906 (+   860us) log.cc:844] Serialized 3601 byte log entry
0709 12:11:24.533957 (+1001051us) op_driver.cc:464] REPLICATION: finished
0709 12:11:24.655668 (+121711us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f9834511ef0
0709 12:11:24.970104 (+314436us) write_op.cc:301] APPLY: starting
0709 12:11:25.024948 (+ 54844us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:25.295047 (+270099us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:25.295085 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:25.316988 (+ 21903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:25.317399 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:11:25.317487 (+    88us) write_op.cc:312] APPLY: finished
0709 12:11:25.317904 (+   417us) log.cc:844] Serialized 71 byte log entry
0709 12:11:25.318134 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:25.318287 (+   153us) write_op.cc:454] Released schema lock
0709 12:11:25.318348 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:25.318857 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:25.318896 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":440260,"reported_tablets":28,"spinlock_wait_cycles":82261888,"child_traces":[["op",{"apply.queue_time_us":352432,"apply.run_cpu_time_us":10511,"apply.run_wall_time_us":388285,"num_ops":9,"prepare.queue_time_us":362532,"prepare.run_cpu_time_us":7856,"prepare.run_wall_time_us":93414,"raft.queue_time_us":214894,"raft.run_cpu_time_us":22889,"raft.run_wall_time_us":350638,"replication_time_us":988748,"spinlock_wait_cycles":45473920,"thread_start_us":485693,"threads_started":4,"wal-append.queue_time_us":136086,"wal-append.run_cpu_time_us":10924,"wal-append.run_wall_time_us":2643483}]]}
I20260709 12:11:28.303172 15690 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.368113 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67225.3us
I20260709 12:11:28.346978 15376 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.349639 15682 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:28.322104 15510 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.371850 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.318766 15524 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.387336 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:28.390920 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:28.346515 15384 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.391621 11287 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.370510 15647 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.359365 15551 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:28.390902 15658 consensus_meta.cc:287] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.601s	user 0.003s	sys 0.009s
I20260709 12:11:28.380503 15690 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.390113 15457 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.393831 15670 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:28.394032 15695 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:11:28.378222 15521 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:28.419217 11292 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:28.419713 11292 pending_rounds.cc:85] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 6
I20260709 12:11:28.419981 11292 pending_rounds.cc:107] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:28.420264 11292 raft_consensus.cc:2889] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.423265 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.416007 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.427203 11293 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:28.370393 15675 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.381387 15376 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.306820 15495 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:11:28.395218 15524 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.405261 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:28.393205 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.407168 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.410697 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.439113 11285 raft_consensus.cc:1813] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:28.439903 11285 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:28.443130 11293 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.408874 15647 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.445164 11292 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.426203 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:28.409070 15510 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:28.447398 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 174929us
W20260709 12:11:28.411477 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 135523us
I20260709 12:11:28.412585 15658 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.432406 15681 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:28.411985 15689 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:28.416064 15457 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.436911 15521 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:28.469559 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.473205 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.474925 11293 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:28.476712 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.449234 15677 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.483127 11288 raft_consensus.cc:2368] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13.
I20260709 12:11:28.479864 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:28.483884 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.485152 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:28.485803 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 80628.9us
I20260709 12:11:28.485930 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:28.484349 11286 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:28.490679 11293 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:28.491151 15274 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:28.491539 15690 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.480938 15642 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.468909 15698 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.495975 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.467167 15584 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:28.526005 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.541576 11213 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.527117 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.542174 11217 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.482471 15510 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:28.528033 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.529071 15670 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.529168 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.545994 11219 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.528867 11293 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:28.530534 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.531445 11210 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:28.547832 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.548516 11210 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:28.549546 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.550278 11210 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:28.531533 11216 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.551422 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.552528 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.553112 11216 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:28.554076 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.501802 15274 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.537009 15675 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.555717 15274 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:28.544196 15154 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.556452 15154 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.556915 15154 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.501773 15687 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:28.558751 11286 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:28.532608 11214 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:28.560184 15658 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.560770 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.561332 15687 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:28.561785 15687 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:28.561865 15521 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.562950 15687 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.564378 15687 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:28.537323 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52269.2us
I20260709 12:11:28.565912 15457 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.566618 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:28.568186 15524 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.568075 15675 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.569952 15376 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.522287 15495 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.570792 15495 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.573014 15495 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.561352 15384 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.546340 11219 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:28.573348 15634 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:28.587716 15634 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:28.588706 15634 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.592330 11219 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.593518 11219 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.595564 15670 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.561993 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.599283 11287 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:28.600077 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.541246 15584 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.600818 15584 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.478166 15456 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:11:28.602910 15675 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:28.603470 15670 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:28.574170 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46795.2us
I20260709 12:11:28.494197 15677 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.606132 15677 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.538651 15690 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.539119 11182 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:28.437258 15682 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:28.543661 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.527791 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:28.555159 11215 raft_consensus.cc:1217] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Deduplicated request from leader. Original: 8.5->[10.6-11.7]   Dedup: 10.6->[11.7-11.7]
I20260709 12:11:28.657505 11215 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:11:28.564541 15647 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.611084 11216 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:28.646978 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.621277 11217 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:11:28.664644 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 257569us
I20260709 12:11:28.665272 11212 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:28.538971 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53112.5us
I20260709 12:11:28.660465 11287 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:28.667901 11213 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:28.662036 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.661966 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.606321 15499 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:28.681404 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.682217 11215 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:28.683050 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.684504 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:28.546236 15698 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.685997 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.686472 11288 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:28.689052 14457 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:28.603227 15456 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:28.593427 15639 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:28.697252 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.699352 11290 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:28.660697 11218 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:28.695307 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:28.696499 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.688030 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.694269 11826 leader_election.cc:400] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13.
I20260709 12:11:28.701498 11826 leader_election.cc:403] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:28.702683 11287 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:28.704420 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.704968 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.612267 15708 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:28.706342 11289 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:28.709583 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 170543us
W20260709 12:11:28.710815 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45161.2us
I20260709 12:11:28.712620 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.713996 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.714946 15677 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:28.715896 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.716352 15687 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:28.716881 14457 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.717200 15687 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.718739 15298 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.719049 15707 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:28.719292 15298 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.719419 15687 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.720058 15707 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.720247 15687 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.720749 15707 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:28.720904 15687 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.721597 15707 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.719976 15298 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.722827 15707 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.722882 15687 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.661363 15510 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:28.724524 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:28.725657 15706 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:11:28.705003 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.725231 15510 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.727056 15669 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.727643 15669 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.710759 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.678158 15690 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:28.750077 14457 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13.
I20260709 12:11:28.750281 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.750627 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.752625 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.753340 11289 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:28.755275 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.755288 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.757022 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.759740 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:28.763320 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.731478 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.671732 15464 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:11:28.696794 15456 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:28.764133 11139 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:28.770800 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.766213 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.773456 11141 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 8: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:28.767235 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:28.774168 11135 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.684755 15642 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:28.777158 11137 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:28.777664 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.781661 11289 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.787004 15456 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.752451 15673 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:28.749782 15689 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:28.813227 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.814019 11142 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:28.729318 15646 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:11:28.798998 11293 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:28.799548 11853 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:28.820700 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.821465 11293 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:28.776878 15670 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.697327 15698 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.833235 11219 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:28.800350 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:28.797935 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 73953.7us
I20260709 12:11:28.816710 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.822672 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:28.823974 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 170499us
I20260709 12:11:28.819208 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2549) took 1786 ms. Trace:
I20260709 12:11:28.752663 15677 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:28.807103 11138 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:28.845709 15687 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.846395 15687 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.849175 15687 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.850648 15635 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:28.851430 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.852059 15703 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:28.852710 15703 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.853184 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:28.853838 11858 raft_consensus.cc:606] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:28.791838 15527 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:11:28.836966 11287 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:28.855072 15703 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.856009 15687 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.856233 11287 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:28.857836 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:28.858613 15687 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.863368 11138 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.864471 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:28.865233 11858 raft_consensus.cc:606] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:28.825103 15584 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:28.868533 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:28.869158 11141 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.870764 15584 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:28.799791 15642 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:28.871491 15642 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:28.776925 15457 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:28.874990 15457 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:28.875339 15457 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:28.876062 15457 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.877146 15457 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.878897 15464 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:28.879580 11289 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:28.879747 15464 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:28.880185 15464 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:28.880973 15464 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.881971 11135 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:28.882757 15690 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.883646 11138 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.885665 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.816591 15535 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:28.886397 15535 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:28.886744 15535 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:28.790192 15603 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:11:28.888230 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:28.890592 15154 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.891739 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:28.892738 15154 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:28.894375 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:28.837076 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.819705 15689 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:28.830083 15647 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:28.896606 15651 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.007s
I20260709 12:11:28.898164 11284 raft_consensus.cc:2410] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:28.898193 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:28.901090 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.916301 11288 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:28.902179 11219 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:28.916929 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.916929 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.917969 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:28.919226 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:28.842125 11293 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:28.839525 15456 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.911835 15646 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.920931 15647 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:28.839737 15670 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.911772 15689 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.842985 11291 rpcz_store.cc:276] 0709 12:11:27.033255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.033478 (+   223us) service_pool.cc:224] Handling call
0709 12:11:27.033837 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.034212 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.034240 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.035785 (+  1545us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.289991 (+1254206us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b180048d300. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:11:28.443182 (+153191us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:28.472733 (+ 29551us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.478743 (+  6010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.478825 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.590020 (+111195us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b180048d300. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:28.610152 (+ 20132us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b180048d300. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:28.819020 (+208868us) raft_consensus.cc:1685] finished
0709 12:11:28.819040 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.819155 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5764,"prepare.queue_time_us":56438,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":9894,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":19936,"spinlock_wait_cycles":27701760,"thread_start_us":152980,"threads_started":1,"wal-append.queue_time_us":1489715}
I20260709 12:11:28.910285 11141 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:28.882274 15464 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.913800 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e660be03b734102a4ad43c954498a96"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:28.921664 11144 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:28.972214 11144 pending_rounds.cc:85] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 5
I20260709 12:11:28.973742 15708 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.930912 11218 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:28.897385 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52042.1us
I20260709 12:11:28.949019 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:28.940758 11217 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.991258 11142 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:28.992894 11217 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:28.961210 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.994277 11141 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:28.995373 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.996620 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.997795 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.936075 11135 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:29.000352 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.851425 15635 consensus_queue.cc:1243] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:28.972556 11144 pending_rounds.cc:107] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:29.001787 11144 raft_consensus.cc:2889] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.002157 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.922953 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.998423 11141 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:11:29.008134 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55481.8us
I20260709 12:11:29.009466 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:29.009858 11135 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:28.938308 15673 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.012394 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:29.011355 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:29.013407 11135 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:29.015244 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:28.941134 15647 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:28.972504 15670 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:29.023968 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:28.936903 15669 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:29.021143 15376 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:28.914577 15274 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.036379 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:29.039556 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:29.015599 15673 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:29.057826 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.020151 15683 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.019244 15524 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.938905 15646 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:29.065595 15704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.025s	sys 0.039s
I20260709 12:11:29.009042 15708 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.124660 15708 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:29.128314 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.128647 15274 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:29.019718 15384 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:11:29.019855 15527 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:11:29.019418 15495 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:11:29.062116 15542 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:29.142441 15542 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:29.143539 15542 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:28.942952 15535 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.147548 15535 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.148965 15689 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.156359 15646 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:29.157444 11137 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:29.159266 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 123252us
I20260709 12:11:29.067126 15673 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.117089 15683 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:29.118544 15521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.045s	sys 0.081s
I20260709 12:11:29.170818 15677 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:29.200248 11286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.039s	sys 0.010s
I20260709 12:11:29.275363 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2828) took 1205 ms. Trace:
W20260709 12:11:29.319541 11286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.046s	sys 0.018s
W20260709 12:11:29.321135 11143 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.013s
W20260709 12:11:29.321617 11143 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.005s	sys 0.013s
I20260709 12:11:29.279086 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:29.193600 11030 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.714s	user 0.005s	sys 0.015s
W20260709 12:11:29.236161 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.319767 11144 rpcz_store.cc:276] 0709 12:11:28.069522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.083328 (+ 13806us) service_pool.cc:224] Handling call
0709 12:11:28.099105 (+ 15777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.002379 (+903274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.275022 (+272643us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000915d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:29.275268 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890473344}
W20260709 12:11:29.184254 15704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.025s	sys 0.041s
W20260709 12:11:29.194705 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.269897 11217 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.333063 11217 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.190132 15683 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:29.264729 15707 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
W20260709 12:11:29.335186 11140 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.002s	sys 0.017s
W20260709 12:11:29.314502 15521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.047s	sys 0.085s
W20260709 12:11:29.338603 11285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.003s
W20260709 12:11:29.343988 11285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.003s
W20260709 12:11:29.339890 11140 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.002s	sys 0.018s
W20260709 12:11:29.316310 15681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.003s	sys 0.015s
W20260709 12:11:29.346556 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 446041us
I20260709 12:11:29.329586 15677 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:29.349171 15634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.008s
I20260709 12:11:29.374373 11214 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:29.349061 15681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.003s	sys 0.015s
W20260709 12:11:29.376114 11259 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.002s	sys 0.022s
W20260709 12:11:29.379920 11259 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.002s	sys 0.023s
W20260709 12:11:29.380353 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 560648us
W20260709 12:11:29.380993 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.332168 15603 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
W20260709 12:11:29.381629 11215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.005s	sys 0.011s
W20260709 12:11:29.382982 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.008s	sys 0.008s
W20260709 12:11:29.377089 15634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.008s
I20260709 12:11:29.377385 15677 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:29.382582 15699 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.004s	sys 0.021s
W20260709 12:11:29.390974 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.008s
I20260709 12:11:29.390446 11217 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:29.467010 11217 pending_rounds.cc:85] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 10
I20260709 12:11:29.467341 11217 pending_rounds.cc:107] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:29.467657 11217 raft_consensus.cc:2889] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:29.391211 11292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.000s	sys 0.036s
W20260709 12:11:29.468855 11292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.000s	sys 0.036s
I20260709 12:11:29.469887 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2561) took 1023 ms. Trace:
I20260709 12:11:29.470117 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:29.471943 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:29.472949 11291 raft_consensus.cc:2410] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:29.470230 11292 rpcz_store.cc:276] 0709 12:11:28.446693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.446828 (+   135us) service_pool.cc:224] Handling call
0709 12:11:28.449805 (+  2977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.450046 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:28.658655 (+208609us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.469368 (+810713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.469426 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.469472 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.469543 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.469831 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22696,"prepare.queue_time_us":160257,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":84,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":976442,"threads_started":2}
W20260709 12:11:29.474764 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.475641 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 726012us
W20260709 12:11:29.476801 11026 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 8ce10840f1d143948ae8836765fb74d1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 10
I20260709 12:11:29.478521 15689 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:29.482430 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:29.484153 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:29.484802 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:29.396801 11144 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:29.385790 11215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.005s	sys 0.011s
W20260709 12:11:29.390946 15298 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.004s
I20260709 12:11:29.366070 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:29.461077 15154 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:29.462901 15457 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.585s	user 0.017s	sys 0.000s
I20260709 12:11:29.463424 15658 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.464365 15669 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.464783 15670 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.465307 15331 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.466096 15646 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.383540 15675 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.393576 11213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.019s
I20260709 12:11:29.506470 11212 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
W20260709 12:11:29.505944 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 140007us
I20260709 12:11:29.506930 15298 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:29.488241 15709 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:11:29.509254 15642 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.003s
W20260709 12:11:29.495347 15699 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.004s	sys 0.021s
I20260709 12:11:29.391984 15698 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.506974 15274 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.508965 15154 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:29.535863 11219 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.521435 15634 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:11:29.525475 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:29.539840 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:29.524268 11213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.016s	sys 0.024s
I20260709 12:11:29.511415 15658 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.542944 15658 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:29.530260 11859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.001s	sys 0.031s
W20260709 12:11:29.544934 11859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.001s	sys 0.031s
W20260709 12:11:29.530171 15682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.031s	sys 0.028s
W20260709 12:11:29.537345 11184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.013s
W20260709 12:11:29.565654 11184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.015s	sys 0.013s
I20260709 12:11:29.545856 11858 raft_consensus.cc:606] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:29.546446 11211 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:29.547755 11216 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.011s	sys 0.010s
W20260709 12:11:29.570401 11216 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.010s
W20260709 12:11:29.537907 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.015s
W20260709 12:11:29.571486 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.015s
I20260709 12:11:29.527705 15675 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:29.572492 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 557300us
W20260709 12:11:29.565526 15682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.032s	sys 0.029s
I20260709 12:11:29.563630 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:29.529376 15683 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:29.530100 15669 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:29.563000 15647 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.569964 11858 raft_consensus.cc:614] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.577692 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:29.563750 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:29.528013 15457 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:29.590267 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:29.526117 15670 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:29.566179 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 544963us
W20260709 12:11:29.548077 15548 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.014s	sys 0.028s
I20260709 12:11:29.528136 15646 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:29.528333 15331 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:29.563050 15639 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.534265 15524 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.586894 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:29.533077 15642 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:29.589197 11136 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.020s	sys 0.073s
I20260709 12:11:29.567163 15651 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.605479 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:29.606367 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:29.600956 11137 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:29.602706 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.011s
W20260709 12:11:29.674981 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.015s	sys 0.012s
W20260709 12:11:29.675681 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 663346us
I20260709 12:11:29.675915 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:29.595988 15510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.011s	sys 0.017s
I20260709 12:11:29.677559 11291 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:29.670373 15331 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:29.679096 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:29.680565 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:29.628603 15673 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:29.685894 15522 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:29.688745 15522 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.689186 15522 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.689574 15522 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.692690 15669 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:29.694285 15709 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.698540 15682 raft_consensus.cc:993] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:29.701493 15464 raft_consensus.cc:1081] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:29.702852 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2233) took 1172 ms. Trace:
I20260709 12:11:29.703446 11211 rpcz_store.cc:276] 0709 12:11:28.530008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.530247 (+   239us) service_pool.cc:224] Handling call
0709 12:11:29.702604 (+1172357us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54002a03d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:29.702776 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298690816}
I20260709 12:11:29.706295 15646 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:29.709287 15642 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:29.722432 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:29.591512 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:29.627337 11183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.024s
W20260709 12:11:29.726928 11183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.004s	sys 0.024s
W20260709 12:11:29.727764 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 136311us
W20260709 12:11:29.728067 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.634640 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:29.638177 15384 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.612340 15548 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.014s	sys 0.028s
I20260709 12:11:29.592113 15456 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:29.602659 15690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.010s	sys 0.031s
I20260709 12:11:29.642313 11286 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
W20260709 12:11:29.643883 11136 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.020s	sys 0.073s
I20260709 12:11:29.645083 11214 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:29.617522 15687 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.626786 15707 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:11:29.666657 11042 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.746855 15647 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:11:29.666682 15524 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:29.729661 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:29.731487 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:29.741559 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.742164 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:29.859993 11860 raft_consensus.cc:606] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:29.860559 11860 raft_consensus.cc:614] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:29.833380 15690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.010s	sys 0.039s
I20260709 12:11:29.619107 15154 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:29.725469 15510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.012s	sys 0.017s
W20260709 12:11:29.818823 11139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.027s	sys 0.031s
I20260709 12:11:29.749980 15384 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:29.791386 15376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.014s	sys 0.021s
I20260709 12:11:29.747534 15651 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:29.911715 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:29.800338 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.794734 11290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.023s	sys 0.020s
I20260709 12:11:29.670373 15670 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:29.823859 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 200391us
W20260709 12:11:29.917217 11290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.025s	sys 0.022s
I20260709 12:11:29.787557 11030 maintenance_manager.cc:643] P 77709ed97aed432192038c6d22f779bc: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.049s	user 0.207s	sys 0.086s Metrics: {"bytes_written":30495,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":150419,"dirs.run_cpu_time_us":451,"dirs.run_wall_time_us":3710,"drs_written":1,"lbm_read_time_us":3932,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":331817,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":4,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":1920,"thread_start_us":526598,"threads_started":2,"update_count":22,"wal-append.queue_time_us":709430}
I20260709 12:11:29.716943 15658 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.750584 15456 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:29.843590 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.788883 15457 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:29.855975 11042 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 9 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:29.827478 15634 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:29.848071 15646 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.848503 15687 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:29.906723 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.905061 11139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.027s	sys 0.032s
W20260709 12:11:29.911468 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 181941us
W20260709 12:11:29.916776 11143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.021s
W20260709 12:11:30.187597 11143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.010s	sys 0.021s
I20260709 12:11:30.188571 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 832) took 1576 ms. Trace:
I20260709 12:11:30.189019 11143 rpcz_store.cc:276] 0709 12:11:28.612594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.612768 (+   174us) service_pool.cc:224] Handling call
0709 12:11:28.613061 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.613262 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:29.322037 (+708775us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.188097 (+866060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.188175 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.188232 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.188321 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.188495 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36782,"prepare.queue_time_us":1042179,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"thread_start_us":1510928,"threads_started":2}
W20260709 12:11:30.056387 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 138673us
W20260709 12:11:30.065577 11142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.013s	sys 0.021s
I20260709 12:11:29.963881 15456 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:29.913786 15376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.017s	sys 0.021s
I20260709 12:11:29.848356 15677 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:30.021559 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 290169us
I20260709 12:11:29.920574 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:29.913364 15651 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.086773 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
W20260709 12:11:30.090958 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.903132 15698 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:29.910575 15409 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
W20260709 12:11:30.119626 11284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.062s
I20260709 12:11:30.060798 15495 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.056910 15669 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:30.087356 15331 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:30.096741 15642 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:30.384598 15642 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.386998 15642 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:30.387575 15642 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:30.388074 15642 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.094589 15670 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:30.389780 15670 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.392021 15670 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:30.392575 15670 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:30.393060 15670 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:29.964573 15658 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.396322 15658 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:30.154948 11285 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.011s	sys 0.011s
W20260709 12:11:30.397234 11285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.011s	sys 0.011s
I20260709 12:11:30.089440 15408 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:11:30.120518 15647 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.162698 11138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.027s	sys 0.021s
I20260709 12:11:30.061743 15549 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:30.072028 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.403172 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.155427 15681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.009s	sys 0.012s
I20260709 12:11:30.175266 11042 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 14, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.411176 11042 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 11, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 11 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:30.183775 11107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.010s
W20260709 12:11:30.414700 11107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.010s	sys 0.010s
W20260709 12:11:30.192965 11142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.014s	sys 0.022s
W20260709 12:11:30.237920 11135 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.002s	sys 0.015s
W20260709 12:11:30.267293 11292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.011s	sys 0.016s
W20260709 12:11:30.416504 11135 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.006s	sys 0.017s
W20260709 12:11:30.416698 11292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.011s	sys 0.019s
W20260709 12:11:30.229822 15542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.008s	sys 0.015s
W20260709 12:11:30.415059 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 846852us
W20260709 12:11:30.284493 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 97083.3us
I20260709 12:11:30.423373 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:30.425275 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:30.193946 15687 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:30.240186 11140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.018s	sys 0.008s
W20260709 12:11:30.241549 11216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.000s	sys 0.017s
I20260709 12:11:30.196413 15376 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:30.231890 15699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.011s
W20260709 12:11:30.361058 11284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.014s	sys 0.062s
W20260709 12:11:30.363292 11109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.007s	sys 0.015s
I20260709 12:11:30.396363 15683 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:30.193873 15646 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.362226 15651 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.372515 11031 maintenance_manager.cc:419] P 77709ed97aed432192038c6d22f779bc: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9395 bytes on disk
I20260709 12:11:30.373293 15603 raft_consensus.cc:993] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:30.183354 15675 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:30.373423 15731 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:11:30.374511 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 891) took 1661 ms. Trace:
I20260709 12:11:30.242692 15384 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:30.383220 15457 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:30.397895 11215 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.113s	sys 0.148s
W20260709 12:11:30.579375 15724 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:11:30.579197 15457 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:30.579802 15732 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.671s	user 0.003s	sys 0.000s
I20260709 12:11:30.581813 15457 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:30.399605 11138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.027s	sys 0.021s
W20260709 12:11:30.363765 15728 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.504s	user 0.000s	sys 0.002s
I20260709 12:11:30.584349 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2571) took 1925 ms. Trace:
W20260709 12:11:30.362424 15548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.009s
I20260709 12:11:30.413391 11042 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 11, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 11 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:11:30.407822 11141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.018s	sys 0.010s
W20260709 12:11:30.586201 11141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.018s	sys 0.010s
I20260709 12:11:30.396891 15658 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.450680 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:30.463071 11289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.011s	sys 0.033s
W20260709 12:11:30.466610 11109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.008s	sys 0.015s
I20260709 12:11:30.359462 11860 raft_consensus.cc:606] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:30.469262 11216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.000s	sys 0.030s
W20260709 12:11:30.469574 11140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.025s	sys 0.014s
I20260709 12:11:30.402884 15549 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:30.480365 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.419847 15681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.009s	sys 0.015s
W20260709 12:11:30.420245 15542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.008s	sys 0.022s
I20260709 12:11:30.409865 15669 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:30.471596 15699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.015s	sys 0.018s
I20260709 12:11:30.462457 15698 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.559365 15642 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:30.560567 15298 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:30.560741 11030 maintenance_manager.cc:643] P 77709ed97aed432192038c6d22f779bc: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":378,"lbm_reads_lt_1ms":4}
W20260709 12:11:30.564479 11210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1846) took 2017 ms (client timeout 2635 ms). Trace:
W20260709 12:11:30.619478 11210 rpcz_store.cc:269] 0709 12:11:28.634721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.661692 (+ 26971us) service_pool.cc:224] Handling call
0709 12:11:30.564265 (+1902573us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000262d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:30.564414 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846680832}
I20260709 12:11:30.565922 15682 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.409844 15647 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.623121 15647 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:30.567770 15673 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:30.569450 15670 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:30.574911 15376 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.624161 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2133) took 1753 ms. Trace:
I20260709 12:11:30.624528 11138 rpcz_store.cc:276] 0709 12:11:28.870399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.007030 (+136631us) service_pool.cc:224] Handling call
0709 12:11:29.007489 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.016716 (+  9227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.016753 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.026148 (+  9395us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.582790 (+1556642us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:30.582837 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.582919 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.623939 (+ 41020us) raft_consensus.cc:1685] finished
0709 12:11:30.623962 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.624102 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88504,"raft.queue_time_us":8904,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7167,"thread_start_us":1390096,"threads_started":1,"wal-append.queue_time_us":1451671}
I20260709 12:11:30.467137 15738 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.575555 15540 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:30.576325 15510 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:30.620679 15682 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.627050 15540 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:30.578521 15733 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:11:30.400069 15331 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:30.629591 15682 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:30.629782 15540 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:30.579519 11215 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.113s	sys 0.148s
I20260709 12:11:30.584829 11285 rpcz_store.cc:276] 0709 12:11:28.659432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.659982 (+   550us) service_pool.cc:224] Handling call
0709 12:11:28.660248 (+   266us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:28.663329 (+  3081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.663357 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:28.678681 (+ 15324us) log.cc:844] Serialized 52 byte log entry
0709 12:11:29.344629 (+665948us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:30.397622 (+1052993us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.401919 (+  4297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.402009 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.584071 (+182062us) raft_consensus.cc:1685] finished
0709 12:11:30.584093 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.584277 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2633,"prepare.queue_time_us":1039026,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":182939,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":10635,"thread_start_us":1586055,"threads_started":2,"wal-append.queue_time_us":1411208}
I20260709 12:11:30.630455 15331 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:11:30.581712 15734 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 12:11:30.631065 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 680) took 1745 ms. Trace:
W20260709 12:11:30.435207 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.632586 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 679) took 1747 ms. Trace:
I20260709 12:11:30.631596 11216 rpcz_store.cc:276] 0709 12:11:28.885632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.896468 (+ 10836us) service_pool.cc:224] Handling call
0709 12:11:28.896760 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.896950 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:29.570908 (+673958us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.630675 (+1059767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.630745 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.630811 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.630882 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.631005 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35521,"prepare.queue_time_us":896546,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":1697474,"threads_started":2,"wal-append.queue_time_us":1011076}
W20260709 12:11:30.595088 11289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.011s	sys 0.033s
I20260709 12:11:30.578214 11290 rpcz_store.cc:276] 0709 12:11:28.713090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.713332 (+   242us) service_pool.cc:224] Handling call
0709 12:11:28.713628 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.713982 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.714010 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.714611 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.918056 (+1203445us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:29.918197 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.918306 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.374219 (+455913us) raft_consensus.cc:1685] finished
0709 12:11:30.374247 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.374418 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1325,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":90,"thread_start_us":1202700,"threads_started":1,"wal-append.queue_time_us":1645547}
I20260709 12:11:30.605623  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:30.633030 11213 rpcz_store.cc:276] 0709 12:11:28.885310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.889352 (+  4042us) service_pool.cc:224] Handling call
0709 12:11:28.889656 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.889979 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.890007 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.890420 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.546883 (+656463us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.546926 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.547000 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.632332 (+1085332us) raft_consensus.cc:1685] finished
0709 12:11:30.632358 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.632518 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1236,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":112,"thread_start_us":656012,"threads_started":1,"wal-append.queue_time_us":1206634}
I20260709 12:11:30.634503 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:30.635007  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:30.616815 15669 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.617519 15384 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.464707 15689 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:11:30.581610 15740 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:30.596714 11042 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 11, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 11 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:30.616364 15725 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 12:11:30.636163  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:30.587347 15548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.013s	sys 0.010s
I20260709 12:11:30.627223 15510 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.642701 15457 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.602002 15408 raft_consensus.cc:1081] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:30.646733 11042 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 13, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 13 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.636425 15758 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.594249 15658 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:30.640512 15647 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.638381 15740 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:30.654726 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:30.639402 15736 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.479s	user 0.001s	sys 0.001s
W20260709 12:11:30.653532 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 460961us
I20260709 12:11:30.648837 15673 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.638710 15681 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.675429 11859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 495) took 1994 ms. Trace:
I20260709 12:11:30.675719 15681 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.675896 11859 rpcz_store.cc:276] 0709 12:11:28.681303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.696221 (+ 14918us) service_pool.cc:224] Handling call
0709 12:11:28.705575 (+  9354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.705968 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.706005 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.708496 (+  2491us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.949284 (+240788us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b18002fd220. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:11:29.545642 (+596358us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:29.545711 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.546203 (+   492us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.675096 (+1128893us) raft_consensus.cc:1685] finished
0709 12:11:30.675120 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.675357 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3321,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":19609,"spinlock_wait_cycles":12122496,"thread_start_us":596021,"threads_started":1,"wal-append.queue_time_us":1300901}
I20260709 12:11:30.605823 15549 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.678200 15681 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:30.680819 15681 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:30.681676 15681 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.615280 15456 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.634167 15707 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:30.660678 15756 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:11:30.660516 11042 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 4 to 9, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.638410 15384 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.690428 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:30.691191 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.022s	sys 0.044s
I20260709 12:11:30.686813 11042 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:30.691884 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.022s	sys 0.044s
I20260709 12:11:30.696395 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 834) took 2081 ms. Trace:
I20260709 12:11:30.693262 11042 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 4 to 6, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 6 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:30.671753 15658 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.696841 11136 rpcz_store.cc:276] 0709 12:11:28.614828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.614985 (+   157us) service_pool.cc:224] Handling call
0709 12:11:28.615254 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.615448 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:29.833789 (+1218341us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.695058 (+861269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.695115 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.695158 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.696212 (+  1054us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.696339 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67198,"prepare.queue_time_us":1059552,"prepare.run_cpu_time_us":4646,"prepare.run_wall_time_us":34402,"raft.queue_time_us":333966,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8189,"thread_start_us":1988778,"threads_started":3,"wal-append.queue_time_us":816207}
I20260709 12:11:30.699326 11042 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.740559 11137 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:30.708220 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:30.744357 11285 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:30.746238 11042 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 8, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.747879 11042 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 12, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:30.743489 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.775192 15753 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:11:30.776867 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 894) took 1298 ms. Trace:
I20260709 12:11:30.777431 11284 rpcz_store.cc:276] 0709 12:11:29.478302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.478447 (+   145us) service_pool.cc:224] Handling call
0709 12:11:29.478836 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.479212 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.479239 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.479668 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.466707 (+987039us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.466770 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.466870 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.776507 (+309637us) raft_consensus.cc:1685] finished
0709 12:11:30.776541 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.776778 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2558,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":986564,"threads_started":1,"wal-append.queue_time_us":992871}
I20260709 12:11:30.781208 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.782032 11143 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:30.784031 15384 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:30.784045 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.785681 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.786264 11143 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:30.787139 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.787711 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:30.788707 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.789112 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2840) took 2025 ms. Trace:
I20260709 12:11:30.789387 11143 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 3.
I20260709 12:11:30.789691 11139 rpcz_store.cc:276] 0709 12:11:28.763712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.772130 (+  8418us) service_pool.cc:224] Handling call
0709 12:11:28.772447 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.778426 (+  5979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.778457 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.778914 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.187080 (+1408166us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:30.238694 (+ 51614us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.657022 (+418328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.657129 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.784757 (+127628us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18003c14e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:30.788734 (+  3977us) raft_consensus.cc:1685] finished
0709 12:11:30.788870 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.789039 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5502,"prepare.queue_time_us":52628,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":63,"raft.queue_time_us":301746,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":29790,"spinlock_wait_cycles":8423296,"thread_start_us":1758166,"threads_started":2,"wal-append.queue_time_us":1559389}
I20260709 12:11:30.790954 11042 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.792294 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.792936 11139 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:30.793828 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.793584 11042 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:30.663519 15457 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.748387 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:30.844337 11136 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.694795 15331 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.695269 15690 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:30.703094 15726 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:11:30.797048 15549 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.684600 15647 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.745507 15762 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:30.790385 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.800128 15510 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:30.800614 15677 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:30.801318 15754 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:30.705688 15670 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.867254 15670 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:30.805676 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 884690us
I20260709 12:11:30.868530 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:30.705569 15646 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:30.777163 15764 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:30.804196 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:30.755546 15740 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:30.690928 15682 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:11:30.739362 15642 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.809470 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2849) took 1210 ms. Trace:
I20260709 12:11:30.806020 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:30.891165 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85233.9us
I20260709 12:11:30.891475 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 892) took 1413 ms. Trace:
I20260709 12:11:30.890216 11137 rpcz_store.cc:276] 0709 12:11:29.598934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.654448 (+ 55514us) service_pool.cc:224] Handling call
0709 12:11:29.672229 (+ 17781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.741287 (+1069058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.809222 (+ 67935us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400264654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:30.809408 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456264064}
I20260709 12:11:30.895452 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:30.899407 11137 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:30.705065 15335 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.696807 15707 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.897294 15642 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:30.912976 11256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.071s
W20260709 12:11:30.913359 11256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.071s
I20260709 12:11:30.915550 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:30.916849 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:30.891737 15766 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.898010 15768 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.935740 15646 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:30.936601 15768 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.937201 15768 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.936865 15646 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.892014 15677 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:30.939113 15677 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.935763 15766 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.939607 15677 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:30.858872 15331 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.865952 15690 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.946870 15456 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:30.953510 15408 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.954119 15408 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:30.967274 15408 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.968720 15408 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.834154 15689 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.969770 15689 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.859174 11143 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:30.973234 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 846) took 1256 ms. Trace:
I20260709 12:11:30.866919 15762 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.671139 15758 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:30.869656 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 895) took 1390 ms. Trace:
I20260709 12:11:30.975895 11289 rpcz_store.cc:276] 0709 12:11:29.478814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.479630 (+   816us) service_pool.cc:224] Handling call
0709 12:11:29.480406 (+   776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.480864 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.480902 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.482143 (+  1241us) log.cc:844] Serialized 501 byte log entry
0709 12:11:30.633389 (+1151246us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.633436 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.633518 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.869400 (+235882us) raft_consensus.cc:1685] finished
0709 12:11:30.869422 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.869593 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1150871,"threads_started":1,"wal-append.queue_time_us":1204825}
I20260709 12:11:30.978406 11139 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:30.981950 11139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:11:30.982088 15542 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:30.877919 15765 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.982880 11139 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:30.983880 11139 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.973663 11143 rpcz_store.cc:276] 0709 12:11:29.717216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.972133 (+1254917us) service_pool.cc:224] Handling call
0709 12:11:30.972603 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.972822 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.972870 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.972930 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:30.972975 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.973046 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.973167 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:31.001401 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.707808 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:30.961020 15740 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.091342 11290 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
W20260709 12:11:30.883993 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79858.9us
W20260709 12:11:31.095616 11141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.017s
W20260709 12:11:31.104027 11141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.001s	sys 0.017s
I20260709 12:11:31.058741 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:31.043673 15675 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:31.110031 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.111404 11210 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:31.044322 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:30.982901 15542 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:30.891857 11292 rpcz_store.cc:276] 0709 12:11:29.477636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.486898 (+  9262us) service_pool.cc:224] Handling call
0709 12:11:29.487266 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.487727 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:30.420571 (+932844us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.890987 (+470416us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.891154 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.891198 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.891240 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.891303 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.891420 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":898711,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":111,"raft.queue_time_us":5360,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":29368,"thread_start_us":1398877,"threads_started":2}
I20260709 12:11:30.846451 11042 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 14, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 14 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:30.855417 15687 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.043351 15765 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.095757 11142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.011s	sys 0.002s
W20260709 12:11:31.145165 11142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.011s	sys 0.002s
I20260709 12:11:31.146363 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2847) took 2126 ms. Trace:
W20260709 12:11:31.095690 11824 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.007s
I20260709 12:11:31.108057 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:31.043035 15456 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.124879 11140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.001s	sys 0.029s
W20260709 12:11:31.162197 11140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.029s
I20260709 12:11:31.127362 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 845) took 1506 ms. Trace:
I20260709 12:11:31.127094 11042 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:31.148927 11824 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.006s	sys 0.007s
I20260709 12:11:31.104668 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2844) took 2206 ms. Trace:
I20260709 12:11:31.163450 11137 rpcz_store.cc:276] 0709 12:11:29.621180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.915581 (+1294401us) service_pool.cc:224] Handling call
0709 12:11:30.915954 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.127055 (+211101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.127086 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.127126 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:31.127156 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.127209 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.127310 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.164804 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:31.166427 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:31.167819 11137 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
W20260709 12:11:31.183185 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.163997 11141 rpcz_store.cc:276] 0709 12:11:28.898606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.012403 (+113797us) service_pool.cc:224] Handling call
0709 12:11:29.012645 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.012832 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:29.533981 (+521149us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.104309 (+1570328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.104377 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.104430 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.104503 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.104614 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":732150,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":93613,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":2046043,"threads_started":3,"wal-append.queue_time_us":1052561}
I20260709 12:11:31.188040 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 833) took 2549 ms. Trace:
I20260709 12:11:31.188534 11140 rpcz_store.cc:276] 0709 12:11:28.613970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.614125 (+   155us) service_pool.cc:224] Handling call
0709 12:11:28.685160 (+ 71035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.685381 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:29.345231 (+659850us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.162713 (+1817482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.162801 (+    88us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:31.162869 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.162966 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.163141 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22428,"prepare.queue_time_us":1029695,"prepare.run_cpu_time_us":4657,"prepare.run_wall_time_us":41006,"raft.queue_time_us":86108,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":58,"thread_start_us":2410076,"threads_started":3,"wal-append.queue_time_us":1238836}
I20260709 12:11:31.181641 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:31.183285 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 59737.4us
I20260709 12:11:31.190451 11213 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:11:31.044255 15767 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:31.191658 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:31.193593 11144 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:31.203059 11285 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:31.204981 11139 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.208369 11136 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:31.196174 11042 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 12, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:31.090297 15771 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:31.211503 11042 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.146911 11142 rpcz_store.cc:276] 0709 12:11:29.019812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.136228 (+116416us) service_pool.cc:224] Handling call
0709 12:11:29.136609 (+   381us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:29.176945 (+ 40336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.176992 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:29.194130 (+ 17138us) log.cc:844] Serialized 78 byte log entry
0709 12:11:30.415767 (+1221637us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:30.468539 (+ 52772us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.145819 (+677280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.145975 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.146047 (+    72us) raft_consensus.cc:1685] finished
0709 12:11:31.146071 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.146279 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39783,"prepare.queue_time_us":53659,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":251985,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":8690,"thread_start_us":1750547,"threads_started":2,"wal-append.queue_time_us":1285854}
I20260709 12:11:31.159467 15154 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.222244 14457 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:31.215431 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2850) took 1616 ms. Trace:
I20260709 12:11:31.159888 15669 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:31.159467 15495 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:11:31.181656 15765 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.160171 15675 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:31.229318 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.289868 11140 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.316632 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:31.395306 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:31.424269 14457 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.200305 15510 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:31.284798 11291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.016s	sys 0.056s
I20260709 12:11:31.330879 15778 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:31.484073 11137 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
W20260709 12:11:31.493327 11216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.008s	sys 0.016s
I20260709 12:11:31.425987 11042 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 9, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 9 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:31.219223 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:31.214829 11183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.028s
W20260709 12:11:31.495033 11183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.009s	sys 0.032s
W20260709 12:11:31.481918 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 86707.4us
W20260709 12:11:31.485595 11291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.026s	sys 0.079s
I20260709 12:11:31.336292 15758 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.293815 11139 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:31.427713 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.336673 15762 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:31.264286 15757 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:11:31.333889 15522 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.644s	user 0.018s	sys 0.005s
I20260709 12:11:31.288228 15670 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:31.493331 15495 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:31.216001 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:31.565551 11141 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:31.567704 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2857) took 1259 ms. Trace:
I20260709 12:11:31.568187 11141 rpcz_store.cc:276] 0709 12:11:30.308363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.566481 (+1258118us) service_pool.cc:224] Handling call
0709 12:11:31.566924 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.567282 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.567325 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.567388 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:31.567432 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.567505 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.567637 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.570276 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2858) took 1261 ms. Trace:
I20260709 12:11:31.572331 11141 rpcz_store.cc:276] 0709 12:11:30.308887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.569349 (+1260462us) service_pool.cc:224] Handling call
0709 12:11:31.569680 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.569887 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.569923 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.569976 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.570018 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.570087 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.570213 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.575341 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2860) took 1265 ms. Trace:
I20260709 12:11:31.228828 15635 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.483356 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 849) took 1427 ms. Trace:
I20260709 12:11:31.581642 11140 rpcz_store.cc:276] 0709 12:11:30.055966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.262332 (+1206366us) service_pool.cc:224] Handling call
0709 12:11:31.289643 (+ 27311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.482978 (+193335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.483273 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.419773 11144 rpcz_store.cc:276] 0709 12:11:29.599239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.729616 (+130377us) service_pool.cc:224] Handling call
0709 12:11:29.730154 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.201594 (+1471440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.215108 (+ 13514us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003ca354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:31.215359 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3365021568}
I20260709 12:11:31.204663 15549 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:31.486879 11259 leader_election.cc:336] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.515s (SENT)
W20260709 12:11:31.587805 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 100958us
W20260709 12:11:31.589470 11259 leader_election.cc:336] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.652s (SENT)
W20260709 12:11:31.212903 15698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.011s
W20260709 12:11:31.590711 15698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.006s	sys 0.015s
I20260709 12:11:31.591061 15698 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:31.592217 15698 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:31.449920 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.011s	sys 0.038s
W20260709 12:11:31.594689 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.013s	sys 0.039s
W20260709 12:11:31.595389 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 1.14473e+06us
W20260709 12:11:31.596081 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.498368 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 673652us
I20260709 12:11:31.597679 15781 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:31.599938 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:31.601118 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:31.498979 14457 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.603017 15762 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:31.311367 15331 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:31.603555 15762 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:31.604293 15762 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:31.590081 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:31.602173 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:31.338615 15647 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.338531 15687 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.301663 15646 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:31.337349 15690 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:31.403580 15708 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.187294 15456 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.511791 11042 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:31.403373 15739 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.339931 15542 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:31.514778 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 295659us
I20260709 12:11:31.356325 15707 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:31.185205 15769 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:31.205108 15775 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:31.585057 15495 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:31.649278 15775 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.621547 15331 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.516666 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 850) took 1387 ms. Trace:
I20260709 12:11:31.650027 15495 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.305320 15642 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:31.451776 15669 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.543716 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2855) took 1236 ms. Trace:
I20260709 12:11:31.657611 11137 rpcz_store.cc:276] 0709 12:11:30.307204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.542557 (+1235353us) service_pool.cc:224] Handling call
0709 12:11:31.543019 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.543261 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.543298 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.543359 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:31.543405 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.543482 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.543637 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.658932 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.659109 11137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:11:31.659730 11137 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:31.660087 11137 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.660795 11213 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:31.661922 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:31.423727 15788 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:31.493396 15376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.013s	sys 0.024s
I20260709 12:11:31.331432 15689 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:31.335816 15681 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.340646 15766 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.489758 15510 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.563391 15522 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.546861 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40324 (request call id 847) took 1825 ms. Trace:
W20260709 12:11:31.493454 11215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.009s	sys 0.027s
I20260709 12:11:31.693702 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:31.547250 15699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.009s	sys 0.059s
W20260709 12:11:31.494674 11216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.008s	sys 0.016s
I20260709 12:11:31.579061 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:31.630885 15780 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:31.698422 11217 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:31.497021 15408 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.007s
I20260709 12:11:31.537274 15726 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:31.662684 15788 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:31.586961 11140 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:31.701990 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2147) took 1297 ms. Trace:
I20260709 12:11:31.337644 15457 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.614822 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:31.217420 15767 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.620246 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.623741 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.708400 11285 raft_consensus.cc:2410] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:31.627427 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.692904 15510 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.635357 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.647730 15634 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:31.603574 15274 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.663461 11042 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:31.671700 15708 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.725978 11042 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 8, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 8 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.728425 11042 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 10, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.731029 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2862) took 1049 ms. Trace:
I20260709 12:11:31.731504 11144 rpcz_store.cc:276] 0709 12:11:30.681376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.643286 (+961910us) service_pool.cc:224] Handling call
0709 12:11:31.643605 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.715142 (+ 71537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.715173 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.715211 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.715239 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.730719 (+ 15480us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b54003cb254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:31.730785 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.730954 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164080384}
I20260709 12:11:31.672336 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.662678 11218 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:31.487152 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 379145us
I20260709 12:11:31.736826 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:31.738706 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:31.497694 15778 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:31.662806 15376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.013s	sys 0.025s
W20260709 12:11:31.694000 11215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.010s	sys 0.027s
I20260709 12:11:31.228603 15771 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.692942 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:31.783697 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45112.5us
I20260709 12:11:31.575798 11141 rpcz_store.cc:276] 0709 12:11:30.309952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.574360 (+1264408us) service_pool.cc:224] Handling call
0709 12:11:31.574708 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.574931 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.574967 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.575023 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:31.575068 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.575137 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.575278 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.688088 11137 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.693441 11139 rpcz_store.cc:276] 0709 12:11:29.720977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.981781 (+1260804us) service_pool.cc:224] Handling call
0709 12:11:31.293038 (+311257us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4c001b7940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982edb913f 00007f982ed7d2ab 00007f982edaaf3c 00007f982edab3fe 00007f982f03888b 00007f9830a37495 00007f9830a8830f 00007f9830ad2a55 00007f9835aa2cd0
0709 12:11:31.546338 (+253300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75774848}
W20260709 12:11:31.697737 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.347460 15677 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.702370 11140 rpcz_store.cc:276] 0709 12:11:30.404602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.582564 (+1177962us) service_pool.cc:224] Handling call
0709 12:11:31.582979 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.701685 (+118706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.701923 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.704321 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.704361 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:31.788606 11289 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.706629 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2845) took 2807 ms. Trace:
I20260709 12:11:31.587074 15635 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:31.698963 15699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.009s	sys 0.059s
I20260709 12:11:31.709196 11290 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:31.802382 11214 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.629060 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:31.803078 11292 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.710172 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.808903 11287 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
W20260709 12:11:31.710927 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 96241.7us
I20260709 12:11:31.711452 15784 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.711591 15767 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.648773 15769 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.717566 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.655611 11136 rpcz_store.cc:276] 0709 12:11:30.128845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.515520 (+1386675us) service_pool.cc:224] Handling call
0709 12:11:31.515956 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.516191 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.516241 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.516300 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:31.516348 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.516429 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.516587 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:31.720952 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.726189 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.829471 11217 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:31.759193 11144 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.730379 11042 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 10, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.726775 15274 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:31.707898 15768 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.770s	user 0.004s	sys 0.014s
I20260709 12:11:31.790518 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1850) took 3104 ms. Trace:
W20260709 12:11:31.784420 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1143951099998048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:11:31.873477 11110 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.515s (SENT)
W20260709 12:11:31.873606 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.740291 15744 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:31.705776 15780 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:31.800742 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:31.814010 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:31.815277 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:31.897682 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97043.7us
I20260709 12:11:31.816004 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:31.816772 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:31.812268 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.671841 15739 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.832250 11042 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:31.716131 15651 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.166s	user 0.028s	sys 0.007s
I20260709 12:11:31.899492 11288 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:31.836400 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:31.849123 15782 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:11:31.854135 11855 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.725679 15765 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:31.871165 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 229266us
I20260709 12:11:31.784080 15542 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.873919 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:31.789914 11135 rpcz_store.cc:276] 0709 12:11:28.898894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.018289 (+119395us) service_pool.cc:224] Handling call
0709 12:11:29.018674 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:29.121085 (+102411us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:29.532524 (+411439us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.826464 (+1293940us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:31.106332 (+279868us) log.cc:844] Serialized 52 byte log entry
0709 12:11:31.106577 (+   245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:31.292923 (+186346us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.296497 (+  3574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.296570 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.706405 (+409835us) raft_consensus.cc:1685] finished
0709 12:11:31.706424 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.706576 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1144028,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":100,"raft.queue_time_us":363962,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":30493,"thread_start_us":1766049,"threads_started":4,"wal-append.queue_time_us":1080481}
I20260709 12:11:31.873150 11215 rpcz_store.cc:276] 0709 12:11:28.635982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.754960 (+118978us) service_pool.cc:224] Handling call
0709 12:11:28.788744 (+ 33784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.789060 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.789092 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.789575 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.501133 (+711558us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:30.630573 (+1129440us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.740056 (+1109483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.740217 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.740285 (+    68us) raft_consensus.cc:1685] finished
0709 12:11:31.740304 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.740488 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13882,"prepare.queue_time_us":292547,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":13540,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":10344,"thread_start_us":2934430,"threads_started":3,"wal-append.queue_time_us":1001333,"wal-append.run_cpu_time_us":4256,"wal-append.run_wall_time_us":1844063}
I20260709 12:11:31.799427 15669 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.892017 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.893363 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:31.900933 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.946427 11292 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:31.899530 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:31.905678 11211 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:31.906931 11042 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 9, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 9 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:31.948570 11042 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 2 to 3, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:31.907881 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.950012 11217 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:31.953660 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.954882 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:31.955825 11288 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.820904 15783 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:11:31.912694 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:31.914532 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:31.938056 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:31.938122 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.967667 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:31.968488 11285 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:31.812549 15784 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:31.939764 11291 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 4.
I20260709 12:11:31.889953 15274 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.990336 15780 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.992223 11861 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:31.993589 11288 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
W20260709 12:11:31.958544 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85101.2us
W20260709 12:11:31.958781 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59368.7us
I20260709 12:11:31.995335 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:31.995676 15522 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:31.959250 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.960544 11042 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 13 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:11:32.003571 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65633.8us
I20260709 12:11:32.014345 11042 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 9, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:31.940047 15757 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:32.015092 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:31.972348 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.020438 11214 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:32.020563 11217 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 4.
I20260709 12:11:31.911070 11289 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:31.973555 11287 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:31.937274 15744 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:31.977722 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:31.983562 15677 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:32.002393 15790 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.290s	user 0.000s	sys 0.003s
I20260709 12:11:31.984010 15771 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:31.989610 15708 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:31.912891 15331 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:31.996061 11110 connection.cc:256] RPC call timeout handler was delayed by -1.022656040999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 12:11:32.043325 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.043881 11217 raft_consensus.cc:2376] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13. Re-sending same reply.
I20260709 12:11:31.996388 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:32.045406 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49084.4us
I20260709 12:11:32.046324 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:32.020449 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:32.044123 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.047508 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.047969 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:31.955380 15675 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:32.049809 15675 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:32.050168 15675 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.024715 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1902) took 1311 ms. Trace:
I20260709 12:11:32.004455 15762 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:31.983338 15796 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:32.051483 15796 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.051846 15796 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:32.050761 11293 rpcz_store.cc:276] 0709 12:11:30.713129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.715744 (+  2615us) service_pool.cc:224] Handling call
0709 12:11:30.716129 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:30.878257 (+162128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.878287 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.108344 (+230057us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.703640 (+595296us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:31.703686 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.714260 (+ 10574us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540017e8d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:31.714317 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.020111 (+305794us) raft_consensus.cc:1685] finished
0709 12:11:32.020137 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.024627 (+  4490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7805,"raft.queue_time_us":7935,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8448,"spinlock_wait_cycles":353796992,"thread_start_us":498107,"threads_started":1,"wal-append.queue_time_us":707216}
I20260709 12:11:31.967140 15779 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.052722 15796 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.050304 15778 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:32.054111 15796 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.936127 15646 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:11:31.964547 15765 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.054641 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 848) took 2305 ms. Trace:
I20260709 12:11:32.055274 15765 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:32.055903 15708 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.054653 15689 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.056643 15708 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:32.056881 11137 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:32.057333 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40324 (request call id 854) took 1300 ms. Trace:
I20260709 12:11:31.895947 15788 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.057590 15708 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.055117 11143 rpcz_store.cc:276] 0709 12:11:29.749170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.112987 (+1363817us) service_pool.cc:224] Handling call
0709 12:11:31.185781 (+ 72794us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:31.220071 (+ 34290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.220106 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:31.262175 (+ 42069us) log.cc:844] Serialized 52 byte log entry
0709 12:11:31.783314 (+521139us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:31.783361 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.783431 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.054389 (+270958us) raft_consensus.cc:1685] finished
0709 12:11:32.054414 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.054578 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19284,"raft.queue_time_us":27574,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":57702,"thread_start_us":469586,"threads_started":1,"wal-append.queue_time_us":721627}
I20260709 12:11:31.997678 15669 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.894820 15768 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.061280 15788 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.062263 15768 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:31.935945 15651 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.064286 15651 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.005532 15635 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.065215 11138 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:32.003232 15456 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.017390 11042 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 15, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.068092 15739 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.069100 15698 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.069546 15698 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:32.070415 15698 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.071771 15274 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.010370 15784 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.024732 15154 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:11:32.004218 15408 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 4 to 9, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:32.043905 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.079916 11215 raft_consensus.cc:2376] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10. Re-sending same reply.
W20260709 12:11:32.037938 15658 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.231s	user 0.012s	sys 0.005s
I20260709 12:11:32.050530 15675 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.964799 15795 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.052554 15762 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.057785 11137 rpcz_store.cc:276] 0709 12:11:30.757339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.658977 (+901638us) service_pool.cc:224] Handling call
0709 12:11:32.056739 (+397762us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b4c001b75c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982edb913f 00007f982ed7d2ab 00007f982edaaf3c 00007f982edab3fe 00007f982f03888b 00007f9830a37495 00007f9830a8830f 00007f9830ad2a55 00007f9835aa2cd0
0709 12:11:32.057268 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75237248}
I20260709 12:11:32.005735 15376 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.004578 15726 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:31.818248 15642 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 12:11:32.055413 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:32.035588 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 222001us
I20260709 12:11:31.970472 15775 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:32.102650 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47304.3us
I20260709 12:11:32.071727 15698 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.103449 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:32.090016 11214 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:32.091325 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:32.091485 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:32.092108 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.106943 11289 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:32.105741 11293 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:32.112810 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:32.042309 15331 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.118010 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.056100 15765 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.224866 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.223728 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.225922 11214 raft_consensus.cc:2376] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10. Re-sending same reply.
W20260709 12:11:32.176219 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63835.8us
I20260709 12:11:32.055747 15769 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:32.215330 11217 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13.
W20260709 12:11:32.135885 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 307279us
I20260709 12:11:32.080847 15777 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.233985 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.234300 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.234700 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.244912 11860 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:32.030294 15738 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:11:32.240950 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:32.251757 11259 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.059s (SENT)
W20260709 12:11:32.248435 11110 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.508s (SENT)
I20260709 12:11:32.253142 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:32.254530 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.257572 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.258425 11211 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:32.214102 15646 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:32.110806 15726 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:32.283429 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 340593us
I20260709 12:11:32.283929 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.291193 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.286504 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:32.225224 15331 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.098636 15658 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.223142 15778 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:32.236816 15765 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.227249 15771 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.300806 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:32.285112 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.310904 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.311334 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.319339 11289 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:32.304128 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:32.312500 11259 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.124s (SENT)
I20260709 12:11:32.289268 15646 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.251672 15769 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:32.226795 15669 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:11:32.314170 15740 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.204s	user 0.012s	sys 0.000s
I20260709 12:11:32.114497 15795 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.328452 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.326411 11293 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:32.334086 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:32.316424 15778 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.340677 11287 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:11:32.325964 15770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.036s	sys 0.055s
I20260709 12:11:32.321369 15771 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.329901 15646 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:32.324656 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:32.263160 15777 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.357451 11858 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:32.344843 15778 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:32.360016 15658 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:32.352749 15771 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.369588 15784 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.356413 15642 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.372617 15670 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.373054 15670 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:32.346092 15770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.036s	sys 0.056s
I20260709 12:11:32.330834 15793 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:32.375335 15793 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.376123 15726 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.377298 15726 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:32.377483 15793 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:32.373896 15670 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.380820 15670 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.383787 15376 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.334477 15769 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.385035 11288 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:32.386047 15769 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:32.390847 15777 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.391764 15795 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.391970 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.394410 15771 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.396502 15771 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:32.397311 15778 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.399344 15778 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:32.399469 15274 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.400048 15646 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:32.400600 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.402025 15646 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:32.403302 11259 leader_election.cc:336] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.134s (SENT)
I20260709 12:11:32.404481 15744 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:32.384250 15376 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:32.407531 15376 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.408869 15376 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.393347 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:32.415195 11854 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.415527 11854 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:32.416406 11854 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.417573 11854 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.417956 11861 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
W20260709 12:11:32.428074 15510 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.000s
I20260709 12:11:32.428568 15510 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.414172 15675 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.451813 15510 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:32.455693 15784 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:32.456619 15776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.018s	sys 0.023s
W20260709 12:11:32.477806 15776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.019s	sys 0.024s
I20260709 12:11:32.534132  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:32.538089 11109 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.9.180.190:38919, user_credentials={real_user=slave}} blocked reactor thread for 287842us
W20260709 12:11:32.540009 11138 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2859) took 1935 ms (client timeout 1662 ms). Trace:
W20260709 12:11:32.549041 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 300445us
W20260709 12:11:32.553836 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.760988 11138 rpcz_store.cc:269] 0709 12:11:30.309430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.654333 (+344903us) service_pool.cc:224] Handling call
0709 12:11:32.244606 (+1590273us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400116cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:32.244770 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198495488}
W20260709 12:11:32.299878 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47839.2us
I20260709 12:11:32.563546 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:32.767295 11137 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.767122 15331 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:32.568189 11210 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:32.570269 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:32.577993 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.772635 11212 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:32.772871 15331 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:32.773190 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.773788 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.774809 11212 raft_consensus.cc:2376] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15. Re-sending same reply.
I20260709 12:11:32.578892 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.776309 11214 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:32.580403 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.777756 11215 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:32.777839 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.778858 11214 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:32.779188 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.780169 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.780615 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.781050 11214 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:32.781647 11140 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.781955 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.581741 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.582540 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.583992 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:32.608388 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.621335 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.586333 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.644913 11291 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.006s
I20260709 12:11:32.649159 15456 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:32.651811 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.655036 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.674371 15603 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:32.679613 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:32.687206 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:32.696552 11293 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:32.701490 11288 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 4 to 9, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:11:32.708360 11169 heartbeater.cc:646] Failed to heartbeat to 127.9.180.190:38919 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.180.190:38919 timed out after 15.000s (SENT)
I20260709 12:11:32.715221 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:32.724450 15675 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:32.724923 15154 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:32.786543 11142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.017s	sys 0.001s
I20260709 12:11:32.728653 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:32.578066 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:32.782127 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.816917 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51634.6us
I20260709 12:11:32.785903 11143 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:32.825477 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.786793 11219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.013s
I20260709 12:11:32.782239 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:32.820380 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.725458 15634 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:32.834972 11219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.019s
W20260709 12:11:32.831918 11142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.019s	sys 0.007s
I20260709 12:11:32.784847 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:32.837361 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:32.835695 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.839s (SENT) [suppressed 41 similar messages]
W20260709 12:11:32.845093 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.847949 11292 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:32.848768 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:32.849633 11136 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:32.851841 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.853514 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:32.854753 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.857798 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 171042us
I20260709 12:11:32.848022 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:32.856273 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:32.844113 11285 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:11:32.859856 11211 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:32.861557 15780 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.862211 15780 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:32.837558 15634 consensus_queue.cc:1243] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:32.863682 15780 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:32.866683 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.868471 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.869632 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:32.870276 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.873670 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.878818 11144 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:32.878814 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.883133 15776 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.888190 11216 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:32.886971 11214 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:32.886963 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.873706 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:32.892016 11217 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:32.898231 11210 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:32.897359 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:32.903406 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.906195 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:32.894766 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:32.910204 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:32.912927 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 186252us
I20260709 12:11:32.916630 11218 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:32.919205 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.919364 11212 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:32.947623 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.952335 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:32.956779 11144 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:32.954965 11218 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:32.955490 11210 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:11:32.961930 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.958195 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.961985 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:32.961236 15154 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.967880 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2253) took 1153 ms. Trace:
I20260709 12:11:32.972899 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:32.954465 15812 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.981634 15812 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:32.982147 15812 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:32.990335 11854 consensus_meta.cc:287] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.520s	user 0.016s	sys 0.010s
I20260709 12:11:32.990918 11854 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:32.991151 11861 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:32.990414 15154 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:32.995206 15698 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.013s
W20260709 12:11:32.999264 15832 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260709 12:11:33.000577 15698 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.001367 15698 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.002769 15826 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.003269 15826 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:33.004475 15826 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.006127 15826 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:33.006740 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 75409.8us
I20260709 12:11:33.007951 15698 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.009421 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:32.979425 11219 rpcz_store.cc:276] 0709 12:11:31.811164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.821483 (+ 10319us) service_pool.cc:224] Handling call
0709 12:11:31.821949 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.822341 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:32.109954 (+287613us) log.cc:844] Serialized 14 byte log entry
0709 12:11:32.908540 (+798586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:32.923683 (+ 15143us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:32.938146 (+ 14463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.950928 (+ 12782us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.963677 (+ 12749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15636,"prepare.queue_time_us":162510,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":41482,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":17050,"thread_start_us":896394,"threads_started":2}
I20260709 12:11:33.013690 11137 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
W20260709 12:11:32.979503 15765 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.556s	user 0.016s	sys 0.000s
W20260709 12:11:33.024259 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 154927us
I20260709 12:11:33.010397 15698 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:11:33.018296 15675 raft_consensus.cc:2764] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:33.041231 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 2864) took 1926 ms. Trace:
W20260709 12:11:33.045413 15827 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:11:33.044247 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:33.048974 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:33.051149 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:33.061372 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:33.031028 15765 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.042976 11142 rpcz_store.cc:276] 0709 12:11:31.107679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.714811 (+607132us) service_pool.cc:224] Handling call
0709 12:11:31.789234 (+ 74423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.792145 (+  2911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.792188 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:32.245078 (+452890us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b2c000014c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:11:32.245589 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:32.879893 (+634304us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:32.879972 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.880119 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.030938 (+150819us) raft_consensus.cc:1685] finished
0709 12:11:33.030962 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.033955 (+  2993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50012,"raft.queue_time_us":12153,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11729,"spinlock_wait_cycles":25115520,"thread_start_us":597180,"threads_started":1,"wal-append.queue_time_us":637729}
I20260709 12:11:33.076768 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:33.069070 15408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50560 (request call id 1) took 4747 ms. Trace:
I20260709 12:11:33.088748 15812 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:33.089840 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52457.6us
I20260709 12:11:33.090669 15799 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.078226 15456 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:33.095031 15775 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.096796 15765 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:33.097157 11139 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:11:33.098559 11184 connection.cc:256] RPC call timeout handler was delayed by -1.0747105760001432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 12:11:33.100001 11293 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.103058 11291 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:33.126914 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:33.105654 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:33.108944 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:33.076846 15820 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.105365 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:33.139412 15820 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.145311 11137 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.135318 15799 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.147202 11860 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:33.149019 15603 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:33.150369 11292 raft_consensus.cc:2410] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:33.152315 15154 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:33.155932 11213 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:33.162345 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 121155us
I20260709 12:11:33.173867 11219 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:33.146261 15820 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.158160 15799 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.174134 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:33.153506 15775 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:33.180910 11284 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:33.180823 15775 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.182047 15810 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.182711 15810 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.185276 15810 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:33.186597 15707 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.186721 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.186932 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.187496 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:33.187762 11293 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:33.188730 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61950.8us
W20260709 12:11:33.191215 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.191107 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:33.192267 11286 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:33.187371 15707 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.194476 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:33.186209 11291 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:33.200906 11288 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:33.203433 15634 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:33.203934 15634 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.204299 15634 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:33.208062 15812 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.208204 15707 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.210186 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:33.211656 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:33.118925 15408 rpcz_store.cc:276] 0709 12:11:28.219129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.219741 (+   612us) service_pool.cc:224] Handling call
0709 12:11:28.237947 (+ 18206us) log.cc:844] Serialized 501 byte log entry
0709 12:11:28.602458 (+364511us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4c003f8340. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982edb913f 00007f982ed7d2ab 00007f982edaaf3c 00007f982edab3fe 00007f982f03850b 00007f9830a37381 00007f9830a3526b 00007f9830a3bd53 00007f9830a3bcd9
0709 12:11:28.604043 (+  1585us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b1800018a60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:32.960333 (+4356290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212,"raft.run_cpu_time_us":3675,"raft.run_wall_time_us":161627,"spinlock_wait_cycles":39075968,"thread_start_us":201052,"threads_started":1,"wal-append.queue_time_us":294311,"wal-append.run_cpu_time_us":1626,"wal-append.run_wall_time_us":1003064}
I20260709 12:11:33.212711 15274 raft_consensus.cc:2764] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:33.213574 15274 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.163476 15603 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:33.195263 11259 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.529s (SENT)
I20260709 12:11:33.202368 11217 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.227974 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.236686 11293 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:33.235111 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:33.241360 11137 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:33.242230 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:33.243639 11293 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:33.229667 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.247006 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:33.230880 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.213678 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:33.223153 15821 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:33.252228 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:33.238593 15274 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:33.217304 15810 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:33.260152 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80696.6us
I20260709 12:11:33.257758 15765 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:33.262691 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49128us
I20260709 12:11:33.264479 15456 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.266881 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:33.280750 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.284734 11289 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:33.295547 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:33.258809 15274 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.298256 15776 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:33.298856 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.309852 15765 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:33.311318 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:33.289915 15810 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.314625 15456 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:33.315737 15810 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:33.318813 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:33.316133 15651 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:33.321710 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 106712us
I20260709 12:11:33.315748 15456 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.331199 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:33.350642 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51766.5us
I20260709 12:11:33.348505 11143 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:33.325656 15651 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.358386 15651 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.361874 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:33.362567 11287 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:11:33.322280 15675 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:11:33.349658 15775 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.371138 15775 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.371591 15775 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.280332 15603 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.382144 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:33.388628 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.400568 11217 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
W20260709 12:11:33.409129 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.346094 15698 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:11:33.457355 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:33.457466 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58945.6us
W20260709 12:11:33.463025 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.356750 15799 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:33.466799 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62007.4us
I20260709 12:11:33.474995 11852 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9.
W20260709 12:11:33.481535 15848 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:11:33.465919 15274 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.475603 15456 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.496587 15708 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:33.480999 15762 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.484220 15795 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.499081 11026 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:33.500389 15799 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.382680 15776 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:33.544129 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78880.3us
W20260709 12:11:33.547700 11259 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.097s (SENT)
W20260709 12:11:33.550725 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45898.8us
I20260709 12:11:33.545013 15634 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.547257 15820 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.553938 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:33.555342 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 100249us
I20260709 12:11:33.549049 15762 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:33.563555 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 64719.3us
I20260709 12:11:33.550179 15795 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.577823 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.578888 11293 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:33.566154 15855 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:33.565500 15698 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.563948 15456 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:33.589200 15770 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:33.589957 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:33.576712 15762 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.577889 15795 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:33.624742 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80077.2us
I20260709 12:11:33.659526 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:33.660646 11293 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:33.588045 15698 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:33.662619 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:33.665285 11259 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.550s (SENT)
I20260709 12:11:33.670409 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:33.679081 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56528.4us
I20260709 12:11:33.679495 15862 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.694893 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.704360 15456 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.695573 15634 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.696218 15698 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.711952 15510 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:33.712409 15510 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:33.712769 15698 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.713519 15510 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.714818 11284 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.716490 15820 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:33.759790 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.687129 15862 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:33.697769 15842 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.441s	user 0.018s	sys 0.010s
I20260709 12:11:33.689374 15274 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:33.691377 15863 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:33.765825 11860 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:33.775533 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 110284us
W20260709 12:11:33.741200 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55381.2us
W20260709 12:11:33.783546 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.784051 11284 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:11:33.702874 15855 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:33.788914 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:33.791148 15856 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:33.791857 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:33.792150 15859 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:11:33.793403 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:33.794680 11293 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:33.779126 15510 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:33.798645 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 208810us
I20260709 12:11:33.798792 15784 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.799549 15784 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.799974 15784 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.800006 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:33.801570 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:33.802145 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.804019 15776 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:33.805646 11259 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.085s (SENT)
I20260709 12:11:33.810564 15784 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.764361 15862 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.794816 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:33.813030 15810 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:33.823370 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.823772 15810 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:33.824143 11284 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:33.824756 15810 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.813983 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:33.826435 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.817978 11861 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:33.828289 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.831873 15274 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.833639 11137 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.826838 11293 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:33.838230 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:33.839296 15457 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.839751 15457 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:33.840163 15457 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.842674 15456 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.843140 15456 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:33.843545 15456 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.845882 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:33.847711 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.854140 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60868.7us
I20260709 12:11:33.790712 15863 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:33.695176 15651 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.685189 15775 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.801610 15780 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.863006 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:33.858933 11292 pending_rounds.cc:85] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 10
W20260709 12:11:33.857931 15842 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:33.869319 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:33.870476 11259 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.144s (SENT)
I20260709 12:11:33.871196 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:33.864320 11292 pending_rounds.cc:107] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:33.872792 11292 raft_consensus.cc:2889] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.860630 15863 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:33.871481 15868 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:11:33.873854 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:33.880841 15855 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.881317 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.859508 15812 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:33.883061 15634 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.883436 15634 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:33.884267 15634 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.885476 15634 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.888156 11182 leader_election.cc:400] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9.
I20260709 12:11:33.888562 11182 leader_election.cc:403] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.863891 15780 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:33.889545 15780 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.890986 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.891789 11291 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:33.915050 15708 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:33.914088 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63382.2us
I20260709 12:11:33.921182 15651 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.922881 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.923664 11285 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:33.909181 15872 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:11:33.930848 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57113.8us
I20260709 12:11:33.913937 15810 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:33.936664 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.934551 11259 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.191s (SENT)
W20260709 12:11:33.940157 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 163158us
I20260709 12:11:33.940521 15784 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:33.941776 11258 leader_election.cc:336] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.515s (SENT)
I20260709 12:11:33.931015 15456 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.948691 15456 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.958009 15775 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:33.963636 15634 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:33.972545 15634 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:33.950438 15795 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:33.964223 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47010.2us
W20260709 12:11:33.976114 11259 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.244s (SENT)
I20260709 12:11:33.977373 11285 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
W20260709 12:11:33.978032 11259 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.506s (SENT)
I20260709 12:11:33.979120 15634 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:33.961021 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.945205 15862 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:33.979579 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:33.942229 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:33.983562 15873 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.983479 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44197us
W20260709 12:11:33.990725 11110 connection.cc:256] RPC call timeout handler was delayed by -1.4857124699999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4159s for a response
I20260709 12:11:33.990875 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:33.992594 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.993458 11293 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:33.996253 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:33.996793 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:33.997515 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.000222 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:33.996001 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:34.001266 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.002215 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:33.999313 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:34.003525 11211 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:34.005167 11216 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.005264 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.006605 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.006780 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.007522 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.008030 11210 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:34.019345 11285 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:33.982859 15762 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.025595 15862 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:34.026595 15762 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:34.027676 11218 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.009406 15708 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:33.995720 15765 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.028256 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.029261 11291 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:34.029410 11293 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.027266 15780 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.029296 11217 raft_consensus.cc:2368] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:34.035292 11219 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:34.042418 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45715.8us
I20260709 12:11:34.042353 15510 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.017354 15634 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:34.044974 11212 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:34.059235 15634 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:34.059672 11291 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:34.060389 15634 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.061369 11219 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.062361 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.062605 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 120870us
I20260709 12:11:34.063130 11217 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:34.002983 15873 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.066983 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:34.064767 15795 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:34.019882 15457 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.070077 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:34.074898 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.076591 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.079651 15780 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:34.087327 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:34.088791 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.089630 11136 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.089700 11292 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.094754 11143 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.095429 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.097716 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80478.6us
I20260709 12:11:34.098135 11219 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:34.099570 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.104878 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.107336 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:34.092528 15707 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:34.070984 15863 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.128732 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.137120 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.138788 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:34.139544 11293 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:34.140071 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.148010 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.152963 11138 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:34.154639 15876 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:34.155853 15863 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.162696 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.149143 11136 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
W20260709 12:11:34.166623 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.163430 11219 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:34.171833 11293 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:34.138042 15707 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:34.174114 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:34.175901 11217 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.175796 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:34.177950 15708 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.181690 15708 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.182337 15707 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.184058 15708 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.185770 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:34.186544 11860 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:34.187783 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:34.192566 15708 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:34.193094 15708 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.194619 15708 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.195427 15765 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:34.196259 15765 consensus_queue.cc:1243] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:34.196780 15765 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:34.197098 15765 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:34.197005 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:34.213491 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.215019 11136 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:34.213296 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 117017us
I20260709 12:11:34.219237 11858 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:34.224115 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44508.1us
I20260709 12:11:34.198022 15861 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:34.231794 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:34.229357 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.234028 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:34.177309 15795 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:34.241518 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:34.251046 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.725s (SENT)
W20260709 12:11:34.254242 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57321.9us
I20260709 12:11:34.227797 15855 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.260185 11136 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.262014 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.262605 11142 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.263321 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:34.264308 11144 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.265482 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.266788 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.234226 15457 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.269295 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.270381 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.263698 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.270694 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.268599 11219 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:34.272648 11144 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.275018 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.276086 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.281471 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.282402 11210 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:34.280859 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.284540 11144 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.235342 15408 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:34.258121 15855 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:34.286859 11143 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:34.281466 11214 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:34.234098 11861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:34.295452 11139 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.299712 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.295495 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.307528 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.308727 11210 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.296713 11861 raft_consensus.cc:606] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:34.300521 11216 raft_consensus.cc:2376] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9. Re-sending same reply.
I20260709 12:11:34.311933 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.313489 11259 leader_election.cc:336] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.139s (SENT)
I20260709 12:11:34.319070 11139 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.322904 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:34.322412 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.365278 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:34.330044 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 96091.2us
I20260709 12:11:34.362994 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.298880 15855 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.285673 15775 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:34.377142 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.377209 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.372843 11216 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.382771 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.382985 15861 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:34.327029 15510 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.392529 11211 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.393759 11144 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:34.394644 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.395330 11210 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.412828 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.414076 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.413705 11219 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
W20260709 12:11:34.437796 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 72637.3us
I20260709 12:11:34.434942 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:34.439944 15893 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:11:34.443953 15891 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:34.450284 11216 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:34.455106 11136 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:34.324025 15765 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.461194 11211 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:34.464211 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.465606 11136 raft_consensus.cc:2410] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:34.477241 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.480033 15810 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.005s
I20260709 12:11:34.480685 15810 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9.
W20260709 12:11:34.483383 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113294us
I20260709 12:11:34.484927 15510 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:34.486022 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 255573us
I20260709 12:11:34.485186 15907 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:34.488813 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.458412 15896 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.500820 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.495074 15905 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.388902 15861 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.505414 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.504385 11210 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:34.601974 11213 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
W20260709 12:11:34.602728 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 99388.5us
W20260709 12:11:34.603749 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 290280us
I20260709 12:11:34.608295 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.652128 11215 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:34.655275 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.503537 15907 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:34.605242 11259 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.681s (SENT)
W20260709 12:11:34.661501 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56308.5us
I20260709 12:11:34.660050 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.672894 11136 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.682174 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.684123 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.684739 15910 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:34.685420 15892 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.311s	user 0.000s	sys 0.000s
I20260709 12:11:34.685307 15910 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:34.686556 15888 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:11:34.671144 15889 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.198s
I20260709 12:11:34.687595 15910 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.688014 15889 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:34.688484 15889 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:34.697358 15899 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.697772 15899 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:34.698689 15899 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:34.704087 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46779.6us
I20260709 12:11:34.688694 15910 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.661056 15907 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:34.726853 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.737980 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:34.730069 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.753860 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.732470 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.619575 15810 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 12:11:34.775511 11212 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 12:11:34.738078 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:34.736236 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.776500 11212 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:34.730473 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:34.687606 15897 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:11:34.774609 11140 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:34.763821 11142 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 12:11:34.742826 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.777987 11217 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.778664 11142 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:34.732380 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:34.782150 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.731798 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:34.784001 11259 leader_election.cc:336] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.048s (SENT)
I20260709 12:11:34.784345 11138 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.732183 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.795574 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.726059 15884 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.514s	user 0.008s	sys 0.010s
I20260709 12:11:34.797241 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.798144 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.799297 11214 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:34.802520 11135 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.803718 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:34.804287 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.708539 15910 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:34.810204 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:34.811954 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.770843 15776 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:34.823231 11214 raft_consensus.cc:2368] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:34.731506 15902 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:34.811599 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 150983us
I20260709 12:11:34.826385 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:34.826705 15707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.003s	sys 0.014s
I20260709 12:11:34.802186 15905 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:34.837990 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65351.3us
I20260709 12:11:34.833392 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.835964 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52306us
I20260709 12:11:34.840559 11141 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.842954 11214 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.842772 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:34.832440 15707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.003s	sys 0.014s
W20260709 12:11:34.851068 11259 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.113s (SENT)
W20260709 12:11:34.835768 15708 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 12:11:34.852303 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.854390 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.856323 11214 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:34.833057 15901 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:34.877770 15901 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.878943 15909 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.879386 15909 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:34.880193 15901 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:34.880322 15909 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.881860 15909 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:34.882063 11259 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.206s (SENT)
W20260709 12:11:34.884800 11259 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.500s (SENT)
W20260709 12:11:34.885895 11259 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.690s (SENT)
I20260709 12:11:34.836699 15799 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:34.888185 15799 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:34.852612 15457 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:11:34.889245 15457 consensus_queue.cc:1243] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:11:34.888540 15907 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.889743 15457 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:34.890147 15457 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:34.855999 15708 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.891085 15457 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.892235 15457 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:34.892750 15708 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.893905 15510 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.836297 15906 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:34.894814 15898 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.895290 15898 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:34.897006 15912 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:34.897385 15898 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:34.834182 15902 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.860322 11853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:34.899379 11853 raft_consensus.cc:606] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:34.899878 11138 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:34.831270 15776 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.871698 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:34.886423 11259 leader_election.cc:336] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.812s (SENT)
I20260709 12:11:34.872551 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.904443 11216 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:34.875569 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.876248 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.874871 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.864714 15855 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.905028 11213 raft_consensus.cc:2376] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11. Re-sending same reply.
I20260709 12:11:34.905997 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.918049 11214 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.903690 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:34.904211 11141 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:34.923995 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.910655 15820 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.927266 15820 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.930707 15910 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.931977 15910 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.932173 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.932845 11139 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:34.934796 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.936025 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.936734 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.925989 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.937717 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.938695 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.888561 15799 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:34.935746 15902 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:34.940299 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:34.940784 15902 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.941934 11143 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.940788 11217 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:34.942318 11140 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.903650 15907 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.943275 11144 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.941586 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:34.950465 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.952224 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.940725 15799 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:34.954234 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.955111 11213 raft_consensus.cc:2368] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:11:34.955111 11214 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:34.956578 11214 pending_rounds.cc:85] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 6
I20260709 12:11:34.956872 11214 pending_rounds.cc:107] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:34.957166 11214 raft_consensus.cc:2889] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:34.961802 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.845077 15905 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:34.963680 11210 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:34.963914 11137 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:34.958110 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.965256 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.965459 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:34.935699 15855 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.967723 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:34.965947 11211 raft_consensus.cc:2376] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14. Re-sending same reply.
I20260709 12:11:34.965611 11140 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:34.970363 11135 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:34.970288 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:34.970469 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.936540 15820 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:34.972306 11140 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.976902 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:34.985255 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.995477 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:34.995707 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 172171us
I20260709 12:11:34.996022 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:34.996584 11136 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:34.954713 15902 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:35.000041 11216 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:35.001825 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.002660 11285 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:35.005061 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:35.006033 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.007597 15873 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:35.010929 11143 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 5: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:35.013720 15776 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:35.018687 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.027410 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:35.017885 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 178277us
I20260709 12:11:34.999840 15799 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:35.031744 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.035252 11143 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:35.059000 11144 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:35.057760 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.030279 15408 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:35.063834 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.056020 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.011399 15902 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.070206 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.076222 11143 raft_consensus.cc:2410] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:11:35.079031 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 192615us
I20260709 12:11:35.082372 11216 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:35.084046 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:35.083035 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.085294 11287 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:35.091121 11140 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.092218 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.097309 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:35.099551 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:35.100327 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.102732 11139 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5.
I20260709 12:11:35.108568 11143 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:35.100243 11219 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:35.082684 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:35.112239 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.066820 15707 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.115212 11138 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:35.115206 11140 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.119040 15795 raft_consensus.cc:993] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:11:35.119580 15795 raft_consensus.cc:1081] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:11:35.122190 15765 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.124899 15873 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:35.126055 15873 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.126432 15873 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:35.115288 15904 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:11:35.132542 15894 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.820s	user 0.000s	sys 0.008s
I20260709 12:11:35.115067 15915 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.133710 11138 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.134008 15915 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:35.063450 15901 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:11:35.139590 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:35.148840 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:35.149503 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.151196 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:35.153162 11144 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:35.149807 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:35.163306 15901 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.163736 15901 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:35.163796 15902 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.081881 15921 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.164772 15921 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:35.164809 15901 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.165926 15921 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.166460 15901 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.168872 15895 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:35.181371 15895 consensus_queue.cc:1243] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:35.181887 15895 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.182199 15895 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:35.169292 15874 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:35.170769 11285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:49838
I20260709 12:11:35.172693 15904 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:35.173750 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55545.5us
I20260709 12:11:35.170996 15915 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.171475 11287 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:11:35.174134 11293 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:35.236832 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.237578 11288 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:35.186859 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:35.158061 15707 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.190418 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.191229 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.192301 15899 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.192545 11286 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:35.246007 11286 pending_rounds.cc:85] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 7
I20260709 12:11:35.246268 11286 pending_rounds.cc:107] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:35.246471 11286 raft_consensus.cc:2889] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.175638 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.156844 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:35.247218 11861 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.176852 11291 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.178239 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:35.195968 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.170470 15898 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:35.199808 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1789521600001081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:11:35.221076 11285 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:11:35.254683 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1339521600000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 12:11:35.254823 11285 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.224128 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.256181 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.232388 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:35.237931 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:35.240571 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53825.8us
W20260709 12:11:35.234148 11259 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.829s (SENT)
I20260709 12:11:35.244540 11292 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9.
I20260709 12:11:35.197116 11139 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.249738 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.248525 11138 raft_consensus.cc:2376] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5. Re-sending same reply.
W20260709 12:11:35.258805 11259 leader_election.cc:336] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.909s (SENT)
I20260709 12:11:35.252430 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:35.252434 11289 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:35.259297 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.227396 11211 raft_consensus.cc:2955] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 4 to 9, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:11:35.255057 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1285521600000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 12:11:35.260121 11110 connection.cc:256] RPC call timeout handler was delayed by -1.1249521600000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 12:11:35.257872 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
W20260709 12:11:35.257833 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.258989 11287 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.259545 11137 raft_consensus.cc:2376] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12. Re-sending same reply.
I20260709 12:11:35.263602 11143 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:35.265239 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 89671.9us
I20260709 12:11:35.265473 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.266330 11292 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.268385 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.268412 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.266016 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.272353 15707 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:35.273274 15603 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:35.274426 15603 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.274861 15603 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:35.275795 15603 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.277254 15603 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:35.286504 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.289740 15925 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:35.291399 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.293192 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.183486 15905 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.168510 15911 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:11:35.249109 15698 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.261088 15902 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.296680 11287 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:35.297552 11292 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:35.298007 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.257495 15898 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:35.302385 11110 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.543s (SENT)
I20260709 12:11:35.265015 15634 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:35.307869 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.291337 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:35.309295 11135 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:35.313774 11292 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:35.315932 11212 raft_consensus.cc:2410] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:35.317363 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0871521599999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:11:35.313812 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72023.9us
I20260709 12:11:35.269109 15861 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:35.291004 15896 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:35.177353 15873 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.242218 15904 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:35.331588 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 72796.8us
I20260709 12:11:35.342023 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.342710 11284 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.329404 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.305030 15902 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:35.326905 15923 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:35.268594 15812 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:11:35.345474 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.357141 11292 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:35.358992 11213 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:35.345842 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.327215 15861 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:35.363006 15861 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.365518 15902 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.307008 15895 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.370939 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.371488 15895 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.371622 11290 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.320798 15898 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.354825 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.385501 11143 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:35.390586 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:35.386626 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 98966.6us
I20260709 12:11:35.396445 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:35.397190 11291 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
W20260709 12:11:35.397899 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.389988 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:35.330153 15905 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:35.400903 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.392395 11285 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.402665 11289 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:35.332404 15634 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:35.411334 11216 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:35.411190 15634 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.407757 11286 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:35.408409 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 115382us
I20260709 12:11:35.410104 15925 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:35.415251 15457 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 12:11:35.415524 15925 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.416164 11142 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 12:11:35.416543 11142 pending_rounds.cc:85] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 14
I20260709 12:11:35.416395 15922 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:35.416920 11142 pending_rounds.cc:107] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:11:35.417464 11142 raft_consensus.cc:2889] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.417598 15922 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:35.418159 15922 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:35.420122 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.427306 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97992us
I20260709 12:11:35.429553 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.434578 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:35.437218 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 108500us
I20260709 12:11:35.387220 15904 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:35.442035 11285 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:35.398540 15765 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.445489 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:35.446316 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.425251 15921 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:35.407009 15905 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:35.452062 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.424649 15889 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:35.460310 15905 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.448361 15896 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.469884 11284 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:35.455070 15921 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:35.481228 11259 leader_election.cc:336] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.099s (SENT)
W20260709 12:11:35.489334 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 171253us
W20260709 12:11:35.490126 11110 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.649s (SENT)
I20260709 12:11:35.492283 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:35.495149 15919 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.495210 11110 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.720s (SENT)
W20260709 12:11:35.496876 11110 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.863s (SENT)
I20260709 12:11:35.497251 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.498139 15457 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:35.499639 11290 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:35.485249 15408 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:35.485993 15921 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:35.508315 11861 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:35.516497 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:35.521335 15930 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:11:35.481933 15922 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.523497 15922 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.528049 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:35.529439 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.506464 15820 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:35.532650 11858 raft_consensus.cc:606] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:35.503233 15925 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:35.536238 11858 raft_consensus.cc:614] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:35.541467 11110 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.866s (SENT)
W20260709 12:11:35.561808 11110 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.027s (SENT)
I20260709 12:11:35.562347 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.564314 15457 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.570070 11110 leader_election.cc:400] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:35.572382 15902 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.579779 15873 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.549793 15861 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.584653 15896 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.570401 11110 leader_election.cc:403] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.585882 15861 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:35.587401 15863 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:35.587555 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.585976 15457 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:35.551584 15925 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.603127 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:35.552064 15945 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.605373 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:35.596758 15865 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:35.618039 15919 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:35.622612 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 93225us
I20260709 12:11:35.632328 15865 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.633014 15865 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:35.633455 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.633342 15457 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:35.634413 15457 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.633929 15865 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.634548 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:35.594345 15902 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.637025 15457 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:35.644132 15457 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.647266 15457 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.638686 15456 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.645673 15776 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.653934 15776 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:35.655017 15776 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.637074 15943 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:35.661962 15943 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.635104 15919 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:35.696352 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.698272 15905 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:35.720894 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 308581us
W20260709 12:11:35.723738 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.725100 15900 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:35.729751 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.730705 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.731230 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.735054 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.746598 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.751053 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.734191 15862 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.757229 15862 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.739066 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:35.753368 11259 leader_election.cc:336] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.748s (SENT)
I20260709 12:11:35.758945 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.760174 15944 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.775482 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.777105 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 338929us
I20260709 12:11:35.781057 15862 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:35.774293 15891 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.776880 15784 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:35.775030 15944 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:35.785259 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.783919 15944 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.801654 15907 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.774550 15916 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:35.779175 15947 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:11:35.803805 15916 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:35.805536 15784 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:35.802184 15907 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:35.813050 11135 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:35.873413 11858 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:35.882833 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.809628 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:35.851332 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:35.806830 11259 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.839s (SENT)
W20260709 12:11:35.885324 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 108337us
W20260709 12:11:35.879709 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 101628us
I20260709 12:11:35.906760 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:35.919071 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:35.919900 11860 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
W20260709 12:11:35.891678 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 252214us
W20260709 12:11:35.892115 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119516us
I20260709 12:11:35.935442 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:35.935109 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 128223us
I20260709 12:11:35.936856 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:35.937911 11854 raft_consensus.cc:606] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:35.938252 11854 raft_consensus.cc:614] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:35.939790 11259 leader_election.cc:336] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.548s (SENT)
I20260709 12:11:35.940289 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:35.806392 15916 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:35.923629 15898 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.518s	user 0.002s	sys 0.013s
I20260709 12:11:35.941718 15902 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.943943 15698 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:35.944341 15925 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:35.945319 11259 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.862s (SENT)
I20260709 12:11:35.991209 15902 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:35.947558 15708 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.952189 15765 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:35.954332 15939 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.464s	user 0.003s	sys 0.008s
I20260709 12:11:35.955412 15944 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.993851 15902 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.938300 15919 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.960098 15940 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:35.968575 11285 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.000345 15820 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:35.891747 15905 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:35.970886 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.991425 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:36.003755 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58474.5us
I20260709 12:11:36.005070 15923 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:11:36.005507 11259 leader_election.cc:336] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.007s (SENT)
I20260709 12:11:35.946894 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.806620 15784 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.006999 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.007210 15905 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.005964 15923 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:36.008577 11285 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.006076 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.010237 15905 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.012735 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.014381 15874 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.014648 15952 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:36.014724 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67945.4us
I20260709 12:11:36.015370 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:36.015686 15943 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:36.016273 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.016489 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:36.016844 15862 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:36.017294 15952 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.017972 15952 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:36.018172 15862 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.018579 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.019006 15862 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:36.013357 15923 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.017093 15909 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.020011 15911 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.019941 15909 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.020464 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:36.013579 15698 consensus_queue.cc:1243] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:36.020975 15909 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.021893 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:36.022365 15915 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:36.022784 15923 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.022786 15915 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:36.024376 15915 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.025429 15910 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.025668 15915 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.019497 15862 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:36.013870 15708 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:36.028749 15862 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.030004 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.028801 15708 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.031105 15923 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:36.032251 15923 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.033638 15911 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.033951 11218 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.019497 15952 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.030431 15862 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.042047 11853 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
W20260709 12:11:35.969726 15895 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.008s
I20260709 12:11:36.048242 11216 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:36.052558 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:36.044211 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.066035 15909 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.067546 11852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:36.070835 11852 raft_consensus.cc:606] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:35.981606 15898 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.106389 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:36.108026 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72018us
I20260709 12:11:36.069525 15947 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:36.104877 15921 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.001s
I20260709 12:11:36.122470 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:36.047056 15907 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:36.116642 15873 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.002s
I20260709 12:11:36.131457  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:36.126142 15943 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:36.148634 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47371.2us
I20260709 12:11:36.117635 15799 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:36.145179 15457 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.126787 15922 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:36.127607 15921 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.189139 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:36.166858 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.125123 15776 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:36.152921 15943 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:36.179123 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 148714us
W20260709 12:11:36.181380 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 169838us
W20260709 12:11:36.195284 11259 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.094s (SENT)
I20260709 12:11:36.195721 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.163503 15940 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:36.185989 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.210577 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.214170 11855 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
W20260709 12:11:36.243203 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.251765 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56519.3us
I20260709 12:11:36.243381  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:36.256350 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64289.4us
I20260709 12:11:36.199888 15820 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.200210 15895 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.213915 15776 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:36.267397 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87746.3us
I20260709 12:11:36.192621 15456 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:11:36.288236 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:36.309378 15922 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.252498 15457 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.263916 15909 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:36.333091 15898 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.286378 15776 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:36.344154 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56027.8us
I20260709 12:11:36.345006 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:36.328994 15457 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:36.339462 15951 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:11:36.285864 15953 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:11:36.339255 15915 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.310130 15922 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.349675 15457 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.409871 15456 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:36.413009 15915 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.340699 15943 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.410645 15959 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:36.425400 15936 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:36.442140 15900 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.443140 15960 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:11:36.443370 15900 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:36.466598 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 256114us
I20260709 12:11:36.432562 15456 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:36.434430 15915 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.475384 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:36.503518 11854 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.502350 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:36.505956 11290 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.508497 11258 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.639s (SENT)
I20260709 12:11:36.452005 15921 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.518401 15900 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:36.504807 15963 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:11:36.544773 11854 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:36.459805 15956 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:11:36.536752 11290 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:36.476457 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:36.541829 15795 raft_consensus.cc:993] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:11:36.434172  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.551817 11284 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:11:36.552320 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84197.5us
I20260709 12:11:36.526902 15922 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.557200 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 925) took 1057 ms. Trace:
I20260709 12:11:36.557605 11855 rpcz_store.cc:276] 0709 12:11:35.499702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.499853 (+   151us) service_pool.cc:224] Handling call
0709 12:11:36.556995 (+1057142us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400152cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:36.557119 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575965440}
W20260709 12:11:36.560637 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55562.2us
W20260709 12:11:36.561094 15975 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:11:36.568747 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.569322 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:36.570668 11110 leader_election.cc:400] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:36.571501 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:36.571651 15971 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:36.573067 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.573863 15971 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.575102 11110 leader_election.cc:400] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 4. Current term is 5.
I20260709 12:11:36.576045 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.576792 15971 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.577608 11284 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:36.578078 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.578866 15971 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.580359 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.581153 15971 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.562163 15795 raft_consensus.cc:1081] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:11:36.583874 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:36.587571 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:36.452497 15776 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.588992 15977 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:36.601471 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.592525 15898 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:36.606258 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.606781 15898 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:36.619393 15898 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.603992 15977 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:36.622673 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.623142 15977 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.625545 15910 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.611342 15907 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.626076 15910 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.626518 15910 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.625571 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 280624us
I20260709 12:11:36.629846 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:36.637928 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.636191 15971 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.640079 11284 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:11:36.640364 15955 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.465s	user 0.003s	sys 0.000s
I20260709 12:11:36.643128 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:36.644295 15911 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:36.644872 15911 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.647258 15891 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.647729 15891 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.649699 15891 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:36.650172 15891 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.650640 15698 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.651098 15698 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.652985 15698 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.654404 11256 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:36.654800 11256 leader_election.cc:403] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.658419 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:36.659968 11136 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.658911 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:36.662592 11142 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:36.659242 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:36.667649 11141 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.663389 11143 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 5.
W20260709 12:11:36.628993 15862 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.006s
I20260709 12:11:36.682544 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:36.655709 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.637730 11285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:49838
I20260709 12:11:36.688187 11285 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.688666 11285 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.567214 15456 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.699409 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.618316 15915 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.637382 15776 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:36.709077 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79306.5us
I20260709 12:11:36.711326 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.667829 15905 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.733589 11136 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:36.720664 11140 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:36.723860 11285 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.695185 15889 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:36.754419 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.754734 11258 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.884s (SENT)
W20260709 12:11:36.758455 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 89211.4us
I20260709 12:11:36.759415 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:36.760721 11140 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
W20260709 12:11:36.761245 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50030.2us
I20260709 12:11:36.762208 11285 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:36.762564 11185 leader_election.cc:400] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9.
I20260709 12:11:36.716390 15943 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:36.716591 15979 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.786700 15979 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.787125 15979 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.787565 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:36.787045 11852 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:36.791841 15874 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:36.795172 15456 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.716328 15978 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.805044 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:36.817085 15982 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:11:36.719040 15923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.020s	sys 0.027s
I20260709 12:11:36.765792 11038 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 2 to 7, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 7 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:36.766808 15862 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.722664 15510 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.767747 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:36.824259 11211 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.823716 15916 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:36.768711 15910 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:36.770829 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 115212us
I20260709 12:11:36.828217 15910 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.828377 11110 leader_election.cc:400] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:11:36.828796 11110 leader_election.cc:403] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.829416 15978 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:11:36.724328 15707 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.744165 15909 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.759928 15968 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.745096 15905 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.774585 15457 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.669629 15891 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.775775 15915 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.842545 11038 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 6 to 12, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:36.761644 15901 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:11:36.777235 15911 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:36.777961 11259 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.884s (SENT)
I20260709 12:11:36.848510 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.779876 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:36.783150 15873 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.785270 11825 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.786197 15889 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:36.851313 15898 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:36.851986 15898 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.852234 15889 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.830318 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.823062 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:36.823654 15923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.021s	sys 0.027s
W20260709 12:11:36.839624 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76233.1us
W20260709 12:11:36.851416 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66256us
I20260709 12:11:36.858771 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:36.865762 11038 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 4 to 10, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:36.868762 15457 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:36.871577 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 93645.3us
I20260709 12:11:36.872008 15898 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:36.872265 11259 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.562s (SENT)
I20260709 12:11:36.872795 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.873445 15943 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:11:36.874518 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44285.5us
I20260709 12:11:36.875411 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:36.878299 15874 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.878834 15820 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:36.877384 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:36.881556 11211 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:36.833948 15862 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:36.889362 11259 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.238s (SENT)
I20260709 12:11:36.840173 15707 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.841925 15895 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:36.840364 15909 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:36.894428 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:36.877103 15510 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:36.905465 11259 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.639s (SENT)
I20260709 12:11:36.907249 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:36.841292 15968 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:36.902276 11038 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.911557 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:36.912673 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 258423us
I20260709 12:11:36.893280 15915 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.920527 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:36.923868 11855 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:36.924278 11855 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:36.906998 15510 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.903563 15987 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.914812 15820 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.924088 15943 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:36.932251 15510 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.931283 15873 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.958748 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.959430 15909 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.959689 11218 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:36.960872 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.963189 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:36.963850 11136 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:36.965011 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:36.969132 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.969480 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.969978 11212 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:36.970021 11217 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:36.971194 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.971884 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:36.971200 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:36.972973 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.971907 11212 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:36.974246 11217 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:36.975463 11216 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:36.980238 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:36.940311 15874 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:36.986831 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:36.987633 11211 raft_consensus.cc:2410] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:36.973910 11855 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.985467 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:36.984712 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79288.6us
I20260709 12:11:36.991241 15891 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:36.994612 15968 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:36.997205 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.001250 15905 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:37.000447 11038 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 8 to 9, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 9 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:37.001910 15905 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:37.002458 15905 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.002875 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.003568 11137 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:37.004647 15905 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:37.005337 11038 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 9 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:11:37.006731 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.006938 11038 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:36.962957 15915 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.010741 15915 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.011062 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:37.011752 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.012820 15915 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.013360 15915 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:37.013682 15915 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.014010 15915 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.015511 15707 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:36.950704 15820 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:36.985960 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.032814 11215 raft_consensus.cc:2368] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13.
I20260709 12:11:37.009814 15979 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:36.983263 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.019516 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.035221 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.040877 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.042325 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.043121 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:37.045176 11855 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.048761 11285 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:36.975876 15873 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:36.985699 15909 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.054711 15964 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.058032 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.058355 15964 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.059208 11286 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:37.060513 15964 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.063136 11289 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:37.063215 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.063848 11291 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
W20260709 12:11:37.064638 15986 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:37.065063 15909 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.065268 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:37.067090 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:37.042642 15967 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:37.071600 11217 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:37.069763 15909 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.073756 15940 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.036106 15943 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:37.075915 11291 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:37.076186 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.079282 11215 raft_consensus.cc:2376] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 5. Re-sending same reply.
I20260709 12:11:37.081884 11289 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:11:37.087005 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.111706 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 236323us
I20260709 12:11:37.113915 11215 raft_consensus.cc:1217] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Deduplicated request from leader. Original: 11.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:11:37.114180 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.114638 11215 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:37.115072 11217 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.074273 15940 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.119794 11135 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:37.125696 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.126657 15820 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.128311 15862 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.129880 15873 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.134768 11217 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:11:37.136615 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 281668us
W20260709 12:11:37.137416 11110 connection.cc:256] RPC call timeout handler was delayed by -1.0854945819999102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 12:11:37.144109 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.121613 15940 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.087378 15943 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.152864 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.103624 15964 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:11:37.153743 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.155503 11217 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:37.196151 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.202442 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:37.202734 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:37.204248 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.206037 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.206311 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.152540 15861 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.206120 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.206920 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:37.134826 15947 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:37.215698 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.216081 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.216599 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:37.213351 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.214572 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.218087 11215 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:37.211661 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 256) took 14711 ms (client timeout 15000 ms). Trace:
I20260709 12:11:37.219293 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.223331 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.224174 11217 raft_consensus.cc:2410] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:37.226747 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:37.233870 11135 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
I20260709 12:11:37.227635 11143 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.246511 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:37.242776 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:37.259271 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:37.260152 15994 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:37.261511 15943 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:37.261927 15996 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:11:37.286782 11855 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:37.288709 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:37.245144 15998 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.311662 11259 leader_election.cc:336] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.823s (SENT)
I20260709 12:11:37.312367 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.314164 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.317080 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.319741 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.317700 11855 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:37.318517 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.319793 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.216902 15861 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.324796 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.325340 11212 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.326256 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.328800 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.330168 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.336776 15456 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.337363 15456 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:37.337863 11259 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.129s (SENT)
I20260709 12:11:37.265837 15909 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.351119 11212 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:37.353686 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.354452 11212 raft_consensus.cc:2376] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11. Re-sending same reply.
I20260709 12:11:37.355357 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:37.356679 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 113968us
I20260709 12:11:37.346171 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.360855 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.361542 11210 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.245420 15898 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:37.364998 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 116584us
I20260709 12:11:37.363330 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:37.321959 15987 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.322121 15979 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.373667 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.373128 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:37.384058 11110 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.229s (SENT)
I20260709 12:11:37.384240 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.378659 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.391219 11212 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:37.322801 15905 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:37.394004 11215 raft_consensus.cc:2368] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13.
I20260709 12:11:37.395339 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:37.398835 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:37.410542 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.415827 11210 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:37.465548 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.381451 15987 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:37.469898 11217 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:37.410454 15905 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.339094 15998 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.476562 11284 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.480206 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:37.486271 11140 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:37.488906 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.379918 15510 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.381510 15915 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:37.534317 15915 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:37.483379 11218 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:37.474345 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 98409.5us
I20260709 12:11:37.473798 11212 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:37.515434 11284 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:37.479208 15898 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:37.525930 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 101615us
I20260709 12:11:37.480866 15923 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.482507 15987 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.529703 11214 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
W20260709 12:11:37.551043 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.553665 11291 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:37.566468 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:37.537220 11110 leader_election.cc:336] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 3.040s (SENT)
I20260709 12:11:37.491739 15820 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:37.546187 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:37.502693 11259 leader_election.cc:336] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.167s (SENT)
I20260709 12:11:37.572132 11135 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:37.573925 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:37.218709 11042 rpcz_store.cc:269] 0709 12:11:22.308940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.309284 (+   344us) service_pool.cc:224] Handling call
0709 12:11:37.020494 (+14711210us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:32.947879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.010464 (+ 62585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.011169 (+   705us) write_op.cc:435] Acquired schema lock
0709 12:11:33.011207 (+    38us) tablet.cc:662] Decoding operations
0709 12:11:33.077204 (+ 65997us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.077317 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.077355 (+    38us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:11:33.081144 (+  3789us) tablet.cc:701] Row locks acquired
0709 12:11:33.081200 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:11:33.081398 (+   198us) write_op.cc:270] Start()
0709 12:11:33.081584 (+   186us) write_op.cc:276] Timestamp: P: 1783599093081322 usec, L: 0
0709 12:11:33.081626 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.144134 (+ 62508us) log.cc:844] Serialized 12118 byte log entry
0709 12:11:33.567482 (+423348us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.784864 (+217382us) write_op.cc:301] APPLY: starting
0709 12:11:33.791149 (+  6285us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:34.072579 (+281430us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:34.072764 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:34.973000 (+900236us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b180009cee0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f983081a0ec 00007f983081caf7 00007f983081dfb0 00007f98345321bb 00007f98345795d4 00007f98344258da 00007f98344283cb 00007f9834427fd3 00007f9834526e34
0709 12:11:35.363657 (+390657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:35.364220 (+   563us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 12:11:35.364295 (+    75us) write_op.cc:312] APPLY: finished
0709 12:11:35.364994 (+   699us) log.cc:844] Serialized 268 byte log entry
0709 12:11:35.466241 (+101247us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:35.489187 (+ 22946us) write_op.cc:454] Released schema lock
0709 12:11:35.493562 (+  4375us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:35.546567 (+ 53005us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:35.548242 (+  1675us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32272,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":131503,"apply.run_cpu_time_us":90442,"apply.run_wall_time_us":1757127,"cfile_cache_hit":122,"cfile_cache_hit_bytes":127856,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6223,"cfile_init":2,"lbm_read_time_us":39398,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":31,"prepare.queue_time_us":282264,"prepare.run_cpu_time_us":13925,"prepare.run_wall_time_us":272561,"raft.queue_time_us":200949,"raft.run_cpu_time_us":51143,"raft.run_wall_time_us":172172,"replication_time_us":465813,"spinlock_wait_cycles":122938240,"thread_start_us":483781,"threads_started":5,"wal-append.queue_time_us":232892,"wal-append.run_cpu_time_us":29299,"wal-append.run_wall_time_us":2419202}]]}
I20260709 12:11:37.579501 11137 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.580971 11287 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.584403 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:37.585456 11854 raft_consensus.cc:2368] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11.
I20260709 12:11:37.536639 15895 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.587189 11292 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:37.540658 15891 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.589365 15999 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:11:37.589658 16003 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:11:37.589917 16004 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:11:37.590240 16011 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:37.590780 16002 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.280s	user 0.005s	sys 0.000s
I20260709 12:11:37.666779 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.545590 15910 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.668285 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.687804 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:37.673312 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 170661us
I20260709 12:11:37.688990 11212 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:37.694581 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.684541 15891 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.695684 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:37.696077 16014 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.696844 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.698078 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:37.565502 15900 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.698796 15900 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.700026 15891 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.700227 15909 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.700899 15900 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.701937 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.703157 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.703668 11292 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:37.704496 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.705032 11292 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:37.705338 11143 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:37.705792 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.563024 15456 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.706254 11218 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:37.579450 15998 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:37.681615 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.706959 15998 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:37.707950 15998 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.669526 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.676016 15895 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.709462 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.696641 16014 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.710218 15895 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:37.711341 15510 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:37.682197 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 144991us
I20260709 12:11:37.712136 16014 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:37.712711 16014 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.712977 15911 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:37.713395 15923 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:37.713585 15911 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.713442 15457 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:37.715497 15923 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:37.716075 15911 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:37.715992 15457 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:37.717003 11140 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:37.711050 15910 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.717926 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:37.688118 15996 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:11:37.719084 15910 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:37.719183 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.698812 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.719832 11290 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:37.720553 11215 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:37.721076 11288 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.707016 11286 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:37.719848 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.710264 11210 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:37.722460 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.727542 11137 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:37.728969 11290 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:37.729665 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.730855 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.732517 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.733965 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.734896 11210 raft_consensus.cc:2368] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13.
I20260709 12:11:37.735874 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.736893 11210 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:37.737875 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.741156 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.742295 11212 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:37.747409 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.748064 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.687525 16016 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.583849 15820 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.746344 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:37.749715 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.757513 11292 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:37.763734 11212 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:37.764262 11212 pending_rounds.cc:85] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 5
I20260709 12:11:37.764572 11212 pending_rounds.cc:107] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:37.764853 11212 raft_consensus.cc:2889] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.766672 11853 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:37.769061 16000 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:11:37.769827 16010 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 12:11:37.771392 16013 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:11:37.772217 11210 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:37.774219 11212 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:37.776015 11210 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:37.779066 11210 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:11:37.779532 11210 pending_rounds.cc:85] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 6
I20260709 12:11:37.779855 11210 pending_rounds.cc:107] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:37.780599 11210 raft_consensus.cc:2889] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.782006 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.750020 15998 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.786000 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:37.792335 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:37.787427 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:37.847977 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55757.8us
I20260709 12:11:37.850919 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:37.851882 11853 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:37.747233 15993 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:11:37.861559 15891 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:37.863451 15820 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:37.864354 16022 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:37.871183 16017 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:37.871814 15995 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.626s	user 0.003s	sys 0.000s
W20260709 12:11:37.872603 16007 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 12:11:37.874179 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1013) took 1040 ms. Trace:
I20260709 12:11:37.874653 11852 rpcz_store.cc:276] 0709 12:11:36.833511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.834370 (+   859us) service_pool.cc:224] Handling call
0709 12:11:36.834686 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.834894 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:37.200898 (+366004us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.873707 (+672809us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b18003de280. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287
0709 12:11:37.873805 (+    98us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.873856 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:37.873904 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.873996 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.874121 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24310,"prepare.queue_time_us":79544,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":43889,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6123,"spinlock_wait_cycles":11075456,"thread_start_us":352549,"threads_started":2}
I20260709 12:11:37.876083 11292 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:37.876456 11292 pending_rounds.cc:85] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 5
I20260709 12:11:37.876681 11292 pending_rounds.cc:107] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:37.876928 11292 raft_consensus.cc:2889] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.855338 11182 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:37.883859 15940 consensus_meta.cc:287] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.718s	user 0.001s	sys 0.011s
I20260709 12:11:37.784556 15861 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:37.884544 15940 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.886801 15905 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:37.888900 16018 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.889482 16018 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:37.891566 16018 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:37.857671 15510 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.788929 16014 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.892967 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 723) took 1156 ms. Trace:
W20260709 12:11:37.897080 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 109893us
I20260709 12:11:37.898269 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:37.900700 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 45449.7us
I20260709 12:11:37.893515 11213 rpcz_store.cc:276] 0709 12:11:36.736354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.736511 (+   157us) service_pool.cc:224] Handling call
0709 12:11:36.749500 (+ 12989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.911407 (+161907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.911439 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.911923 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.321090 (+409167us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.321898 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.892349 (+570451us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400385254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:37.892426 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.892516 (+    90us) raft_consensus.cc:1685] finished
0709 12:11:37.892539 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.892879 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3937,"raft.queue_time_us":723,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3697,"spinlock_wait_cycles":368398592,"thread_start_us":388878,"threads_started":1,"wal-append.queue_time_us":538495}
W20260709 12:11:37.908320 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 330797us
W20260709 12:11:37.914789 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.007s
W20260709 12:11:37.915264 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.007s	sys 0.007s
I20260709 12:11:37.915555 11288 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:37.918334 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.920873 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.920228 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:37.905548 15993 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.905666 15910 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:37.926944 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:37.912433 16011 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:37.933876 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 219575us
I20260709 12:11:37.936527 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:37.952106 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:37.914752 15698 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:37.925556 16016 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.923936 15905 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.927953 15910 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.967360 16020 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:11:37.967903 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:37.977216 11291 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.953718 15993 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:38.000141  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:37.956396 16022 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:38.001041 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64607.3us
I20260709 12:11:38.002388 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:38.001645 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.999876 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:37.950397 15510 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.011721 15510 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:37.996578 11110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.103s (SENT) [suppressed 64 similar messages]
I20260709 12:11:38.003882 11290 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:38.004127 11288 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:38.004650 11213 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:38.021620 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.022301 11290 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
I20260709 12:11:38.005955 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.006618 15895 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.023453 11210 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:38.010653 16031 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.996192 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.026829 11293 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.017623 15993 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:37.974888 15998 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.025866 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.032409 11136 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:38.032436 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:37.976850 15910 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.028327 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.033285 11210 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.034591 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.035982 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.035218 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:38.001602 15940 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.039316 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:38.040807 11293 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:38.079744 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2311) took 1117 ms. Trace:
I20260709 12:11:38.037751 16022 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.080309 11211 rpcz_store.cc:276] 0709 12:11:36.966477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.988301 (+ 21824us) service_pool.cc:224] Handling call
0709 12:11:37.047141 (+ 58840us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:37.053192 (+  6051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.053257 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:37.071828 (+ 18571us) log.cc:844] Serialized 52 byte log entry
0709 12:11:37.204899 (+133071us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:37.228317 (+ 23418us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.047945 (+819628us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b180048e020. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f982d9f0a40 00007f982d9eb4e4 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf 00007f9830af5038
0709 12:11:38.078934 (+ 30989us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.079235 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.079334 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.079470 (+   136us) raft_consensus.cc:1685] finished
0709 12:11:38.079484 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.079673 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11823,"prepare.queue_time_us":34856,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":17742,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5386,"spinlock_wait_cycles":34096896,"thread_start_us":90680,"threads_started":1,"wal-append.queue_time_us":253008}
I20260709 12:11:38.030241 15776 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:38.042268 15895 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.044169 15457 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.105469 15698 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:38.041237 16026 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:38.110831 11210 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:38.083226 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:38.043780 15901 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:11:38.112144 11289 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: [9.6-12.7]
I20260709 12:11:38.049547 15909 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.116586 11286 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:38.045169 16012 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:38.084825 16022 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:38.107203 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 68915.2us
I20260709 12:11:38.110667 16014 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.031188 16031 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.146713 16023 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:38.106328 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60566.2us
W20260709 12:11:38.151244 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68119.2us
I20260709 12:11:38.175037 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:38.152238 15987 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.006s
I20260709 12:11:38.176946 15987 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.180403 11287 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:38.181314 16023 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.184309 16023 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.185796 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:38.186846 16031 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.153928 15895 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.189378 15895 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.189795 15895 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.157315 16012 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.193848 16012 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.196417 15874 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:38.196960 15874 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:38.161382 16022 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.153966 15909 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.203915 15909 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:38.204810 11258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.018s	sys 0.032s
W20260709 12:11:38.205176 11258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.018s	sys 0.032s
W20260709 12:11:38.207782 16034 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:11:38.210574 11110 leader_election.cc:400] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13.
I20260709 12:11:38.159832 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:38.173260 11291 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:11:38.212014 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52290.4us
I20260709 12:11:38.213402 15901 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:38.214576 15901 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:38.215886 15784 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:38.216323 15915 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:38.218086 11212 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:38.218349 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 855088us
I20260709 12:11:38.219444 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:38.215482 15901 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.220661 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:38.220882 15998 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.221491 15943 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.213452 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.222754 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:38.223562 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.223997 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:38.188922 16036 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.284s	user 0.003s	sys 0.000s
I20260709 12:11:38.084281 16011 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.222651 16026 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.215991 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.232808 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:38.231480 16031 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.235469 15905 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.231480 15993 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.239465 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.233285 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.236227 11258 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10.
W20260709 12:11:38.238606 16046 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:38.245561 16020 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.258713 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.259640 11218 raft_consensus.cc:2376] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15. Re-sending same reply.
I20260709 12:11:38.246100 15698 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.248770 15915 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:38.255234 16033 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.264698 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.265444 11211 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:38.261945 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.263368 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.266829 11210 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:38.266060 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:38.254258 16026 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.271382 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.198011 15874 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.257854 15510 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.261121 15698 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.279016 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.269819 15915 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.285250 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:38.275419 16041 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.009s
I20260709 12:11:38.273520 16023 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.276189 15943 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.288132 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.294945 11292 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:38.279467 16031 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.298569 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.300032 11136 raft_consensus.cc:2368] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11.
I20260709 12:11:38.300997 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.302073 11140 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:38.302709 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.287379 15698 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.287626 15915 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:38.308017 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.308758 11292 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:38.289354 15784 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:38.319434 15784 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.311359 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.321568 15910 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.329867 11219 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:38.294739 15943 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:38.332242 15910 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.332639 15943 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.333266 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:38.333873 11854 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.303357 15457 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:11:38.273243 16033 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.299293 16026 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.294910 16049 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.344976 11854 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:38.351218 11182 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:38.346311 16026 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.358902 15510 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:38.359521 15510 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:38.360488 15510 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.358953 16026 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.366356 11256 leader_election.cc:400] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11.
I20260709 12:11:38.366784 11256 leader_election.cc:403] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.297554 16023 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.369529 16030 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11.
I20260709 12:11:38.338469 15776 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:38.306346 16031 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:38.389284 16008 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.996s	user 0.004s	sys 0.000s
I20260709 12:11:38.385190 16030 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.384518 15820 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.352787 16049 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.409662 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:38.381880 16022 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:38.414602 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.383697 15909 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.429138 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:38.430003 11854 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:38.430294 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:38.430851 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:38.431927 11852 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:38.419463 16055 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:38.414409 16050 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 12:11:38.448045 11213 raft_consensus.cc:2368] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:38.418179 16033 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.435187 11215 raft_consensus.cc:606] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:38.416079 16031 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.414337 16023 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.406200 15895 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.418370 15820 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.470623 11215 raft_consensus.cc:614] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:38.479151 11211 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
W20260709 12:11:38.472504 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 170406us
I20260709 12:11:38.434856 15905 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:38.470150 16020 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.481577 16067 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.478170 16023 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.482152 16067 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:38.481231 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 52038.9us
I20260709 12:11:38.482684 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.470063 16060 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:38.489735 11216 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:38.423535 16026 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.495412 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.422596 16030 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.499032 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.501019 16024 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.501688 16024 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:38.502532 11214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2306) took 1542 ms (client timeout 1829 ms). Trace:
W20260709 12:11:38.502955 11214 rpcz_store.cc:269] 0709 12:11:36.959672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.960650 (+   978us) service_pool.cc:224] Handling call
0709 12:11:38.502290 (+1541640us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540035c354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:38.502428 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306026368}
I20260709 12:11:38.504220 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.504504 16024 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.504958 11214 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:38.505759 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.493618 15910 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.506450 15910 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.509174 15910 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.512079 15895 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.487589 16023 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.482594 15923 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:11:38.515017 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.515744 16023 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.516280 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.517545 15698 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.491091 15998 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.515213 15923 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:38.520291 16012 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.521095 16067 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.521690 11218 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:38.527200 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.481268 16020 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.530766 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.551962 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.544615 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.552747 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:38.534091 16049 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.539149 15909 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.520680 15698 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.548197 11216 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:11:38.561321 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.561866 11293 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:38.562651 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.563625 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.564239 11216 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:38.564849 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:38.554823 11214 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:38.494503 16060 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:38.571204 11216 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:38.560722 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.567986 11143 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:38.573283 11855 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:11:38.566793 11290 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:38.563880 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:38.569682 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.579419 16070 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:38.580330 16012 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.579440 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.580394 15907 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:38.582454 15987 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:38.583292 16064 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:11:38.559090 16051 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:11:38.573925 15923 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:38.586710 15698 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:38.566345 16023 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:38.577625 15909 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:38.588085 15977 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:38.599679 15910 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.615206 16026 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.615450 15910 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.616034 15910 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.617262 16030 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.621124 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.621897 11291 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:38.622301 11290 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 6.
I20260709 12:11:38.559799 15889 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:38.599731 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:38.603696 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 2981) took 1058 ms. Trace:
I20260709 12:11:38.603207 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:38.604619 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2634) took 1021 ms. Trace:
I20260709 12:11:38.612272 15909 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.612610 15977 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.613341 16022 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.687688 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.609387 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.688277 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:38.688853 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79540.5us
I20260709 12:11:38.629360 15820 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:38.599956 16056 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:11:38.630739 11284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49838 (request call id 980) took 1225 ms (client timeout 1515 ms). Trace:
I20260709 12:11:38.605360 16060 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.577148 16049 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.632201 16023 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.632305 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:38.634877 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.645511 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.639009 11287 rpcz_store.cc:276] 0709 12:11:37.582816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.585817 (+  3001us) service_pool.cc:224] Handling call
0709 12:11:37.586141 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.180889 (+594748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.604401 (+423512us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54000622d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:38.604562 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366124416}
I20260709 12:11:38.638396 11137 rpcz_store.cc:276] 0709 12:11:37.545090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.545831 (+   741us) service_pool.cc:224] Handling call
0709 12:11:38.603540 (+1057709us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b540032f0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:38.603634 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14396672}
I20260709 12:11:38.597105 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.647320 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:38.612721 16020 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.689808 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:38.691399 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.692438 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.689280 11286 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:38.693066 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.764688 11136 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 5.
W20260709 12:11:38.696071 11284 rpcz_store.cc:269] 0709 12:11:37.394906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.395065 (+   159us) service_pool.cc:224] Handling call
0709 12:11:38.620247 (+1225182us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b54002d0fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:38.620337 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177496320}
I20260709 12:11:38.708535 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:38.765486 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72497.1us
W20260709 12:11:38.765820 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76139.6us
I20260709 12:11:38.766077 11144 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.607055 15698 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:38.633343 15905 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:11:38.690447 15456 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.800036 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 313371us
W20260709 12:11:38.736006 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 103767us
I20260709 12:11:38.687124 15977 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:38.738804 11141 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:38.687337 15776 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.705441 16011 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.713526 16023 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:38.818611 11144 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:38.687992 16059 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:38.608834 15915 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.693650 15889 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:38.763700 11140 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.825929 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.773476 15820 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:38.761106 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 164061us
I20260709 12:11:38.674714 15907 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:11:38.766801 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:38.822716 11286 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:38.835000 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68266.5us
I20260709 12:11:38.776783 16049 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.778599 16060 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.782473 11143 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.783730 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.786772 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.840548 11137 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:38.841665 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.788383 15909 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:38.789752 11138 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:38.846328 16059 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:38.847997 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.793608 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.646656 16070 raft_consensus.cc:476] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:38.808553 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.747186 15979 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:38.710784 15943 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.765479 16027 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:38.858881 11141 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:38.806437 16010 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:11:38.773049 16044 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:38.827241 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.747268 11288 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.828434 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:38.843880 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.845916 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:38.854550 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.849467 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.858963 11139 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:38.861714 11140 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:38.853966 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:38.865424 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:38.868059 11143 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:38.994065 11141 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:38.814275 16011 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.845878 16023 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:38.854933 16068 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:11:38.849512 16059 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.851536 16014 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.831969 15820 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:38.811520 15456 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.821616 15776 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.015225 15776 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:38.993124 16072 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:39.009501 15874 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.017139 16072 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.019567 16072 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:39.019868 16006 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.488s	user 0.004s	sys 0.004s
I20260709 12:11:39.021503 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 1942) took 1971 ms. Trace:
I20260709 12:11:39.021900 11285 rpcz_store.cc:276] 0709 12:11:37.049996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.050112 (+   116us) service_pool.cc:224] Handling call
0709 12:11:37.050557 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.066008 (+ 15451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.066036 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.072574 (+  6538us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.195187 (+122613us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:37.211138 (+ 15951us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.233962 (+ 22824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.234044 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.531747 (+297703us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b180028ad40. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:39.019295 (+1487548us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:39.021194 (+  1899us) raft_consensus.cc:1685] finished
0709 12:11:39.021224 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.021375 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61189,"prepare.queue_time_us":15826,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3352,"raft.queue_time_us":22995,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21780,"spinlock_wait_cycles":32154112,"thread_start_us":81571,"threads_started":1,"wal-append.queue_time_us":152521}
I20260709 12:11:38.947826 15698 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:39.028790 16049 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.031396 11141 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:38.876715 15979 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:38.873235 16052 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:38.870002 15899 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:38.852167 15889 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:38.875676 11137 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:38.864385 16027 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.106438 11212 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.994256 11136 raft_consensus.cc:2410] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:38.996176 16067 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:38.877600 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49324.2us
I20260709 12:11:39.001564 11144 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:39.120821 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.082252 16052 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.083045 15915 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.083961 16078 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:39.084537 15943 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:39.084846 16031 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:39.085906 15923 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.006105 16011 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.982882 15987 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.825914 15993 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:39.011168 15820 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.116200 16070 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:39.113893 11215 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.007201 16020 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:39.125085 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:39.119061 15899 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:39.199337 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 359155us
I20260709 12:11:39.101845 16030 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:39.114760 16027 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.035218 16014 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.211337 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:39.245193 11286 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.090579 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:39.181867 16023 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:39.243487 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118471us
I20260709 12:11:39.248020 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:39.206140 15943 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:39.208027 15993 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:39.251735 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:39.256717 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:39.244890 15915 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.266609 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:39.257077 15910 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.006s
I20260709 12:11:39.269630 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:39.207279 16031 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.201803 16078 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.228968 15987 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.271569 11215 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:39.257493 15911 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.241394 16070 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.267568 15968 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.251266 16067 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:39.247336 16030 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.245002 16020 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.270509 16024 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.244856 15979 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.260104 15943 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.286309 11285 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:39.296226 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:39.281669 15915 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:39.301640 11852 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:39.290330 16024 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:39.306044 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 460159us
I20260709 12:11:39.308179 11110 leader_election.cc:400] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:39.309087 11110 leader_election.cc:403] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.275699 15910 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.312389 16019 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.314985 16078 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.317083 16070 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.318729 16031 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.320485 16030 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.324821 16065 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:39.292739 15510 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.326769 15510 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.327997 15987 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:39.283638 15874 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:39.330613 16020 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.331442 16031 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:39.332070 16031 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.333139 15910 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.329031 15510 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.337774 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.334219 16031 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.341637 11855 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:39.344918 11182 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:39.339926 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:39.349675 11110 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:39.308847 15456 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.308209 16024 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.358445 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2659) took 1114 ms. Trace:
I20260709 12:11:39.282115 15899 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.342911 16070 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:39.364511 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.359068 11292 rpcz_store.cc:276] 0709 12:11:38.244543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.703196 (+458653us) service_pool.cc:224] Handling call
0709 12:11:38.703640 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.706818 (+  3178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.706872 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.712210 (+  5338us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.994592 (+282382us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:39.351548 (+356956us) log.cc:844] Serialized 14 byte log entry
0709 12:11:39.358017 (+  6469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.358126 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.358186 (+    60us) raft_consensus.cc:1685] finished
0709 12:11:39.358205 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.358371 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24388,"prepare.queue_time_us":211906,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1597,"raft.queue_time_us":3560,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":36468,"thread_start_us":448346,"threads_started":2,"wal-append.queue_time_us":340647}
W20260709 12:11:39.375881 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.296212 15977 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.352313 15510 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.379753 15510 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.380196 15510 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.380313 15977 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.287063 15993 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.392251 15698 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:39.392858 15698 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.395848 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:39.397034 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:39.397725 16071 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.384s	user 0.003s	sys 0.000s
I20260709 12:11:39.399428 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:39.400023 11290 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:39.400717 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:39.401834 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:39.402370 11292 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.404765 11286 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:39.400363 15510 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:39.353173 16031 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:39.425102 11110 leader_election.cc:400] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:39.426690 11110 leader_election.cc:400] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:39.427902 11286 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:39.363039 16052 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.436679 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.436991 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.439529 11217 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:11:39.439980 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.443490 11218 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:39.454438 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:39.455296 11210 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.456656 11290 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
W20260709 12:11:39.478024 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48721.4us
I20260709 12:11:39.498265 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:39.540136 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 106996us
I20260709 12:11:39.541410 11258 leader_election.cc:400] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11.
I20260709 12:11:39.542196 11212 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:39.542840 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62726.6us
I20260709 12:11:39.544940 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:39.427640 16079 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:39.555213 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.542441 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:39.586987 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:39.580804 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 99896.1us
I20260709 12:11:39.647044 11144 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:39.589018 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.591699 11210 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:39.634819 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.427412 16031 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:39.649011 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:39.650581 11212 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:11:39.642294 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:39.652364 11141 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:39.659158 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 111187us
I20260709 12:11:39.664966 11141 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:39.667472 16031 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:39.676774 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.678854 16084 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:39.643581 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:39.669230 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 126884us
I20260709 12:11:39.685941 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:39.692912 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:39.694929 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:39.695777 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:39.433486 16070 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.219s
I20260709 12:11:39.707005 11143 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:39.702225 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:39.707280 11139 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.498108 16024 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.673993 15987 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.700938 11144 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 6: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:39.402787 16011 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.643121 11292 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:39.581105 15456 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:11:39.633721 16089 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.675550 15698 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.743369 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:39.744167 11144 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.645704 16020 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:11:39.758225 11213 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:39.761740 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65399.1us
I20260709 12:11:39.698275 16086 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:11:39.769737 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:39.770738 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 969358us
I20260709 12:11:39.788334 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:39.789844 16091 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:11:39.803009 15510 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.778187 15923 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:39.769886 15943 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:39.814921 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.815688 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.816283 15799 raft_consensus.cc:2764] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:39.815119 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.819787 16011 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:39.820760 16094 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:39.821175 16094 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:39.822276 16027 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.002s
I20260709 12:11:39.822054 16094 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.822738 16027 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.823344 16094 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.824118 15943 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.824770 15943 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:39.824889 16027 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.825265 15943 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.825803 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.828796 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2660) took 1583 ms. Trace:
I20260709 12:11:39.829347 11291 rpcz_store.cc:276] 0709 12:11:38.245126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.770835 (+525709us) service_pool.cc:224] Handling call
0709 12:11:38.771379 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.800499 (+ 29120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.800537 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.260130 (+459593us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:11:39.260554 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:11:39.431510 (+170956us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:39.431631 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.431769 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.828366 (+396597us) raft_consensus.cc:1685] finished
0709 12:11:39.828401 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.828720 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7894,"raft.queue_time_us":42724,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7252,"spinlock_wait_cycles":15612288,"thread_start_us":147236,"threads_started":1,"wal-append.queue_time_us":499980}
I20260709 12:11:39.830855 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.814165 16024 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:39.844996 11139 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:39.845566 11139 pending_rounds.cc:85] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 6
I20260709 12:11:39.845860 11139 pending_rounds.cc:107] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:39.846158 11139 raft_consensus.cc:2889] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:39.847695 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.849150 15943 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:39.850212 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.855108 11144 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:39.886026 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:39.884845 15915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.052s	sys 0.113s
I20260709 12:11:39.899674 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:39.895771 15915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.053s	sys 0.113s
I20260709 12:11:39.907195 11852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:39.908025 11852 raft_consensus.cc:606] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:39.907693 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:39.908578 11852 raft_consensus.cc:614] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:39.915953 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:39.922036 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 992) took 1379 ms. Trace:
I20260709 12:11:39.924306 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:39.927167 11144 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:39.922536 11288 rpcz_store.cc:276] 0709 12:11:38.542943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.882928 (+339985us) service_pool.cc:224] Handling call
0709 12:11:39.010683 (+127755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.307591 (+296908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.307622 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.307662 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:39.307693 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.921803 (+614110us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540017f7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:39.921851 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.921975 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682151296}
I20260709 12:11:39.890411 15987 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:39.902729 15820 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 12:11:39.931293 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:39.934121 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:39.936583 11854 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.935485 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:39.938772 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:39.943862 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:39.945550 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:39.946287 11293 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:39.948130 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 279554us
I20260709 12:11:39.905941 15915 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:39.972419 11852 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.974050 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.975973 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.979794 15456 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:39.985209 11293 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:39.949755 16023 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.952265 16074 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.996814 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:39.994849 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 919) took 1353 ms. Trace:
I20260709 12:11:39.963169 15891 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.964823 15987 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.962918 16052 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:40.041816 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:40.044359 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.054236 11293 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 6: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:40.054324 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.056265 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.051715 16027 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:40.050249 15915 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:39.973843 16069 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:40.057209 11291 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:40.044945 11142 rpcz_store.cc:276] 0709 12:11:38.641086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.641578 (+   492us) service_pool.cc:224] Handling call
0709 12:11:38.641910 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.977574 (+335664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.977610 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.977654 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.977682 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.994601 (+1016919us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54001243d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:39.994658 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.994788 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554679040}
I20260709 12:11:40.062175 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.065546 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.066026 11292 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:40.038604 15707 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.948261 15820 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.040977 15899 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:40.081874 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.097509 11293 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:40.068542 16027 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.119474 16027 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.120697 16069 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:40.123967 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.124776 11293 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:40.128715 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.089672 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:40.092630 16101 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:11:40.094614 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.047431 15964 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:40.056842 15799 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:40.131119 11854 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:40.141808 11858 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.129078 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:40.097100 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.133625 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:40.053048 16024 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:11:40.137691 11290 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:40.136952 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:40.052505 15891 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.145257 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:40.065254 16052 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:40.207545 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62442us
I20260709 12:11:40.208391 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:40.208487 15891 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.208648 16052 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:40.209029 16077 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.187s	user 0.002s	sys 0.008s
I20260709 12:11:40.182876 11289 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:40.210213 16078 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.210635 16078 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:40.211457 16078 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.212719 16078 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.215694 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.215929 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.216710 11854 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:40.216892 11861 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:40.217789 15820 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.218437 15820 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.218911 15820 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:40.219810 15820 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.223667 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 1946) took 1936 ms. Trace:
I20260709 12:11:40.223923 16011 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.224493 16011 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:40.225682 16011 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.186321 11291 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [8.4-11.6]
I20260709 12:11:40.183760 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.193635 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.236819 11140 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:40.127240 15899 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.196841 15998 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.211835 16084 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.140883 16102 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.224359 11214 rpcz_store.cc:276] 0709 12:11:38.290922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.565605 (+274683us) service_pool.cc:224] Handling call
0709 12:11:38.565846 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.583408 (+ 17562us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:38.583711 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.825988 (+242277us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.844718 (+ 18730us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.844933 (+   215us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.859927 (+ 14994us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.870617 (+ 10690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.870705 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.208458 (+1337753us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:40.223474 (+ 15016us) raft_consensus.cc:1685] finished
0709 12:11:40.223495 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.223613 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26388,"prepare.queue_time_us":5422,"prepare.run_cpu_time_us":6818,"prepare.run_wall_time_us":101489,"raft.queue_time_us":31243,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":33175,"spinlock_wait_cycles":140730112,"thread_start_us":241794,"threads_started":1,"wal-append.queue_time_us":437667}
I20260709 12:11:40.247942 11182 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:40.134369 16023 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:11:40.224709 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:11:40.183696 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:40.276980 11860 raft_consensus.cc:606] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:40.235139 11137 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:40.243103 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:40.278749 11861 raft_consensus.cc:2368] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:11:40.249398 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:40.215693 16094 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:11:40.295456 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46153.1us
I20260709 12:11:40.096087 15707 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:40.245054 16031 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.004s
W20260709 12:11:40.298903 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 317061us
W20260709 12:11:40.299360 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 373329us
W20260709 12:11:40.298373 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 338376us
I20260709 12:11:40.182384 16027 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.318617 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:40.331368 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.295403 16103 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:11:40.336815 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.301020 16052 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.232316 15799 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.317013 16086 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.344580 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.181790 15964 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.256193 15998 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.326385 16067 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.345218 16052 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:40.340878 15923 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:40.358559 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.347011 15891 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.295506 16107 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:11:40.295921 16102 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.369171 16098 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:40.369305 16107 consensus_queue.cc:1243] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:40.349255 16118 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.330282 16031 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.334321 16027 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.399121 16116 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:40.399976 16116 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:40.361918 16089 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.361408 16106 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.371452 15891 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:40.413412 11142 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.394903 16118 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.355374 16086 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.373522 16049 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.432170 16070 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:40.435065 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 381603us
I20260709 12:11:40.403815 16111 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.405289 16059 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.371320 15923 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:40.454185 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 112907us
I20260709 12:11:40.418433 15891 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.368345 16067 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.461043 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 915) took 1827 ms. Trace:
W20260709 12:11:40.468293 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 259997us
I20260709 12:11:40.471060 15456 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:40.472489 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.470052 11135 rpcz_store.cc:276] 0709 12:11:38.633776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.634320 (+   544us) service_pool.cc:224] Handling call
0709 12:11:38.687282 (+ 52962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.032226 (+344944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.032258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:39.032300 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:39.032339 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.460730 (+1428391us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54000910d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:40.460793 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.460967 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792735488}
I20260709 12:11:40.471997 15456 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.484695 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:40.488178 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:40.489420 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:40.432859 16070 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.450919 15977 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.468012 16098 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:40.416987 16089 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:40.496994 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 152512us
I20260709 12:11:40.517726 11142 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:40.523000 11285 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.532262 16094 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.533618 16080 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.534577 15909 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.563572 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:40.497319 16110 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:40.579845 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.581890 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.563627 11285 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:40.490739 16030 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.491348 16084 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:40.442343 16049 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.463253 16111 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.584658 11285 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.600427 11285 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.515451 16098 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:40.572804 15698 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.593542 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:40.596591 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 124160us
I20260709 12:11:40.567883 15899 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.598552 15707 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.461416 16052 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.583012 15909 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:40.615868 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.580984 16110 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.583418 15905 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:40.558656 15977 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.592512 16106 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.581929 16080 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.614868 15457 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.624549 15915 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:11:40.624487 16115 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:11:40.595274 16119 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.654817 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.585974 16094 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.598814 16116 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:40.639498 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46061us
I20260709 12:11:40.660429 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:40.661006 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.670351 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.671425 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.673528 11285 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:40.673911 11285 pending_rounds.cc:85] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 10
I20260709 12:11:40.674155 11285 pending_rounds.cc:107] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:40.674619 11285 raft_consensus.cc:2889] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:40.632467 16122 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 12:11:40.647015 16124 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:11:40.678328 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 92476.9us
W20260709 12:11:40.677443 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 114439us
I20260709 12:11:40.634860 15799 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.659348 16117 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.635556 15923 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.680073 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.620198 15899 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:40.637599 16031 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.634830 15998 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.636061 15964 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.636471 16027 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.643858 16023 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.632997 16118 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.633533 16014 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.627869 16110 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:40.721591 16075 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.703s	user 0.005s	sys 0.007s
I20260709 12:11:40.723224 15977 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.637262 16106 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.724988 16106 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.640738 16086 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.636412 16067 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.639343 16135 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.727120 16135 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.727598 16135 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:40.729063 15943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:40.667184 16084 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.695413 11854 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:40.635792 16102 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.730803 16084 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.675941 16129 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.733364 16084 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.733656 15891 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.734184 16111 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.693735 16120 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.701314 16080 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.702961 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.696692 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.682948 16030 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:40.711066 16073 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.699s	user 0.001s	sys 0.008s
I20260709 12:11:40.659825 15905 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:40.717928 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57034us
I20260709 12:11:40.644300 15457 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:40.776603 15457 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.679631 16137 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:40.639909 16098 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.694094 16117 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:40.780023 16117 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.781245 16117 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.783013 16070 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.783623 16011 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.777773 16137 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.712937 16142 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:40.763856 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.764762 11256 leader_election.cc:400] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
W20260709 12:11:40.793557 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 90711.7us
I20260709 12:11:40.793855 11256 leader_election.cc:403] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:11:40.763818 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.768162 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.769321 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.769927 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.771584 16049 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.772094 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:40.756677 16111 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.774416 15905 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:40.791074 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 98667.8us
W20260709 12:11:40.791867 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 95303.9us
I20260709 12:11:40.719910 16023 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:40.796267 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.804984 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.810632 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.811121 11143 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:40.811553 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.812196 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.812418 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.812767 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.812980 11143 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:40.813691 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.815100 11291 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.818809 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.819379 11291 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:40.820536 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:40.821142 11291 raft_consensus.cc:2368] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:40.822984 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.823611 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.823802 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.824178 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:40.795212 16107 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:11:40.824311 11290 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:40.794988 16120 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:40.795717 16148 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:40.802052 15784 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:40.831197 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.832461 16089 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.832360 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:40.833177 16118 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.810046 16027 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:40.800905 16080 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:11:40.835266 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.782187 16110 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.800777 15910 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.719391 15909 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.865146 15909 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.866824 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39166
I20260709 12:11:40.867448 11135 raft_consensus.cc:606] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 12:11:40.867794 11135 raft_consensus.cc:614] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.869138 16137 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.869390 16084 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.842556 16094 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.869825 16084 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.870244 16084 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.805984 16111 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.875257 11289 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:40.877852 16074 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.878473 16074 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.880508 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.881224 16110 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.878909 16111 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.882000 16074 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.884809 16106 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.801066 16070 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.914875 16120 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.915879 16110 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.916471 16111 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.916610 16110 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.917155 16111 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.809808 16049 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.849182 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:40.919462 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 70480.4us
I20260709 12:11:40.920905 11110 leader_election.cc:400] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:40.921330 11110 leader_election.cc:403] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:40.922252 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:40.929353 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 124457us
W20260709 12:11:40.937692 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.931284 16049 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:40.931186 15457 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.940940 15457 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.941352 15457 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.852226 16148 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:40.944700 16148 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.946887 16111 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.929029 16011 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.947876 16011 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.949988 16011 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.952405 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.955631 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.956367 11289 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:40.958259 15457 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.962575 16049 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:40.963052 16049 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.963423 16049 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.965318 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.966986 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.967737 11290 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:11:40.967250 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 202811us
I20260709 12:11:40.969584 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.970198 11291 raft_consensus.cc:1813] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Handling vote request from an unknown peer 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:40.970820 11291 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:40.972209 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.972836 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.973616 11288 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:40.974236 15457 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:40.974231 11286 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:40.972862 11292 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:40.979152 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.980259 11287 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:40.837852 16142 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.814232 15698 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:40.830018 16059 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.838224 16102 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.986567 16102 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.988600 16098 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.855194 16118 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:40.989041 16078 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.003s
I20260709 12:11:40.989846 16118 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.838122 16129 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:40.855068 16135 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:40.851357 16060 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.859622 16023 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.840256 15998 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:40.860863 15891 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.863512 16080 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.968088 16070 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.767957 16030 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:40.909024 16106 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:40.843712 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.982798 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:40.982165 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 179170us
I20260709 12:11:41.026630 11285 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:40.982187 16110 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.974637 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:40.959190 16011 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:40.997390 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:40.997498 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:41.002857 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 189146us
I20260709 12:11:41.003535 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.003862 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:41.050213 11284 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:41.004195 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.051139 11140 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:41.003546 11142 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:41.004647 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.005357 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.050380 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:40.958799 16067 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:41.008898 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.054997 11136 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:41.011083 16078 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:40.888355 15993 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:41.018181 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:40.974077 16089 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.024422 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:41.069712 11860 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.016765 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:40.989094 16102 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:40.983140 16149 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.015615 16151 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:40.986451 16059 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.013348 16142 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.008425 16084 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.012961 16060 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.062697 16023 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.036171 16135 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.021781 16129 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.023154 16107 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.014245 15977 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:41.020740 15911 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.023708 15998 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:41.109247 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 82480.1us
I20260709 12:11:41.060022 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:41.063275 11141 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:41.063931 11135 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:11:41.071372 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54747.7us
I20260709 12:11:41.013945 16080 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:41.073895 11144 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:41.025827 16094 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.035820 15799 raft_consensus.cc:993] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:41.083225 11211 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.084432 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:41.086640 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.124099 11213 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:41.088143 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.088825 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.085426 16067 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:41.073263 16089 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.098989 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:41.097652 16154 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.105404 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.135243 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.048607 16030 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:41.111250 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 104088us
I20260709 12:11:41.112855 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:41.117844 16106 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.109543 16107 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.108865 16129 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.160861 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.114008 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.161854 16110 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.079174 16117 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.118206 11219 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:41.119357 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.119488 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.085865 16060 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.085153 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:41.162302 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48391.1us
I20260709 12:11:41.169613 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.173724 11287 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:41.174834 11217 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:41.175655 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:41.125521 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.124707 11212 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:41.085022 16143 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:41.072834 16078 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.127449 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.129048 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:41.101935 16052 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.193075 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:41.115741 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:41.194546 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78874.1us
I20260709 12:11:41.102953 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.080219 16149 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.140894 15799 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:41.140254 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 11, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.127027 16094 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.142177 16154 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.216602 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.114959 15911 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.151825 16080 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.149471 11284 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.113189 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.151564 16084 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:41.152045 15964 raft_consensus.cc:1081] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:41.123610 16148 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.156582 16142 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.157246 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.241899 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.146359 16153 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:41.159361 16059 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.159540 16067 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.160241 15998 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.169788 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.275434 11292 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 6.
I20260709 12:11:41.275607 16152 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.276098 16152 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.277148 16154 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.193239 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.177152 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.176704 11210 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:41.280615 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.281312 11210 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:41.282181 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.282783 11210 raft_consensus.cc:1813] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Handling vote request from an unknown peer 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:41.283324 11210 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:41.134122 16089 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.199890 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.200027 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.198204 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.201046 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.162804 16129 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.162536 16107 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.162300 16110 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:41.212785 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.196110 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.162897 16030 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:41.217788 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:41.143638 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:41.231199 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 111926us
I20260709 12:11:41.236232 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:41.195101 16069 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.162686 16117 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.202111 15899 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:11:41.243188 11215 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:41.269002 15707 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:41.268386 11139 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:41.268869 11219 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:41.198801 16011 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:41.273478 11284 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:41.283694 16084 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.290627 11210 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:11:41.292021 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 93881.9us
I20260709 12:11:41.292394 11213 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.240001 16026 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:41.278419 16162 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:11:41.203058 15979 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:41.199160 16143 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:41.290144 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 170729us
I20260709 12:11:41.279109 16111 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.268428 16148 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.298122 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.293092 11860 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:41.302886 11211 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:41.350602 11861 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.305598 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.309768 11215 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:11:41.309798 11217 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:41.315692 11291 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:41.352794 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:41.294091 16080 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.304589 11287 raft_consensus.cc:2376] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11. Re-sending same reply.
I20260709 12:11:41.316761 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.304613 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.318997 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.301295 16059 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:41.308725 16030 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.300700 16102 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.402180 16102 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.402920 16102 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.404515 16143 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.345048 16152 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:41.406129 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53462us
I20260709 12:11:41.320422 16026 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:41.327584 16084 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.410411 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.410367 16026 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.411778 16026 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.411849 16084 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:41.312000 16069 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.413029 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:41.413779 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:41.381415 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62497.5us
I20260709 12:11:41.414319 16069 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.414513 11138 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.385407 11216 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:41.415511 16024 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:41.354035 16049 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:41.387513 15911 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.395234 16094 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:41.395969 16148 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.354321 16111 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.399163 16107 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.399717 15979 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:41.400831 16158 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:11:41.402248 16110 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.406904 16052 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.378322 16059 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:41.408144 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103624us
I20260709 12:11:41.408267 16137 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.412259 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.300251 15909 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.386168 16117 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:41.428669 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 148059us
I20260709 12:11:41.423683 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.422855 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.315341 15707 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.493762 11140 raft_consensus.cc:1813] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Handling vote request from an unknown peer 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:41.528221 11140 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:41.482985 11137 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:41.494535 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:41.482084 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 288910us
I20260709 12:11:41.446919 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:41.433400 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 147195us
I20260709 12:11:41.402072 16030 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:41.523685 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.527034 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.534570 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.535188 11286 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.535231 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.538609 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.532130 11107 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:41.539073 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.539776 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:41.541517 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46950.7us
I20260709 12:11:41.532106 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.421156 15943 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.416111 16024 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.561358 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.562925 11287 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:41.542451 16069 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.564636 16069 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.567956 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.535915 16052 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:41.571568 16052 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.573133 16069 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.574563 11292 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
W20260709 12:11:41.575202 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.421267 15998 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.459138 16094 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.576835 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44813.6us
I20260709 12:11:41.494150 16107 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.578163 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:41.511277 16059 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.477918 16143 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.493618 16137 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.600294 16137 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.600185 15979 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.577085 16088 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:41.601653 16088 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.602010 16088 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:41.578912 15909 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.602857 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.603519 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:41.530917 15707 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:41.604496 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.604951 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.605755 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.607236 11212 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:41.608270 16143 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.608632 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.609649 16088 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.610174 16106 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.610755 16106 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.596014 16069 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.611668 16069 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.612036 16088 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.614024 16069 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.597169 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.597512 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.598909 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:41.599118 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60159.2us
I20260709 12:11:41.657642 11184 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.599323 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.600529 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.596462 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:41.658991 11854 raft_consensus.cc:606] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:41.659468 11854 raft_consensus.cc:614] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:41.588002 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.596091 16098 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.630776 16143 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.619386 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:41.642294 16129 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.585676 16074 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.594762 16107 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.643693 16049 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:41.646744 16022 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.540534 16023 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.672251 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.585882 16011 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.652156 16111 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:41.592943 15998 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.652264 15909 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:41.652925 16024 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.618955 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:41.618361 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.689852 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.620180 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.626202 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.618180 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:41.617455 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:41.624997 11038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 252) took 25120 ms (client timeout 15000 ms). Trace:
I20260709 12:11:41.631646 11142 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:11:41.664260 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65051.3us
W20260709 12:11:41.664276 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76384.7us
I20260709 12:11:41.664813 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.675736 16110 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.676134 16098 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.676813 15993 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.597626 16078 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.720534 11039 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 10 to 12, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 12 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:41.686419 11285 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:41.687997 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.724505 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:41.716657 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.714149 11141 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:41.688337 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:41.725149 11288 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:41.726994 11293 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:41.688657 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.681038 16129 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:41.685777 15998 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:41.729669 11291 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:41.674409 16149 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.578833 15943 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.725888 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.689589 15889 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.742455 11852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:41.753346 11852 raft_consensus.cc:606] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:41.753786 11852 raft_consensus.cc:614] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:41.595330 16094 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.719830 15993 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:41.747377 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82639.1us
I20260709 12:11:41.688884 16074 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.751965 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.774425 11141 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
W20260709 12:11:41.744259 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 54491.4us
I20260709 12:11:41.776399 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.680635 16070 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:11:41.746565 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.719544 16111 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.784453 11289 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:11:41.712160 11038 rpcz_store.cc:269] 0709 12:11:16.504893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.505239 (+   346us) service_pool.cc:224] Handling call
0709 12:11:41.624894 (+25119655us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:37.476810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:37.477422 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:37.477458 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:37.477480 (+    22us) tablet.cc:662] Decoding operations
0709 12:11:37.478379 (+   899us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:37.478443 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:37.478470 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:37.479106 (+   636us) tablet.cc:701] Row locks acquired
0709 12:11:37.479122 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:11:37.479286 (+   164us) write_op.cc:270] Start()
0709 12:11:37.479390 (+   104us) write_op.cc:276] Timestamp: P: 1783599097479231 usec, L: 0
0709 12:11:37.479411 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:37.480163 (+   752us) log.cc:844] Serialized 2923 byte log entry
0709 12:11:38.353846 (+873683us) op_driver.cc:464] REPLICATION: finished
0709 12:11:38.632043 (+278197us) write_op.cc:301] APPLY: starting
0709 12:11:38.632155 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:39.114388 (+482233us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:39.126737 (+ 12349us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:39.399395 (+272658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:39.399635 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:39.399678 (+    43us) write_op.cc:312] APPLY: finished
0709 12:11:39.399942 (+   264us) log.cc:844] Serialized 73 byte log entry
0709 12:11:39.890672 (+490730us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.895327 (+  4655us) write_op.cc:454] Released schema lock
0709 12:11:39.897414 (+  2087us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:39.921116 (+ 23702us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.930882 (+  9766us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1321863,"reported_tablets":50,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":229035,"apply.run_cpu_time_us":80123,"apply.run_wall_time_us":1282778,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33471,"num_ops":7,"prepare.queue_time_us":458376,"prepare.run_cpu_time_us":21575,"prepare.run_wall_time_us":499530,"raft.queue_time_us":91094,"raft.run_cpu_time_us":22536,"raft.run_wall_time_us":189907,"replication_time_us":859299,"thread_start_us":1250251,"threads_started":5,"wal-append.queue_time_us":1097277,"wal-append.run_cpu_time_us":11088,"wal-append.run_wall_time_us":2437870}]]}
I20260709 12:11:41.785794 11293 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:41.771675 11039 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.687435 16118 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:41.680111 16011 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:41.780223 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.780519  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:41.679961 16023 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.679667 16022 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.791350  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:41.783614 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.799892  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:41.794147 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47726.5us
I20260709 12:11:41.789738 11039 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.679140 16137 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.806044 15457 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.683701 15707 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.806782 15457 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.760304 16152 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.761037 15998 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.775817 15993 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.752943 16049 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.759547 16084 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:41.682211 16089 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:41.823122 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.860689 11137 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
W20260709 12:11:41.860747 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 319564us
I20260709 12:11:41.775244 16074 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.816773 11288 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:41.790807 16011 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.804829 16031 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.834028 16120 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:41.834760 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.867648 11139 raft_consensus.cc:2410] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:41.843879 16137 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.844411 11217 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.861899 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:41.805056 15909 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.818336 16125 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.828457 11212 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:11:41.790607 16118 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.746285 16030 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.894634 11143 raft_consensus.cc:2368] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12.
I20260709 12:11:41.860114 16111 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.803103 16143 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:11:41.846807 15998 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.870215 16074 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.905162 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.916456 11039 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.864766 16153 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:41.890185 15909 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:41.896226 16118 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.906916 11288 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:41.907410 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:41.896808 16171 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.911223 11293 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:41.902767 15998 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.869855 16049 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.931272 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.885099 16031 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.927978 16111 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:41.926117 16060 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.727s	user 0.012s	sys 0.000s
I20260709 12:11:41.936538 11039 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.939975 15943 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:41.905591 16102 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:41.945407 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:41.965543 11288 raft_consensus.cc:2410] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:11:41.928289 15909 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.952214 16049 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:41.891004 16120 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:41.955925 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 179496us
I20260709 12:11:41.962201 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:41.919449 15799 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:41.914170 16106 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.976485 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:41.962839 16111 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.982339 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:41.959371 16026 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:41.899637 16129 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:41.985730 11855 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:11:41.991528 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 281699us
W20260709 12:11:41.990991 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 159711us
I20260709 12:11:41.995496 11039 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 3 to 7, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 7 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:41.996088 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:41.999349 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:42.001929 11039 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:41.981062 16098 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.010192 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:41.989396 16111 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.966743 16060 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.021158 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.021924 16078 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:42.022480 16078 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.023586 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:42.024585 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:42.011300 16070 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:42.031690 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:11:42.011191 16049 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:42.035207 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:42.036255 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.041939 11285 raft_consensus.cc:2410] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:41.992847 16026 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.019766 16069 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:42.023509 16023 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.023458 16181 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:42.039436 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:42.042673 11140 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:42.036309 11141 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.018390 16117 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:42.060133 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 276633us
I20260709 12:11:42.020898 16185 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:42.065908 11141 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.036990 16135 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.043711 16094 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.044190 15943 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:42.058284 16089 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.058364 16070 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:42.059906 16030 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.095891 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.072829 16172 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:42.040817 16088 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:11:42.063499 16069 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.086148 16185 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.104423 11141 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:42.113334 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97049.5us
I20260709 12:11:42.075683 16084 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.125306 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.179162 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:42.096336 16094 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:42.133195 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 109693us
I20260709 12:11:42.118458 16172 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:42.182025 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56872.8us
I20260709 12:11:42.183120 16118 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.202072 16118 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.185062 16196 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.202857 16094 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.203538 16094 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.204694 16172 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.205778 16152 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:42.206185 16152 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:42.111985 15993 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.188652 16070 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.190761 16186 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.191030 16179 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:11:42.192174 16185 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.100800 16178 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:42.199527 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.210559 16120 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.211766 16026 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.212657 16078 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.216333 15707 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.216234 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:42.216965 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:42.195555 16102 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.218701 15457 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.219054 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.220835 11293 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:42.221352 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.222064 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:42.269899 11286 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.222739 11284 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:42.226962 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 177366us
I20260709 12:11:42.095019 15943 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:42.285534 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 86193.8us
I20260709 12:11:42.287663 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:42.260105 16177 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.301s	user 0.000s	sys 0.008s
I20260709 12:11:42.118134 16106 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:42.231087 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52905us
I20260709 12:11:42.300058 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:42.196758 16080 consensus_meta.cc:287] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
I20260709 12:11:42.250520 11287 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:42.179955 16110 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.254021 11290 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:42.259055 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.328276 11285 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:42.197994 16031 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.187276 11859 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:42.278080 16185 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.266296 16178 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.284678 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:42.237542 16049 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:42.241488 16170 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.239389 15889 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:42.377486 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77528.7us
I20260709 12:11:42.383999 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:42.378372 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 90813.7us
I20260709 12:11:42.385437 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.387406 11141 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.388773 11286 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:42.180939 16084 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.282898 15964 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:42.416904 11090 auto_rebalancer.cc:893] Removing replace marker failed: Replica 018d40ceb45d4447aa293f4c1d929bb8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:42.418556 15964 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:42.403513 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:42.416810 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.419801 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:42.471436 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 68022.4us
I20260709 12:11:42.472185 11288 raft_consensus.cc:2410] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:42.472440 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:42.419287 11090 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:11:42.293905 16030 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:42.479923 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87311us
I20260709 12:11:42.484071 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.422344 16180 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.294131 16196 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:42.491746 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.382874 16181 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.495723 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.496150 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.496742 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.495748 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.498605 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.499523 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.500761 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.259878 16186 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.515029 11217 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:42.383090 16198 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.449141 16185 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.553771 11138 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 6.
I20260709 12:11:42.554183 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:42.517356 11090 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:11:42.572057 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.577018 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:42.558763 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 86435.7us
I20260709 12:11:42.447101 16089 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:42.557569 11141 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.578006 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.578337 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.475463 16110 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:42.577775 11138 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:42.419663 15998 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.579900 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.580516 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.563124 11216 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:42.566437 11290 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:42.564174 15964 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.583546 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.564568 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.473474 15899 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 12:11:42.567732 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 136980us
I20260709 12:11:42.584878 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.447384 15977 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:11:42.560937 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.582353 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:42.564931 16107 consensus_meta.cc:287] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.887s	user 0.008s	sys 0.005s
I20260709 12:11:42.566843 11213 raft_consensus.cc:2368] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:42.488436 16060 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.601753 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.585505 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.603632 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.586180 11219 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.417393 16142 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:42.602950 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.434738 16163 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:42.579229 16059 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.002s
I20260709 12:11:42.396414 16152 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:42.609009 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.568684 16030 raft_consensus.cc:2764] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:42.616339 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.579286 16089 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:42.618299 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.559389 16078 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:11:42.604928 16107 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.636492 16024 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:42.580566 16185 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:42.620900 11216 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:42.618513 11141 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:42.624754 16186 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.627089 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:42.637997 15909 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.006s
I20260709 12:11:42.655010 15909 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.657403 15909 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.601358 16102 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:42.630879 15993 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.631323 16152 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.649950 16185 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.661371 16084 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.633217 15998 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.633528 15964 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.665068 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3037) took 1254 ms. Trace:
I20260709 12:11:42.616099 16059 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.615756 16080 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.567178 16196 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.668762 16059 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.634922 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.669700 16196 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.669818 11217 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.670749 11144 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:42.638000 11291 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.610852 16110 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.582856 16022 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.639878 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:42.674465 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52852us
I20260709 12:11:42.642582 11219 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
W20260709 12:11:42.629748 16011 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.002s
I20260709 12:11:42.605429 16142 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:42.654058 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:42.680676 16011 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.682886 16011 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.683063 15909 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.647346 16078 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.638610 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.685518 11289 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:42.685418 16078 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:42.654605 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 369987us
I20260709 12:11:42.687788 16078 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.690642 16011 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:42.691257 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.691910 11138 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:42.692821 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.693773 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.695139 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.695672 11140 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.695744 11141 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.699638 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.706334 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:42.708053 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.691151 16011 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.690281 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:42.665474 11136 rpcz_store.cc:276] 0709 12:11:41.411116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.411752 (+   636us) service_pool.cc:224] Handling call
0709 12:11:41.412057 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.412436 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.412467 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.412986 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.757341 (+344355us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:42.057649 (+300308us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.664538 (+606889us) spinlock_profiling.cc:243] Waited 934 us on lock 0x7b1800436240. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287
0709 12:11:42.664664 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.664740 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.664786 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:42.664878 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.665008 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6773,"prepare.queue_time_us":326754,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":1222,"raft.queue_time_us":28069,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5754,"spinlock_wait_cycles":2147584,"thread_start_us":647245,"threads_started":3,"wal-append.queue_time_us":490249}
W20260709 12:11:42.653553 16111 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.005s
I20260709 12:11:42.627100 16069 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.646854 16107 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.712524 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.724397 11136 raft_consensus.cc:2410] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:42.711402 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:42.727218 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:42.727537 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 147734us
I20260709 12:11:42.719765 11141 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:42.716425 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:42.725665 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.675609 16125 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.740175 16125 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:42.740621 16125 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.741268 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.731194 16196 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.731308 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:42.728899 16201 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:11:42.723090 16022 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:42.737099 16080 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:42.738070 16074 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.005s
I20260709 12:11:42.744699 11213 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.744882 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.746196 11110 leader_election.cc:400] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:42.762534 11110 leader_election.cc:403] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:42.746627 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.618865 16163 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.749337 16110 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.720858 16186 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:42.750667 16069 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.720652 16172 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.763303 16022 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.721377 16129 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.752122 11142 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:42.732522 16118 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.779170 16022 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:42.778931 16118 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.781224 16118 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.727604 15943 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.763998 11212 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:42.746222 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.728742 16200 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:42.782869 16200 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.784965 16200 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.726130 16111 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.767143 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:42.743086 16107 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.714463 16078 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:11:42.769551 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.606925 16049 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:42.747191 15998 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.774753 11217 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:42.774361 16186 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.774091 16070 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.793955 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.796314 11213 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:42.762625 16196 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:42.798382 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52271.7us
I20260709 12:11:42.797261 16107 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.768893 16110 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:42.774832 16069 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:42.809132 11212 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:42.809269 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.736477 16089 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.816535 11285 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:42.793853 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:42.804912 16178 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.750317 16142 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.818732 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:42.818995 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:42.770813 16074 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.812773 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2250) took 1279 ms. Trace:
I20260709 12:11:42.804123 16186 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:42.802351 15943 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.827185 16059 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:11:42.831272 16059 consensus_queue.cc:1243] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:42.832262 16142 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.832172 16196 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.819671 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.820439 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:42.839610 11141 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:42.840149 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:42.841378 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.821882 16080 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:42.824422 16212 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:42.824884 16074 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:42.819686 11143 rpcz_store.cc:276] 0709 12:11:41.533474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.023476 (+490002us) service_pool.cc:224] Handling call
0709 12:11:42.023838 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.024188 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.024216 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.035196 (+ 10980us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.150754 (+115558us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:42.150814 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.150913 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.812516 (+661603us) raft_consensus.cc:1685] finished
0709 12:11:42.812540 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.812706 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1646,"raft.queue_time_us":885,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":3568,"thread_start_us":87128,"threads_started":1,"wal-append.queue_time_us":334515}
I20260709 12:11:42.802991 16211 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.857477 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.858109 11284 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:42.858831 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:42.859611 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.860055 11284 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:42.827369 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:42.842815 11141 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:42.863253 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:42.863880 11854 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:42.864225 11854 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:42.844157 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.823069 16163 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.844914 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.865098 11213 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:42.846233 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.846612 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.846997 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.866221 16178 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.866434 11217 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:42.867002 16178 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:42.867712 16178 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.866590 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:42.814003 16110 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.871400 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:42.812702 16107 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.876277 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3049) took 1433 ms. Trace:
I20260709 12:11:42.876706 11137 rpcz_store.cc:276] 0709 12:11:41.442482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.928849 (+486367us) service_pool.cc:224] Handling call
0709 12:11:41.929243 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.950899 (+ 21656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.950927 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:41.950965 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:41.950993 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.876043 (+925050us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5400252bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:42.876094 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.876215 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49404800}
I20260709 12:11:42.816392 16069 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.866258 11218 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.885396 16089 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.865128 11854 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:42.895634 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3051) took 1277 ms. Trace:
I20260709 12:11:42.896291 11139 rpcz_store.cc:276] 0709 12:11:41.618669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.039980 (+421311us) service_pool.cc:224] Handling call
0709 12:11:42.040272 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.057318 (+ 17046us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:42.295393 (+238075us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.580017 (+284624us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.580072 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:42.580112 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.895262 (+315150us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b540028fad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:42.895339 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.895543 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20179,"prepare.queue_time_us":137316,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":20569,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":18529,"spinlock_wait_cycles":95424640,"thread_start_us":482362,"threads_started":2,"wal-append.queue_time_us":324572}
I20260709 12:11:42.829006 16084 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.862864 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:42.870368 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.836123 16129 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:42.852421 11143 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.911731 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:42.901656 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:42.903064 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:42.812234 16185 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:42.829437 16200 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.907366 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.903581 11141 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:42.914285 11289 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
W20260709 12:11:42.850852 16094 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 12:11:42.915565 11184 leader_election.cc:400] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12.
I20260709 12:11:42.917007 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:42.849604 15943 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.976702 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:42.853821 16080 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.851064 15993 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:42.987025 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:42.978965 11218 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:43.025898 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:43.020776 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 935) took 1359 ms. Trace:
I20260709 12:11:43.041363 11138 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:42.915729 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:42.980254 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74151.1us
I20260709 12:11:43.070432 11142 rpcz_store.cc:276] 0709 12:11:41.661512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.189555 (+528043us) service_pool.cc:224] Handling call
0709 12:11:42.189895 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.778295 (+588400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.020451 (+242156us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54002c0454. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:43.020703 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292299648}
I20260709 12:11:42.980734 11291 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:43.071416 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.071661 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.018332 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 936) took 1356 ms. Trace:
I20260709 12:11:42.981840 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:42.848556 15899 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.985939 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.861192 15998 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.987097 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:43.022521 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:42.915639 16011 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:42.908692 16211 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:43.070644 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.983507 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:43.074054 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 158420us
I20260709 12:11:42.914304 15707 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.074307 11861 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.913954 16141 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:43.007655 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:42.979722 16163 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.202s
I20260709 12:11:43.014442 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:43.070211 11286 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:43.069175 11289 pending_rounds.cc:85] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 12
W20260709 12:11:43.181782 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65881.3us
I20260709 12:11:43.182149 11289 pending_rounds.cc:107] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:11:43.182703 11289 raft_consensus.cc:2889] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.072280 11140 rpcz_store.cc:276] 0709 12:11:41.661824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.209525 (+547701us) service_pool.cc:224] Handling call
0709 12:11:42.209835 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.696658 (+486823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.018014 (+321356us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54002c0e54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:43.018252 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076180224}
I20260709 12:11:43.039917 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:43.110776 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.083083 11211 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:43.076269 11137 raft_consensus.cc:2410] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:43.115996 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 200561us
I20260709 12:11:43.117297 11218 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:43.118417 15707 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.118608 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:43.187390 11291 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.081296 16074 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.986940 16129 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:42.987517 16052 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.120182 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.121104 16211 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.193235 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:43.008232 16185 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.199059 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:43.122645 16107 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.122803 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.124565 16181 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:43.125306 11142 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:43.076926 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.219772 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.078117 11141 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:43.220165 11284 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:43.079298 16080 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:43.080948 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55148.7us
I20260709 12:11:43.094269 15899 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.138549 16094 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.081732 16067 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:43.024091 16174 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.137s	user 0.000s	sys 0.007s
I20260709 12:11:43.007238 16111 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.140379 16110 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:43.158859 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87288us
W20260709 12:11:43.188782 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62234.4us
I20260709 12:11:42.917626 16180 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.165s
I20260709 12:11:43.145534 16178 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.267529 16178 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.202440 11860 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:43.199685 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.268538 15899 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.269322 11289 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:43.218979 16181 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:43.270591 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:43.195824 11288 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:43.216863 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.272080 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.272500 11292 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.273746 11292 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:43.275043 11292 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:43.219512 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.187131 16200 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.277293 16200 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.196265 15979 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:43.234903 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.188665 15943 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:43.281775 15943 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:43.239550 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.204824 16118 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:11:43.208186 16213 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.285331 16213 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.287441 16200 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.260111 15707 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.081463 15998 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.187467 16164 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:11:43.216071 16022 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.075220 16170 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.154s
W20260709 12:11:43.312017 16208 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.689s	user 0.003s	sys 0.002s
I20260709 12:11:43.312980 16129 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.308741 16069 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.318935 16149 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:43.319515 16149 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:43.319818 16094 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:43.320669 16149 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.321484 16080 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:43.322739 16125 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.004s
I20260709 12:11:43.298874 16186 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.191380 16141 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.324342 16107 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.325309 16141 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.322919 16110 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.331216 11854 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:43.332666 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.318291 16069 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.308846 15979 consensus_queue.cc:1243] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:43.323163 16125 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.341629 16141 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:11:43.321488 16213 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:43.370383 15998 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.339694 16151 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:43.343112 16169 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:43.373804 15899 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:43.387770 15899 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:43.405306 15899 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.407306 15899 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.415722 16125 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:43.417536 16089 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.005s
W20260709 12:11:43.420756 16070 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 12:11:43.424571 16141 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:43.427170 16149 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:43.428676 16181 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.423575 16186 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.442322 16141 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:43.436510 16217 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.430s	user 0.008s	sys 0.003s
I20260709 12:11:43.456266 16171 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.434295 16200 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.456745 16171 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:43.453404 16181 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:43.457962 16171 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.508563 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.076891 11138 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:43.511274 11138 pending_rounds.cc:85] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 5
I20260709 12:11:43.511214 11139 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:43.512017 11138 pending_rounds.cc:107] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:43.512593 11138 raft_consensus.cc:2889] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.514544 11139 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:43.515735 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 931) took 2256 ms. Trace:
I20260709 12:11:43.518844 11139 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.521066 11139 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:43.184127 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:43.528650 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3030) took 2119 ms. Trace:
I20260709 12:11:43.529165 11144 rpcz_store.cc:276] 0709 12:11:41.408934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.409130 (+   196us) service_pool.cc:224] Handling call
0709 12:11:41.409509 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.671305 (+1261796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.527969 (+856664us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002e31d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:43.528420 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2900062976}
I20260709 12:11:43.516593 11135 rpcz_store.cc:276] 0709 12:11:41.258895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.259092 (+   197us) service_pool.cc:224] Handling call
0709 12:11:41.259596 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.260080 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.260122 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.286785 (+ 26663us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.533018 (+246233us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:41.533055 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.533129 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.023654 (+1490525us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b240013f268. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2d09d 00007f983065f10e 00007f983067688c 00007f9830675bb6 00007f98306757d8 00007f983067f221
0709 12:11:43.514879 (+491225us) raft_consensus.cc:1685] finished
0709 12:11:43.514938 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.515454 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":22787328,"thread_start_us":215851,"threads_started":1,"wal-append.queue_time_us":500226}
W20260709 12:11:43.222818 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.535606 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 321026us
I20260709 12:11:43.515856 11138 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:11:43.543916 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.543620 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:43.035451 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce10840f1d143948ae8836765fb74d1 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38310
W20260709 12:11:43.547119 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 318890us
I20260709 12:11:43.160624 11214 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:43.207396 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:43.551581 11219 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:43.552217 11215 raft_consensus.cc:2410] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:11:43.551601 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:43.192459 11218 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:43.556887 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:43.292138 11286 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:43.569144 11285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.048s	sys 0.036s
W20260709 12:11:43.569809 11285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.049s	sys 0.037s
I20260709 12:11:43.573016 11286 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:43.573505 11290 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.575706 11286 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.162122 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:43.255931 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:43.252753 11291 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:43.254895 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:43.308198 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:43.558058 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 1989) took 1061 ms. Trace:
I20260709 12:11:43.564939 11284 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:43.565337 11854 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:43.566814 16232 tablet_replica.cc:333] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:11:43.569100 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.593197 11139 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:43.603019 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.610598 16089 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:43.621277 16171 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.651634 16089 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.621905 16142 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.621273 16125 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:11:43.625415 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68932us
I20260709 12:11:43.625813 16049 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.444617 16070 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
W20260709 12:11:43.655803 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48091.4us
I20260709 12:11:43.678690 16023 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.650267 11214 rpcz_store.cc:276] 0709 12:11:42.496731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.500453 (+  3722us) service_pool.cc:224] Handling call
0709 12:11:43.557603 (+1057150us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400025dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:43.557835 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372050816}
I20260709 12:11:43.686829 16049 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.688565 16151 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.626039 15943 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.618098 16024 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:43.627672 16069 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:43.769685 16142 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.625854 16141 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.629046 15909 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:43.790896 15909 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:43.791188 16049 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:43.767691 11289 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:43.780421 11290 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:43.620087 16067 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.783595 16129 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:43.796022 16199 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:43.796569 16129 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.797056 16199 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:43.798457 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 636362us
I20260709 12:11:43.798729 16151 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.799857 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:43.801047 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.801903 16151 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.802735 16163 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:43.803966 16163 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.804493 16069 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.620677 16118 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 12:11:43.807071 16213 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:43.807936 16163 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.808055 16213 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.810047 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:43.810994 15993 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.814502 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:43.814599 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.815078 16141 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.815573 11138 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:43.802597 15998 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:43.824410 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 568386us
I20260709 12:11:43.826956 16196 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.831195 15909 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.832096 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:43.835563 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.839738 16180 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.840408 16180 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.838153 15977 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:43.841797 15977 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:43.811214 11859 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:43.826016 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:43.855865 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.858525 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:43.859869 16199 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.859503  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.861296 16180 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.867218 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.868644 11284 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
W20260709 12:11:43.870972 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84258.7us
I20260709 12:11:43.622649 16059 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.170s
I20260709 12:11:43.884784 16199 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.885646 16152 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.886410 16152 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.886309 16142 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:43.886962 16152 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.889572 16142 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:11:43.890971 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74610.8us
W20260709 12:11:43.894371 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63302.1us
I20260709 12:11:43.895193 15977 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.897296 16118 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:43.897935 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 207508us
I20260709 12:11:43.898417 16118 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:43.898886 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:43.898665 16189 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.908059 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:43.908881 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 83203.4us
I20260709 12:11:43.906522 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:43.907480 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:43.914420 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:43.897282 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:43.909260 16186 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.943464 16213 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:43.907868 16022 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:11:43.899706 16089 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.950757 11293 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
W20260709 12:11:43.955991 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49841.5us
I20260709 12:11:43.885794 16199 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:43.957254 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58526.7us
I20260709 12:11:43.958698 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:43.959672 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:43.899370 15889 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:11:43.974720 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:43.921309 16023 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.976608 11136 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:43.983772 16052 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:11:43.986577 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2006) took 1121 ms. Trace:
I20260709 12:11:43.987112 11290 rpcz_store.cc:276] 0709 12:11:42.856020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.866302 (+ 10282us) service_pool.cc:224] Handling call
0709 12:11:43.973200 (+1106898us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b54000f5fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:43.977154 (+  3954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596690816}
I20260709 12:11:43.952720 16152 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:43.989354 16023 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.990693 16152 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.996001 16089 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.996471 16089 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:43.996907 16089 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.998643 15977 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.999558 15977 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.000216 15977 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.008026 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2266) took 1189 ms. Trace:
I20260709 12:11:44.008564 11136 rpcz_store.cc:276] 0709 12:11:42.818201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.818448 (+   247us) service_pool.cc:224] Handling call
0709 12:11:44.007783 (+1189335us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400263c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:44.007942 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303863040}
I20260709 12:11:43.998697 16164 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.969880 16180 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:44.013036 16164 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.019691 16164 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.956278 15943 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.023381 11856 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
W20260709 12:11:44.026613 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 148590us
I20260709 12:11:44.028676 15943 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.029137 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.030172 16152 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.031360 16148 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:44.031868 16148 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.032961 16148 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.034404 16186 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.035228 16186 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.037901 16186 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:43.978891 16213 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.033591 16199 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.041814 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:43.971150 16118 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.973387 16022 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.045974 16213 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:44.046754 16149 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.011s
I20260709 12:11:44.047078 16069 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:43.994311 16067 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.047857 16067 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.047441 16213 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.048588 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.049419 11292 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.048997 16067 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:44.050915 16181 consensus_meta.cc:287] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.009s
W20260709 12:11:44.047998 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 486897us
I20260709 12:11:44.062018 11293 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:44.063427 15899 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.015s
W20260709 12:11:44.067616 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.071163 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.072103 11293 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:44.073711 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.074458 11284 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.074632 16022 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:44.075891 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.073848 11287 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:44.059646 11854 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:11:44.051570 16129 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.082072 11854 pending_rounds.cc:85] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 6
I20260709 12:11:44.089399 11854 pending_rounds.cc:107] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:11:44.089668 11854 raft_consensus.cc:2889] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.092145 15964 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.059348 16181 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:44.102952 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.104396 16118 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.104902 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.105882 16152 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.106516 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:44.107267 11856 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.100577 16181 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.124105 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.120069 16148 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.130566 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.127108 16181 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.130806 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:44.121789 16022 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:44.141626 11284 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:44.140990 15889 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:11:44.145684 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2402) took 1115 ms. Trace:
I20260709 12:11:44.146276 11210 rpcz_store.cc:276] 0709 12:11:43.010056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.209997 (+199941us) service_pool.cc:224] Handling call
0709 12:11:43.210290 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:43.607428 (+397138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.607488 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:43.608677 (+  1189us) log.cc:844] Serialized 52 byte log entry
0709 12:11:43.787852 (+179175us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:44.090360 (+302508us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.099364 (+  9004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.115169 (+ 15805us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.115226 (+    57us) raft_consensus.cc:1685] finished
0709 12:11:44.115245 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.125678 (+ 10433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10327,"prepare.queue_time_us":307024,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":38821,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":39353,"thread_start_us":741537,"threads_started":3,"wal-append.queue_time_us":281962}
I20260709 12:11:44.135861 16189 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:44.155068 16189 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.155516 16189 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.156560 16189 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.136226 16067 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.159382 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 187273us
I20260709 12:11:44.159555 16199 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.160298 16199 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:44.161355 16199 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.161921 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.165357 11107 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:44.149607 16232 raft_consensus.cc:2243] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:44.136425 16129 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:44.168510 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 261177us
W20260709 12:11:44.185539 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84211.5us
I20260709 12:11:44.158315 16189 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.189427 15889 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.191891 16232 raft_consensus.cc:2272] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:44.192348 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.206823 15889 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.207880 15889 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.209263 15889 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.192212 16129 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.196416 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:44.210395 16236 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
I20260709 12:11:44.210729 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.211854 16049 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.212226 16049 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.212595 16049 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.197710 16052 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:44.213233 16052 consensus_queue.cc:1243] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:44.214303 16118 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.198388 16152 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:44.179687 15964 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.215170 16152 consensus_queue.cc:1243] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:44.215919 16152 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.216353 16152 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.217487 16152 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.218717 16129 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.219125 16129 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.215394 15964 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.223476 11292 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:44.223768 16152 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.226161 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.226755 16089 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.236987 11856 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:44.245548 16067 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.240097 16059 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:44.240222 16164 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.277688 11855 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:11:44.279664 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53602.4us
I20260709 12:11:44.269577 16186 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.283324 16186 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.285720 16186 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.285861 15964 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.287811 11860 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.288354 15964 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:44.288975 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78388.2us
I20260709 12:11:44.290230 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.291118 16069 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.291823 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.292655 16069 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.293298 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.294037 16069 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:11:44.297252 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.308494 16022 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:44.308909 16067 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:44.309567 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.309775 16067 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.310555 11210 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:44.311751 11854 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:44.313848 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:44.315327 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.315128 16142 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:44.315618 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.315999 11292 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.317341 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.309340 16022 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:44.325111 16243 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 12:11:44.325700 16022 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.326103 16089 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.330330 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.290480 16049 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.341152 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:44.333108 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.333446 16240 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:11:44.334527 16118 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:11:44.334693 16125 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:11:44.314424 16164 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.331158 11215 raft_consensus.cc:2368] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:44.339555 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:44.338975 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.355425 11292 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:44.334870 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.365046 16142 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:44.366179 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:44.336091 16213 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.368046 16213 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:44.367175 11142 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.336289 16069 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.373615 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:44.374313 11136 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.375000 11139 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.375819 11135 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:44.376384 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.376880 11138 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.377039 11217 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.378209 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.379083 11218 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:44.337829 16067 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.344772 16232 ts_tablet_manager.cc:1916] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:44.336130 16129 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.390280 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.392951 16164 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:44.374799 16069 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.397632 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.343550 15977 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.399106 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.396656 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.330463 16181 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.408080 16129 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.410003 11858 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.410763 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.411451 11219 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.412586 15977 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.413002 16049 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.413812 16213 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:44.393255 15998 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:44.415553 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.420331 16022 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.420778 16022 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.421685 16022 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.423169 15889 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:44.423818 15889 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.425064 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.424979 15889 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.426599 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.427547 11290 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.427416 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.428664 11287 raft_consensus.cc:2368] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17.
I20260709 12:11:44.428766 11213 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:44.415154 15998 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.429069 16110 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:44.430227 16110 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.431270 16196 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.431154 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:44.431885 16196 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.432349 11286 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:44.433447 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.409217 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.404582 16069 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.459514 11854 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:44.460917 11286 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:11:44.464130 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55061.1us
I20260709 12:11:44.464378 16049 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.464969 16049 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.465188 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.465426 16049 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.466941 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.469070 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.470448 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.471243 11210 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:44.471469 15998 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:44.472035 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.437731 15889 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.481279 11217 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:44.443626 16089 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.484438 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.492651 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:44.493357 11287 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:44.483532 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:44.491834 11139 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:44.494449 11860 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:44.488471 16245 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:44.489820 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:44.491285 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 156510us
I20260709 12:11:44.486776 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.495597 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:44.501813 11211 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.502368 11213 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:44.513588 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:44.513712 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:44.514791 16118 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.515244 16118 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.517566 11218 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:44.517330 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:44.480168 16059 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:44.492792 16089 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:44.525058 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:44.526044 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:44.519726 16023 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:44.528985 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.529436 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.554739 11287 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:44.555207 11286 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.533782 15707 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:11:44.544298 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.504598 16240 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:11:44.530097 16152 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:44.515643 16118 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.530474 16186 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.550239 16070 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.559373 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:44.564013 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46779.6us
I20260709 12:11:44.565171 11212 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
I20260709 12:11:44.562578 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.568697 11213 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:44.556164 16089 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.576781 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.562914 16180 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.562714 16186 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.593042 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.572526 16196 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:44.593024 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.574s (SENT) [suppressed 4 similar messages]
I20260709 12:11:44.578943 16129 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.586236 16189 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.587419 16224 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.590165 16186 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.600742 11293 pending_rounds.cc:85] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 4
I20260709 12:11:44.607769 11293 pending_rounds.cc:107] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:44.608042 11293 raft_consensus.cc:2889] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.592391 16180 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:11:44.613287 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 122346us
W20260709 12:11:44.618956 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 117150us
I20260709 12:11:44.603984 16189 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.607188 16224 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:44.626451 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 110997us
I20260709 12:11:44.631367 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.595145 16070 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.620532 16181 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.637028 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:44.661531 15707 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.662132 15707 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.663426 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:44.665035 16251 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:44.666869 11259 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
I20260709 12:11:44.667204 11259 leader_election.cc:403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:11:44.669181 16248 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:11:44.663156 16164 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:44.670671 15998 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12.
I20260709 12:11:44.676699 11210 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
W20260709 12:11:44.655947 16247 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:11:44.677300 16110 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.678231 16189 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.679518 16189 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.681638 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:44.683421 16052 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:44.683900 16052 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:44.684139 16250 log.cc:927] Time spent T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:44.688081 16070 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.688347 11210 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:44.689851 11210 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:44.691268 11216 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:44.695619 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.696592 11289 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:44.697284 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:44.697458 16022 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.697568 16118 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:44.698215 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77095us
I20260709 12:11:44.699059 16224 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:44.701105 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.703066 15707 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.709146 11219 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:44.713054 11860 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:44.752058 11286 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:44.720345 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56998.3us
I20260709 12:11:44.722476 16125 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:44.731381 16254 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:44.734004 16180 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:44.735657 16255 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:44.736800 16224 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.737586 16213 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:44.737644 16257 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:44.738147 16240 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:44.767313 16142 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:44.767853 16142 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.767421 16240 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.770095 16240 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.760902 16067 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:11:44.771509 16240 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.771885 16240 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:44.772740 16240 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.773262 16089 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.774008 16240 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.739898 15899 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:44.775457 15899 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.775853 15899 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:44.776738 15899 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.778059 15899 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.743100 16049 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.793421 16049 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.746418 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.794301 11854 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:44.795644 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.798184 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:44.799576 16107 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:44.799990 16107 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.800352 16107 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:44.801887 16249 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.286s	user 0.005s	sys 0.000s
I20260709 12:11:44.803325 16089 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.753906 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:44.744205 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:44.763589 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.759413 11107 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:44.738840 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96367.7us
I20260709 12:11:44.740828 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:44.779343 16196 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.781775 16213 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:44.784586 16069 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.788949 11215 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:44.765069 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:44.789963 16199 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:44.804085 16252 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.270s	user 0.007s	sys 0.002s
I20260709 12:11:44.806604 11185 leader_election.cc:400] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17.
I20260709 12:11:44.820272 11185 leader_election.cc:403] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.719153 11211 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
W20260709 12:11:44.807919 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63828us
I20260709 12:11:44.768904 16142 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:44.811167 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57387.8us
W20260709 12:11:44.811503 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 52232.2us
I20260709 12:11:44.815595 11210 raft_consensus.cc:606] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:44.833077 11210 raft_consensus.cc:614] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:44.817730 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77035us
W20260709 12:11:44.818886 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 230552us
I20260709 12:11:44.814450 16129 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:44.814283 16196 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:44.823557 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61501.2us
I20260709 12:11:44.826125 16211 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:44.829205 16125 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17.
I20260709 12:11:44.841878 11144 raft_consensus.cc:1217] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[8.4-12.6]   Dedup: 8.4->[10.5-12.6]
I20260709 12:11:44.815969 16164 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.814920 16240 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.845266 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:44.844117 11144 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [8.4-12.6]
I20260709 12:11:44.848542 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:44.818594 16199 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:44.852689 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.855304 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.774106 16052 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.843370 16089 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:44.861552 16052 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.862560 16089 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.863188 16089 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:44.864182 16089 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.865257 16118 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:44.837118 16110 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:44.866500 16199 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.868000 16199 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.861001 16213 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.841096 16211 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:44.879617 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:44.853307 16067 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.841148 16049 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:11:44.894250 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.894204 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:44.894827 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.882843 15998 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.904474 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:44.903395 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49442us
I20260709 12:11:44.906196 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:44.888101 16211 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.913885 16264 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.891237 16240 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.867965 16110 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:44.871802 16181 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:11:44.939692 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:44.909428 16067 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:44.908773 16186 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.946942 16196 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:44.953593 16232 ts_tablet_manager.cc:1929] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 12:11:44.958632 16264 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:44.952407 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:44.960940 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:44.950942 11141 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:44.928696 16257 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:44.976315 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.954246 16232 log.cc:1199] T 8ce10840f1d143948ae8836765fb74d1 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/8ce10840f1d143948ae8836765fb74d1
I20260709 12:11:44.988097 11215 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:44.950039 15964 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.953152 16186 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:44.932717 16224 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:11:44.950811 16067 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:44.993707 16022 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:11:44.976188 16257 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.948190 16129 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:45.024672 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 193784us
I20260709 12:11:45.031833 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.039602 11141 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.062722 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:45.038415 16069 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.039160 16257 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.032989 16186 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:45.079219 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 83593.5us
I20260709 12:11:45.068975 16189 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:45.064805 15964 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:45.065045 16264 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:45.098681 11856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:45.111851 11856 raft_consensus.cc:606] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:45.112336 11856 raft_consensus.cc:614] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:45.116030 11141 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
W20260709 12:11:45.098536 16266 log.cc:927] Time spent T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:11:45.099594 16267 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:45.110631 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:45.101615 16232 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38310 (request call id 0) took 2067 ms. Trace:
I20260709 12:11:45.099339 15964 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.126868 16272 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.088579 16189 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:45.110723 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 289326us
W20260709 12:11:45.135986 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 175785us
W20260709 12:11:45.144126 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 130387us
I20260709 12:11:45.098287 16265 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:45.131711 16263 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:11:45.129254 16259 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 12:11:45.088182 16186 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.131534 15943 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:45.167084 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 75934.4us
I20260709 12:11:45.168156 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:45.170061 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.170629 11286 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.171000 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.147897 16163 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.172199 16265 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:45.195195 11286 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:45.167832 15998 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:45.196700 16268 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:11:45.205674 16107 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.206321 16274 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.206863 16274 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.208380 16107 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:45.209228 16274 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.127152 16129 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.176539 15943 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:45.219465 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 893ed9b3a6054165a7d66c6d7ae1249c: Illegal state: Replica 018d40ceb45d4447aa293f4c1d929bb8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:45.215006 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.277206 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:45.295517 11856 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:45.204823 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:45.281003 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 112927us
I20260709 12:11:45.148643 16272 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.299604 11144 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.299860 11286 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:45.284639 16211 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.286151 16268 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:45.131930 16232 rpcz_store.cc:276] 0709 12:11:43.034755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.035084 (+   329us) service_pool.cc:224] Handling call
0709 12:11:43.565295 (+530211us) ts_tablet_manager.cc:1151] Deleting tablet 8ce10840f1d143948ae8836765fb74d1
0709 12:11:43.565474 (+   179us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:11:44.724676 (+1159202us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:44.953431 (+228755us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:45.101493 (+148062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365204,"tablet-delete.queue_time_us":17487,"thread_start_us":15511,"threads_started":1}
I20260709 12:11:45.287812 15889 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:45.203343 16189 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.309944 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:45.196134 16163 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:45.322934 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 118261us
W20260709 12:11:45.293298 16278 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:11:45.320324 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 153956us
I20260709 12:11:45.327308 11213 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:11:45.327852 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.328796 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.344175 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.344578 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.350422 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.352931 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.355165 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:45.356601 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52865.4us
I20260709 12:11:45.356824 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.358441 11286 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:45.319029 16199 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:45.366914 11856 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:45.333276 15964 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.368393 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.333534 16069 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.376981 11290 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:45.335578 16107 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.368676 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.369299 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.370385 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.370530 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.336249 15889 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:45.415695 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:45.423305 16285 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:11:45.429832 15889 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.378258 16186 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:45.386929 16279 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 12:11:45.377321 16069 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.451997 16279 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.452158 11290 raft_consensus.cc:2368] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:11:45.452491 16279 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:45.453833 16069 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.434075 11286 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.389017 16199 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.440207 16265 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.457127 16199 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.347188 15943 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.417702 16275 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:45.458877 16275 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.448709 11288 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:45.444139 11293 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 12:11:45.417075 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.454190 16279 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.466477 11289 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.468219 11292 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:45.376477 15964 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:45.468611 11110 connection.cc:256] RPC call timeout handler was delayed by -1.4679664519999278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 12:11:45.439339 16211 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:45.447350 16107 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:45.441551 16163 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.503006 15964 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.516429 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:45.438335 16257 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:45.531811 11286 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
W20260709 12:11:45.529515 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 172104us
I20260709 12:11:45.535082 11141 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:45.520434 16049 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.520144 16089 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:45.545047 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.545679 11286 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:45.554726 16107 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.558068 16288 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.546645 16089 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.560570 16089 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:45.563639 16189 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:45.536388 16163 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:11:45.550643 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.571509 16152 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:45.543681 16049 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.574709 16049 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.575675 16288 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.544168 16199 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.581789 16257 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:45.539477 16275 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:45.583244 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.591243 11289 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:45.596612 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:45.599361 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59559.7us
I20260709 12:11:45.601006 11856 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:45.597496 11110 leader_election.cc:400] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:45.609104 11110 leader_election.cc:403] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.608536 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:45.610961 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65979us
I20260709 12:11:45.612138 16089 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:11:45.614800 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.617988 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.620121 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:45.618726 11144 raft_consensus.cc:1217] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[8.4-12.6]   Dedup: 8.4->[10.5-12.6]
I20260709 12:11:45.620965 11144 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [8.4-12.6]
I20260709 12:11:45.620958 11856 raft_consensus.cc:2368] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:45.625186 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.631134 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.638357 16290 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:45.638770 16142 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.642616 16284 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:45.643059 16284 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.643389 16284 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.631464 16272 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:45.659935 16290 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:45.661646 16288 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.665272 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.666000 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.671276 11138 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:45.551291 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet 8ce10840f1d143948ae8836765fb74d1 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:11:45.672739 11211 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:11:45.674556 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.673727 11144 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:45.675418 11143 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.676168 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:45.676440 11029 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 125308us
I20260709 12:11:45.674413 11041 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 11 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.681388 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:45.685734 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 135) took 20946 ms (client timeout 15000 ms). Trace:
I20260709 12:11:45.688246 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.689718 11041 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 10 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.686738 16288 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.696952 11041 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 5 to 6, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 6 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.698663 11144 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.699460 11143 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:45.703291 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.696785 16288 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:45.714566 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 776da81ff0064a87b29c2949e7bc5291: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:45.717447 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.718252 11140 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:45.718042 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.718829 11137 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:45.710765 11041 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 12 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.709352 16288 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:45.722613 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet d3619bd8cdd6482dad222b2265b94b48: Illegal state: Replica 018d40ceb45d4447aa293f4c1d929bb8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:45.732954 16284 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.723042 11139 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:45.735780 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 5fd2e22241c745b9aa339da0259546f0: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:45.736616 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:45.737396 11859 raft_consensus.cc:2368] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
W20260709 12:11:45.686182 11039 rpcz_store.cc:269] 0709 12:11:24.750809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.751087 (+   278us) service_pool.cc:224] Handling call
0709 12:11:24.995879 (+244792us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:11:45.685434 (+20689555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:42.652580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:42.655358 (+  2778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:42.655403 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:11:42.655437 (+    34us) tablet.cc:662] Decoding operations
0709 12:11:42.656442 (+  1005us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:42.656502 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:42.656537 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:42.657292 (+   755us) tablet.cc:701] Row locks acquired
0709 12:11:42.657306 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:11:42.657475 (+   169us) write_op.cc:270] Start()
0709 12:11:42.657605 (+   130us) write_op.cc:276] Timestamp: P: 1783599102657415 usec, L: 0
0709 12:11:42.657619 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:11:42.658319 (+   700us) log.cc:844] Serialized 3664 byte log entry
0709 12:11:43.435120 (+776801us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:43.476811 (+ 41691us) op_driver.cc:464] REPLICATION: finished
0709 12:11:43.596526 (+119715us) write_op.cc:301] APPLY: starting
0709 12:11:43.615441 (+ 18915us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:44.156416 (+540975us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:44.156463 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:44.379604 (+223141us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:44.383217 (+  3613us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:11:44.383282 (+    65us) write_op.cc:312] APPLY: finished
0709 12:11:44.409678 (+ 26396us) log.cc:844] Serialized 89 byte log entry
0709 12:11:44.409934 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:44.410154 (+   220us) write_op.cc:454] Released schema lock
0709 12:11:44.410240 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:44.410804 (+   564us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:44.410838 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":426808,"reported_tablets":28,"spinlock_wait_cycles":126451456,"child_traces":[["op",{"apply.queue_time_us":1102,"apply.run_cpu_time_us":43111,"apply.run_wall_time_us":932462,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41855,"num_ops":9,"prepare.queue_time_us":495161,"prepare.run_cpu_time_us":51608,"prepare.run_wall_time_us":187102,"raft.queue_time_us":18800,"raft.run_cpu_time_us":2268,"raft.run_wall_time_us":143988,"replication_time_us":818610,"spinlock_wait_cycles":153308544,"thread_start_us":642303,"threads_started":4,"wal-append.queue_time_us":193158,"wal-append.run_cpu_time_us":33203,"wal-append.run_wall_time_us":2569539}]]}
I20260709 12:11:45.739540 11137 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:45.738380 11041 catalog_manager.cc:5697] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 7 to 11, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 11 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.746436 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.747164 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.745803 16276 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.748764 16276 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.749881 16284 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.753782 16276 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.755692 11041 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:45.757701 11041 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 8 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:45.759150 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:45.761701 15943 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:45.762281 15943 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:45.762403 16186 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:45.763350 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.763578 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.741652 16288 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.772610 11256 leader_election.cc:400] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:45.773128 11256 leader_election.cc:403] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.774937 11144 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:45.775686 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.775974 11137 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:45.776731 11142 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:45.763271 15943 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.778892 11859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:45.778642 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.781050 16213 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:45.782459 11135 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:45.783432 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.783640 11107 leader_election.cc:400] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:45.784063 11107 leader_election.cc:403] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.784072 11136 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.781193 11859 raft_consensus.cc:606] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:45.784940 11859 raft_consensus.cc:614] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:45.782337 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.781975 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.786638 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.701449 15964 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.788262 11137 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:45.805217 11137 pending_rounds.cc:85] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 9
I20260709 12:11:45.805572 11137 pending_rounds.cc:107] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:45.790421 16224 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:45.796057 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.792172 15964 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.806205 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.806569 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.807180 16288 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.785709 16022 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.807650 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.799490 11291 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:45.796226 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:45.833999 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53332.7us
I20260709 12:11:45.800770 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.834537 11135 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:45.835736 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.836470 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.836917 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.790167 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.839600 16288 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:45.840209 16288 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.837884 16022 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.799140 11139 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:45.843755 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.844702 16022 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.845022 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.809536 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.801904 11215 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:45.852587 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.808128 11137 raft_consensus.cc:2889] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.811321 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.797647 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.814988 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.855216 11216 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:45.815408 16279 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.855608 11219 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:45.826665 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.820139 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.830654 11210 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:45.858690 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 241097us
I20260709 12:11:45.859141 11135 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:45.859596 16148 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.860163 16148 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.861265 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:45.861595 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.862215 11286 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.865563 16067 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.866096 16067 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.867096 16152 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.867699 16152 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.868182 11216 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:45.869299 16189 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.869889 16152 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.869832 16189 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.870811 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.870922 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.872117 16189 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:45.873206 16276 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:45.873260 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.874037 11212 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:45.873900 16276 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.875025 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.874918 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.875820 11216 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:45.876251 16276 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:45.878065 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:45.879005 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:45.879295 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:45.860179 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.802369 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.880424 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:45.828339 16180 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:11:45.846971 11140 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:45.848688 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.816537 16224 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:45.838105 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.845362 16022 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:45.854368 11213 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:45.870306 11215 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:45.880872 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.880515 16152 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:45.924809 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:45.926474 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.861286 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.846374 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.927341 11139 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.832082 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.928198 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.928565 11142 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:45.826658 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.879845 11859 raft_consensus.cc:2410] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:45.930132 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.921010 11135 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:45.876322 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:45.890946 11287 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:45.921799 11136 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:45.923352 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.832018 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.935691 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:45.936321 11854 raft_consensus.cc:606] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:45.936889 11854 raft_consensus.cc:614] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:45.937203 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:45.937942 11292 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.939066 16310 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.939627 16310 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.942101 16310 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.942605 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.934549 16022 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.943274 11138 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:45.946287 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.947405 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.947767 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.948907 11141 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:45.950307 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:45.954106 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.955292 11139 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:45.956071 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:45.957365 11136 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:45.936218 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:45.946803 16070 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.964350 11286 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
W20260709 12:11:45.965610 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 102171us
I20260709 12:11:45.966212 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.881836 16023 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 8. Current term is 9.
I20260709 12:11:45.851982 16110 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.868183 16067 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.968310 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.881796 15998 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.924469 16059 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.971194 11219 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:45.979282 11217 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:45.965664 11288 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:45.923512 16303 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:45.882191 16288 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.923445 16213 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:46.002393 16059 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:45.991802 16310 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:46.021719 16303 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:46.026680 16310 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:45.981326 16107 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.027220 16303 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.028100 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:46.025522 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:46.028275 11140 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:46.020802 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:46.010478 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:46.020139 11290 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:46.032641 11219 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
W20260709 12:11:45.986651 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50521.7us
I20260709 12:11:46.017166 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:46.023145 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:45.993954 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:45.998788 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:46.034027 11210 raft_consensus.cc:606] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.001187 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:46.016048 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:46.034461 11217 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:45.862241 16148 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.028795 16213 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:46.028955 16275 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:46.029650 16269 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:46.030444 16211 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:45.947492 16271 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.027696 16059 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:45.989423 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:46.050657 11287 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.985585 11289 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:46.038512 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.034138 11213 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:46.034461 11210 raft_consensus.cc:614] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:46.035195 11291 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:46.040177 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:46.049520 11284 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.040923 11212 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:46.027705 16310 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.067420 11292 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:11:46.071825 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:46.069728 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 132737us
I20260709 12:11:46.025691 16022 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.003690 16186 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.075997 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.079840 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:46.046711 15964 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.076030 11110 leader_election.cc:400] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:11:46.028053 16107 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:45.998592 15998 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.009922 16110 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.100039 11859 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:46.092204  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:46.085976 11110 leader_election.cc:403] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.087062 11856 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:46.095366 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56965.3us
I20260709 12:11:46.104141 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.020399 16163 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:46.097790 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:46.102526  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:46.113008 15977 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:46.118818 16067 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.119489 16067 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:46.120484 16067 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.124213 15889 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.124643 16142 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.125332 16142 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.127530 16142 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.124719 15889 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.128177 15889 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.130626 15964 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:46.131227 11210 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:46.131910 15964 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.136593 16107 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:46.137318 16107 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:46.139108 11293 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:46.140208 15998 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:46.082587 16288 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:46.154860 15899 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:11:46.154886 15889 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:46.170007 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 128322us
I20260709 12:11:46.174749 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:46.186374 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82343.2us
I20260709 12:11:46.186712 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:46.188146 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:46.187254 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:46.091192 16186 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.161549 15889 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.192255 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:46.084121 16271 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.194324 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:46.164299 16288 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:46.197228 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.204329 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:46.204978 11285 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.197620 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:46.194820 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 166800us
I20260709 12:11:46.207322 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:46.203805 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 127982us
I20260709 12:11:46.189787 16142 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.215481 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:46.215853 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 184946us
W20260709 12:11:46.217250 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 111567us
I20260709 12:11:46.219728 11135 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.200730 16268 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.219201 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:46.220932 11290 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:46.220518 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:46.199337 16276 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.229611 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:46.208369 16118 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.196005 16052 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:46.235220 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:46.212849 16295 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:11:46.234138 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:46.227396 16268 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.228802 16148 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.229313 16276 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.230623 16269 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.262400 11135 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:46.235948 16142 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.201761 16224 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.242188 15943 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.270002  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:46.256011 16322 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.261610 16268 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.232997 16089 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:11:46.257195 15977 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:46.258590 16069 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.236181 16070 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:46.269279 16276 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.265594 16290 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.235678 16315 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:11:46.272593 16324 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:46.315318 16278 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:46.301529 16152 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:46.323361 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 69242.3us
I20260709 12:11:46.316351 16322 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:46.334753 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 119358us
W20260709 12:11:46.338035 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 97899.8us
I20260709 12:11:46.345675 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.339097 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:46.319470 16321 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.349817 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:46.351410 11140 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:46.272915 16269 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.354087 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:46.355799 11210 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:46.326967 15943 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:46.363080 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:46.330528 16069 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:46.363842 11144 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:46.370631 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:46.371600 11215 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:46.365113 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.344480 16110 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:46.375298 16336 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:46.346901 16322 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.378105 16256 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:46.379397 16304 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:46.376053 16326 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:11:46.384543 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.392716 11287 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:46.320396 16288 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:46.352821 16321 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:46.332216 16049 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:11:46.355104 16125 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.405591 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.332629 16290 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.404062 16023 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.419907 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.429770 16070 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:46.452414 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 217257us
I20260709 12:11:46.453364 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:46.443778 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104744us
I20260709 12:11:46.449105 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.409461 16052 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.455158 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:46.421624 16125 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:46.366070 16324 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:11:46.464681 11285 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:11:46.446563 16247 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:11:46.412678 16321 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.444901 16186 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:46.513320 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:46.441213 16328 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.464931 16271 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.480842 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.480238 16125 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.455750 16129 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.412322 16304 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.410183 15977 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:46.560781 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80029.7us
I20260709 12:11:46.566818 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.568498 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.463284 16199 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:11:46.528995 16328 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.504648 16052 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.574319 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.552117 16118 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.555809 16186 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:46.580924 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58606.3us
W20260709 12:11:46.563426 16279 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.002s
I20260709 12:11:46.565896 16070 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.565457 16256 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:46.605433 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 150345us
I20260709 12:11:46.606722 16199 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.606719 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.529724 16283 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:11:46.666808 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62971.6us
I20260709 12:11:46.578413 16213 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.669976 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.671202 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:46.570587 15943 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:46.668433 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:46.583201 16129 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.680101 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:46.582827 16328 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.584101 16118 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.528661 16069 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.604038 16317 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.663403 16265 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.662104 16289 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.695689 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:46.668443 16070 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.679569 16186 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:46.584010 16336 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:11:46.698657 16333 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.686820 16129 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.694129 16118 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.720610 16329 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 12:11:46.731369 16314 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 12:11:46.732201 16327 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 12:11:46.732497 16343 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:46.702865 16256 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.731773 16347 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.709898 16273 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.712730 16271 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.758740 16342 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.721246 16129 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.757449 16332 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.709601 16289 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.720925 16265 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:46.692667 15943 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:46.805836 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 110236us
I20260709 12:11:46.831796 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:46.758878 16333 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.717516 16317 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.778190 16347 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:46.778718 16256 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.805580 16271 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.887036 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2430) took 1013 ms. Trace:
I20260709 12:11:46.887701 11286 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:46.828980 16265 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:46.899665 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67948.1us
I20260709 12:11:46.901198 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:46.900420 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 297225us
I20260709 12:11:46.905357 11286 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:46.898030 16337 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 12:11:46.910671 11290 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:46.910972 11285 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:46.913313 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 242185us
I20260709 12:11:46.914012 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:46.893082 11216 rpcz_store.cc:276] 0709 12:11:45.873577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.876926 (+  3349us) service_pool.cc:224] Handling call
0709 12:11:45.877225 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.877572 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.877600 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.878009 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 12:11:46.164761 (+286752us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:46.164817 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.164909 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.886780 (+721871us) raft_consensus.cc:1685] finished
0709 12:11:46.886811 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.886973 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2636,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":172,"thread_start_us":286314,"threads_started":1,"wal-append.queue_time_us":377534}
I20260709 12:11:46.896828 16271 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.890892 16290 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.897692 16256 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.895936 16265 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:46.839416 16332 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.807058 16273 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:46.923007 16052 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.924841 16336 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.967358 16362 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:46.966557 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46812.2us
I20260709 12:11:46.968197 16348 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:46.969651 16338 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:11:46.970752 16354 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
W20260709 12:11:46.971441 16352 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:46.972731 16354 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:46.973263 16354 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.926205 16333 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:46.974102 16350 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:11:46.975454 16333 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:46.976610 16354 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:46.975482 16346 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
W20260709 12:11:46.975545 16339 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.004s
I20260709 12:11:46.893537 16186 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:46.958802 16199 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:46.999667 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 91959.3us
I20260709 12:11:46.998307 11286 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:11:47.002625 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 83935.7us
I20260709 12:11:46.958808 16304 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:47.014276 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:47.005980 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:47.016093 11293 raft_consensus.cc:2368] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:11:47.018069 11292 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:47.024748 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.025512 11144 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:47.025906 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:47.027966 11293 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 7: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:47.034314 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 111949us
I20260709 12:11:47.060834 11217 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:47.064234 15943 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:47.064922 16199 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.066787 16360 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:11:47.072089 16344 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.072697 16344 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.080722 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:47.082683 16052 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.083194 16052 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.085826 16317 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.086228 16289 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.087392 16273 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.087635 16289 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.088104 16289 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.990252 16347 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.088539 16289 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.089561 11216 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:47.090830 16303 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:47.091380 16303 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.046815 16070 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:47.107306 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 104382us
W20260709 12:11:47.111284 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 1618626d8c194b9ea8b2ac9f3554b006: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:47.105084 15943 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:47.113919 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.114477 15943 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:47.115561 16322 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
I20260709 12:11:47.062323 16359 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.115855 11213 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:47.116000 16322 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.116981 15943 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:47.118805 16344 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:47.119333 16118 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.121018 16347 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.124145 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2434) took 1246 ms. Trace:
I20260709 12:11:47.124517 11214 rpcz_store.cc:276] 0709 12:11:45.877447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.880815 (+  3368us) service_pool.cc:224] Handling call
0709 12:11:45.881155 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:45.923612 (+ 42457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.923646 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:45.951433 (+ 27787us) log.cc:844] Serialized 52 byte log entry
0709 12:11:46.219213 (+267780us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:47.123339 (+904126us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b1800491680. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf
0709 12:11:47.123478 (+   139us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.123708 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.123778 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.123821 (+    43us) raft_consensus.cc:1685] finished
0709 12:11:47.123910 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.124050 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52659,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":7321,"raft.queue_time_us":696,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10600,"spinlock_wait_cycles":7988096,"thread_start_us":291846,"threads_started":2,"wal-append.queue_time_us":338691}
W20260709 12:11:47.128125 16268 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.001s
I20260709 12:11:47.128542 16268 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.129318 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:47.129902 11287 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:47.130694 11211 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:47.131435 16321 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 12:11:47.131825 16321 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:47.141315 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45602.2us
I20260709 12:11:47.119333 16129 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.149606 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.151306 16118 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.160934 16052 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.173950 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:47.126222 16271 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.138765 16303 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:47.185590 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46055.3us
I20260709 12:11:47.144610 16268 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.187496 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:47.191597 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.187095 16276 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.004s
I20260709 12:11:47.140260 16328 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.184746 16269 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:47.189822 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:47.149355 16321 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:47.196947 16364 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.197510 16328 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.198141 16276 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.230792 16059 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:47.231215 16059 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:47.201713 16322 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:47.192260 16357 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 12:11:47.203222 16125 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:11:47.234791 16125 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.235556 16332 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:47.237047 16125 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.204365 16022 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.241503 16022 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.207718 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.242712 11219 raft_consensus.cc:2368] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:11:47.231407 16276 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.212877 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.247850 16271 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:47.248128 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet ddd0a7b2bb3645519f8c5c9bf85633d9: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:47.248313 11214 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 7.
I20260709 12:11:47.213042 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:47.249408 11213 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.251158 11288 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:47.253088 16129 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.213575 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:47.255029 11287 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.254854 16364 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.216988 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.217785 16224 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.217360 16289 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.219388 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.219731 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.220542 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.263291 11141 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:47.263952 11143 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:47.222708 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:47.222950 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.224084 11142 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:47.226392 16265 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.214365 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.267234 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.267596 11135 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:47.232215 16059 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.207600 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:47.211336 11286 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:47.268847 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:47.243610 16089 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:47.270670 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.271636 11142 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:47.267247 16070 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:47.272658 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65145.8us
I20260709 12:11:47.243866 16022 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.244988 16315 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.243391 16256 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.255168 16377 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.218708 11136 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:47.259047 16293 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:47.261029 15964 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:11:47.277223 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.274716 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.280386 11213 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:47.282269 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:47.299714 11141 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.285703 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.300637 11219 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:47.286327 11286 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:47.286767 11216 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:47.283339 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:47.301671 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:47.287680 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85488.6us
I20260709 12:11:47.289304 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.302467 11219 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:47.290759 11287 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:47.291425 11136 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:47.296821 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.303694 11217 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:47.297207 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.296898 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:47.274078 16059 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.274250 16142 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:47.302742 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:47.307183 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:47.287721 11110 leader_election.cc:400] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:11:47.273527 16289 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.306721 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.314458 11110 leader_election.cc:403] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.292670 16288 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.323156 16288 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.325331 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:47.325548 16288 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:47.326124 15998 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:47.326545 15998 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:47.326592 16357 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:47.327466 15998 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.328694 15998 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.329067 16142 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:47.332002 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:47.333014 11288 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:11:47.315253 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:47.335721 11137 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.313717 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.336441 11138 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 6.
I20260709 12:11:47.337735 11290 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.304497 11211 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:47.317672 16370 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:47.341475 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:47.318038 15977 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.292775 16377 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.272133 16317 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:47.301203 16299 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:47.341280 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.361981 11213 raft_consensus.cc:2368] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:47.345065 11286 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:47.349414 16361 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.350056 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:47.350457 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:47.338335 16360 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.275218 16271 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:47.351330 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.353578 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:47.300834 16069 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:11:47.355159 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:47.319396 16375 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.283000 16328 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:47.272274 16089 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.304243 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:47.359086 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.306187 16070 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.366551 11110 leader_election.cc:400] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:11:47.350883 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:47.368566 11259 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:47.421823 11259 leader_election.cc:403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:47.421865 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55500.1us
I20260709 12:11:47.392632 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:47.360936 16348 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.361405 16377 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.395115 11138 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.396306 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:47.369201 16299 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.364902 16129 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:47.291365 16315 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.403589 11141 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
W20260709 12:11:47.405606 11218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2425) took 1537 ms (client timeout 1756 ms). Trace:
I20260709 12:11:47.360936 16347 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:47.383687 16364 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.391911 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.450766 11213 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:11:47.438585 11218 rpcz_store.cc:269] 0709 12:11:45.868191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.870670 (+  2479us) service_pool.cc:224] Handling call
0709 12:11:47.405293 (+1534623us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54002a08d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:47.405503 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832192896}
W20260709 12:11:47.423187 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 69684.7us
I20260709 12:11:47.452376 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:47.422403 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53968.5us
I20260709 12:11:47.373284 16240 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:47.372274 16321 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.435802 16289 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:47.413244 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:47.394415 16022 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:47.424331 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:47.454313 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:47.376255 16361 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.425429 16375 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:47.463797 11259 leader_election.cc:400] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:47.480845 11140 raft_consensus.cc:2410] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:47.481006 11259 leader_election.cc:403] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.458734 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:47.466082 16349 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.465435 16069 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:47.475023 11136 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:11:47.475221 11860 raft_consensus.cc:2410] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:11:47.431154 16348 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.424091 16269 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.372331 16322 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 12:11:47.478603 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 127690us
I20260709 12:11:47.409374 16369 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:11:47.489128 11825 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:47.561816 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 72869.7us
I20260709 12:11:47.490247 11141 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:47.498714 11136 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:47.390920 16142 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.482939 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:47.470112 16118 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.469287 16265 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.558808 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:47.476531 16289 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.490097 16069 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:47.490309 16052 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:47.596649 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 113778us
I20260709 12:11:47.475610 16023 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:11:47.484436 16107 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
W20260709 12:11:47.615607 16382 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:11:47.552021 16348 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.485661 16349 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:47.484082 16357 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:47.554314 16332 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:47.475580 16240 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.582108 16368 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.479318 16022 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:47.656625 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 91409.2us
I20260709 12:11:47.661233 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2034) took 1304 ms. Trace:
I20260709 12:11:47.597095 16289 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.602720 16052 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.667922 11210 rpcz_store.cc:276] 0709 12:11:46.357290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.357423 (+   133us) service_pool.cc:224] Handling call
0709 12:11:46.357704 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.582703 (+224999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.582730 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:46.582782 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:46.582818 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.660611 (+1077793us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400012cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:47.660828 (+   217us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.661146 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517013376}
I20260709 12:11:47.672232 16349 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.676664 16349 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.677443 16023 consensus_queue.cc:1243] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:47.677920 16240 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:47.666679 16256 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.607445 16067 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.679055 16089 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.664479 16369 consensus_queue.cc:1243] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:47.719961 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:47.728485 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:47.664160 16368 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:47.725232 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65889.2us
I20260709 12:11:47.733407 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:47.734664 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:47.722002 11211 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:47.735467 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:47.737478 11210 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:47.680522 16052 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:47.680404 16364 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:47.751345 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2039) took 1387 ms. Trace:
W20260709 12:11:47.755636 16385 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:11:47.772644 11212 rpcz_store.cc:276] 0709 12:11:46.364005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.365545 (+  1540us) service_pool.cc:224] Handling call
0709 12:11:46.365815 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.168639 (+802824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.168673 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.168736 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:47.168771 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.751087 (+582316us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:47.751136 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.751282 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845852416}
I20260709 12:11:47.662822 16332 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.731190 16067 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:47.736876 16089 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:47.704301 15889 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:47.763599 16386 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:11:47.774592 11138 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:47.740525 16368 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.742806 15977 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:47.785785 16299 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:47.792047 16387 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 12:11:47.793401 16224 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.006s
I20260709 12:11:47.673188 16375 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.803067 11139 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:11:47.851297 11139 pending_rounds.cc:85] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 11
I20260709 12:11:47.851559 11139 pending_rounds.cc:107] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:11:47.851835 11139 raft_consensus.cc:2889] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.805133 16022 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:47.805660 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.811177 16364 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.812327 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:47.667421 16357 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.816252 16361 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:47.823987 16059 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.853715 11219 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:47.823956 16391 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:47.904908 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.813921 11211 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.848213 16315 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:47.940629 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 206029us
W20260709 12:11:47.947573 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 577541us
I20260709 12:11:47.948752 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:47.822168 16089 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.825155 15889 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:47.855484 16322 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:47.877435 16283 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.006932 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:47.886703 16391 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.016079 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:47.934038 16110 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.016335 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.017104 11287 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:48.011212 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.022131 11284 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:47.965981 16257 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.023546 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:47.970858 16386 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:47.847668 15977 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:47.971232 16213 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.024466 11288 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:48.027316 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:48.043497 11216 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:47.970268 16107 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:47.875312 16067 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.091043 11285 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:48.020335 16391 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:48.114940 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.115983 11216 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:11:48.018630 16322 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.091698 16265 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.021903 16283 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.023586 16125 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:48.117937 16360 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.000s
I20260709 12:11:48.026212 16110 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.102948 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:48.115981 16386 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:48.155684 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.042557 16257 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.162034 16125 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.160224 16360 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:11:48.176656 16257 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:48.181558 16377 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.003s
I20260709 12:11:48.182972 16377 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.185537 11856 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:48.184109 16125 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.192750 16377 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.194461 16391 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.200596 16391 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.162456 16107 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:48.220422 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 224407us
I20260709 12:11:48.279779  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:48.283138 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.154742 16265 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.295256 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.284986 16257 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.216885 16107 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:48.280201 16315 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.296964 16240 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:48.348858 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.372121 16049 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.372851 16049 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.374954 15977 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.377051 11110 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:48.378556 11110 leader_election.cc:403] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:48.380489 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:48.299649 16357 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:48.376086 16398 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 12:11:48.359097 16361 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.326829 16335 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.304275 16364 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:48.310606 16349 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.008s
I20260709 12:11:48.375757 15889 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.397200 16361 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.400612 16361 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.401234 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2044) took 1031 ms. Trace:
I20260709 12:11:48.401263 16335 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.401813 11212 rpcz_store.cc:276] 0709 12:11:47.369747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.780364 (+410617us) service_pool.cc:224] Handling call
0709 12:11:47.780840 (+   476us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:47.781357 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.781403 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:47.819534 (+ 38131us) log.cc:844] Serialized 52 byte log entry
0709 12:11:48.211661 (+392127us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:48.218451 (+  6790us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.218728 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.218803 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.400977 (+182174us) raft_consensus.cc:1685] finished
0709 12:11:48.401002 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.401171 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":540,"prepare.queue_time_us":68102,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":59884,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":11993,"thread_start_us":354699,"threads_started":1,"wal-append.queue_time_us":546896}
I20260709 12:11:48.312445 16257 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.403637 16265 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.404143 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.405380 16257 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:48.406078 16289 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.717s	user 0.005s	sys 0.006s
I20260709 12:11:48.378108 16315 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.318333 16069 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:48.407779 16069 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.408007 16315 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.378007 16240 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.410614 16240 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.403671 16335 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.411885 16335 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.412329 16335 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:48.413991 16052 consensus_meta.cc:287] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.001s
I20260709 12:11:48.377811 16089 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.405411 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:48.395568 15998 consensus_meta.cc:287] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.066s	user 0.010s	sys 0.005s
I20260709 12:11:48.407114 16049 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.370095 16283 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.418147 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2302) took 1203 ms. Trace:
I20260709 12:11:48.418653 11140 rpcz_store.cc:276] 0709 12:11:47.215083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.216710 (+  1627us) service_pool.cc:224] Handling call
0709 12:11:48.417848 (+1201138us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54002c0e54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:48.418068 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509198720}
W20260709 12:11:48.419480 16400 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 12:11:48.383968 16360 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:48.396727 16411 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.422107 16411 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.422619 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:48.424001 16332 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.424573 16411 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.425244 16089 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.425674 16089 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.426074 16089 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.431159 16240 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:48.431797 16390 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.979s	user 0.005s	sys 0.008s
I20260709 12:11:48.431933 16240 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.434965 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3140) took 1179 ms. Trace:
I20260709 12:11:48.435362 11143 rpcz_store.cc:276] 0709 12:11:47.255117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.307010 (+ 51893us) service_pool.cc:224] Handling call
0709 12:11:47.307307 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.307677 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.307713 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.343217 (+ 35504us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.420747 (+ 77530us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:47.420823 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.420941 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.431117 (+1010176us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:48.434595 (+  3478us) raft_consensus.cc:1685] finished
0709 12:11:48.434619 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.434871 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6298,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":8048,"spinlock_wait_cycles":8266112,"thread_start_us":45874,"threads_started":1,"wal-append.queue_time_us":59866}
I20260709 12:11:48.414891 16347 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.440335 16347 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.441219 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.442591 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:48.443960 16269 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 12:11:48.444523 16269 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:48.444864 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.447363 16107 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.449311 16107 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.435324 16240 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.462689 16347 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.414336 16335 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.320500 16110 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.463537 16289 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:48.481009 16368 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.004s
I20260709 12:11:48.481244 11217 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:48.481639 16368 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.482987 11860 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:48.483795 16213 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.485159 11288 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:48.414461 16052 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.487425 11212 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:48.488600 16052 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:48.468726 16348 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.796s	user 0.004s	sys 0.009s
I20260709 12:11:48.490111 16269 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.513298 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.503618 16348 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.538864 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2451) took 1194 ms. Trace:
I20260709 12:11:48.531102 16368 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.532373 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:48.533205 16315 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.543289 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:48.544389 11856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 648) took 1223 ms. Trace:
I20260709 12:11:48.539371 11210 rpcz_store.cc:276] 0709 12:11:47.344207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.746793 (+402586us) service_pool.cc:224] Handling call
0709 12:11:47.747149 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.747524 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:48.041636 (+294112us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.377870 (+336234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.384951 (+  7081us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.385118 (+   167us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:48.385404 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.391266 (+  5862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.391343 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.538598 (+147255us) raft_consensus.cc:1685] finished
0709 12:11:48.538626 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.538797 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5612,"prepare.queue_time_us":374217,"prepare.run_cpu_time_us":156,"prepare.run_wall_time_us":6420,"raft.queue_time_us":6384,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":11310,"thread_start_us":521305,"threads_started":2,"wal-append.queue_time_us":419843}
I20260709 12:11:48.545579 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:48.544965 11856 rpcz_store.cc:276] 0709 12:11:47.316048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.316385 (+   337us) service_pool.cc:224] Handling call
0709 12:11:47.316632 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.185913 (+869281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.539646 (+353733us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400513954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:48.539848 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997833472}
I20260709 12:11:48.552217 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.557121 11110 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:48.563652 11291 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:11:48.558151 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:48.542112 16052 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:48.542801 16049 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.566128 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.511212 16269 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.551689 16129 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.556522 16407 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:48.563567 16289 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.563130 16265 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.582288 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.571691 16403 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:48.577198 16349 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:11:48.588088 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2454) took 1099 ms. Trace:
I20260709 12:11:48.592803 11216 rpcz_store.cc:276] 0709 12:11:47.488512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.136524 (+648012us) service_pool.cc:224] Handling call
0709 12:11:48.137048 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.137314 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:48.375894 (+238580us) log.cc:844] Serialized 14 byte log entry
0709 12:11:48.587617 (+211723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:48.587693 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:48.587754 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.587846 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.588014 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4330,"prepare.queue_time_us":25310,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":66,"raft.queue_time_us":99,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5451,"thread_start_us":438897,"threads_started":2}
I20260709 12:11:48.596100 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.600055 16269 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.590673 16407 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.576731 16295 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.573048 16049 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.568416 16315 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.589535 16403 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.574605 16052 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.606308 16348 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.591121 16265 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:48.627997 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.629401 11218 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:48.630529 11143 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:48.631108 11140 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:48.632499 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.634059 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:48.634435 11211 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:48.639597 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:48.621476 16403 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:48.641498 11140 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:48.620433 16129 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:48.619076 16067 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.645819 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.647666 11284 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:48.647702 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.649273 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.650653 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2041) took 1444 ms. Trace:
I20260709 12:11:48.646476 11288 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:48.653805 16107 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.654392 16107 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.654592 16343 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.656544 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.657145 16107 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.657641 11286 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:48.658840 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.660562 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.663636 11293 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:48.618860 16269 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.651019 11215 rpcz_store.cc:276] 0709 12:11:47.206673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.206957 (+   284us) service_pool.cc:224] Handling call
0709 12:11:47.207273 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.207627 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.207664 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.250627 (+ 42963us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.412776 (+1162149us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b180001d560. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:11:48.614358 (+201582us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:48.614408 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.614507 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.638729 (+ 24222us) raft_consensus.cc:1685] finished
0709 12:11:48.638758 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.650584 (+ 11826us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20191,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":17805,"spinlock_wait_cycles":14442240,"thread_start_us":201356,"threads_started":1,"wal-append.queue_time_us":1380548}
I20260709 12:11:48.666464 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.662191 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.676591 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:48.665372 16348 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:48.675822 11144 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:48.653410 11137 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:48.640877 16360 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.675899 16368 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.732663 16368 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.652917 16129 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:48.734138 16129 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.734949 16368 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.735524 16129 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.687288 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.688071 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.740010 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.741743 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:48.689464 16394 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.011s	user 0.003s	sys 0.006s
I20260709 12:11:48.696523 11288 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:48.742852 11288 pending_rounds.cc:85] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 6
I20260709 12:11:48.743146 11288 pending_rounds.cc:107] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:48.743425 11288 raft_consensus.cc:2889] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:48.702088 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.744536 11292 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:48.744729 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:48.745627 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.745483 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.745865 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.704705 16369 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:48.746479 11288 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:48.707324 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.638616 16410 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.711911 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.750473 16410 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.751098 11290 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 7.
I20260709 12:11:48.752614 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2438) took 1474 ms. Trace:
I20260709 12:11:48.753607 16410 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.728354 16052 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.628499 16342 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.722662 16403 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:48.731590 16421 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:48.733039 16240 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.716470 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.673514 16289 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:48.672951 16265 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.780474 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.791810 11293 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:48.753166 11214 rpcz_store.cc:276] 0709 12:11:47.277990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.278370 (+   380us) service_pool.cc:224] Handling call
0709 12:11:47.295107 (+ 16737us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:47.295586 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.295633 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:47.338519 (+ 42886us) log.cc:844] Serialized 78 byte log entry
0709 12:11:47.480557 (+142038us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:47.823281 (+342724us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.823749 (+   468us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.847421 (+ 23672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.847513 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.688558 (+841045us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:48.752324 (+ 63766us) raft_consensus.cc:1685] finished
0709 12:11:48.752357 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.752531 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32879,"prepare.queue_time_us":881472,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":37372,"raft.queue_time_us":25519,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":42493,"spinlock_wait_cycles":14638336,"thread_start_us":309223,"threads_started":2,"wal-append.queue_time_us":196306}
I20260709 12:11:48.785429 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.793148 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.793665 11287 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.787436 11110 leader_election.cc:400] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:48.789944 11285 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.794752 11110 leader_election.cc:403] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:48.795469 16407 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:48.796236 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.796936 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:48.676460 16067 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.799310 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.800272 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.800643 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:48.798727 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:48.801705 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.802088 11293 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:48.802536 11284 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:48.803133 16315 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.680804 16269 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.805604 16269 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.806715 16089 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.807713 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.789852 16342 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.808821 16089 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.800930 11290 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.809864 16342 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.784226 16069 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:48.810928 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2301) took 1596 ms. Trace:
I20260709 12:11:48.811303 11135 rpcz_store.cc:276] 0709 12:11:47.214755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.218605 (+  3850us) service_pool.cc:224] Handling call
0709 12:11:47.218886 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.267961 (+ 49075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.810682 (+1542721us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b5400263c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:48.810867 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111545600}
I20260709 12:11:48.812530 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.813105 11135 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:48.813894 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.815188 16416 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:48.815917 16403 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:48.815991 16416 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.817932 16289 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.816390 11135 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:48.827205 11285 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:48.827267 11287 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:48.790086 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:48.832053 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.789186 16240 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.837527 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.849231 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.849815 11212 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:48.838400 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.838579 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.839499 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.834692 11290 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:48.851166 11135 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:48.828964 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.840925 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.851994 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.842912 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:48.847635 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.841802 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.854171 11218 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:48.854022 11215 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 8: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:48.850270 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:48.853899 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:48.855129 11293 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 8.
I20260709 12:11:48.855891 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:48.857388 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:48.858155 11286 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:48.854082 16342 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:48.860589 16342 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.835474 16416 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.839334 16410 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.858794 16348 raft_consensus.cc:2764] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:48.856499 16142 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:48.870379 16240 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.872290 16199 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.872738 16199 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:48.873597 16199 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.875466 16410 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:48.876371 16343 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:48.876645 11292 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:48.880556 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.854061 16269 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:48.886628 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.884232 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:48.866447 16189 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.862813 16332 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:48.889899 11214 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.891381 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:48.860143 16407 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:48.853816 16367 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:48.867444 16069 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.940956 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60503.7us
W20260709 12:11:48.941694 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43970.6us
I20260709 12:11:48.942716 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:48.882987 15964 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:48.882462 16371 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.951645 11135 raft_consensus.cc:2410] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:11:48.951762 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60475us
I20260709 12:11:48.964143 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.963198 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:48.972997 16067 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.964169 16342 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:48.975162 16410 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.964910 16349 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:48.976045 16349 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.977138 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.977563 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 974) took 1622 ms. Trace:
I20260709 12:11:48.965126 16371 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.949602 16089 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:48.980065 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.945163 16411 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:48.944177 16199 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.982522 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.881857 16416 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:48.977990 11141 rpcz_store.cc:276] 0709 12:11:47.354774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.620724 (+265950us) service_pool.cc:224] Handling call
0709 12:11:48.420084 (+799360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.420476 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.420505 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.421079 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.630262 (+209183us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:48.630298 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.630359 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.744580 (+114221us) raft_consensus.cc:1685] finished
0709 12:11:48.744606 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.977272 (+232666us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54002c0e50. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:48.977498 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":873,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":1717160192,"thread_start_us":208806,"threads_started":1,"wal-append.queue_time_us":321770}
I20260709 12:11:48.989926 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.950295 16335 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:48.994601 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51972.2us
I20260709 12:11:48.963078 16107 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.999459 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:48.967139 16370 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.978353 16349 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.006330 16335 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.006254 16370 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:49.006920 16335 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.009457 16335 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:48.959951 15964 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.020804 16438 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:49.021344 16438 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:49.021745 16438 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.024744 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.025450 11212 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:49.026335 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:49.027413 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:49.027933 11212 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:49.029009 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:48.990955 16411 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:49.033813 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 190614us
I20260709 12:11:48.966374 16069 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:49.041554 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 79060.3us
I20260709 12:11:49.002771 16315 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.004842 16107 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.050546 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:49.058822 11286 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
I20260709 12:11:49.052867 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.053648 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.061533 11285 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:49.062320 11284 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:49.054855 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.056016 11287 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:49.056274 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:49.046370 16405 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.057266 16342 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:49.080943 16405 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.083669 16416 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.088414 16370 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:49.040956 16348 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:49.093250 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:49.094046 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:49.099335 16411 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.095953 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:49.100638 16411 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.101466 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:49.102903 16213 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.103319 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.103967 16371 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:49.111218 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:49.111728 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:49.103504 16315 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.114390 16342 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:49.115068 16315 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.115998 16347 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:49.116658 16347 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:49.104010 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.117599 16347 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.119426 16347 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:49.103446 16213 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:49.097431 16395 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:49.098580 16107 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.099116 16069 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.116000 11143 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:49.120268 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 80436.6us
I20260709 12:11:49.120852 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.096184 15964 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.121311 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.123708 11285 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:49.237639 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:49.226171 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:49.241390 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:49.242400 11144 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.242957 11141 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
W20260709 12:11:49.248239 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 249099us
I20260709 12:11:49.248569 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.251339 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.253108 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.255774 11136 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:49.257784 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:49.267966 11212 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:11:49.271302 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.273021 11288 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:49.275581 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:49.281150 11219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2449) took 1951 ms (client timeout 1518 ms). Trace:
W20260709 12:11:49.281692 11219 rpcz_store.cc:269] 0709 12:11:47.329968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.358752 (+ 28784us) service_pool.cc:224] Handling call
0709 12:11:49.280943 (+1922191us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000271d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:49.281067 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008156032}
I20260709 12:11:49.273923 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:49.290948 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.284317 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.292227 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:49.301148 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:49.226570 16129 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.309655 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.247433 16189 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:49.313652 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.319257 11214 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:49.234505 16349 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:49.321547 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.287853 16343 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.325284 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.328497 11141 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:49.299037 16410 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.312084 16211 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.308547 16069 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.292522 16332 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:49.360117 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.357892 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.374176 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.307186 16110 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.227797 16395 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:49.385831 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 122213us
I20260709 12:11:49.327978 16343 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:49.407749 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.409513 11138 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:49.410626 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.411401 11138 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:49.413298 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.370600 16211 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:49.322702 16129 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.415056 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:49.408715 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 309621us
I20260709 12:11:49.329679 16349 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.422780 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:49.431494 11138 raft_consensus.cc:2410] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:49.432523 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:49.433794 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.440272 16360 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.440925 16360 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.378641 16070 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:49.428332 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:49.410781 16343 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.456885 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:49.459669 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.422067 16211 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.375469 16069 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.419355 16322 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:49.453065 16430 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:49.470252 16213 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:11:49.473392 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.470636 16439 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:11:49.458359 16410 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:49.454311 16437 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:49.470566 16395 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.467935 16416 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:49.458670 16070 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:49.499074 16434 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.005s
I20260709 12:11:49.503027 16335 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.522918 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.481376 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113990us
W20260709 12:11:49.523849 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 147987us
W20260709 12:11:49.518923 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 117936us
I20260709 12:11:49.513967 16322 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.471149 16332 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.473783 16189 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.506771 16446 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:49.534106 16432 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:49.535583 11144 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:49.539511 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:49.545331 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.556020 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:49.571475 11138 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:49.504426 16410 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.549171 16447 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.550561 16129 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.501482 16437 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.553427 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:49.549329 16110 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:49.574957 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:49.578789 11212 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:49.571677 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:49.576315 11144 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:11:49.565999 16199 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.001s
I20260709 12:11:49.579253 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:49.575917 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:49.551229 16289 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.533092 16335 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.607297 11138 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:49.643780 11144 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:11:49.646061 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66717.4us
I20260709 12:11:49.574779 16257 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.645588 11110 leader_election.cc:400] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 7 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8.
W20260709 12:11:49.653566 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62329.7us
I20260709 12:11:49.575181 16436 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.650462 11144 raft_consensus.cc:1240] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.588575 16022 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.551841 16322 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.592726 16129 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:49.571053 16304 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:11:49.654970 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:49.646896 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71046.9us
I20260709 12:11:49.662863 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:49.591706 16446 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:49.643326 16431 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.653128 16257 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.672720 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:49.648427 16450 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:49.654181 16069 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.657608 16436 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.582958 16447 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.692881 16395 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.646816 16368 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:11:49.659031 16435 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:11:49.682009 16438 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.000s
I20260709 12:11:49.677450 16349 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.676298 16129 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:49.681169 16257 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.676981 16199 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.707836 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:49.705016 16444 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 12:11:49.751309 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43572.9us
I20260709 12:11:49.741712 16438 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.739360 15964 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:49.757903 11110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.131:41465 timed out after 1.826s (SENT) [suppressed 10 similar messages]
W20260709 12:11:49.749104 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 83854.4us
I20260709 12:11:49.698232 16022 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:49.695904 16436 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.755641 16453 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:49.752574 16411 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.650s	user 0.014s	sys 0.003s
I20260709 12:11:49.750631 16349 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.735337 16069 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:49.775074 11293 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:49.760097 15964 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:49.705510 16110 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.699937 16450 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.765830 16070 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:49.787146 16347 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.667s	user 0.015s	sys 0.000s
I20260709 12:11:49.772349 16453 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:49.795681 16452 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:11:49.796697 16454 log.cc:927] Time spent T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:49.830736 11284 raft_consensus.cc:2410] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:49.832091 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.832824 11287 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
W20260709 12:11:49.833179 16426 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.972s	user 0.004s	sys 0.011s
I20260709 12:11:49.833637 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.800064 16410 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.801532 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2328) took 1114 ms. Trace:
I20260709 12:11:49.775638 16446 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.834416 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2323) took 1189 ms. Trace:
I20260709 12:11:49.839599 11135 rpcz_store.cc:276] 0709 12:11:48.644579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.851744 (+207165us) service_pool.cc:224] Handling call
0709 12:11:49.834172 (+982428us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54002e1dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:49.834349 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227254016}
I20260709 12:11:49.797963 16467 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:49.790230 15964 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.804802 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 977) took 2338 ms. Trace:
I20260709 12:11:49.852721 11139 rpcz_store.cc:276] 0709 12:11:47.466604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.687254 (+220650us) service_pool.cc:224] Handling call
0709 12:11:47.730341 (+ 43087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.852266 (+121925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.804535 (+1952269us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b540032f5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:49.804735 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165905280}
I20260709 12:11:49.854187 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.855082 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:49.855571 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.856274 11139 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:49.856848 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.857257 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:49.857702 11287 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:49.858124 11139 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:49.806712 16129 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.859128 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.860560 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:49.806285 16107 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.004s
I20260709 12:11:49.814323 16257 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.817529 16211 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.798115 16343 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:49.820111 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2045) took 2450 ms (client timeout 1786 ms). Trace:
I20260709 12:11:49.822726 16335 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:49.823050 11291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2070) took 2491 ms (client timeout 1826 ms). Trace:
I20260709 12:11:49.823316 16437 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.824784 16052 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.825076 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:49.903180 11291 rpcz_store.cc:269] 0709 12:11:47.331904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.332744 (+   840us) service_pool.cc:224] Handling call
0709 12:11:49.822787 (+2490043us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003197d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:49.822936 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626118912}
I20260709 12:11:49.825697 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.907351 11293 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:49.826596 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:49.828016 11288 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.829138 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:49.832221 16453 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.840541 11141 rpcz_store.cc:276] 0709 12:11:48.686897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.472094 (+785197us) service_pool.cc:224] Handling call
0709 12:11:49.498212 (+ 26118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.515502 (+ 17290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.515544 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.520327 (+  4783us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.660256 (+139929us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:49.660310 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.660398 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.801315 (+140917us) raft_consensus.cc:1685] finished
0709 12:11:49.801335 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.801474 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16841,"raft.queue_time_us":18670,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5724,"thread_start_us":110128,"threads_started":1,"wal-append.queue_time_us":213960}
I20260709 12:11:49.849161 16433 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:49.851048 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:49.861292 11287 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:49.840963 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:49.917496 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66566.3us
I20260709 12:11:49.802068 16360 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:49.918471 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 246284us
I20260709 12:11:49.897812 16304 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:49.920621 16304 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.923372 16304 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.896277 16467 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.927932 16453 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:49.927789 16457 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:49.900784 11217 rpcz_store.cc:269] 0709 12:11:47.369991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.424292 (+ 54301us) service_pool.cc:224] Handling call
0709 12:11:49.819830 (+2395538us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400295ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:49.819989 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313372416}
I20260709 12:11:49.896823 16023 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:49.930109 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:49.931983 11293 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:49.926347 16467 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:49.936203 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:49.932799 16433 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:49.941347 16433 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.936520 16023 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.944645 11210 raft_consensus.cc:606] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:49.945070 11210 raft_consensus.cc:614] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:49.945699 16023 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.860908 15964 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.916703 16436 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.909143 16052 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.948486 16436 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.900012 16107 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:49.949970 16052 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.950811 16107 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:49.951690 11140 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.955986 11286 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.961103 16343 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:49.963367 16257 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:49.967155 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:49.979372 16391 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.980051 16391 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:49.989107 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 326312us
I20260709 12:11:49.990097 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:49.937899 16453 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.000058 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.004962 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.009032 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:50.007258 11140 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:49.996628 16049 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.008759 16332 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:50.007586 16257 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:50.001091 16269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.061s	user 0.015s	sys 0.016s
W20260709 12:11:50.026827 16269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.016s	sys 0.016s
I20260709 12:11:50.006384 16473 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:50.019418 16468 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:11:50.020742 16211 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.022759 15964 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.006771 16453 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.034088 16453 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.034443 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.037403 16052 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.038249 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:50.041348 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.045809 16052 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.993948 16391 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.051752 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.052630 16052 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:50.054071 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.063010 16240 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.044238 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3163) took 1176 ms. Trace:
I20260709 12:11:50.063441 16240 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.063901 16240 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.043439 16322 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.063700 11143 rpcz_store.cc:276] 0709 12:11:48.867430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.976783 (+109353us) service_pool.cc:224] Handling call
0709 12:11:50.044032 (+1067249us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400371c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:50.044178 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317005568}
I20260709 12:11:50.064249 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.065737 16303 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:50.066224 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.067546 16446 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.067844 15964 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.062117 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:50.068149 16446 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.069721 15964 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:50.070264 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:50.072460 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:50.075177 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:50.056320 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 35f8f77c6e8c4a66b41088646a9c8c90: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:50.075810 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.076800 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.077842 11143 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:50.078197 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.078907 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.079231 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.080747 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.080853 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.081236 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.081617 11137 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:50.081925 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.073930 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:50.087080 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.089133 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:50.098367 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.100948 11136 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.101392 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.103842 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:50.111690 11137 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:50.112975 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.114889 11139 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:50.070312 16446 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.089386 16070 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:50.086711 16361 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.063463 16438 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.088898 16332 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.175274 11136 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:50.113018 16304 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.088762 16473 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.089288 16369 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.113873 16433 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:50.112960 16351 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.105444 16391 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:50.106525 16052 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.112751 16437 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:50.222713 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52509.1us
I20260709 12:11:50.168311 16070 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.152907 16436 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.204411 16332 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:50.206101 16304 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:50.210657 16473 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:50.210294 16369 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:50.168787 16023 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:50.169287 16435 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 12:11:50.216509 16351 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:50.221948 16391 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.337713 16070 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:50.346133 16199 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.380570 16052 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:50.380438 16347 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.374267 16211 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:50.375808 16470 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.215395 16431 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 12:11:50.386548 16332 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.389277 16304 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:50.407397 11292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 2806) took 1609 ms (client timeout 1584 ms). Trace:
I20260709 12:11:50.389009 16369 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:50.406368 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.394400 16269 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:50.393916 16435 consensus_queue.cc:1243] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:50.379258 16022 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:50.393837 16351 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.391580 16473 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.399241 16391 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:50.411710 11292 rpcz_store.cc:269] 0709 12:11:48.797916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.836223 (+ 38307us) service_pool.cc:224] Handling call
0709 12:11:50.407191 (+1570968us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b540041a5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:50.407321 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42584448}
W20260709 12:11:50.426097 16482 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:11:50.431352 16478 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:50.433341 16351 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.435370 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.436964 11292 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:50.441895 16351 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.404136 16211 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:50.443365 16477 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:50.444473 16211 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:50.445083 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 382f5b53b1974dc083d6b840e190fbf9: Illegal state: Replica ba2779405e8d452e95f42421b2b60928 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:50.404356 16347 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.453470 16303 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:50.407374 16470 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:50.463263 16487 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:50.464039 16347 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.407011 16052 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:50.467644 16453 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.467692 16052 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.478430 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2096) took 1051 ms. Trace:
I20260709 12:11:50.402247 16199 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:50.490396 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 386647us
I20260709 12:11:50.412304 16269 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:50.396746 16023 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.499374 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49838 (request call id 1087) took 1273 ms. Trace:
I20260709 12:11:50.418105 16265 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.485002 16453 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.483361 11291 rpcz_store.cc:276] 0709 12:11:49.427391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.937454 (+510063us) service_pool.cc:224] Handling call
0709 12:11:49.972716 (+ 35262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.975986 (+  3270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.976019 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.976539 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.012825 (+ 36286us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:50.012872 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.012959 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.478088 (+465129us) raft_consensus.cc:1685] finished
0709 12:11:50.478122 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.478340 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2806,"raft.queue_time_us":4040,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":35784,"threads_started":1,"wal-append.queue_time_us":140154}
I20260709 12:11:50.493947 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.499950 11284 rpcz_store.cc:276] 0709 12:11:49.225654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.225844 (+   190us) service_pool.cc:224] Handling call
0709 12:11:50.499107 (+1273263us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540017f7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:50.499294 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361396096}
I20260709 12:11:50.519654 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.404965 16436 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.528471 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:50.490922 16488 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:50.537002 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 231257us
I20260709 12:11:50.504968 16110 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.527850 16446 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.529836 16361 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.545019 16240 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.552379 16023 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.554271 16348 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.537642 16488 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.528853 16407 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:50.555986 16110 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.516593 16265 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.560426 16436 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:50.561816 16481 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:50.563401 16463 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.528059 16438 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.571274 16446 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:50.591833 11286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.012s
W20260709 12:11:50.592502 11286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.006s	sys 0.012s
I20260709 12:11:50.579627 16437 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.566839 16491 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:11:50.579203 16489 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.585045 16142 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:11:50.619712 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 81985.9us
I20260709 12:11:50.561798 16332 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.576262 16348 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.577224 16407 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.569654 16269 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.592125 16438 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.604482 16436 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.605510 16491 consensus_queue.cc:1243] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:50.587177 16257 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:11:50.634702 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 95544.4us
I20260709 12:11:50.607259 16433 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:50.598989 16070 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:50.651033 16332 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.649852 16407 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:50.654609 16449 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.129s	user 0.007s	sys 0.000s
I20260709 12:11:50.657332 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2068) took 1768 ms. Trace:
I20260709 12:11:50.641435 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:50.642629 16436 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.657740 11219 rpcz_store.cc:276] 0709 12:11:48.889024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.318271 (+429247us) service_pool.cc:224] Handling call
0709 12:11:49.318630 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.324412 (+  5782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.324449 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.359883 (+ 35434us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.519578 (+159695us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:49.519621 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.519715 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.654249 (+1134534us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b24000fda78. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2d09d 00007f983065f10e 00007f983067688c 00007f9830675bb6 00007f98306757d8 00007f983067f221
0709 12:11:50.657023 (+  2774us) raft_consensus.cc:1685] finished
0709 12:11:50.657047 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.657269 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12775,"raft.queue_time_us":42898,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":14212,"spinlock_wait_cycles":13059840,"thread_start_us":147245,"threads_started":1,"wal-append.queue_time_us":163223}
I20260709 12:11:50.639964 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:50.660559 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.662829 16438 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.663061 16436 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.663405 16438 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.636626 16490 consensus_queue.cc:1059] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:50.650947 16070 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.664039 16438 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.664356 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:50.664881 16490 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.665551 16490 raft_consensus.cc:3055] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:50.665872 16490 raft_consensus.cc:740] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:50.667132 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.667682 16497 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.668238 16497 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:50.666277 11217 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:50.666878 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:50.669960 11215 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.647351 16488 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.673628 11135 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:50.669867 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.662266 16433 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.647852 16470 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.672194 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.676972 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:50.663345 16332 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.691951 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.686959 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.674028 16269 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.683593 11139 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: [15.9-17.10]
W20260709 12:11:50.690903 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.679077 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.692893 11219 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:50.704233 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.712710 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.714027 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.716866 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:50.711318 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62594.7us
I20260709 12:11:50.686281 16488 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.687644 16199 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.732894 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:50.717947 11219 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:50.734679 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.737821 11215 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:50.738816 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:50.740384 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.742266 11217 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:50.694589 16332 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:50.669140 16497 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.752455 11219 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:50.694207 16342 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.755501 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.749722 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:50.760572 11219 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:50.712090 16436 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.748726 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:50.772243 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.737278 16070 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:50.769150 16436 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.778962 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:50.779722 11215 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:50.783033 16473 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.785555 16473 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.786736 16446 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.786939 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:50.788596 16360 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.778213 16436 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.781926 16304 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.791280 16304 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.792786 11218 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.731513 16488 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.761361 16332 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.798821 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.800848 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.809919 11284 raft_consensus.cc:2376] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14. Re-sending same reply.
I20260709 12:11:50.801575 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.811092 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.811889 11284 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:50.779270 16442 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.260s	user 0.004s	sys 0.012s
I20260709 12:11:50.805011 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.819041 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1078) took 1772 ms. Trace:
I20260709 12:11:50.759884 16438 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.807747 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.802561 11219 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:50.819573 11289 rpcz_store.cc:276] 0709 12:11:49.046303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.046712 (+   409us) service_pool.cc:224] Handling call
0709 12:11:49.047084 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:49.087787 (+ 40703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.087818 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:49.088365 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 12:11:49.406534 (+318169us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.406597 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.406692 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.778656 (+1371964us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:50.818570 (+ 39914us) raft_consensus.cc:1685] finished
0709 12:11:50.818603 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.818923 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40236,"raft.queue_time_us":40340,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":59,"spinlock_wait_cycles":7281920,"thread_start_us":317688,"threads_started":1,"wal-append.queue_time_us":406683}
I20260709 12:11:50.827950 11292 raft_consensus.cc:2376] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14. Re-sending same reply.
I20260709 12:11:50.828540 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.805653 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.821851 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:50.823156 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.702693 16490 consensus_queue.cc:260] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.824543 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.826882 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.829316 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.832676 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.833281 11292 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:50.834134 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.834456 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.834969 11292 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:50.829337 11291 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:50.839125 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.839335 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.839725 11289 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.766566 16342 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.804093 16436 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.852864 16416 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.853538 16416 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.853966 16416 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.859203 16490 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.860731 16342 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.844075 11141 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:50.865329 16369 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.844069 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.869499 11292 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:50.870613 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.873221 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:50.875191 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.879740 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.830838 16347 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:50.881801 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.840497 16211 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.884562 11144 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:50.884953 11136 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:50.885731 16450 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.887111 11142 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.809301 16070 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.887455 11142 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:50.887610 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.888865 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.888366 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2094) took 1461 ms. Trace:
I20260709 12:11:50.846263 16110 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.890923 11289 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:50.895408 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.899312 11144 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:50.899919 11141 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:50.901007 11284 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:50.902004 11861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:50.902475 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.902650 11861 raft_consensus.cc:606] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:50.892966 11287 rpcz_store.cc:276] 0709 12:11:49.426840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.918216 (+491376us) service_pool.cc:224] Handling call
0709 12:11:49.918449 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.926713 (+  8264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:49.927007 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.123028 (+196021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:50.123089 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.123144 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.888207 (+765063us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b540017e3d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:50.888238 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.888325 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":673,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":8227,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":42188,"spinlock_wait_cycles":18508672,"thread_start_us":195568,"threads_started":1,"wal-append.queue_time_us":411041}
I20260709 12:11:50.903296 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.905109 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.906636 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.892519 11142 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.907876 11142 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.908020 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.909337 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.891749 16211 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.916554 16211 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.918673 11211 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:50.921304 16391 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.872788 16436 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:50.923692 16369 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.924222 16436 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.925616 16070 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.925931 16488 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.907698 16348 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.904925 16375 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.930756 11136 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:50.930966 16375 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.931488 11142 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:11:50.931910 11142 pending_rounds.cc:85] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:11:50.932159 11142 pending_rounds.cc:107] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:50.932423 11142 raft_consensus.cc:2889] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:50.933158 16375 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.901213 16470 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:50.936417 16470 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.913250 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.939605 11292 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:50.946612 16405 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:50.946532 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.953426 16368 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.953815 16368 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:50.890295 16347 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.954679 16368 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:50.955889 16368 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.957252 16347 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:50.944694 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.959182 11289 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:50.958982 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.913240 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:50.961539 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:50.963483 11141 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:50.967135 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.967535 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:50.943194 16470 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:50.987783 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2814) took 1651 ms. Trace:
I20260709 12:11:50.972990 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:50.969247 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.990294 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.981418 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:50.988354 11288 rpcz_store.cc:276] 0709 12:11:49.336864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.357648 (+ 20784us) service_pool.cc:224] Handling call
0709 12:11:49.827877 (+470229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.908479 (+ 80602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.987490 (+1079011us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54000622d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:50.987706 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080730496}
I20260709 12:11:50.945047 16269 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:50.991084 11856 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:50.991143 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:50.994055 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:50.993356 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:50.966145 16347 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.000425 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:51.002907 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.005156 11288 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:50.968585 16211 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.982049 16199 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.982244 16110 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.006155 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:51.018319 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.007664 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:51.015085 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 92511.1us
I20260709 12:11:50.958946 16348 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:50.991012 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.022890 11289 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:50.993479 16360 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.992190 16450 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.020031 11288 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:51.017942 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.029753 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.030593 11288 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:51.030689 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:50.995358 16269 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.024879 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.017486 16453 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.008937 16411 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.033327 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.031576 11288 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:50.968036 16416 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.002594 16070 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:50.991888 16438 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:51.032968 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:50.998059 16342 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.006718 16347 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.015827 16199 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.027442 16360 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:51.037942 11856 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:51.027768 16110 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:51.096318 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:51.031952 16269 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.034956 16411 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.107290 11856 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:51.111449 16416 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:51.070403 16199 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.108414 16391 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.119015 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:51.126955 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.037305 16211 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.123473 11289 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.105484 16360 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.099772 16070 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:51.099064 16347 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.132313 11137 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.035817 16450 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.105154 16342 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:51.134541 11856 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:51.108047 16411 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:51.134909 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104344us
I20260709 12:11:51.191624 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:51.168156 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.191851 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.197065 11856 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:51.197130 11860 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:51.197613 11859 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 7.
I20260709 12:11:51.172294 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.158056 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.175010 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.172873 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.143847 16450 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:51.199747 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.198041 11137 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:51.201910 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:51.155478 16342 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.186015 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.157699 16391 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.207281 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.176136 16369 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.202920 16450 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.160197 16436 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.203073 16440 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.208254 16448 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.206799 16348 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.221848 16240 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.205938 16438 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:11:51.222892 16438 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:51.223269 16438 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:51.224157 16438 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.225410 16438 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.210326 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.209376 16470 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.229857 16470 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.230286 16470 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.164041 16332 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.232034 16450 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.232686 16332 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.233412 11210 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:51.204387 16515 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.177563 16110 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.234154 16450 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:51.215281 16369 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.216488 11854 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:51.175208 16070 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.235663 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:51.237138 16436 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.217379 16391 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.239271 16448 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.239892 16348 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:51.240865 16493 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.617s	user 0.004s	sys 0.001s
I20260709 12:11:51.240737 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:51.268770 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64851.3us
I20260709 12:11:51.244230 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.246682 16303 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:51.260248 16369 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.241994 16367 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:51.271243 16445 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.271747 16445 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:51.270756 16368 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.273492 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.274297 16368 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.277184 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.279673 16391 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.284353 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.262617 16450 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.299420 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.296624 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:51.305245 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.306226 11853 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:51.308459 16453 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.310597 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.312211 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:51.313071 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.313378 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.313875 11856 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:51.315409 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:51.316409 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.316443 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2333) took 1555 ms. Trace:
I20260709 12:11:51.315496 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.317670 11140 rpcz_store.cc:276] 0709 12:11:49.760653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.954354 (+193701us) service_pool.cc:224] Handling call
0709 12:11:49.965544 (+ 11190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.012535 (+ 46991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.316244 (+1303709us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54002e31d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:51.316391 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95323904}
I20260709 12:11:51.318784 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.319959 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.320206 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.321023 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.321305 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.322093 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.322377 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:51.323153 16189 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.323246 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.323433 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:51.323567 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.324218 16189 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.324445 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.325098 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.325395 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.325695 11215 raft_consensus.cc:1813] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Handling vote request from an unknown peer 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.326303 11215 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:51.326756 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.324728 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.329694 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.331107 16490 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.331836 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:51.331636 16490 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.333101 16265 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.335005 16490 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.332244 16304 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:51.335811 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:51.336251 16304 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.337255 11142 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.338068 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:51.338604 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:51.339198 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.339778 16304 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.340103 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:51.340720 11218 raft_consensus.cc:606] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.341066 11218 raft_consensus.cc:614] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.342224 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.343662 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.344746 11136 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:11:51.345539 16303 raft_consensus.cc:993] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:51.345674 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:51.346060 16303 raft_consensus.cc:1081] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:51.347622 11210 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:11:51.348766 16367 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:51.349074 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.349767 16303 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.349795 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.350371 16303 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:51.350806 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.351301 16303 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.352312 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.353485 16303 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.353750 16467 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.354087 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.355042 16467 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.356200 16467 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:51.356690 16467 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.339923 11292 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:51.360841 11292 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.306252 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.355759 11210 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:51.354996 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:51.364317 16367 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:51.364853 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.326314 16189 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.365530 11218 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:51.365578 16375 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:51.366223 16375 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:51.368038 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:11:51.368528 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.368718 11136 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.369086 11136 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.369153 11218 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:51.371878 11212 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:51.373661 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 77146us
I20260709 12:11:51.374316 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:51.277537 16199 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.390291 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:51.392510 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:51.392480 11136 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.401749 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.403877 11852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:51.404807 11852 raft_consensus.cc:606] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.405304 11852 raft_consensus.cc:614] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.371690 16450 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.407208 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:51.414027 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.415215 16447 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.437814 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.417531 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1094) took 1342 ms. Trace:
W20260709 12:11:51.425803 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.391849 16315 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:51.300362 16446 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 12:11:51.445979 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.443481 11212 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:51.443647 11218 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.444324 11285 rpcz_store.cc:276] 0709 12:11:50.075373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.102697 (+ 27324us) service_pool.cc:224] Handling call
0709 12:11:50.102963 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.113902 (+ 10939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.113961 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.117221 (+  3260us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.538607 (+421386us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:50.538674 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.538792 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.240262 (+701470us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:51.416328 (+176066us) raft_consensus.cc:1685] finished
0709 12:11:51.416361 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.417454 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9553,"spinlock_wait_cycles":8411008,"thread_start_us":330514,"threads_started":1,"wal-append.queue_time_us":429334}
I20260709 12:11:51.462383 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.465029 11217 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:51.430109 16342 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.478945 11289 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.470698 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:51.444042 16481 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:11:51.450906 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43829us
I20260709 12:11:51.412653 16089 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.441982 16450 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.436213 16416 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.487123 16189 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.487672 16369 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:51.446889 16315 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.461777 16405 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:51.443720 16265 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.495934 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:51.503048 11218 raft_consensus.cc:606] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.502369 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.500051 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.500901 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.505749 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.506026 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.489280 16089 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.499218 16405 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.512151 11136 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.500053 16315 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:51.408272 16375 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.497874 16369 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:51.515920 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.490893 16332 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:51.505151 16446 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.518955 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.502770 16265 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.491195 16347 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.492611 16431 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:51.469522 16348 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.511546 16089 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.509856 16436 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.539736 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.550428 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:51.517838 16448 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.524035 16447 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.521997 16369 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.574049 11288 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:51.574213 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:51.575011 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 243255us
I20260709 12:11:51.580943 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.523033 16446 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:51.528179 16265 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.599864 11285 pending_rounds.cc:85] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 6
I20260709 12:11:51.601166 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:51.602596 11292 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:51.557341 16416 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.606158 16433 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.605731 16360 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:51.608827 16524 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:11:51.564175 16375 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.609965 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.605466 11285 pending_rounds.cc:107] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:51.612033 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:51.593322 16447 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:51.614535 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.640458 11284 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:51.609661 16416 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:51.637670 11285 raft_consensus.cc:2889] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.622324 16199 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:51.626629 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:51.522604 16515 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:11:51.633858 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:51.663300 16405 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.642930 16433 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:51.670275 16433 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.675839 16347 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:51.613318 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:11:51.635795 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 337984us
I20260709 12:11:51.651067  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:51.685496 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.619282 16435 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.566262 16431 consensus_queue.cc:1243] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:51.651633 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.643399 16447 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:51.694942 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 285398us
W20260709 12:11:51.656967 16269 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.000s
I20260709 12:11:51.658684 16283 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.652555 16110 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:51.652783 16416 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.667939 16360 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:51.698933 11107 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.698457 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.618245 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.724591 11290 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:51.651562 16436 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 12:11:51.715633 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 221825us
I20260709 12:11:51.644573 16411 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.690598 16391 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:51.722653 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 202009us
I20260709 12:11:51.699575 16435 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.697420 16283 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:51.726255 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 109445us
I20260709 12:11:51.731124 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.738710 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.725514 16405 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.715632 16052 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:51.699822 16332 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:51.845151 16332 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.845633 16332 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:51.846634 16332 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.848155 16332 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.798906 16450 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:51.843673 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 70570.2us
I20260709 12:11:51.803412 11143 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.803432 11136 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:51.854054 11256 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.699817 16269 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.855047 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:51.803859 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:51.804944 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:51.860687 11142 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:51.808053 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:51.809279 16342 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:51.810665 11137 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:51.812429 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:51.814867 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:51.817044 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:51.821852 16368 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:51.826733 16445 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.834218 16304 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:51.835455 16023 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.714922 16022 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:51.652586 16446 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.743944 16283 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.799743 16402 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.871915 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:51.737887 16391 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.719967 16110 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.875409 11140 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:51.875923 11136 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
W20260709 12:11:51.878225 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 177679us
I20260709 12:11:51.881274 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2827) took 1082 ms. Trace:
I20260709 12:11:51.889019 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:51.881788 16470 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.651s	user 0.002s	sys 0.008s
I20260709 12:11:51.872990 11144 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:51.901441 11288 rpcz_store.cc:276] 0709 12:11:50.798438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.036821 (+238383us) service_pool.cc:224] Handling call
0709 12:11:51.037183 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.592232 (+555049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.881001 (+288769us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540015ca54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:51.881208 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234147200}
W20260709 12:11:51.885500 16438 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.009s
I20260709 12:11:51.883206 16367 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:51.871373 16533 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:51.914670 11286 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:11:51.915221 11286 pending_rounds.cc:85] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 11
I20260709 12:11:51.915498 11286 pending_rounds.cc:107] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:11:51.915762 11286 raft_consensus.cc:2889] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.916762 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.882006 16304 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:51.903560 16529 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
W20260709 12:11:51.904368 16534 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:51.887243 16211 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:11:51.887173 16525 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:11:51.874879 16405 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:51.875391 16199 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.895610 16531 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:51.894065 16467 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.003s
I20260709 12:11:51.890208 16450 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:51.893388 16402 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:51.926149 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:51.931619 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 193000us
I20260709 12:11:51.947396 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.890377 16023 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.948715 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:51.920138 16533 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:51.946904 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 215872us
I20260709 12:11:51.924479 16438 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.931288 16531 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:51.936782 16402 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.929098 16538 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.910902 16470 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.937644 16515 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.984949 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:51.919113 16486 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:11:51.950659 16453 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.952360 16521 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:51.994697 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 192543us
I20260709 12:11:51.932782 16315 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:51.965481 16533 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:51.980899 16440 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.934115 16467 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.984479 16531 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:52.010239 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53588.2us
I20260709 12:11:51.999105 16461 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:11:52.021173 16067 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.021277 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:52.037855 11288 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:52.022467 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:52.023064 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 170654us
I20260709 12:11:52.024746 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:52.038964 11290 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.009915 16411 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.017843 16542 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.998046 16265 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:51.959635 16304 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:52.028893 11859 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.048828 16467 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.049371 16445 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.033022 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:52.109640 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 76715.8us
I20260709 12:11:52.049392 11144 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:52.051788 11143 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:52.051957 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 149658us
I20260709 12:11:52.052719 11139 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:52.053067 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.055135 11290 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:11:52.050221 16089 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:52.057817 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97146.9us
I20260709 12:11:52.113389 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.113461 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:52.056160 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.113732 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.117313 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.118214 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.118629 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.119513 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.120342 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.120358 11214 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:52.055987 16486 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:52.039326 16440 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:52.172652 16440 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.173957 16557 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:52.124142 16486 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:52.174774 16557 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.175519 16486 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.179176 11216 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:52.124653 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.114935 16407 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:52.125800 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:52.126191 16551 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:52.126654 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.190790 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:52.126974 16547 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:11:52.128129 16089 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.128039 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.192613 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.131001 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.131449 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:52.131790 11290 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:52.134323 16461 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.137574 11291 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:52.190052 11182 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:52.213832 11216 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:52.139580 16070 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.053188 16067 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.140173 11288 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.142277 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.146136 16265 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.149981 16488 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.150365 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.151463 16315 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.153070 16110 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.156232 16289 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:52.160470 16537 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 12:11:52.168218 16497 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:52.169063 16391 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:52.171718 16369 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 12:11:52.180689 11210 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:52.192997 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.200915 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:52.202574 11292 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:52.203687 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:52.266418 11293 raft_consensus.cc:2368] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
W20260709 12:11:52.229478 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 98112us
I20260709 12:11:52.267669 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:52.139700 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.234050 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.146138 16069 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:52.239107 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 96953.1us
I20260709 12:11:52.239156 11289 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.273531 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.241990 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.274858 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.275837 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.221864 16416 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.188143 16199 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:52.244481 16407 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.232517 16515 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:52.256700 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 106441us
I20260709 12:11:52.237607 16486 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:52.260958 11218 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:11:52.248773 16560 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.236279 16558 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.239300 16070 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.256383 16289 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:52.208413 16447 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.245429 16488 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:52.289885 11216 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:52.301524 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:52.292176 16211 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:52.310583 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 193940us
I20260709 12:11:52.278877 16023 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.271692 16069 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:52.279076 16110 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:52.292575 16125 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.279440 16561 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.287312 16557 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.283216 16515 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.278471 16369 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:52.349143 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.286026 16461 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:52.372057 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 985) took 3264 ms. Trace:
W20260709 12:11:52.373135 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71724.7us
I20260709 12:11:52.263715 16497 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.379467 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:52.375504 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63435us
I20260709 12:11:52.377425 11138 rpcz_store.cc:276] 0709 12:11:49.107868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.908864 (+800996us) service_pool.cc:224] Handling call
0709 12:11:49.915967 (+  7103us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.916433 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:49.916461 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.434269 (+1517808us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2c000014c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:11:51.434696 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.690352 (+255656us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:51.690406 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.690804 (+   398us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.159933 (+469129us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:52.371793 (+211860us) raft_consensus.cc:1685] finished
0709 12:11:52.371821 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.371989 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13706,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":1861,"spinlock_wait_cycles":40444672,"thread_start_us":255250,"threads_started":1,"wal-append.queue_time_us":305663}
I20260709 12:11:52.300257 16052 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:52.310329 16211 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.332032 16315 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.287412 16199 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.381853 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:11:52.373183 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 89533.7us
I20260709 12:11:52.386003 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.387028 16539 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:52.386752 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.311106 16431 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:11:52.389576 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.370870 16023 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:52.391794 11141 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.395004 11138 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:52.377153 16375 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.001s
I20260709 12:11:52.376644 16515 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.331677 16559 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:11:52.411883 16497 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.382558 16470 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.413265 11141 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:52.343039 16558 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:11:52.431352 16446 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.424371 16360 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.432540 16360 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:52.396768 16289 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.420661 16369 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.419379 16070 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.388439 16407 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.370151 16110 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:52.423381 16283 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 12:11:52.419206 16265 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.418836 16067 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.414330 16069 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.439934 16069 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:52.440467 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53869.1us
I20260709 12:11:52.441318 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.442765 16576 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.443567 11211 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:52.433387 16360 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.448227 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.457324 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.458665  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:52.459573  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.469471 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.488754 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.443555 16576 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.422219 16447 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.491478 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:52.429832 16211 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.428383 16199 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.429551 16445 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.494257 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:52.496420 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.501462 16461 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.503175 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.506634 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:52.507066 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.508740 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.514856 11853 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:52.516049 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.485361 16369 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:52.517309 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 135542us
I20260709 12:11:52.516513 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:52.523500 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:52.522028 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.436861 16283 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.526654 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:52.493911 16539 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:52.484993 16533 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.426558 16560 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:11:52.466610 16265 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:11:52.497678 16189 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.490454 16490 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:52.510974 16445 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:52.498512 16360 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.540680 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:52.629779 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 89216.3us
I20260709 12:11:52.629585 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.488546 16531 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:52.565652 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 121352us
I20260709 12:11:52.498983 16023 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.520375 16391 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:52.628798 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.578307 16283 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:52.579254 16562 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.650990 16562 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.582286 16269 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.654537 16561 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:52.654953 16561 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:52.626732 16445 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.662998 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2115) took 1861 ms. Trace:
I20260709 12:11:52.663427 11286 rpcz_store.cc:276] 0709 12:11:50.801404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.223633 (+422229us) service_pool.cc:224] Handling call
0709 12:11:51.223985 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.916351 (+692366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.662733 (+746382us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54000618d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:52.662930 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587292544}
I20260709 12:11:52.665982 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:52.666659 11137 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:52.588650 16533 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.592224 16549 raft_consensus.cc:993] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:52.523397 16542 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:52.528561 16436 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:52.594784 16304 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:52.598223 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.572793 16189 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:52.528249 16497 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:52.604979 16142 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:52.627580 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.628628 11859 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:52.691684 11861 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:52.633430 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.415256 16488 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.560017 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.514636 16067 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.577927 11212 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:52.641667 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 197487us
I20260709 12:11:52.643453 11144 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:52.643368 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:52.706661 11141 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:52.644518 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.645509 16470 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.645747 11136 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:52.640316 16023 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:52.668061 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:52.668390 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:52.714624 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46676.6us
I20260709 12:11:52.569011 16407 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:52.675706 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.682336 16070 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.701056 16515 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.701220 16445 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.685889 16489 raft_consensus.cc:1081] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:11:52.719059 16023 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:52.708065 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 181536us
I20260709 12:11:52.779709 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:52.726575 16550 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.672806 16416 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.698984 16110 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.812702 16110 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:52.813279 16110 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.814670 16189 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:52.758929 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.757764 16342 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:11:52.760538 11210 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:52.528303 16405 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 12:11:52.688501 16391 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:52.761700 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56038.9us
I20260709 12:11:52.683359 16283 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:52.766209 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.708277 11135 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14.
I20260709 12:11:52.774893 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.824273 11213 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:52.824759 11861 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:52.716352 16067 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:52.778764 16211 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.783617 16199 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:52.784178 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.765527 16533 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:52.778286 16488 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.774286 16447 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.793716 16303 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:52.802138 16531 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:52.803015 16023 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.804354 16515 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.805034 11858 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.807153 16445 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:52.777292 16402 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.776s	user 0.012s	sys 0.000s
I20260709 12:11:52.818631 11140 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:52.819862 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:52.775336 11212 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:52.829893 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:52.895824 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76031.2us
I20260709 12:11:52.896780 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:52.818746 16550 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.823024 16391 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.835041 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.818900 16540 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.817973 16289 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.815986 16189 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.815830 16110 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:52.891638 11184 leader_election.cc:400] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14.
I20260709 12:11:52.908818 11184 leader_election.cc:403] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.844831 16490 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.909211 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79456.9us
I20260709 12:11:52.911957 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:52.835875 16561 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:52.900461 16486 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 12:11:52.840838 16211 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.837386 16283 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:52.914255 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 131142us
I20260709 12:11:52.932678 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:52.845805 16533 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.906196 16550 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.936882 11110 leader_election.cc:400] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:52.938298 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.940200 11213 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:52.935719 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.914088 16332 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:52.936025 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.935073 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.935417 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:52.848979 16447 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.939831 11110 leader_election.cc:403] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.964155 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.965399 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.965862 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:52.905767 16435 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:52.904695 16540 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:52.888449 16558 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:11:52.946902 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:52.947897 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56458.3us
I20260709 12:11:52.934741 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:53.039953 11210 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.949770 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:52.913372 16586 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.051370 11143 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:52.937577 16530 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.032012 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.064010 11217 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:53.066757 11289 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:52.923640 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141156us
I20260709 12:11:52.921558 16199 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:53.082821 16199 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:53.084118 16199 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.036636 11137 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:52.906548 16402 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.048570 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:52.938848 16561 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.032217 16433 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14.
I20260709 12:11:53.069343 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.070281 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.074244 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:53.074434 16515 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.075230 16531 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.076046 16110 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:53.062366 16536 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.052902 16572 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.080612 16368 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.920469 16022 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 12:11:52.916505 16490 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:52.958333 11854 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:11:53.105373 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:53.116151 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.119939 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:53.120702 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:53.112483 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.133138 11218 raft_consensus.cc:2410] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:11:53.062606 16558 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:52.933223 16584 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 12:11:53.139592 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:52.949025 16069 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 12:11:53.036386 16557 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:53.145649 16533 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.077551 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.094173 16440 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.053184 16542 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:11:53.253695 11215 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
W20260709 12:11:53.254304 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 214740us
W20260709 12:11:53.259491 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 181994us
I20260709 12:11:53.156486 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:53.179206 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:53.268499 11143 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.181578 11141 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:53.189687 11289 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:53.189669 11137 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:53.208115 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:53.216831 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.136047 16530 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:53.230659 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 91161.2us
I20260709 12:11:53.150763 16531 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.256740 16595 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:53.156102 16368 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.153564 16110 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.230623 16125 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:11:53.154577 16572 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.147593 16515 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.349228 11143 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:53.264995 16592 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:53.277096 16594 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.257113 16556 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:11:53.335656 16486 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:53.392413 16360 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.000s
I20260709 12:11:53.325670 16332 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:53.262559 16440 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.402750 11210 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:53.259868 16557 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.336018 16461 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.436615 11290 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.347277 16067 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.222153 16540 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.349478 16211 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.354661 16552 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.412321 16348 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:53.445819 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:53.460435 16593 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260709 12:11:53.462318 16591 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:11:53.463429 16596 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:11:53.415598 16592 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.467371 16592 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.427253 16402 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.475521 16440 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.477936 16368 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.428349 16594 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.520684 16594 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.454212 16211 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.437536 16283 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:53.507181 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61496.5us
I20260709 12:11:53.521535 16211 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.522704 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:53.492103 16531 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:53.522929 16289 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.005s
I20260709 12:11:53.523844 16531 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.478391 16557 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.524453 16211 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.510114 16603 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:53.524565 16531 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:53.525056 16211 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:53.525151 16603 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.526039 16531 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:53.526712 16391 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.002s
I20260709 12:11:53.527076 16490 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.437987 16486 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:53.511128 16304 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.828s	user 0.013s	sys 0.000s
I20260709 12:11:53.511236 16110 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.540597 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:53.514945 16488 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.002s
W20260709 12:11:53.517585 16189 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.002s
I20260709 12:11:53.555390 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:53.556221 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.556696 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.556809 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:53.492923 16447 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.491128 16540 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.494375 16515 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:53.566622 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.527617 16391 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.531275 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.440579 16530 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.526064 16586 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.506822 16348 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:53.447374 16461 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.537483 16486 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.455443 16552 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.524188 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:53.488103 16572 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.558749 11213 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
W20260709 12:11:53.612022 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 87891.6us
I20260709 12:11:53.565685 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:53.582176 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50972.6us
I20260709 12:11:53.614537 11144 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.615567 11142 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.616712 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.617851 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.567654 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:53.619596 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.619920 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:53.620216 11144 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:53.621016 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.621459 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.619637 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.621902 11293 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:53.622179 11285 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:53.542263 16584 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.539829 16490 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.577728 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:53.586688 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.628656 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.629237 11285 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:53.527705 16603 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.566668 16606 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:53.558166 16407 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.585356 16488 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:53.580771 16089 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:53.625293 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.637318 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:53.641453 11288 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:53.626582 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.584302 16368 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.617199 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.613188 16289 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.632879 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.645221 11291 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:53.645718 11143 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:53.634107 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.558473 16069 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.629333 11135 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
W20260709 12:11:53.636168 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58573.8us
I20260709 12:11:53.647913 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.648353 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:53.624542 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:53.649101 11861 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:53.625054 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.638353 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:53.649308 11138 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:53.638425 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:53.610916 16598 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:53.652432 16598 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.650085 11293 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:11:53.584543 11210 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:11:53.643275 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92257.9us
I20260709 12:11:53.630191 16110 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:53.646394 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.638885 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.650449 11852 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:53.640220 16283 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.634337 16584 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:11:53.651904 16536 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 12:11:53.655120 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:53.655539 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.657084 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.657179 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.657753 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.642729 16447 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.634644 16595 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:53.668665 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:53.669008 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.669670 11144 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:53.609979 16539 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:11:53.675809 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.664458 11210 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:53.660182 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.667002 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:53.671228 11854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 686) took 1155 ms (client timeout 1514 ms). Trace:
I20260709 12:11:53.673362 16446 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:53.673502 16536 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 10. Current term is 11.
I20260709 12:11:53.642978 16603 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:53.636902 16490 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.679626 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.677546 11217 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:53.686180 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:53.677802 11854 rpcz_store.cc:269] 0709 12:11:52.506561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.506723 (+   162us) service_pool.cc:224] Handling call
0709 12:11:53.661335 (+1154612us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400068bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:53.661500 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978091904}
I20260709 12:11:53.686133 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.687105 11217 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.680794 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.689262 11852 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:53.689740 16607 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.690131 16607 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:53.690649 16110 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.691023 16592 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:53.692329 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.696406 11289 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:53.643167 16488 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.702203 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.707114 16595 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.659719 16613 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:53.697853 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.654224 16289 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.684391 16283 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:53.698398 16436 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.016s	user 0.014s	sys 0.000s
I20260709 12:11:53.731437 16436 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:53.703265 16559 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.732560 16559 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.733078 16559 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.726859 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.718797 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.691421 16607 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.691062 16110 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:53.737016 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44808.7us
I20260709 12:11:53.740356 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.664515 16348 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.742651 16615 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.743003 16553 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:53.739207 11210 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:53.679893 16447 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.744534 11219 raft_consensus.cc:2410] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:11:53.738831 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 99078.2us
I20260709 12:11:53.746133 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.743505 16553 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:53.717579 16332 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:53.750836 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:53.773573 11210 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.747745 11217 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:53.744287 16592 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:53.744601 16440 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.775445 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.775815 16592 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.744843 16614 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:11:53.724066 16552 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.777947 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.718917 16611 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:53.779222 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.778378 16368 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:11:53.777330 16553 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.745191 16598 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.751611 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:53.796042 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44508us
I20260709 12:11:53.795475 16553 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.776690 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.704402 16603 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.789426 16391 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.747102 16110 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.791282 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.782007 16332 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:53.748433 16550 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
I20260709 12:11:53.716539 16604 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:11:53.793430 11289 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:53.781862 16594 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.800256 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:53.797394 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:53.787698 16436 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.773066 16211 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:53.783746 16530 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:53.789225 16611 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.793746 16446 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.750952 16612 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:53.793483 16440 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.819882 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:53.797222 16561 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:53.824512 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 695) took 1309 ms. Trace:
I20260709 12:11:53.850680 11858 rpcz_store.cc:276] 0709 12:11:52.515410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.515563 (+   153us) service_pool.cc:224] Handling call
0709 12:11:52.515827 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.889714 (+373887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.824224 (+934510us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400659854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:53.824444 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664569600}
I20260709 12:11:53.817215 16211 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.848470 16577 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:53.857172 16594 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.848542 16611 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.852403 16440 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.816005 16550 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.853017 16461 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.847437 16530 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.877017 16488 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:53.859760 16561 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.815550 16618 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:53.867655 16446 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:53.859589 16445 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:53.870445 16577 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.881973 16490 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.869623 16614 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:53.893215 16614 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:53.894137 16614 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.895598 16614 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.882797 16618 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.879318 16615 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.901774 16618 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.897369 16577 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.903371 16561 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.909346 16581 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:53.909839 16581 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:53.915156 16624 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:53.915652 16624 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:53.916220 16603 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.809908 11217 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:53.912822 16583 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.013055 16583 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.014837 16583 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.015946 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:54.017104 11217 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.018357 16584 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:53.910925 16581 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.021386 16581 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.995747 16289 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.022692 16536 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:53.980576 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 189201us
I20260709 12:11:53.986194 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.986513 16052 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:53.988049 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:53.875531 16332 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.878746 16440 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.867873 16211 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.995697 16488 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:53.997452 16315 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.047869 16315 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.902685 16550 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.050732 16022 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:54.051331 16022 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.053586 16570 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:54.052801 16022 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.877494 16435 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:54.063635 16435 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.064402 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:53.821293 16436 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:53.890432 16445 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:54.073241 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:54.074256 11219 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:54.074698 16445 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.079175 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.080042 11142 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:11:53.916544 16624 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.999373 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.023551 16536 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.026042 16600 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.038865 16446 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:53.916020 16607 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.016583 16583 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.057993 11293 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:54.058648 16361 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.059955 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.061612 11289 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:11:54.024026 16530 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:53.997967 16447 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.042114 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:54.086191 11286 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:54.084738 16361 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:54.088925 11211 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:54.089018 16361 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.067984 16052 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.081287 16550 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.066294 16570 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.090997 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 831) took 1373 ms. Trace:
I20260709 12:11:54.091040 11211 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:54.093948 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52316.6us
I20260709 12:11:54.095063 11214 rpcz_store.cc:276] 0709 12:11:52.717787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.718152 (+   365us) service_pool.cc:224] Handling call
0709 12:11:52.718417 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.031350 (+312933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.031381 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:53.031434 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:53.031467 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.090462 (+1058995us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b5400304dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:54.090557 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.090800 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719186816}
I20260709 12:11:54.096436 16391 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.097111 16391 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.097576 16536 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.097707 16446 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.099380 16489 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:54.099907 16489 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.100087 16391 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.103132 11210 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:54.103034 16550 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.084365 16142 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:54.111907 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.077948 16559 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.098333 16536 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.115763 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.112237 16368 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.121201 16315 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.119422 11142 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:54.108695 16142 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.132622 16142 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:54.133639 16545 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.702s	user 0.013s	sys 0.019s
I20260709 12:11:54.135466 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:54.136233 16607 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.136590 16562 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.137326 16486 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:54.138072 16562 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.137729 16368 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.140698 16368 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.086135 16600 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.065357 16435 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.125916 11858 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:54.128062 16052 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.130663 11292 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:54.117012 16536 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.138268 16486 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.146123 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.154546 11219 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.101289 16489 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.148922 11289 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:54.141741 16562 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:54.162446 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.150847 16536 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.175124 16315 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.163938 16435 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.163297 16562 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.188416 16142 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.189344 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:54.195153 16549 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:54.183645 16022 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.198961 16436 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.202627 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2118) took 1265 ms. Trace:
I20260709 12:11:54.202931 16315 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.203295 11213 rpcz_store.cc:276] 0709 12:11:52.936670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.946655 (+  9985us) service_pool.cc:224] Handling call
0709 12:11:54.200845 (+1254190us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54002968d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:54.202345 (+  1500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194397440}
I20260709 12:11:54.205945 16315 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:54.187191 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 123118us
I20260709 12:11:54.212451 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:54.215761 16624 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.221138 16486 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:54.225318 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.223489 11212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2496) took 2104 ms (client timeout 1740 ms). Trace:
I20260709 12:11:54.195726 16549 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.232892 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:54.184063 16515 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:54.233795 16549 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.235282 16549 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.230685 16023 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.235644 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:54.236977 11210 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:54.239283 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:54.230921 16600 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.241578 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.244181 16391 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.232133 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:54.246321 11856 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:11:54.247751 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.248068 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.253273 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2116) took 1317 ms. Trace:
I20260709 12:11:54.253808 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.210927 16361 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:54.225894 11212 rpcz_store.cc:269] 0709 12:11:52.117034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.117879 (+   845us) service_pool.cc:224] Handling call
0709 12:11:54.221420 (+2103541us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54001d3654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:54.221689 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055230848}
I20260709 12:11:54.253723 11218 rpcz_store.cc:276] 0709 12:11:52.935920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.949414 (+ 13494us) service_pool.cc:224] Handling call
0709 12:11:54.252871 (+1303457us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002f53d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:54.253070 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188321536}
I20260709 12:11:54.268594 11291 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:54.269371 16588 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.092s	user 0.003s	sys 0.006s
I20260709 12:11:54.270043 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:54.261395 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.257018 16315 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:54.276710 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.286084 11210 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:11:54.292068 11861 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:54.261960 16486 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:54.276506 16559 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.298234 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.299335 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:54.297427 16557 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.305553 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:54.306814 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.304782 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.305553 11289 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:54.297359 16599 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:54.308986 16552 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:54.310391 16552 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.310781 16552 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:54.306871 16560 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:54.311798 16533 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.312543 16533 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:54.312148 16552 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.313040 16533 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.314057 16552 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.315765 11142 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:11:54.315577 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:54.309207 16559 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:54.312198 11212 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:54.311853 16560 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:54.323984 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46091.4us
I20260709 12:11:54.299335 16486 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.328006 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.328989 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.325088 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:54.330763 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.331040 16570 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.341143 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.331980 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.344901 11138 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:54.332820 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.346304 11136 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:11:54.347337 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.347627 16607 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:54.348062 16632 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:54.332959 16533 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.333997 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.320252 16559 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.292977 16315 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:54.350813 16559 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:54.325428 16560 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.337234 11135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:11:54.352415 11135 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:54.352829 11135 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.353924 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 112712us
I20260709 12:11:54.356089 16436 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:54.337489 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.357542 16023 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.358069 16023 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:54.358093 11858 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:54.338822 16603 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:54.339510 11141 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.359479 16603 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:54.359424 16023 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.360822 16603 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.341024 16618 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.341868 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:54.331627 11217 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:11:54.348841 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.349632 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2119) took 1412 ms. Trace:
I20260709 12:11:54.351866 16315 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.367650 11216 rpcz_store.cc:276] 0709 12:11:52.937956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.950336 (+ 12380us) service_pool.cc:224] Handling call
0709 12:11:52.950691 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:53.090069 (+139378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.090120 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:53.114264 (+ 24144us) log.cc:844] Serialized 26 byte log entry
0709 12:11:53.978099 (+863835us) spinlock_profiling.cc:243] Waited 949 us on lock 0x7b18003be360. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:11:54.012912 (+ 34813us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:54.013014 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.232606 (+219592us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400026cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:54.232658 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.349268 (+116610us) raft_consensus.cc:1685] finished
0709 12:11:54.349290 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.349451 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47258,"raft.queue_time_us":80729,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":4769,"spinlock_wait_cycles":258379520,"thread_start_us":32851,"threads_started":1,"wal-append.queue_time_us":1002616}
I20260709 12:11:54.361342 16023 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.366472 11135 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.373214 11135 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.363390 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:54.374419 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 66778.9us
I20260709 12:11:54.341674 16486 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.374794 16369 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.378599 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.374720 16440 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.375488 11141 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:11:54.308269 16536 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.376157 16607 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:54.376497 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 113032us
I20260709 12:11:54.376959 16533 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.382516 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:54.379009 16369 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:54.396261 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.403247 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:54.403699 11854 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:54.408456 16070 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.409144 16070 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.409559 16070 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.414757 16369 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.387133 16391 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:11:54.419059 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:54.425205 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46747.8us
I20260709 12:11:54.436455 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.387655 16607 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.441723 16607 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.436432 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:54.444145 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:54.425293 16533 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.445406 16446 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.445825 16446 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.446161 16446 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.440580 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:54.447746 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.437028 16560 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.448516 16560 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:54.448899 16560 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:54.441212 16407 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.011s
I20260709 12:11:54.415225 11182 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:54.478621 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:54.485035 11292 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:11:54.489920 16361 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:54.490195 11140 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.789s	user 0.020s	sys 0.001s
W20260709 12:11:54.490942 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.491149 16052 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.468916 16533 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.490967 11140 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:54.490304 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:54.483130 16599 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.512290 11290 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.490558 16361 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.473389 16407 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.501288 11291 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:54.501947 16342 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:54.502708 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55055.2us
I20260709 12:11:54.502707 16052 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.504496 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.505357 11137 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:54.506470 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.507289 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.503980 16211 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.508329 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:54.509136 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:54.509382 16110 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.005s
I20260709 12:11:54.510303 11136 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:54.495929 16447 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:54.497880 11218 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:11:54.518692 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.528400 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.493988 16603 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:54.532426 11217 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.532891 11217 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.533684 16211 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.533869 11217 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.534425 16110 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.535087 11217 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.535440 16536 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.536840 16110 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:54.537603 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.538601 11138 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:54.538861 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.539728 11136 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:11:54.528429 16447 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.541656 16447 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.543231 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.534830 16533 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.520771 16361 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.541080 11136 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.518324 16550 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.551597 11217 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:54.551820 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.552910 16110 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:54.554148 16348 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.558746 11141 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:54.560324 16052 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.541049 16342 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.544844 16533 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.562883 16342 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.563047 16533 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.546970 16332 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:54.564210 16332 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:54.564878 16631 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.276s	user 0.004s	sys 0.000s
W20260709 12:11:54.563580 16633 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.271s	user 0.000s	sys 0.002s
I20260709 12:11:54.554416 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:54.569833 11144 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:54.590018 16618 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.590480 16531 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.590914 16531 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:54.591442 16611 consensus_meta.cc:287] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.009s
I20260709 12:11:54.592056 16611 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.593320 11211 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
W20260709 12:11:54.589387 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 174413us
I20260709 12:11:54.545998 16022 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:11:54.592891 16637 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:11:54.600422 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.591446 16531 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.579703 16052 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.572999 16332 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.575064 16607 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:54.626137 16634 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.286s	user 0.000s	sys 0.002s
W20260709 12:11:54.628855 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74522.3us
I20260709 12:11:54.629806 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2372) took 1660 ms. Trace:
I20260709 12:11:54.630215 11140 rpcz_store.cc:276] 0709 12:11:52.964070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.965596 (+  1526us) service_pool.cc:224] Handling call
0709 12:11:54.619058 (+1653462us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54001176d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:54.624062 (+  5004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687945088}
I20260709 12:11:54.642906 16578 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.643404 16578 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:54.647166 16557 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:54.647701 16557 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.645172 16578 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.609247 16603 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.651918 16603 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:54.658167 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.659711 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.660341 11144 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.642079 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:54.625757 16614 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.007s
W20260709 12:11:54.625591 16577 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.004s
I20260709 12:11:54.625380 16440 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.671263 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.670699 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.673489 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:54.678012 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.653169 16578 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.679616 11292 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:54.620757 16052 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:54.709746 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.633424 16562 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.719489 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:54.715583 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.684552 16283 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.832s	user 0.017s	sys 0.005s
I20260709 12:11:54.677438 16618 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:54.685662 16636 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
W20260709 12:11:54.688977 16553 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.010s
I20260709 12:11:54.678161 16577 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:54.724287 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.724947 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51781.4us
I20260709 12:11:54.725595 16556 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:54.726652 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.728173 11140 raft_consensus.cc:1217] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[8.4-14.7]   Dedup: 8.4->[10.5-14.7]
I20260709 12:11:54.736526 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2115) took 1755 ms. Trace:
I20260709 12:11:54.742465 11215 rpcz_store.cc:276] 0709 12:11:52.935611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.935795 (+   184us) service_pool.cc:224] Handling call
0709 12:11:54.673906 (+1738111us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002a12d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:54.691271 (+ 17365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697158016}
I20260709 12:11:54.754912 16303 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:54.756494 16052 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.757114 16303 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.758344 16022 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:54.759984 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.760746 11136 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:54.761162 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 88662us
W20260709 12:11:54.762167 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.762656 16583 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.654s	user 0.003s	sys 0.011s
I20260709 12:11:54.765072 11141 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.764478 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 4 to 9, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:54.765601 16559 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:54.675221 16369 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.766710 16581 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.767534 16581 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:54.766724 11141 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:54.768893 16369 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.766732 16283 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.768694 16581 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.769246 16607 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:54.771981 16624 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.555s	user 0.013s	sys 0.001s
I20260709 12:11:54.775916 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:54.778710 16348 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.779843 11142 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:54.781113 11290 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:54.732719 16332 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:54.782232 16332 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.783530 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.784713 16447 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.785239 16332 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.787310 16447 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:54.729729 16618 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.787916 16618 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.788362 11256 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:54.788830 11256 leader_election.cc:403] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:54.790969 11293 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:54.794507 16577 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.794247 16560 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.795468 11860 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:54.796298 16562 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.796555 16560 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:54.799115 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.800554 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:54.747248 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 81265.7us
I20260709 12:11:54.804100 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:54.741955 11140 pending_rounds.cc:85] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:11:54.807011 11140 pending_rounds.cc:107] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:54.807372 11140 raft_consensus.cc:2889] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.813604 11290 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
W20260709 12:11:54.810196 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46881.1us
I20260709 12:11:54.815892 16407 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:54.816588 16407 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.819192 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.818717 11039 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.819489 16407 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:54.820649 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.820612 11039 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 12, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:54.822032 11292 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:54.713735 16070 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:54.822803 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.223s (SENT) [suppressed 11 similar messages]
W20260709 12:11:54.746160 11041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 256) took 26609 ms (client timeout 15000 ms). Trace:
W20260709 12:11:54.827338 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.802398 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:54.741331 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:54.833093 11139 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14.
W20260709 12:11:54.834827 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46747.2us
I20260709 12:11:54.837461 11144 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:54.838748 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:54.714404 16142 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:54.848735 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 114741us
I20260709 12:11:54.853590 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.847004 16142 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.855494 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:54.855808 11290 raft_consensus.cc:3060] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.802759 16440 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.731823 16446 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.757548 16303 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:54.865232 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:54.862087 11291 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
W20260709 12:11:54.873961 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74107us
I20260709 12:11:54.874730 11855 raft_consensus.cc:2368] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:11:54.875036 11142 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:54.875182 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:54.852546 16348 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:54.893100 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 324703us
I20260709 12:11:54.862790 16368 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:54.861202 16607 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.865772 16577 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:54.891415 11039 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 14, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.861474 16556 consensus_queue.cc:1243] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:54.899286 11287 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 8: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:54.873754 16488 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.907745 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:54.915457 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.916577 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.918115 11143 raft_consensus.cc:2368] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:54.900139 16368 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.919757 11142 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:11:54.921839 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119587us
I20260709 12:11:54.908309 16577 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.926357 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:54.928992 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:54.929666 11291 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.937274 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.937608 11039 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:54.939450 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:54.939584 11039 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:54.941994 16265 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:54.942715 16265 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.945004 16265 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.945632 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:54.911672 16304 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:11:54.947351 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.915159 16435 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.951702 11291 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:11:54.946712 16067 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:54.942018 11039 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 10, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.948282 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.919698 16368 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.950902 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.955725 11137 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.958926 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:54.959189 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84135us
W20260709 12:11:54.963330 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 140571us
I20260709 12:11:54.965821 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:54.967685 11857 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.952634 16070 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:54.974779 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:54.981109 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:54.985486 11852 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:54.987457 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:54.988320 11138 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:54.989782 11290 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:54.973788 11039 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 9 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:54.970988 16556 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:54.994966 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 191010us
I20260709 12:11:54.995857 11182 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:54.997536 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:54.825910 11041 rpcz_store.cc:269] 0709 12:11:28.136745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.137055 (+   310us) service_pool.cc:224] Handling call
0709 12:11:54.745790 (+26608735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:46.205777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:46.373339 (+167562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:46.405152 (+ 31813us) write_op.cc:435] Acquired schema lock
0709 12:11:46.411247 (+  6095us) tablet.cc:662] Decoding operations
0709 12:11:46.715148 (+303901us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:46.758024 (+ 42876us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:46.763345 (+  5321us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:46.978313 (+214968us) tablet.cc:701] Row locks acquired
0709 12:11:46.978377 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:11:46.978641 (+   264us) write_op.cc:270] Start()
0709 12:11:46.978830 (+   189us) write_op.cc:276] Timestamp: P: 1783599106978546 usec, L: 0
0709 12:11:46.978863 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:11:46.979764 (+   901us) log.cc:844] Serialized 2866 byte log entry
0709 12:11:47.805340 (+825576us) op_driver.cc:464] REPLICATION: finished
0709 12:11:48.302378 (+497038us) write_op.cc:301] APPLY: starting
0709 12:11:48.327908 (+ 25530us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:48.448480 (+120572us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:48.448588 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:48.593477 (+144889us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:48.593768 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:48.593829 (+    61us) write_op.cc:312] APPLY: finished
0709 12:11:48.594128 (+   299us) log.cc:844] Serialized 73 byte log entry
0709 12:11:48.594325 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:48.612459 (+ 18134us) write_op.cc:454] Released schema lock
0709 12:11:48.612547 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:48.629938 (+ 17391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:48.633872 (+  3934us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":744519,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":410433,"apply.run_cpu_time_us":14297,"apply.run_wall_time_us":325973,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33471,"num_ops":7,"prepare.queue_time_us":229182,"prepare.run_cpu_time_us":37301,"prepare.run_wall_time_us":924056,"raft.queue_time_us":399443,"raft.run_cpu_time_us":51050,"raft.run_wall_time_us":370958,"replication_time_us":803496,"thread_start_us":774731,"threads_started":4,"wal-append.queue_time_us":203918,"wal-append.run_cpu_time_us":66296,"wal-append.run_wall_time_us":2459196}]]}
I20260709 12:11:54.982197 16486 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:54.928639 16303 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:54.990614 16581 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.006628 16488 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.011117 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.012290 16303 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:55.016055 16570 consensus_queue.cc:1175] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ba2779405e8d452e95f42421b2b60928" responder_term: 15 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: [14.12-14.12]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:55.020896 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67466us
I20260709 12:11:54.976639 16435 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.023640 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.021477 16557 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:54.982156 16562 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:11:54.997007 16142 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.027073 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.027213 11039 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 14, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 14 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.001192 16550 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:55.043491 11136 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:54.995301 16361 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.048729 11039 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 11, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 11 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.058089 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.058786 11291 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:55.019414 16581 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:55.019747 16556 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.070181 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.062954 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.057251 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 12, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.063714 11290 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:55.066862 11291 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 9.
I20260709 12:11:55.074229 16583 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:55.074730 16583 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:55.076803 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 95765.8us
I20260709 12:11:55.077960 16446 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:55.082839 16556 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:54.902737 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 126930us
I20260709 12:11:55.087292 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.089355 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:55.090940 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.091300 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.092897 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:55.090960 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.094792 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.095569 11215 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.096359 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.097188 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.098071 11214 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:55.069284 16581 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.094835 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:55.099426 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:11:55.098191 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.101265 11212 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.101250 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.102488 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.100994 11856 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:55.104080 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.112130 11136 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:55.110795 16067 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.104069 16557 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.103525 16304 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:55.117781 16304 consensus_queue.cc:1243] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:55.119616 16488 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.120210 16488 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.120653 16488 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.115058 16618 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.127620 11144 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:55.129246 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.137253 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.112495 11039 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.119520 16577 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.141845 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.100471 16549 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.127472 16562 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:55.148104 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.149021 11288 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:55.153751 11218 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:55.154738 11854 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:55.155370 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.156981 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.162912 11291 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:55.163364 11289 raft_consensus.cc:2393] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:55.157232 11039 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 14, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 14 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:55.159206 16556 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.168502 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.171746 11039 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.165745 16070 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.179239 16070 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.181509 16070 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.186940 11212 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:55.142591 16583 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.189127 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.186355 16361 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.190447 11288 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:55.173759 16556 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.191164 11039 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 9, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.191979 16348 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:55.197150 11215 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:55.197654  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.198572 11217 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:55.199033 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.199548 16559 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:55.200067 11293 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:55.203308 11287 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:55.167384 16562 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:55.207266 11256 leader_election.cc:400] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:11:55.207841 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:55.210187 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:55.226888 11256 leader_election.cc:403] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.212755 16489 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:55.213644 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.213892 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.228281 11219 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.227399 11185 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:55.214318 11218 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:55.215461 16611 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.219187 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.219936 11289 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:55.228946 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.229902 11212 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:11:55.230031 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.230574 16052 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.230971 16052 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.231118 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.231348 16052 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.231668 11289 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.235363 16435 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.236531 16375 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:55.236881 16375 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:55.237721 16375 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.238852 16559 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:55.238983 16558 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:55.239574 16558 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.222573 16556 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.242838 16618 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:55.225664 16486 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:55.244166 11855 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:55.244669 11258 leader_election.cc:400] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14.
I20260709 12:11:55.245909 16348 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:55.246511 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.248771 11219 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:55.248993 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.249994 11285 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:55.221355 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.210753 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.224095 11292 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.224968 11039 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 12, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.186542 16142 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:55.210878 16531 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
I20260709 12:11:55.224120 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:55.221930 16578 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.005s
I20260709 12:11:55.252413 11289 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:55.253937 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:55.239593 16559 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:55.268738 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44684.2us
I20260709 12:11:55.269374 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.269991 11285 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:55.269760 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.269851 11039 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.260469 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.255803 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.258703 11288 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:11:55.272236 11287 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:55.272568 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.272886 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.273167 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.273586 11287 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:55.273941 11290 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:55.272258 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.274580 11293 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.256978 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:11:55.272694 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:55.260035 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.220945 16022 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:55.278327 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:55.282505 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 75399.7us
I20260709 12:11:55.283946 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:55.273598 11286 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:55.266407 16550 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:55.292908 11291 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:55.253729 16435 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:11:55.295094 16435 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:55.295493 16435 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.296031 16440 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:11:55.296530 16435 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:55.298265 16655 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:55.299291 16265 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.299906 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.295598 16558 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.300122 16265 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.272411 16436 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.300833 16558 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.301299 16436 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:55.301515 11138 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.291975 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.274838 16407 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.302357 16436 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.299029 16536 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.258689 16023 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:55.253404 16142 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.302722 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.268357 16549 raft_consensus.cc:2804] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:55.326387 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.309011 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.288108 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.272284 16375 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.316027 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.331261 11142 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.321519 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.322607 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.332087 11143 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.274931 16447 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.305220 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.336926 11138 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:11:55.299463 16583 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.337764 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.326678 11039 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 13 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.302448 16265 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.239255 16562 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.303747 16407 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:55.305393 16654 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.321048 16348 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:55.351557 11287 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:55.340652 11184 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14.
I20260709 12:11:55.316376 16611 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.354028 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.364092 11184 leader_election.cc:403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.263587 16531 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.333746 16618 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:55.299522 16435 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.361440 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.307374 16486 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:11:55.366458 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.343108 16549 raft_consensus.cc:697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:11:55.372905 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 44115.6us
I20260709 12:11:55.303426 16581 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.364471 11212 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:55.352133 16447 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:55.381201 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.383297 11287 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:55.324591 16446 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 12:11:55.385792 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.390594 11855 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:55.377758 11219 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:55.325955 16536 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.363461 16407 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.392459 11289 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:11:55.339439 16440 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:55.406849 11039 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 12, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:55.401094 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:55.391888 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74308.5us
I20260709 12:11:55.404191 11138 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:11:55.407135 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70480us
I20260709 12:11:55.384150 16570 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:55.384464 16022 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14.
I20260709 12:11:55.411564 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.420292 11219 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:55.382774 16125 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.411003 11285 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:55.432478 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 127356us
I20260709 12:11:55.428187 11284 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:55.433282 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.435539 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.423839 11139 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:55.426928 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:55.439723 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.406853 16656 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.441695 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.441498 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.393240 16577 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:11:55.414685 16570 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:55.443271 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.448153 11217 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:55.453060 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.441989 11039 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 9 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.449437 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.435804 16559 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.458699 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.462056 11141 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:55.410096 16618 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.443266 16067 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.469864 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.471421 11285 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.479415 16446 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.480020 16446 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.481303 16665 raft_consensus.cc:2764] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:55.483719 16536 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.436685 16142 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.493681 16142 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.498628 16572 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.499217 16572 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:55.500169 16572 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.501874 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.502748 11214 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:11:55.503710 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.453549 16570 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.475376 11039 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.512645 11218 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:55.512575 11039 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 3 to 6, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 6 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:55.450714 16367 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:55.518970 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet f482641e4e2a4d109ab2f3acbbaebbb2: Illegal state: Replica ba2779405e8d452e95f42421b2b60928 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:55.521315 11855 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:11:55.521816 11855 pending_rounds.cc:85] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 11
I20260709 12:11:55.522091 11855 pending_rounds.cc:107] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:11:55.522362 11855 raft_consensus.cc:2889] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:55.528257 16431 consensus_queue.cc:1175] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "018d40ceb45d4447aa293f4c1d929bb8" responder_term: 15 status { last_received { term: 13 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: [12.7-14.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:55.528640 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:55.451382 16125 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.531428 16125 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.531731 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:55.447993 16552 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:55.482299 16446 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:55.536012 11142 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:11:55.451469 16550 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 12:11:55.545243 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 776da81ff0064a87b29c2949e7bc5291: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:55.555341 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.555409 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.543881 11285 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:11:55.545707 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 14, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 14 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.503698 16531 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:55.567492 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.566033 11039 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.564172 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.566401 16367 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:55.575873 16367 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.528177 16556 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.584743 16556 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:55.591359 16581 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.593676 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.594421 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.596987 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.597713 11218 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:55.600766 11219 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:55.604405 16553 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.605058 16553 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.607653 16553 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.608759 11039 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.611011 11039 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 15, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.614147 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.614810 16447 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:55.614945 11142 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:55.616075 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.617937 16265 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:55.618358 16265 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:55.619330 16265 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.620604 16265 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:55.622090 16368 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
I20260709 12:11:55.490165 16052 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.626150 11211 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:11:55.626708 11211 pending_rounds.cc:85] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 10
I20260709 12:11:55.627002 11211 pending_rounds.cc:107] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:11:55.627290 11211 raft_consensus.cc:2889] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:55.612562 11039 catalog_manager.cc:5697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 12, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:55.635198 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.636945 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.634790 11292 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:55.638597 11290 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:55.640298 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 176764us
I20260709 12:11:55.644608 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:55.648301 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 212761us
I20260709 12:11:55.649421 11110 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.640695 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.652894 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.655601 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:55.656868 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.651696 11039 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 17, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:11:55.660686 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.470161 16549 consensus_queue.cc:237] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.661924 11289 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:55.647544 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:55.669584 11852 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.665307 11288 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.671554 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.674348 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:55.675079 11856 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:55.685091 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:55.688402 11213 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:11:55.562742 16125 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 12:11:55.689492 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.653841 16348 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:55.652627 16447 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.703955 16125 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:55.707862 16489 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:55.657697 16431 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.635221 16368 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:55.698702 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:55.760546 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.699728 16361 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:55.701005 16407 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.707774 16570 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.656931 16578 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.709074 16304 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.782763 16304 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.758478 16431 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.786787 16431 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.762224 16361 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:11:55.790975 16488 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.000s
I20260709 12:11:55.791374 16488 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.791999 16368 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:55.652928 16067 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.710752 16624 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:55.669381 16556 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:55.692624 16618 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:55.718369 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.750344 16489 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.722800 16675 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:55.723671 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.724159 16446 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.682962 16668 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:11:55.727591 16531 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.727772 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.728492 16663 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.813700 16663 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.814086 16663 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.729900 16348 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.730633 16550 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.815089 16348 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.815335 16550 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.732493 11215 raft_consensus.cc:2410] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:11:55.743286 11139 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:55.742998 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:55.747108 11852 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:55.750169 11143 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:11:55.818652 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:55.751391 11288 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:55.821662 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.822389 11142 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:11:55.759670 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63345.9us
W20260709 12:11:55.769866 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 67136.8us
I20260709 12:11:55.824342 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.780225 16578 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.796766 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:55.826349 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.797168 16407 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.797829 16067 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.799502 11212 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:55.851699 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.682943 16440 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.799021 16624 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:55.885747 11211 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:11:55.750761 16670 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:55.809957 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 82291.1us
I20260709 12:11:55.891939 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.893146 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:55.812117 16674 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.825202 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:55.897702 11854 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.793362 16488 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:55.827777 16265 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:55.832787 16489 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.885388 16581 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.900766 16489 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.901448 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.790014 16361 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.853964 16436 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:55.860227 16067 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:55.862455 16550 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:55.863857 16570 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.866945 16348 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:55.939078 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.939817 11137 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:55.830377 16558 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.834203 16435 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:55.879797 16052 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.947588 16435 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.880143 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:55.949050 11856 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:55.948859 16435 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:11:55.880591 16375 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
I20260709 12:11:55.835074 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.800513 16556 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:55.950950 16023 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.886826 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:55.951399 16556 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.887820 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:55.895992 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 214006us
I20260709 12:11:55.953805 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.903852 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.955101 11215 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:11:55.830739 16675 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:55.956282 16675 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:55.957526 16675 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:55.909046 16531 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:55.921484 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.923942 16304 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.960886 16578 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.961390 11857 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:55.937911 16265 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:55.963864 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:55.964586 11861 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
W20260709 12:11:55.950716 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 119461us
I20260709 12:11:55.951501 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.927574 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.968670 11144 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.935262 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:55.969851 11136 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:55.936041 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:55.970847 11135 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.903816 16447 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.973186 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.941592 11826 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:55.946799 16558 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:55.977100 11860 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:55.975175 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.964824 16265 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:55.977943 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:55.978981 16052 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.978125 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:55.979156 16304 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:55.993966 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.981035 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:55.995699 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:55.979399 11212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:55.978623 16611 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:55.975502 16685 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:11:55.983639 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:11:55.987326 16672 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:11:55.951632 16023 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:56.017848 11212 raft_consensus.cc:606] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:55.987831 16550 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:55.931340 16488 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.903453 16446 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:11:55.982033 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:55.987380 16662 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.011502 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:55.989866 16348 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:11:56.014025 16440 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:56.006152 16611 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.015174 16578 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.035530 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:56.018404 11212 raft_consensus.cc:614] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:56.021804 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:56.014667 16674 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:56.006434 16265 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.025874 11135 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:56.030697 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:56.046084 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:56.046598 11292 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.047017 11215 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:56.031399 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.031930 11290 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:56.031422 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:56.050043 11216 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.051254 11210 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.052394 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:56.024986 16550 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:56.032820 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.024089 11136 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:56.040199 11217 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:56.043699 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:55.999099 16431 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.048251 11286 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:11:56.056226 11218 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:11:56.024103 16440 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.024351 16675 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.022325 16488 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.060802 11144 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:56.025615 16677 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.034327 16611 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.054033 16550 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.074623 16265 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:56.076224 16687 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:56.026194 16531 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:11:56.064483 16562 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.045465 16578 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:56.085413 16440 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:56.081411 11288 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:56.091022 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:56.092916 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:56.093923 11290 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:11:56.118010 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.095930 11854 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:56.041567 16662 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:56.102571 11218 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:56.099419 16687 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:56.104702 16488 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:56.105245 11210 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:11:56.106633 16675 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:56.100293 16023 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.108786 16265 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.113405 16562 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.114636 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:56.136802 11292 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:56.120021 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:56.094238 16674 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:56.128468 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 88768.7us
I20260709 12:11:56.080596 16431 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:56.121840 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:56.140614 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:56.123641 16531 consensus_queue.cc:1243] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:56.147868 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:56.148399 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.153309 11290 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:56.150640 11216 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:56.151393 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:56.126142 16067 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:56.085227 16558 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.164207 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:56.168267 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:56.169059 11136 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.139456 16562 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.144359 16581 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.150992 16022 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:56.177011 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:56.179430 11141 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:56.180428 16435 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.187220 16675 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.187390 16435 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.190121 16435 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:56.191331 11144 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:11:56.193853 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:56.182062 16022 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.203562 16022 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.161825 16067 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.209213 16067 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:56.209318 16674 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.173270 16531 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.166204 16304 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:56.226656 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72210.3us
W20260709 12:11:56.222373 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56648.7us
I20260709 12:11:56.228788 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:56.171007 16680 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.150471 16556 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.158438 16618 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 12:11:56.246204 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 213541us
I20260709 12:11:56.255647 11219 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:56.251411 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:56.233098 11215 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:11:56.273160 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.274286 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:56.239864 16583 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:11:56.275727 16559 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:56.276253 16559 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.276659 16559 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.249469 16607 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:56.175478 16687 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.278272 16607 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:56.278734 16687 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.279402 16607 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.224771 16662 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.244727 16578 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.286885 16556 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:56.246306 16680 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:56.291740 16680 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:56.292948 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 255c201215d14e89bc735bb8b57682cb: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:11:56.294780 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:56.295481 11219 raft_consensus.cc:606] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:56.295866 11219 raft_consensus.cc:614] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:56.254627 16304 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:56.297302 16304 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.301256 16618 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:56.305428 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47934.4us
I20260709 12:11:56.237690 16440 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:56.307017 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.309037 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:56.330384 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.332479 11219 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.335000 11144 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:56.248723 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:56.336076 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87491.6us
I20260709 12:11:56.346194 11136 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
W20260709 12:11:56.341331 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 188749us
I20260709 12:11:56.380117 11286 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:56.319077 16070 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.318967 16447 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:56.393841 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59621.7us
W20260709 12:11:56.394605 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:56.394280 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56181.6us
I20260709 12:11:56.403117 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:56.337927 16489 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.414611 11212 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:56.415596 11211 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.337384 16671 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:56.375870 16690 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:56.314479 16663 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.387809 16125 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.429674 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:56.435074 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:56.440318 11285 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.441264 11213 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:56.435747 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.437740 11293 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:56.423458 16583 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.457716 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:56.454221 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:56.414054 16070 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.521713 11285 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:11:56.452131 16361 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:56.458410 11854 raft_consensus.cc:606] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:56.516661 11284 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
W20260709 12:11:56.524133 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.652079 11854 raft_consensus.cc:614] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:56.540839 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:56.546778 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.563828 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:56.655552 11288 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:56.657881 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 253428us
I20260709 12:11:56.657996 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.429109 16531 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:11:56.669142 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:56.430251 16656 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:11:56.665818 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.428854 16489 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.672017 16407 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.672665 16407 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.673171 11293 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:56.673781 16489 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:56.418674 16447 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.675163 16407 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:56.675935 16447 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:56.418942 16674 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:11:56.676541 16559 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.457289 16583 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.667913 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.685441 11288 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
W20260709 12:11:56.659168 16611 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.002s
I20260709 12:11:56.516310 16265 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:56.648782 16710 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 12:11:56.682168 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118482us
I20260709 12:11:56.682670 11287 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:56.670650 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:56.666621 16681 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 12:11:56.694695 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 282529us
I20260709 12:11:56.667794 16673 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:56.451606 16125 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.445215 16671 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.690665 16583 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.711431 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:56.720670 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 286639us
I20260709 12:11:56.687083 16578 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:56.679961 16486 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:11:56.725634 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:56.724282 11211 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:56.698683 16489 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:56.750902 16690 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:56.765892 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet aaa499c4330145abb0fb264ec515ea63: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:56.767328 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:56.701963 16611 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.721369 16664 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:56.804761 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79184.2us
I20260709 12:11:56.787285 16431 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:56.786240 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54923.9us
I20260709 12:11:56.715291 16265 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.807089 11288 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:56.825821 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:56.821313 11137 raft_consensus.cc:1275] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:56.786837 16662 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:56.710979 16624 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.766042 16052 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:56.813113 16549 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.932928 11289 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.937688 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:56.841315 11136 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:11:56.791685 16488 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:56.969331 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49838 (request call id 1139) took 1288 ms. Trace:
W20260709 12:11:56.969663 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 144372us
W20260709 12:11:57.013594 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 187845us
I20260709 12:11:56.794309 16578 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:56.843094 16558 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:57.059572 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:11:56.922781 16685 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:11:57.013432 11137 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:56.825619 16440 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.056370 16023 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:57.060295 11136 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.021505 16662 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:56.831542 16431 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:57.146557 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.128861 16710 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:57.120741 16675 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:57.042990 16489 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:56.984637 16407 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:57.127315 16070 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:57.119459 16724 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:57.121541 16719 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:11:56.825304 16664 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.116375 16488 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:57.115005 16698 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:11:57.036989 16674 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 12:11:57.049049 11284 rpcz_store.cc:276] 0709 12:11:55.644788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.644943 (+   155us) service_pool.cc:224] Handling call
0709 12:11:55.723545 (+ 78602us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6eee 000000000036eb39 00007f9835a2a1e0 00007f9835af30c4 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:11:56.932435 (+1208890us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540041a0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:56.932675 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638901248}
W20260709 12:11:57.189158 16067 consensus_meta.cc:287] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.979s	user 0.011s	sys 0.003s
W20260709 12:11:57.190995 16562 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.952s	user 0.009s	sys 0.001s
W20260709 12:11:57.222265 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 116177us
I20260709 12:11:57.106750 16663 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.255537 11136 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:11:57.183913 16022 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.006s
W20260709 12:11:57.267086 11107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.006s
W20260709 12:11:57.333777 11107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.006s
I20260709 12:11:57.120002 16265 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:57.266633 11290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.008s	sys 0.001s
W20260709 12:11:57.336766 11290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.009s	sys 0.002s
I20260709 12:11:57.059262 16549 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.342737 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:11:57.296967 11183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.010s
W20260709 12:11:57.344123 11183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.003s	sys 0.011s
W20260709 12:11:57.321632 11293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.012s
W20260709 12:11:57.308331 11286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.000s	sys 0.014s
I20260709 12:11:57.013944 16690 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:57.321978 11185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.015s
W20260709 12:11:57.339849 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.347681 11286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.001s	sys 0.015s
W20260709 12:11:57.345870 11293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.004s	sys 0.012s
W20260709 12:11:57.348948 11185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.015s
W20260709 12:11:57.350510 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.005s	sys 0.016s
W20260709 12:11:57.351049 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.016s
I20260709 12:11:57.353282 11826 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
W20260709 12:11:57.332736 16715 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.628s	user 0.002s	sys 0.000s
W20260709 12:11:57.350435 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 530959us
W20260709 12:11:57.350863 11109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.007s	sys 0.015s
W20260709 12:11:57.371079 11109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.015s
W20260709 12:11:57.371577 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.372150 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.327283 16067 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.335096 16562 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.359109 16265 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:57.380999 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.380549 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.384222 11284 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:11:57.384644 11854 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:11:57.386016 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:57.374449 16720 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:11:57.347056 16447 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.375126 16722 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:57.362703 16671 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.375769 16562 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:11:57.425983 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63479.4us
I20260709 12:11:57.352737 16125 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.323283 16407 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.342015 16022 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.395659 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:57.361975 16607 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:57.406991 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71587us
I20260709 12:11:57.360342 16488 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.377069 16729 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.375674 16067 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.360271 16664 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.398147 16265 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:57.425179 16446 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.467118 11258 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.223s (SENT)
I20260709 12:11:57.428813 16611 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.430768 16745 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:57.442703 16607 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:11:57.483240 16677 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.381s	user 0.007s	sys 0.007s
I20260709 12:11:57.458925 16070 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.426396 16447 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.498021 16745 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.506510 16549 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.506224 16265 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.484337 16732 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:57.507339 16732 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.507746 16732 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:57.508160 16745 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.497061 16023 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.511054 16023 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.514950 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.515600 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:11:57.521622 16583 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.001s
I20260709 12:11:57.522787 16431 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.434129 16489 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.524267 16607 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.525338 16607 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.515834 11284 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:11:57.536338 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 69275.6us
I20260709 12:11:57.545804 11218 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:57.522123 16583 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.546206 16578 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.497965 16744 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:11:57.526702 16687 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.247s	user 0.014s	sys 0.000s
I20260709 12:11:57.496130 16741 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:57.498797 16675 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:57.585291 16675 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:57.557171 16727 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 12:11:57.569026 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45938.5us
I20260709 12:11:57.561085 16737 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.571890 16583 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:57.578014 16725 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:11:57.579183 16697 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.012s	user 0.009s	sys 0.005s
I20260709 12:11:57.579073 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2181) took 1176 ms. Trace:
I20260709 12:11:57.456804 16729 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.503762 16723 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.583477 16744 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.597219 16743 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:57.644938 16743 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.646059 16662 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.604528 16531 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.646740 16662 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.647159 16531 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.647393 16662 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.649145 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1151) took 1256 ms. Trace:
I20260709 12:11:57.649753 16531 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.485795 16446 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:57.559835 16736 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.081s	user 0.000s	sys 0.004s
I20260709 12:11:57.536091 16677 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.589787 16718 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:57.646936 16361 consensus_meta.cc:287] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.003s
I20260709 12:11:57.538172 16671 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:11:57.584444 16712 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 12:11:57.586450 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1154) took 1188 ms. Trace:
I20260709 12:11:57.535172 16070 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.588817 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.742331 11211 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:57.609452 16687 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:57.604871 16348 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.641852 16559 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.686887 16751 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.694653 11289 rpcz_store.cc:276] 0709 12:11:56.398198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.398776 (+   578us) service_pool.cc:224] Handling call
0709 12:11:56.932667 (+533891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.986101 (+ 53434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.586120 (+600019us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540041a0d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:57.586334 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227160448}
I20260709 12:11:57.599197 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:57.750066 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 151107us
W20260709 12:11:57.682926 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65442.3us
I20260709 12:11:57.650821 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2547) took 1210 ms. Trace:
I20260709 12:11:57.752743 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:57.693382 11287 rpcz_store.cc:276] 0709 12:11:56.403078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.540432 (+137354us) service_pool.cc:224] Handling call
0709 12:11:57.578851 (+1038419us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b540031a1d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:57.579007 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62884736}
W20260709 12:11:57.694327 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 298752us
I20260709 12:11:57.649554 11286 rpcz_store.cc:276] 0709 12:11:56.392438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.393331 (+   893us) service_pool.cc:224] Handling call
0709 12:11:56.393626 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.425630 (+ 32004us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:56.425678 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.437495 (+ 11817us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.350014 (+912519us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:57.350118 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.350192 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.648902 (+298710us) raft_consensus.cc:1685] finished
0709 12:11:57.648931 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.649080 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21047,"raft.queue_time_us":39799,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":14023,"thread_start_us":700112,"threads_started":1,"wal-append.queue_time_us":1029696}
I20260709 12:11:57.587613 16675 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.751746 11210 rpcz_store.cc:276] 0709 12:11:56.440062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.451284 (+ 11222us) service_pool.cc:224] Handling call
0709 12:11:56.451731 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.550110 (+ 98379us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:56.550553 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.650258 (+ 99705us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.666772 (+ 16514us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.666946 (+   174us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:56.666989 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.667078 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.650419 (+983341us) raft_consensus.cc:1685] finished
0709 12:11:57.650441 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.650752 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101308,"prepare.queue_time_us":320,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":44,"raft.queue_time_us":196736,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":14217,"spinlock_wait_cycles":896,"thread_start_us":18976,"threads_started":1,"wal-append.queue_time_us":497137}
I20260709 12:11:57.682422 16662 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.597815 16717 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.684177 16375 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.597966 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.774290 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.584833 16741 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.644207 16744 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:57.690537 16578 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.760623 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:57.755630 16730 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:57.685751 16531 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.641713 16022 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.769619 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:57.773875 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:57.786510 11854 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:57.768019 16489 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.765380 16486 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:57.784869 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:57.779994 11210 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:57.756667 16361 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:57.795789 11289 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:57.797729 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.743840 16671 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.804641 11285 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:57.695317 16723 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.796310 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.796837 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:57.773000 16559 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.805729 11291 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:57.796931 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.797829 11288 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:57.809693 11293 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:57.750703 16687 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.811419 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2910) took 1472 ms. Trace:
I20260709 12:11:57.813244 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:57.755928 16348 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:57.815377 11287 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.817408 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:57.818027 11854 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:57.777060 16741 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.819877 11136 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:57.787432 16558 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.823460 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:57.826152 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:57.746187 16718 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.789834 16680 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.815189 11290 rpcz_store.cc:276] 0709 12:11:56.339136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.340011 (+   875us) service_pool.cc:224] Handling call
0709 12:11:56.340534 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.401621 (+ 61087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.401673 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.419480 (+ 17807us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.337213 (+917733us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:57.431941 (+ 94728us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.432344 (+   403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.432450 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.811220 (+378770us) raft_consensus.cc:1685] finished
0709 12:11:57.811242 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.811361 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60828,"prepare.queue_time_us":219363,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2620,"raft.queue_time_us":243364,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":10631,"thread_start_us":893328,"threads_started":2,"wal-append.queue_time_us":941369}
I20260709 12:11:57.834702 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2152) took 1735 ms. Trace:
I20260709 12:11:57.828900 11136 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.830063 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:57.802728 16489 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.847102 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:57.847694 11137 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.827057 11288 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.835103 11217 rpcz_store.cc:276] 0709 12:11:56.099861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.101190 (+  1329us) service_pool.cc:224] Handling call
0709 12:11:56.101581 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:56.119642 (+ 18061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.119682 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:56.120188 (+   506us) log.cc:844] Serialized 52 byte log entry
0709 12:11:56.368591 (+248403us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:56.368935 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.388319 (+ 19384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.388397 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.566799 (+178402us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b18004ceb20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:11:57.578592 (+1011793us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:57.834465 (+255873us) raft_consensus.cc:1685] finished
0709 12:11:57.834510 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.834646 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19104,"prepare.queue_time_us":194,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":25420,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":15755,"spinlock_wait_cycles":206580864,"thread_start_us":205772,"threads_started":1,"wal-append.queue_time_us":275245}
I20260709 12:11:57.843225 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.854354 11854 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:57.855846 16749 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.856487 16749 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.857178 16742 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.857290 16680 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.857908 16742 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.782475 16375 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:57.858736 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73967.3us
I20260709 12:11:57.859545 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:57.860159 16742 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.860687 16742 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.813879 16737 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.803985 16696 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:57.809845 16556 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.866734 11293 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:57.878834 11290 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:11:57.882104 11136 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:57.862391 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:57.887964 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1159) took 1775 ms. Trace:
I20260709 12:11:57.888777 11855 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:11:57.820863 16664 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.815562 16743 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.894155 11291 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:57.787483 16531 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.899107 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.888684 11852 rpcz_store.cc:276] 0709 12:11:56.112358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.112521 (+   163us) service_pool.cc:224] Handling call
0709 12:11:56.115032 (+  2511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.115244 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:56.517084 (+401840us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.825692 (+1308608us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b18003939a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:11:57.887518 (+ 61826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.887621 (+   103us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:57.887668 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.887740 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.887877 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126503,"prepare.queue_time_us":322262,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2335,"raft.queue_time_us":13370,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":16090880,"thread_start_us":423973,"threads_started":2}
I20260709 12:11:57.901959 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:57.902734 11284 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.828229 16407 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.765846 16751 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.914238 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:57.914848 11144 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:11:57.834137 16022 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.917029 11288 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:57.791496 16578 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.862917 16671 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.851398 16265 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.933822 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.809478 16486 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.865581 16489 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.787551 16730 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.819159 16559 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.932273 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:57.889106 16367 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:57.936714 11217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:11:57.929055 16435 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.913156 16361 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.941602 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.798537 16717 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:57.942762 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 115766us
I20260709 12:11:57.834811 16558 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:57.927825 11137 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:11:57.943254 11212 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:11:57.948886 11217 raft_consensus.cc:606] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:57.898759 16696 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.863972 16755 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:11:57.963822 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:57.933779 16125 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.909690 16664 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.020467 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.949831 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:57.960526 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.013999 11217 raft_consensus.cc:614] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:57.928671 16677 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.957837 11861 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:57.907091 16556 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:58.011188 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45095.2us
I20260709 12:11:57.950846 16431 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.877782 16732 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:57.950532 11284 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
W20260709 12:11:57.964238 16700 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.246s	user 0.003s	sys 0.000s
I20260709 12:11:58.036480 16664 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.931294 16022 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.036898 16431 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.037532 16431 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.038631 16022 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.039495 16486 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:57.958952 16447 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.043643 16531 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.026988 16618 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:58.044288 16531 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:58.044477 16754 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:11:57.890846 16737 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:11:58.044857 16531 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:11:58.031428 16677 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.045840 16531 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:58.033799 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84128.8us
I20260709 12:11:57.958956 16730 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.034458 16070 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.034770 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.035475 16583 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:57.963222 16704 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.176s	user 0.000s	sys 0.002s
I20260709 12:11:57.942570 16265 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.043437 16731 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 12:11:58.047365 16737 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.070016 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.028867 16729 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.951212 16662 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.048187 16696 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.048346 16734 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:11:58.049044 11859 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 8.
I20260709 12:11:58.051409 16749 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:57.964422 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.955350 16578 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.957444 16751 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:57.940204 16671 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:11:57.962096 16753 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:57.965173 16142 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:11:58.068202 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.077613 16348 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:11:58.047737 16677 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.031594 16446 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.016531 16435 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.091713 16680 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.091945 16753 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.093314 16435 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:58.093535 16607 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 12:11:58.094066 16732 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.096271 16742 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:58.096799 16742 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:58.097730 16742 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.084894 16687 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.098902 16742 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:58.073479 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.075412 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.080237 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.032205 16125 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.083330 16740 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.083788 16489 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.084846 16717 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.068796 16022 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:58.085486 16761 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:58.086149 16723 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.087651 16265 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.088937 11287 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:11:58.110994 16740 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:58.116076 16721 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.050s	user 0.003s	sys 0.000s
I20260709 12:11:58.115005 16022 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.117863 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1036) took 1783 ms. Trace:
I20260709 12:11:58.094313 16753 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.103470 11217 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:11:58.111346 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:57.959051 16367 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.118247 11141 rpcz_store.cc:276] 0709 12:11:56.334565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.376020 (+ 41455us) service_pool.cc:224] Handling call
0709 12:11:56.376408 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:56.398124 (+ 21716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.398165 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:56.425467 (+ 27302us) log.cc:844] Serialized 52 byte log entry
0709 12:11:56.701808 (+276341us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:56.701845 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.701912 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.102599 (+1400687us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:58.117330 (+ 14731us) raft_consensus.cc:1685] finished
0709 12:11:58.117351 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.117782 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1566,"raft.queue_time_us":17870,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":17489,"spinlock_wait_cycles":98291456,"thread_start_us":182476,"threads_started":1,"wal-append.queue_time_us":376551}
I20260709 12:11:58.122099 11852 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:11:58.125600 16559 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.127549 16022 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.126951 16125 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.128311 16624 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.131649 16556 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.136318 16431 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.118520 16687 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:58.139859 16687 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.141921 16023 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.143198 16718 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.147161 16558 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.153107 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.156612 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.159987 16666 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.160305 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.160591 16666 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.162640 16717 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.163160 16717 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.164050 16489 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.164964 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.165329 16717 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:58.165447 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.166052 16717 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.141925 16687 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.118095 16740 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.167901 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.168373 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.168507 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:11:58.169363 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.169967 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.170645 11287 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
I20260709 12:11:58.150506 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:58.172106 16666 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.172175 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:11:58.173494 16756 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.378s	user 0.003s	sys 0.000s
I20260709 12:11:58.174875 11143 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:11:58.173609 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 311265us
I20260709 12:11:58.171237 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:58.175694 11290 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.175932 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:58.176649 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.190691 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.196309 11137 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:58.197800 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.198355 11137 raft_consensus.cc:2376] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11. Re-sending same reply.
I20260709 12:11:58.199000 11141 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:58.194654 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.203902 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:58.204568 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 240366us
I20260709 12:11:58.207721 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.208585 11144 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:58.192879 16023 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:58.216338 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.216543 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.217034 11139 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:58.201040 16740 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.217656 16740 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:58.217958 11143 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.218043 16740 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.189440 16583 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:58.222311 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.223284 16583 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.224097 16435 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.224628 16435 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.215847 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.227708 11144 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:58.155483 16431 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.192323 16549 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:58.247071 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.247895 11142 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:58.248965 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.249234 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.249780 11291 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:58.243665 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:11:58.200044 16718 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.245074 16673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.480s	user 0.011s	sys 0.008s
I20260709 12:11:58.216941 16023 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:58.244329 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.251358 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.253762 11290 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:11:58.253324 11211 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:58.266026 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.253901 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.215837 16696 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:58.265981 11144 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:58.263415 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.263338 11216 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:58.263316 11140 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:58.267422 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.269220 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.267336 11139 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:58.272058 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:11:58.272831 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.272697 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.272722 11290 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:58.276232 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.192660 16734 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:58.200919 16671 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:58.239182 16751 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:58.190995 16717 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.238431 16304 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:58.274421 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.251955 16559 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.251020 16549 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.247169 16125 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:58.251863 16022 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.282239 11142 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:11:58.285463 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:11:58.263705 16673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.532s	user 0.011s	sys 0.008s
I20260709 12:11:58.281157 11144 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:58.246938 16052 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:58.403335 16052 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.365541 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.366374 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.369552 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.405422 16052 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.405701 11143 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:58.373486 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.374043 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.408077 11287 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:58.375793 16562 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:58.409227 16562 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:58.410171 16562 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.376413 16435 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.376698 11138 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:58.412937 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.413736 11138 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:11:58.380415 11285 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:11:58.414610 16125 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.415887 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.416554 11285 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:58.416957 16125 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.417932 16435 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:58.418681 16435 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.419485 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.418610 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.274793 16696 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.424513 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:58.425117 11289 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.425873 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.426260 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:58.426414 11138 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 8.
I20260709 12:11:58.381057 16717 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.381553 16770 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.266537 16718 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.366914 16304 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.402760 16673 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:58.283592 16732 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:58.466903 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.372263 16549 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.408166 11142 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:58.375716 16558 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:58.410820 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.410899 16726 raft_consensus.cc:2764] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:58.426999 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:58.427500 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.471946 11290 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.397840 16741 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.432677 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.433072 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.476933 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.429564 16696 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:58.446074 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.447844 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:58.447844 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.469779 11286 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:11:58.470311 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.467733 11139 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:58.467940 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.469098 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.480486 11284 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:11:58.481112 11142 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:58.481923 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.424288 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.478547 11211 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:11:58.394191 16740 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.482623 11212 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:11:58.433135 16052 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:11:58.486058 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61869.9us
I20260709 12:11:58.483961 11292 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:58.479336 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.485579 11144 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:11:58.479883 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:58.429939 16022 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.484126 11215 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:58.371330 16559 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.491179 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.494824 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.372922 16751 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.495500 11143 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.471552 16562 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.411768 16023 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.475855 16732 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:58.493577 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.494196 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.513763 11290 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:58.514230 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.496697 11289 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:11:58.497588 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:11:58.473922 16717 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:58.467794 16489 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.494000 16440 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.510380 11216 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:58.495070 11138 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.511415 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.501212 16671 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.514091 11140 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:58.485574 16769 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:58.494987 16550 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:58.476097 16583 consensus_queue.cc:1048] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:11:58.530717 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.532568 11213 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:58.534113 11139 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:11:58.446144 16770 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.539845 16740 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.486253 16558 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.540952 16440 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.541249 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:58.541458 16022 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.526399 16618 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:11:58.486414 16142 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:58.528903 16752 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:58.536626 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.533519 16717 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:58.526032 16673 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.526113 16768 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.491732 16687 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:58.554646 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.555622 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.556720 11288 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.558254 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.560544 11143 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:11:58.564145 16375 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:58.587919 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56364.2us
I20260709 12:11:58.494793 16052 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.601919 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.605188 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.605967 16717 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:58.579723 16550 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.611984 11290 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:11:58.603385 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:58.610028 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.609993 11289 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:58.580159 16671 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:58.606647 16778 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:11:58.680444 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:11:58.603302 11110 connection.cc:256] RPC call timeout handler was delayed by -1.174713071000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:11:58.604559 16142 consensus_queue.cc:1243] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:58.600800 16624 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:11:58.605222 16743 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:11:58.622221 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.570011 16489 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.612655 16740 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:58.688951 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 85639.7us
I20260709 12:11:58.690441 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.683485 11140 raft_consensus.cc:2376] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9. Re-sending same reply.
I20260709 12:11:58.609155 16687 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:58.692266 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.692689 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.693406 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.611660 16752 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:58.698961 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:11:58.686374 16776 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:11:58.615155 16768 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:58.727448 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.727378 16768 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.728749 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.729984 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.733723 16558 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.727473 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.735641 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.721244 16687 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.736730 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.737931 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.740530 11144 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:58.743376 11144 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:58.744443 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.744664 11144 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:58.745157 11288 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:58.746387 11144 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:11:58.708575 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.712998 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:58.747753 16663 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.748190 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:58.748982 16663 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.749275 16489 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.694669 16773 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:58.720288 11142 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
W20260709 12:11:58.754765 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55905.5us
I20260709 12:11:58.693249 16550 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.711280 16431 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:58.741199 16558 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.703572 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:58.752230 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.759621 16773 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.774353 16773 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:58.774595 16558 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.775831 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.776613 11284 raft_consensus.cc:2368] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:11:58.776932 16558 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.765213 16431 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.777508 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.778015 16431 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.778209 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.780632 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1149) took 2403 ms. Trace:
I20260709 12:11:58.781203 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:58.781030 11292 rpcz_store.cc:276] 0709 12:11:56.377715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.377906 (+   191us) service_pool.cc:224] Handling call
0709 12:11:56.378202 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.492794 (+2114592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.780377 (+287583us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b540017edd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:58.780543 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4841975168}
I20260709 12:11:58.782573 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:58.783496 16726 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:58.682061 16677 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:11:58.711757 16740 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.789975 16740 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.766877 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.771078 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:11:58.802147 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 291017us
I20260709 12:11:58.762841 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.787984 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:58.774688 16624 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:58.803732 11284 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:11:58.805213 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 101739us
I20260709 12:11:58.806159 11138 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:58.713248 16741 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.810310 16558 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.815618 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:58.816605 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:58.685297 16732 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.823009 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:58.824378 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:58.760564 16774 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.826548 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:58.831909 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:58.817308 16769 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:58.821539 16489 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:11:58.814225 16742 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:58.857654 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.908360 11138 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:11:58.910072 11138 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:58.859843 11144 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:58.863624 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:11:58.912411 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 48923.2us
I20260709 12:11:58.827509 16304 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.831377 16718 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.831681 16774 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:58.829857 16556 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.815202 16624 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:58.840826 16789 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.920120 11284 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:58.918254 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:58.908053 16742 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.841737 16743 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.997485 16578 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.997330 16743 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.997994 16578 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.907465 16558 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.825532 16022 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:11:58.826028 16680 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:11:58.918908 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:11:59.012066 11140 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 8.
W20260709 12:11:58.975992 16788 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:11:58.976197 16624 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.969482 16770 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:58.976452 16671 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:58.984874 16787 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:11:58.926901 16769 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.997366 16431 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:58.970013 16304 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:58.970382 16774 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.988581 16789 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.008348 16558 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.998865 16742 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.998431 16578 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:59.063510 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 281026us
I20260709 12:11:59.073437 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:58.841498 16752 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.079357 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.080924 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.075810 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.081804 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.082546 11852 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:11:59.081873 16726 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.083081 11859 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:59.084497 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.084718 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.079792 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.095932 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.096143 16726 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:59.097256 16663 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.097738 16726 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.097941 16431 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.014901 16550 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.098762 11284 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.096495 16368 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.025112 16741 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:59.102108 11861 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:11:59.080688 16788 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:59.106141 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.110782 11857 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:11:59.068797 16558 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.069954 16789 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.074304 16671 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.119004 16550 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.060379 16787 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:59.139801 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 313315us
I20260709 12:11:59.143515 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.103451 16726 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.107563 16368 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:59.156889 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.149601 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 317792us
I20260709 12:11:59.116887 16671 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:59.150995 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.109699 16770 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:11:59.168439 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:59.164561 16142 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.149798 16753 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:59.183508 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:59.200070 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:59.202788 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.168730 16368 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.166792 16726 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:59.203171 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:11:59.220371 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2417) took 1004 ms. Trace:
I20260709 12:11:59.225725 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:59.148175 16687 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.223279 11137 rpcz_store.cc:276] 0709 12:11:58.199663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.214824 (+ 15161us) service_pool.cc:224] Handling call
0709 12:11:58.215244 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.215690 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:58.359164 (+143474us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.589248 (+230084us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.672857 (+ 83609us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.681555 (+  8698us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:58.681693 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.681851 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.203758 (+521907us) raft_consensus.cc:1685] finished
0709 12:11:59.203783 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.203920 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5986,"prepare.queue_time_us":271209,"prepare.run_cpu_time_us":192,"prepare.run_wall_time_us":1838,"raft.queue_time_us":8917,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":6783,"thread_start_us":262145,"threads_started":2,"wal-append.queue_time_us":342243}
I20260709 12:11:59.239413 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:11:59.207147 16304 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.190181 16431 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.250717 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.260701 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.257885 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.221287 16556 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.207479 16489 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.267277 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.261550 11213 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:11:59.233757 16142 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:59.276646 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.248692 16583 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.232204 16671 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.251418 16304 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.289562 16687 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:59.290668 16773 consensus_meta.cc:287] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.004s
I20260709 12:11:59.291481 16787 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.248055 16731 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.267481 16556 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.259971 16743 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:11:59.222810 16753 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.302891 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.257364 16790 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.238745 16740 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.308220 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.296500 16583 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.258724 16791 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:11:59.301105 16304 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.315546 11211 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:11:59.299401 16142 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:59.308018 16556 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.355441 16790 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:59.355928 16731 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:11:59.362190 11214 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16.
I20260709 12:11:59.360235 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:59.349119 16549 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.003s
I20260709 12:11:59.342284 16583 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.390082 16367 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.342876 16023 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:59.391474 16023 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.390105 16583 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.306020 16773 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:59.358439 16696 consensus_meta.cc:287] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.002s
W20260709 12:11:59.398227 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 315295us
I20260709 12:11:59.394222 16023 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:59.367300 16743 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.411819 11287 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:59.411242 16368 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.415512 16368 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.421003 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.423856 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:11:59.405620 16696 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.437357 16696 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.440304 16773 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:59.441834 16790 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.312378 16726 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.459738 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2938) took 1186 ms. Trace:
I20260709 12:11:59.363490 16142 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.461328 11293 rpcz_store.cc:276] 0709 12:11:58.292985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.293191 (+   206us) service_pool.cc:224] Handling call
0709 12:11:58.368808 (+ 75617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.372143 (+  3335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.372179 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.749226 (+377047us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:11:58.749608 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.184398 (+434790us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:59.184432 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.184539 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.451883 (+267344us) raft_consensus.cc:1685] finished
0709 12:11:59.451913 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.459647 (+  7734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2938,"raft.queue_time_us":3437,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":5409024,"thread_start_us":434365,"threads_started":1,"wal-append.queue_time_us":609296}
I20260709 12:11:59.411022 16743 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.400519 16549 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.450322 16731 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:11:59.486172 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 401518us
I20260709 12:11:59.487339 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:59.481096 16531 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.490233 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.491847 11293 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:11:59.479669 16743 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.494932 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.496483 11855 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:11:59.497536 11218 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12.
I20260709 12:11:59.502779 11857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:11:59.500138 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.505059 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.506057 11855 raft_consensus.cc:2410] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:59.506022 16802 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:59.515355 16558 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.517946 16558 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:59.527143 16797 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:11:59.529815 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.531230 11289 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:59.532114 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.493357 16696 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.532780 11289 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:11:59.517676 16774 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.522303 16789 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.501220 16673 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.542151 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:59.545897 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.560050 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.562114 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:59.562446 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:11:59.565825 11860 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:11:59.536311 16696 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:11:59.542819 16802 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:59.558619 16558 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:11:59.558475 16663 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:59.572227 16773 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:59.573607 16142 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:11:59.574827 16779 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.047s	user 0.009s	sys 0.004s
I20260709 12:11:59.578292 16052 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:11:59.580215 16782 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.044s	user 0.008s	sys 0.000s
I20260709 12:11:59.580654 16696 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.581488 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.581856 16740 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.588306 16549 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:59.591239 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2194) took 1027 ms. Trace:
I20260709 12:11:59.591595 16559 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:59.583722 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:11:59.604609 11213 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:11:59.555862 16717 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.868s	user 0.014s	sys 0.000s
I20260709 12:11:59.608891 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3283) took 1446 ms. Trace:
I20260709 12:11:59.621292 11287 rpcz_store.cc:276] 0709 12:11:58.563651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.737688 (+174037us) service_pool.cc:224] Handling call
0709 12:11:59.591040 (+853352us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54004263d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:59.591180 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548188928}
I20260709 12:11:59.621944 11141 rpcz_store.cc:276] 0709 12:11:58.162215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.167215 (+  5000us) service_pool.cc:224] Handling call
0709 12:11:58.167504 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.199414 (+ 31910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.608669 (+1409255us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b540028fad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:59.608835 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71571712}
I20260709 12:11:59.554833 16673 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:59.616132 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.619184 11214 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
W20260709 12:11:59.627259 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 43605.2us
I20260709 12:11:59.625257 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:59.628979 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 205211us
I20260709 12:11:59.629776 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.629859 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 881) took 1409 ms. Trace:
I20260709 12:11:59.630435 11210 rpcz_store.cc:276] 0709 12:11:58.219993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.220112 (+   119us) service_pool.cc:224] Handling call
0709 12:11:58.220444 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:58.220798 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.220829 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:58.221513 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 12:11:58.405292 (+183779us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b180029c140. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1
0709 12:11:58.405464 (+   172us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:58.405501 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.405568 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.573799 (+1168231us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:11:59.629588 (+ 55789us) raft_consensus.cc:1685] finished
0709 12:11:59.629613 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.629777 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84095,"raft.queue_time_us":32747,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":14667,"spinlock_wait_cycles":29355136,"thread_start_us":32628,"threads_started":1,"wal-append.queue_time_us":256619}
I20260709 12:11:59.599712 16802 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:59.635411 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.608348 16663 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.638092 11293 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:11:59.640983 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:59.643003 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.644537 11287 raft_consensus.cc:2368] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:11:59.647926 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.648306 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.648757 11214 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
W20260709 12:11:59.640216 16578 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.003s
I20260709 12:11:59.656061 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:11:59.631538 16673 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.659821 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.636384 16798 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:59.660450 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:11:59.660606 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.611626 16558 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.643679 16663 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:59.747677 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.749408 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.750249 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:11:59.639334 16559 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:11:59.701947 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.701947 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.743516 16802 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.744303 11288 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
W20260709 12:11:59.746774 16805 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:11:59.750677 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1043) took 1887 ms. Trace:
I20260709 12:11:59.775446 11288 pending_rounds.cc:85] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 7
W20260709 12:11:59.781942 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.631381 16717 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.801450 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.791761 11135 rpcz_store.cc:276] 0709 12:11:57.863346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.866157 (+  2811us) service_pool.cc:224] Handling call
0709 12:11:57.866472 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.111442 (+244970us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:58.247637 (+136195us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.592779 (+1345142us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800427300. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b23a
0709 12:11:59.592973 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.593514 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:11:59.593657 (+   143us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:59.593693 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.593763 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.750341 (+156578us) raft_consensus.cc:1685] finished
0709 12:11:59.750440 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.750615 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10351,"prepare.queue_time_us":363870,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":86890,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":5339,"spinlock_wait_cycles":6958464,"thread_start_us":489271,"threads_started":3,"wal-append.queue_time_us":642198}
I20260709 12:11:59.748353 16558 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.671319 16798 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.814872 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.815793 16798 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:59.816474 16814 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.820151 16794 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:59.822158 11288 pending_rounds.cc:107] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:59.851711 11288 raft_consensus.cc:2889] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:59.826455 11210 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
W20260709 12:11:59.853211 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 223509us
I20260709 12:11:59.670352 16578 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.854242 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.865958 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:11:59.870797 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.870682 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:11:59.822594 16810 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:11:59.821595 16802 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.873843 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.821198 16789 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.891393 11212 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:59.799997 16559 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:11:59.885409 11210 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
W20260709 12:11:59.904083 11184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.760s (SENT) [suppressed 7 similar messages]
I20260709 12:11:59.851895 16794 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:11:59.871743 16023 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.910396 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.892441 16726 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:59.916431 16726 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:11:59.917052 16726 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:11:59.916584 16816 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:11:59.923331 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 369114us
I20260709 12:11:59.925230 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:11:59.929313 11259 leader_election.cc:400] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16.
I20260709 12:11:59.929673 11259 leader_election.cc:403] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:59.909561 16821 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:59.930853 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.933063 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:11:59.932719 16663 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:11:59.935148 11286 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.932747 16687 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:59.936807 11216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 889) took 1669 ms (client timeout 1833 ms). Trace:
W20260709 12:11:59.958340 11216 rpcz_store.cc:269] 0709 12:11:58.267179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.268887 (+  1708us) service_pool.cc:224] Handling call
0709 12:11:59.936618 (+1667731us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400385c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:59.936752 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552426368}
I20260709 12:11:59.959874 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:11:59.960616 11216 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:11:59.937556 16435 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:11:59.903477 16572 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:11:59.944514 11289 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:59.920291 16814 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.949720 16559 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.921643 16774 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:11:59.976140 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2945) took 1561 ms. Trace:
I20260709 12:11:59.965610 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:11:59.975824 11136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3287) took 1812 ms (client timeout 1760 ms). Trace:
I20260709 12:11:59.979125 11215 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:59.976529 11285 rpcz_store.cc:276] 0709 12:11:58.415104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.417279 (+  2175us) service_pool.cc:224] Handling call
0709 12:11:58.417557 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.528604 (+111047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.528651 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:58.528712 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:58.528756 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.975925 (+1447169us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400404554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:11:59.975968 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.976087 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254878464}
I20260709 12:11:59.981314 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:11:59.982385 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:11:59.979357 11136 rpcz_store.cc:269] 0709 12:11:58.163395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.169157 (+  5762us) service_pool.cc:224] Handling call
0709 12:11:59.975620 (+1806463us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002e1dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:11:59.975749 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043847936}
I20260709 12:11:59.986030 11216 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:59.988171 11216 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:59.998853 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.000494 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:00.000803 11216 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:59.976539 16742 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.876s	user 0.011s	sys 0.003s
I20260709 12:11:59.962443 16687 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:00.009414 11213 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:00.006892 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:00.004693 11185 leader_election.cc:400] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:00.010735 11185 leader_election.cc:403] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:00.002928 16742 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.004320 16786 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.066998 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:00.067667 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:00.009229 16559 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.077034 11854 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.067584 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:00.065394 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:00.013554 11210 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:00.015252 16687 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:00.066746 16821 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:00.008543 16769 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.062366 16731 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:00.079998 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 426531us
I20260709 12:12:00.049551 16726 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.004060 16789 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:59.975304 16572 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.084756 11859 raft_consensus.cc:2368] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:00.086521 11292 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:00.077709 16786 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.092036 16742 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.092368 16769 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:00.092394 16663 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.098783 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2189) took 1545 ms. Trace:
I20260709 12:12:00.089705 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:00.100193 16784 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.546s	user 0.023s	sys 0.030s
I20260709 12:12:00.098132 16814 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:00.101713 16819 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:12:00.133307 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 229270us
I20260709 12:12:00.102006 16572 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:00.104367 16753 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.113812 16671 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.116205 16531 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:00.119700 16687 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.120986 11854 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:12:00.114074 16673 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.157114 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.157451 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.158535 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.159168 11289 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.060057 16142 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:59.982236 16794 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.081734 16559 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:00.127121 11182 leader_election.cc:400] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:00.171362 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.128091 11292 rpcz_store.cc:276] 0709 12:11:58.553749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.085849 (+1532100us) service_pool.cc:224] Handling call
0709 12:12:00.086110 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.098448 (+ 12338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.098711 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:00.167897 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.094733 16717 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.125787 16786 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.142524 11825 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.146620 11216 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:00.147672 11290 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:00.128463 16769 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.175383 16559 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.183432 16794 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.168799 16742 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:00.184958 16742 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.159957 16789 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:12:00.178438 16743 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.003s
I20260709 12:12:00.188920 16743 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.189486 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2935) took 1917 ms. Trace:
I20260709 12:12:00.190878 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.191263 11287 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:00.191941 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2203) took 1592 ms. Trace:
I20260709 12:12:00.192276 11293 rpcz_store.cc:276] 0709 12:11:58.599214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.671961 (+1072747us) service_pool.cc:224] Handling call
0709 12:11:59.748919 (+ 76958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.749300 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.749331 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.790780 (+ 41449us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.004372 (+213592us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.004416 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.004481 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.191758 (+187277us) raft_consensus.cc:1685] finished
0709 12:12:00.191776 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.191891 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15736,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":2410,"thread_start_us":203631,"threads_started":1,"wal-append.queue_time_us":346382}
I20260709 12:12:00.193811 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.139040 16823 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:00.148684 11285 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:00.150527 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 284594us
I20260709 12:12:00.194980 16823 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.196305 11110 leader_election.cc:400] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:12:00.196625 11110 leader_election.cc:403] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:00.149225 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2200) took 1554 ms. Trace:
I20260709 12:12:00.161327 16578 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.197074 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.136639 16663 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.197286 11284 rpcz_store.cc:276] 0709 12:11:58.594969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.000194 (+405225us) service_pool.cc:224] Handling call
0709 12:11:59.018686 (+ 18492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.099151 (+ 80465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.148965 (+1049814us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b540017fcd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:00.149163 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183683968}
I20260709 12:12:00.170091 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.196648 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:00.199301 11284 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:00.199591 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.200898 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.201504 11137 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:00.171607 11826 connection.cc:256] RPC call timeout handler was delayed by -1.1474316620001446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 12:12:00.203012 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:00.171492 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 47316.5us
I20260709 12:12:00.174028 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.204634 11141 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:12:00.204874 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:00.206120 16578 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:00.206656 16673 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.206781 16578 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:00.208025 16578 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.174326 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.211210 11139 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:00.177136 11138 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:12:00.212153 11138 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:00.212487 11138 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.166712 16531 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.135545 16814 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.203210 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:00.172757 11135 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:00.216045 11135 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:00.216919 11135 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.218080 11135 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:00.226233 16793 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.226861 16793 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:00.228473 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.203997 11143 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 9.
I20260709 12:12:00.174414 11136 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:12:00.235364 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.252103 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:00.253396 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74359.3us
I20260709 12:12:00.250890 16770 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.190057 11291 rpcz_store.cc:276] 0709 12:11:58.272030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.272190 (+   160us) service_pool.cc:224] Handling call
0709 12:11:58.272541 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.272889 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.272915 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.273407 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.483810 (+210403us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:58.483851 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.483915 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.981867 (+1497952us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:00.189105 (+207238us) raft_consensus.cc:1685] finished
0709 12:12:00.189131 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.189415 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":583,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":72,"spinlock_wait_cycles":34658560,"thread_start_us":205159,"threads_started":1,"wal-append.queue_time_us":245389}
I20260709 12:12:00.263813 11289 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:00.252146 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.266819 16673 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.267247 16673 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:00.175238 16802 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.276017 11857 raft_consensus.cc:606] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:00.226109 16023 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16.
I20260709 12:12:00.270696 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.267727 16572 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:00.274173 16806 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:12:00.281165 16572 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:00.281723 16572 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:00.283468 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet ddd0a7b2bb3645519f8c5c9bf85633d9: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:00.267361 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.276160 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.284714 11289 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:00.257550 16822 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:00.290088 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.294588 11143 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:00.287776 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 358582us
I20260709 12:12:00.275032 16751 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:00.276258 16673 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.275195 16753 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.274145 16743 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:00.283927 16687 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.281107 16531 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.287608 16696 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:00.315655 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.317868 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:00.330228 16677 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:00.341007 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 71380.7us
I20260709 12:12:00.350277 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:00.358777 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 68747.8us
I20260709 12:12:00.358868 11143 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.359850 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.361965 11292 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:12:00.361871 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:00.315963 16556 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.917s	user 0.020s	sys 0.001s
I20260709 12:12:00.274221 16770 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.361318 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.285717 16802 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.363814 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.366722 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2562) took 1124 ms. Trace:
I20260709 12:12:00.364265 11292 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:00.364281 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.357074 11135 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:12:00.366734 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.367123 11212 rpcz_store.cc:276] 0709 12:11:59.242655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.242807 (+   152us) service_pool.cc:224] Handling call
0709 12:11:59.259127 (+ 16320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.892030 (+632903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.366437 (+474407us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003c41d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:00.366658 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453452672}
I20260709 12:12:00.369413 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:00.369529 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.357839 16726 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.371253 16823 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:00.378691 11143 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:00.382165 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2956) took 1026 ms. Trace:
I20260709 12:12:00.382682 11288 rpcz_store.cc:276] 0709 12:11:59.355729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.880467 (+524738us) service_pool.cc:224] Handling call
0709 12:11:59.880751 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.884760 (+  4009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.884791 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.900462 (+ 15671us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.131597 (+231135us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:00.131662 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.131778 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:00.381901 (+250123us) raft_consensus.cc:1685] finished
0709 12:12:00.381927 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.382091 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8550,"thread_start_us":192233,"threads_started":1,"wal-append.queue_time_us":379236}
I20260709 12:12:00.384239 16822 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:00.385071 16822 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:00.385439 16822 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.385741 16822 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:00.387311 16824 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.387825 16824 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:00.388195 16824 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.389446 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2202) took 1790 ms. Trace:
I20260709 12:12:00.390167 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.391074 11284 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 12: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:00.320308 16753 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.393744 16753 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:00.391100 16802 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.389922 11287 rpcz_store.cc:276] 0709 12:11:58.598915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.647505 (+1048590us) service_pool.cc:224] Handling call
0709 12:11:59.647877 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.191606 (+543729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.389189 (+197583us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540031a6d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:00.389381 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249299712}
W20260709 12:12:00.404371 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.404397 16440 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.405902 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.406571 11139 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.406352 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2576) took 1082 ms. Trace:
I20260709 12:12:00.407588 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:00.407995 11215 rpcz_store.cc:276] 0709 12:11:59.323861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.980246 (+656385us) service_pool.cc:224] Handling call
0709 12:12:00.384720 (+404474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.384902 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.384931 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.384971 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:00.385003 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.385060 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.406176 (+ 21116us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540035aa50. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:00.406282 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922136960}
I20260709 12:12:00.412384 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.413156 11292 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.449316 11292 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:00.415504 11139 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:00.465325 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:00.427501 11218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 882) took 2207 ms (client timeout 2035 ms). Trace:
W20260709 12:12:00.481658 11218 rpcz_store.cc:269] 0709 12:11:58.220270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.222035 (+  1765us) service_pool.cc:224] Handling call
0709 12:12:00.427188 (+2205153us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400385254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:00.427421 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927672704}
I20260709 12:12:00.449591 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.418169 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:00.434630 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 231506us
W20260709 12:12:00.438588 11258 connection.cc:256] RPC call timeout handler was delayed by -1.2927042680000795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2658s for a response
W20260709 12:12:00.487656 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 232479us
I20260709 12:12:00.424650 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:00.462582 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.499826 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:00.515854 11286 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:00.516142 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.360016 16696 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:00.504009 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.519920 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.524747 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.363440 16742 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.414419 16731 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:00.545244 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.522262 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.535701 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.428550 16023 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.540841 11288 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:00.565866 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.566658 11138 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:00.567642 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.568265 11138 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.569478 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.570163 11214 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.571398 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.572659 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.579696 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.581848 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:00.583098 11142 raft_consensus.cc:2410] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:12:00.498289 11141 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:12:00.417040 16814 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:00.592041 11286 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:00.592710 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:00.593156 11213 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:00.593261 11284 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.514871 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:00.556020 16770 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.556957 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.598733 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.598999 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.559044 16583 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.560099 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:00.535998 16696 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:00.561299 16798 consensus_meta.cc:287] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.006s
I20260709 12:12:00.615337 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.562139 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:00.417152 16793 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.595827 11139 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:12:00.603830 11142 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:00.476082 16556 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.365942 16677 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.544713 16440 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.535441 16830 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.616933 11213 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:00.574422 16531 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.596989 16753 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:00.648236 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.634475 11138 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:00.685309 11284 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:12:00.686789 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 92807.2us
I20260709 12:12:00.687711 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.688767 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:00.667062 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 297692us
I20260709 12:12:00.691561 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.693763 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.674510 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:00.700870 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.605881 16549 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:12:00.705210 11217 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:00.652002 16834 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:12:00.722152 16814 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:00.727030 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52622.8us
I20260709 12:12:00.736538 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:00.677264 16304 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 1.313s	user 0.011s	sys 0.006s
I20260709 12:12:00.733994 16829 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.621572 16717 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 12:12:00.747188 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 205790us
W20260709 12:12:00.754870 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 809626de5a674cba911a83815f1e05ca: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:12:00.758998 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.758843 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:00.627096 16798 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.650537 16687 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:12:00.708195 16023 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:00.776087 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 160853us
I20260709 12:12:00.782220 11142 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:12:00.777767 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.725715 16770 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.773546 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.778694 16823 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:00.789693 11142 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:00.743351 16768 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.629827 16845 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 12:12:00.703943 16440 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:12:00.754158 16751 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.797055 11137 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:00.789769 16823 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:00.743309 16828 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:12:00.754570 16304 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.786888 16717 consensus_queue.cc:1243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:00.791366 16753 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.786178 16023 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:00.784632 16855 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:00.804003 16786 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.007s
W20260709 12:12:00.819212 16769 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
W20260709 12:12:00.821271 16839 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 12:12:00.821785 16663 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.009s
I20260709 12:12:00.806505 16751 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.678998 16830 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.817106 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:00.826882 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 338323us
I20260709 12:12:00.809950 16823 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:00.813510 16671 consensus_meta.cc:287] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.005s
W20260709 12:12:00.816079 16559 consensus_meta.cc:287] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.003s
I20260709 12:12:00.857064 11219 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:00.809456 16578 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.850945 16023 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:00.871937 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54911.5us
I20260709 12:12:00.885723 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.878912 11135 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.846611 16859 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:12:00.853087 16753 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:00.847856 16773 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:00.891655 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:00.892105 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 352093us
I20260709 12:12:00.893824 11135 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:12:00.879383 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 190685us
W20260709 12:12:00.880200 16673 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:12:00.868954 16663 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16.
I20260709 12:12:00.898940 11215 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:00.916258 16830 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:00.861821 16769 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.878942 16855 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:00.894577 16572 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.004s
I20260709 12:12:00.922103 16572 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.924414 16572 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:00.885739 16794 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.005s
I20260709 12:12:00.882788 16845 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.925443 11140 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:00.926663 11210 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.885023 16559 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.855494 16786 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.909065 16751 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:00.910161 16824 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.522s	user 0.002s	sys 0.007s
I20260709 12:12:00.907137 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:00.912916 16822 consensus_meta.cc:287] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.002s
I20260709 12:12:00.881209 16578 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:00.928462 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.931216 11214 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:00.934904 11291 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:00.927611 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 150718us
I20260709 12:12:00.938659 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.903937 16857 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:00.936196 16556 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.947808 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:00.952070 11218 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:00.957796 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54321.4us
I20260709 12:12:00.938072 16680 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:00.938829 16830 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:00.959890 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:00.962123 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.945603 16578 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.941222 16751 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:00.950380 16142 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:00.971321 16789 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:00.972832 16844 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:00.951375 16857 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:00.986727 16857 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:00.986842 16806 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.987536 16304 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:00.966416 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:00.964988 16830 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:00.992962 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:00.987563 16806 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:00.972904 16741 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.989599 16696 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.950841 16717 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.935556 16673 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.003410 11210 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:00.992676 16830 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:00.950591 16768 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:12:00.961155 16680 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.940991 16824 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:00.946986 16822 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.050454 16822 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.053084 16824 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.053946 11143 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.055702 16806 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.057338 16806 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.041215 16768 consensus_queue.cc:1243] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:12:01.061293 16830 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.064869 16769 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.065636 16769 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.066027 16769 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:01.067946 16673 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.007506 16741 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:01.068817 16741 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.986946 16556 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.964490 16740 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:12:01.045336 16876 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:01.077891 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.008589 16798 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:01.094656 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.093849 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 137416us
W20260709 12:12:01.096458 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 102682us
I20260709 12:12:01.066421 16769 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.086930 16680 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:01.101131 16142 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.106564 16877 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:01.107563 16142 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:01.109160 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 116253us
I20260709 12:12:01.110220 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.110586 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.112125 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.118257 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.093617 16789 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.096088 16556 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.036383 16753 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.144052 16531 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:01.144482 16023 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.145893 16556 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.123796 16876 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.146848 16880 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:01.109294 16751 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.120445 16855 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:01.125990 16870 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:01.157805 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 289976us
I20260709 12:12:01.123713 16871 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:12:01.148494 16559 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.151219 16876 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:01.163653 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:01.144503 16583 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:12:01.125069 16877 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 12:12:01.219199 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 101098us
W20260709 12:12:01.219640 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 95116.5us
I20260709 12:12:01.147240 16789 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.163136 16786 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.155401 16751 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.172058 16865 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.251878 11212 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.252915 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.269654 16880 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.285615 16696 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:01.313916 16835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.005s
I20260709 12:12:01.331691 16828 consensus_queue.cc:1243] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:01.332417 16828 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:01.332801 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.332932 16828 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:01.329488 16885 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:12:01.337137 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.336751 16680 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.337880 16828 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:01.339224 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.224242 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:01.225162 11289 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:01.342724 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.221158 16845 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.235349 16741 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.236477 16857 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.237095 16023 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.165459 16572 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:12:01.215898 16878 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:01.236413 16823 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:12:01.241355 11219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2571) took 1943 ms (client timeout 1768 ms). Trace:
W20260709 12:12:01.346314 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 122177us
I20260709 12:12:01.242669 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3315) took 1066 ms. Trace:
I20260709 12:12:01.348687 11140 rpcz_store.cc:276] 0709 12:12:00.175797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.175912 (+   115us) service_pool.cc:224] Handling call
0709 12:12:01.242456 (+1066544us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54002e31d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:01.242604 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673298688}
I20260709 12:12:01.349057 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:01.246781 16849 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.501s	user 0.004s	sys 0.002s
I20260709 12:12:01.246910 11286 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:01.247278 11288 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:01.249514 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.217523 16884 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.361114 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.362231 11213 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:01.362447 16559 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.363332 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.364369 16857 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.347644 16773 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.364586 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.365573 16884 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:01.342976 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.366652 16874 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:12:01.367020 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:01.231326 16873 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:12:01.343488 11289 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.364591 16823 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:01.345366 11287 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:12:01.329610 16835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.006s	sys 0.006s
I20260709 12:12:01.358052 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.345269 16802 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:12:01.359064 16769 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.375618 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.376245 11286 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.377234 16769 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.359545 16815 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:01.348009 11219 rpcz_store.cc:269] 0709 12:11:59.297601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.615646 (+318045us) service_pool.cc:224] Handling call
0709 12:12:01.241078 (+1625432us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540013fe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:01.241273 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2821043072}
I20260709 12:12:01.361470 11285 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.165349 16876 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.368556 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.379951 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:01.382172 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 648676us
I20260709 12:12:01.379055 11218 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:01.345309 11293 raft_consensus.cc:2368] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:01.387676 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.388213 11289 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:01.387677 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.390277 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:01.392426 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 253385us
I20260709 12:12:01.396287 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.397289 11289 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.346725 16865 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:01.395505 16671 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:12:01.405697 16583 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:01.392315 16815 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.404507 16774 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:01.407771 16774 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.408182 16774 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:01.408913 16815 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.409171 16774 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.410800 16680 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.410887 16774 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:01.416361 11110 connection.cc:256] RPC call timeout handler was delayed by -1.070224885000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:12:01.416551 16857 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:01.417407 16671 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:01.417901 16837 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.742s	user 0.002s	sys 0.000s
I20260709 12:12:01.418603 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:01.419526 16863 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.623s	user 0.000s	sys 0.001s
I20260709 12:12:01.366693 16884 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.421180 16726 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:01.425640 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.404237 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.435942 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.436702 11137 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 9: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:01.438047 11293 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:01.440455 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.392498 16859 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.433943 11140 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.445199 11142 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:12:01.441107 11141 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:01.446609 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.442090 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.445230 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.449045 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.402537 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.433568 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.441923 11289 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:01.443392 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.449278 11137 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 12:12:01.434159 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 209497us
I20260709 12:12:01.398813 16794 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.454061 11137 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 12:12:01.398866 16773 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.462404 11185 leader_election.cc:400] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:01.462908 11185 leader_election.cc:403] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:01.465731 11140 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:01.345347 16578 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.455093 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.456883 11139 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:01.434525 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44321.7us
I20260709 12:12:01.422860 16823 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.460572 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.441376 16023 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.431226 16726 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:01.474263 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.498253 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.415346 16741 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.483309 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.446959 16673 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:01.476372 16888 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.495854 16773 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:01.497823 16886 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.498716 16844 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:01.499706 16875 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:01.415498 16769 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:12:01.476207 16583 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:01.417979 16671 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.439419 16857 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:12:01.468705 11285 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:01.504894 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:01.507133 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 104709us
I20260709 12:12:01.540643 11289 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:01.476980 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:01.541636 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64781.9us
I20260709 12:12:01.541735 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.542927 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.544220 16741 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.464614 16794 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:01.544957 16741 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:01.480394 16852 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.637s	user 0.001s	sys 0.001s
I20260709 12:12:01.512036 11826 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.528062 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.547138 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2970) took 1067 ms. Trace:
I20260709 12:12:01.546115 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.548202 16798 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.507359 16859 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.509922 16774 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.545655 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.549206 16859 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.549901 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.550889 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.551515 11219 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:01.552218 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.484850 16891 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:01.547505 11292 rpcz_store.cc:276] 0709 12:12:00.480215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.480370 (+   155us) service_pool.cc:224] Handling call
0709 12:12:00.480771 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.481252 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.481281 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.481826 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.675703 (+193877us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.675759 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.675836 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.377449 (+701613us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:01.546840 (+169391us) raft_consensus.cc:1685] finished
0709 12:12:01.546863 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.547078 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13361,"raft.queue_time_us":90,"raft.run_cpu_time_us":8103,"raft.run_wall_time_us":58173,"spinlock_wait_cycles":164397952,"thread_start_us":193534,"threads_started":1,"wal-append.queue_time_us":258360}
I20260709 12:12:01.544982 16794 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.554054 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.555651 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.556594 11292 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:01.557488 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.558745 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.510037 16830 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:01.544291 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.567270 11214 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:01.553421 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.480316 16751 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:01.547678 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.572499 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.573359 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.551870 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.511435 16556 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:01.548209 11143 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:12:01.578418 11143 pending_rounds.cc:85] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:12:01.578730 11143 pending_rounds.cc:107] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:12:01.511179 16870 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:01.587689 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.482690 16815 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:12:01.507874 16680 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:12:01.560187 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.514408 16673 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.551863 16859 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:01.510021 16845 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:12:01.578926 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66978.6us
I20260709 12:12:01.578946 11143 raft_consensus.cc:2889] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.581871 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:01.545950 16741 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.510428 16023 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.533924 16865 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.619278 16673 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.620416 16023 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.587535 16871 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:01.560344 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:12:01.600286 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.597043 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:01.525065 16888 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.583665 11286 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:01.629639 11289 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.608147 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:01.539422 16814 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:12:01.611743 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.630729 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.587744 16556 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.590803 16774 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:01.614780 16860 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:01.615341 16894 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 12:12:01.616295 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.616966 16845 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:01.590356 16789 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.624738 11285 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:01.473212 16880 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.650063 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.651527 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:01.652266 11285 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:01.627748 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.631887 11286 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.631891 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:01.600941 16870 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:01.573210 16830 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.611876 16751 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.645416 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.659360 11219 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.646852 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.595283 16798 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:01.635285 16023 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.658468 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2566) took 2408 ms. Trace:
I20260709 12:12:01.737110 11217 rpcz_store.cc:276] 0709 12:11:59.250156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.250327 (+   171us) service_pool.cc:224] Handling call
0709 12:12:01.658267 (+2407940us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002968d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:01.658407 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3321269120}
I20260709 12:12:01.738513 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.739373 11217 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:01.739801 16794 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.740209 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.740962 11138 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.642755 16774 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:01.636525 16859 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:01.741205 16870 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.742139 16774 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:01.742522 16794 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:01.743000 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.744140 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.744751 11143 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:01.745445 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.747184 11143 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:01.640671 16556 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:01.705276 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 43674.3us
I20260709 12:12:01.639782 16855 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:12:01.756387 16023 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.757265 16023 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.706357 16835 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:01.706889 16531 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.758734 16531 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:01.759307 16531 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.639938 16823 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:12:01.763283 16823 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.763743 16823 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:01.764876 16823 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.768955 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:01.707799 16894 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.770318 16894 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:01.771474 16894 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.773089 16894 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.708352 16888 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.643186 16845 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:01.622349 16773 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.710609 16671 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.644433 16740 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:01.712689 16578 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.655853 16860 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.713593 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2973) took 1174 ms. Trace:
I20260709 12:12:01.713747 16829 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:01.716284 11140 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:01.717523 16840 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.937s	user 0.002s	sys 0.000s
I20260709 12:12:01.718978 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.720932 16828 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.663264 16789 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.722838 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.692622 16827 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.154s
I20260709 12:12:01.722913 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.572752 16726 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.629213 16680 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:01.750252 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:01.752187 11217 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:01.817387 11290 rpcz_store.cc:276] 0709 12:12:00.539417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.540129 (+   712us) service_pool.cc:224] Handling call
0709 12:12:00.540436 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.901337 (+360901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.901373 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.915205 (+ 13832us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.000006 (+ 84801us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:12:01.000060 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.658112 (+658052us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400418cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:01.658159 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.658208 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:01.658221 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.713513 (+ 55292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15591,"raft.queue_time_us":23916,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":793004928,"thread_start_us":84376,"threads_started":1,"wal-append.queue_time_us":180301}
I20260709 12:12:01.753911 11219 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:12:01.756306 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:01.781415 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 171601us
W20260709 12:12:01.782573 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 137071us
W20260709 12:12:01.784569 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.785436 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:01.823038 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66795.1us
I20260709 12:12:01.817816 11140 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:01.823505 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:01.824389 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:01.825775 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 75649.1us
I20260709 12:12:01.831785 11217 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.832953 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:01.835736 16743 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.836071 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.836426 16859 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.837296 16859 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.837780 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:01.840317 16753 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:01.841722 16743 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:01.842115 16743 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:01.843060 16743 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.844411 16743 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.844583 11219 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:01.846613 11219 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:12:01.849124 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:01.850258 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.852136 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.854918 11217 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:01.847236 16859 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:01.824493 11140 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.796172 16823 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.859593 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.864650 11140 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.859310 11290 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.858556 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:01.795588 16489 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:01.803066 16830 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:01.924575 16869 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:01.822012 16860 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:01.923992 11136 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:12:01.925863 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67034.7us
W20260709 12:12:01.922940 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 100454us
I20260709 12:12:01.866434 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:01.930661 11143 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:01.925768 11285 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:01.848318 16751 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.797504 16786 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:01.857618 16871 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:01.801242 16774 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.819649 16829 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:01.941569 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 92562.4us
I20260709 12:12:01.937786 11219 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.867259 16717 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.849045 16908 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.831636 16828 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.831321 16680 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.867494 16726 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.926638 16740 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:01.929596 16859 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:01.962212 11136 pending_rounds.cc:85] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 4
I20260709 12:12:01.982412 11136 pending_rounds.cc:107] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:12:01.982888 11136 raft_consensus.cc:2889] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.949890 11139 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:01.804675 16556 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.966636 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:01.848739 16844 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 12:12:01.967903 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3318) took 1788 ms. Trace:
I20260709 12:12:01.935510 16835 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.000797 16835 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:01.923107 16876 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.005738 11218 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:01.998710 11140 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:01.994751 11144 rpcz_store.cc:276] 0709 12:12:00.179707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.180212 (+   505us) service_pool.cc:224] Handling call
0709 12:12:00.180671 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.219184 (+ 38513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.219231 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.219835 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.496003 (+276168us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:00.717602 (+221599us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.719312 (+  1710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.719434 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.716892 (+997458us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:01.960995 (+244103us) raft_consensus.cc:1685] finished
0709 12:12:01.967615 (+  6620us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.967818 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83120,"prepare.queue_time_us":361792,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":39334,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":226,"spinlock_wait_cycles":57293184,"thread_start_us":362830,"threads_started":2,"wal-append.queue_time_us":448543}
I20260709 12:12:02.008924 11140 pending_rounds.cc:85] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:12:02.009322 11140 pending_rounds.cc:107] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:02.009696 11140 raft_consensus.cc:2889] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.941192 16875 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:12:01.960320 16871 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:01.932781 16489 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:02.018604 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52985.9us
I20260709 12:12:02.024402 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:01.951830 16886 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:12:01.952865 16023 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:01.992544 16859 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:02.057909 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 159132us
I20260709 12:12:01.956111 16786 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:02.064321 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.945006 16845 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.096133 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:02.097195 11256 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 1.580s (SENT)
I20260709 12:12:02.099561 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.053571 16830 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:02.095191 16840 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:02.115880 11142 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:12:02.117949 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 65836.5us
W20260709 12:12:02.115886 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61252.5us
I20260709 12:12:02.136737 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.146201 16023 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.157267 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.009006 16789 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.103513 16865 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:02.111749 16917 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.178375 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.180085 11219 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:12:02.182125 16913 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:12:02.183241 16914 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:12:02.183691 16489 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.162614 16845 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.050622 16829 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.167763 16865 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:02.115528 16830 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.175191 16717 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:02.160772 16875 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:02.176062 16915 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:02.207165 16920 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:12:02.208287 16556 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.219040 16865 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.220307 16865 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:02.220566 16887 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:02.221060 16887 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:02.209235 16828 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.209262 16827 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.223119 16786 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.223196 16827 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.175055 16859 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.114310 16740 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.225441 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:02.226464 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:02.212517 16774 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.189015 16917 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:02.202512 16909 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:12:02.214318 16793 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:02.221935 16887 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.228636 16793 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:02.229192 16887 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.229254 16875 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.229949 16875 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:02.226824 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:02.230845 16915 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:02.231357 16915 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.231030 16875 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.231812 16915 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.229534 16793 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.232402 16875 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.234104 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:02.232940 16793 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.173089 16886 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:12:02.247675 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.251101 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.263581 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 126956us
I20260709 12:12:02.264226 11143 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:02.266788 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:02.268181 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.273706 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.247890 16829 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.283743 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.287097 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.290329 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.291522 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.277199 16023 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:02.275259 16774 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.175886 16871 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.294860 16680 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.355237 16917 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:02.355933 16861 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:02.356503 16861 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.356918 16861 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.358946 16023 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:02.359472 16023 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.359901 16023 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.289706 16798 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.294130 16894 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:02.289774 16794 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.266189 16828 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:02.296972 16671 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:02.379487 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 88038.8us
W20260709 12:12:02.394392 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:02.431969 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.349820 16774 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:02.365675 16894 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.384352 16671 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:02.454032 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 356854us
W20260709 12:12:02.460932 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.445801 16774 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:02.468240 16531 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.002s
I20260709 12:12:02.468717 16531 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.469636 16915 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.470717 11292 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:02.471362 16830 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.456696 16671 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.475137 16915 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:02.478619 16827 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:02.483233 16743 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.004s
W20260709 12:12:02.484411 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.488381 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.455188 16894 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:02.499054 16847 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.727s	user 0.006s	sys 0.000s
I20260709 12:12:02.499203 16531 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.503506 16677 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.494112 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.461622 16794 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:12:02.506727 16827 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:02.496465 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.507759 16687 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.508430 16687 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:02.512084 11214 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:02.512801 16023 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.513248 11214 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:02.514950 16023 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:02.496153 16726 consensus_meta.cc:287] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
W20260709 12:12:02.471357 16928 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:12:02.496556 16942 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:12:02.496987 16930 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:02.497211 16798 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:02.515184 11291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 2961) took 2154 ms (client timeout 2098 ms). Trace:
W20260709 12:12:02.523964 11291 rpcz_store.cc:269] 0709 12:12:00.361060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.363551 (+  2491us) service_pool.cc:224] Handling call
0709 12:12:02.514948 (+2151397us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b540031abd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:02.515080 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258961664}
I20260709 12:12:02.525167 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:02.495703 16937 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:12:02.527251 16823 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.002s
I20260709 12:12:02.463714 16862 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.527738 16869 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:02.528142 16869 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:02.528025 16862 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.517145 16894 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.526381 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:02.537859 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:02.538674 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 105758us
I20260709 12:12:02.540994 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.541956 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.542913 11291 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:02.549883 11217 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.551103 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.552798 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:02.559034 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:02.559623 11217 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.561573 16726 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:02.562103 16726 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:02.563090 16531 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:02.562952 16726 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.563896 16531 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:02.564128 16726 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:02.564363 16531 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:02.565505 16531 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.545490 16125 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:02.567000 16125 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.561902 16823 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:02.568492 16823 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.568884 16823 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:02.569207 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:02.569720 11137 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:12:02.570252  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:02.570099 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:02.571432 11143 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:12:02.570087 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:02.570618 16940 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 12:12:02.572839 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.541811 16677 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:02.576139 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:02.577243 16853 log.cc:927] Time spent T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.634s	user 0.008s	sys 0.003s
I20260709 12:12:02.579231 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2993) took 1004 ms. Trace:
I20260709 12:12:02.585319 11287 rpcz_store.cc:276] 0709 12:12:01.575230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.655035 (+ 79805us) service_pool.cc:224] Handling call
0709 12:12:01.655275 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.777887 (+122612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.777921 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.777974 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:01.778005 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.579002 (+800997us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400404554. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:02.579061 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.579171 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281402624}
I20260709 12:12:02.580667 16023 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.588160 16023 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.583508 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3350) took 1035 ms. Trace:
I20260709 12:12:02.589901 11144 rpcz_store.cc:276] 0709 12:12:01.548465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.006963 (+458498us) service_pool.cc:224] Handling call
0709 12:12:02.007365 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.007739 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.007774 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.008353 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.243866 (+235513us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:02.243928 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.244019 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.583287 (+339268us) raft_consensus.cc:1685] finished
0709 12:12:02.583305 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.583444 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4062,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":7694,"thread_start_us":235109,"threads_started":1,"wal-append.queue_time_us":280689}
I20260709 12:12:02.585680 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:02.595261 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:02.599885 16023 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:02.601310 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.602712 16531 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:02.604852 11217 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:02.605973 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:02.606856 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:02.607122 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.607784 16023 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:02.608174 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.577291 16844 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.614114 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:02.569746 16823 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.580030 16828 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.622474 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.623589 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.624212 11861 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:02.613210 16798 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.600543 16794 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:02.615618 16687 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:02.637079 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.637779 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.642890 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.645229 11855 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.630154 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.642786 11853 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:02.643982 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.649681 11857 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:02.652390 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.618579 16915 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.652081 11217 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:02.658372 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.659137 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:02.659355 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.659953 11857 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:02.660650 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.660827 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.661214 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.625327 16856 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:12:02.640753 16860 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.002s
I20260709 12:12:02.597440 16677 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.667416 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.641572 16798 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.672739 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.673998 16023 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:02.657758 16823 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.675563 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.675844 16023 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:02.660437 16925 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.171s	user 0.000s	sys 0.015s
I20260709 12:12:02.644500 16687 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.682929 16919 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:12:02.683645 16933 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.112s	user 0.004s	sys 0.003s
I20260709 12:12:02.572749 16869 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.668004 16939 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:02.639410 16828 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.695963 11853 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:02.627977 16844 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.702680 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:02.695091 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.705304 11137 pending_rounds.cc:85] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:12:02.720459 11137 pending_rounds.cc:107] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:12:02.720781 11137 raft_consensus.cc:2889] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.689860 16687 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:02.711127 16677 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.667083 16856 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.693029 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:02.657281 16794 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.720338 11286 raft_consensus.cc:2376] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16. Re-sending same reply.
I20260709 12:12:02.740299 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.680384 16798 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.705526 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:02.672472 16860 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.665669 16915 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.752990 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:02.731349 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.753700 11860 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:12:02.734517 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.754040 11860 pending_rounds.cc:85] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 10
I20260709 12:12:02.754292 11860 pending_rounds.cc:107] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:12:02.754698 11860 raft_consensus.cc:2889] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.734680 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:02.691756 16125 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.742163 11291 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:02.742586 11286 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:02.741716 16861 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:02.746667 16887 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.003s
I20260709 12:12:02.750967 16862 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:02.765964 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.766436 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.766952 16844 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.767318 11853 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:02.767817 16938 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:02.759268 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.768563 11217 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:02.769310 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:02.728012 16793 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.770419 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:02.770252 16793 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.771735 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.772344 11284 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:02.738129 16869 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:02.774305 11291 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:02.761003 11855 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:02.763185 16894 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.764108 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3353) took 1214 ms. Trace:
I20260709 12:12:02.764463 16861 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:02.765336 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.767163 11858 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 9: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:02.778650 11185 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:02.755646 11144 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:02.772384 16793 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.761952 16794 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.776918 11856 raft_consensus.cc:2410] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:12:02.777233 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.778316 11140 rpcz_store.cc:276] 0709 12:12:01.549753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.016966 (+467213us) service_pool.cc:224] Handling call
0709 12:12:02.017336 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.041075 (+ 23739us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:12:02.041108 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.041622 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.158541 (+116919us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:12:02.158585 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.158648 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.763874 (+605226us) raft_consensus.cc:1685] finished
0709 12:12:02.763902 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.764043 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45015,"raft.queue_time_us":24018,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9618,"thread_start_us":116583,"threads_started":1,"wal-append.queue_time_us":199360}
I20260709 12:12:02.781263 11286 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 12: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:02.751144 11859 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:02.782977 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.784021 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:02.788223 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.789677 11286 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:02.791293 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.784492 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:02.792356 11291 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:02.793540 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:02.794718 11140 raft_consensus.cc:2410] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:02.797266 11288 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:02.800148 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.800498 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.801262 11217 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:02.759389 16875 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.006s
I20260709 12:12:02.803979 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:02.805850 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.804121 16939 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:02.807790 16939 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.811372 11856 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:02.813905 11291 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:02.817358 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.808853 16916 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:02.786736 16915 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:02.821949 16856 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.796483 16894 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.808195 16939 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.829604 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.811708 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:02.814239 16861 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.833207 11856 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:02.816345 16125 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:02.834321 11216 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:02.840519 11291 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:02.835098 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.838752 16950 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:02.844632 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.827241 16916 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.827448 16886 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:02.852451 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:02.845355 16940 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:02.857589 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.869760 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:02.848977 16916 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:02.871973 11291 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:02.851325 16125 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:02.877450 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2180) took 1333 ms. Trace:
I20260709 12:12:02.877837 11218 rpcz_store.cc:276] 0709 12:12:01.543630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.545880 (+  2250us) service_pool.cc:224] Handling call
0709 12:12:02.877292 (+1331412us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54000276d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:02.877406 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051527552}
I20260709 12:12:02.878436 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:02.879180 11219 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.887862 16583 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:02.888327 16583 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:02.856168 16886 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:02.890719 16583 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:02.858996 16940 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:02.877899 16828 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:02.894143 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2995) took 1028 ms. Trace:
I20260709 12:12:02.881764 16856 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.897643 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:02.894791 11290 rpcz_store.cc:276] 0709 12:12:01.865751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.936839 (+ 71088us) service_pool.cc:224] Handling call
0709 12:12:01.944215 (+  7376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.945302 (+  1087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.945338 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:01.950647 (+  5309us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.804702 (+854055us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b1800319c60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:12:02.868637 (+ 63935us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:02.868683 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.868749 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.890049 (+ 21300us) raft_consensus.cc:1685] finished
0709 12:12:02.890064 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.894076 (+  4012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8676,"raft.queue_time_us":23024,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":35263,"spinlock_wait_cycles":4937088,"thread_start_us":59774,"threads_started":1,"wal-append.queue_time_us":905144}
I20260709 12:12:02.883559 16860 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:02.906277 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:02.934935 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.032574 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.034180 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.035645 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:03.040097 16774 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.003s
W20260709 12:12:03.044071 16952 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:12:03.043991 16774 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.045643 11142 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:03.046155 16774 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.037900 16842 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.053416 16842 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:03.054456  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:03.055663  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.057940 11286 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:02.894454 16671 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.043143 16789 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.060207 16789 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.061455 16671 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:03.062889 11210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 899) took 2909 ms (client timeout 2278 ms). Trace:
W20260709 12:12:03.063660 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.063313 11210 rpcz_store.cc:269] 0709 12:12:00.153437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.170403 (+ 16966us) service_pool.cc:224] Handling call
0709 12:12:03.062673 (+2892270us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540035b454. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:03.062809 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549397888}
I20260709 12:12:03.064774 11291 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:03.066825 11136 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:03.049273 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2175) took 2814 ms. Trace:
I20260709 12:12:03.050315 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1192) took 1224 ms. Trace:
I20260709 12:12:03.051100 16687 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.052191 16798 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.059003 16842 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:03.047277 16954 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:12:03.067914 11212 rpcz_store.cc:276] 0709 12:12:00.234785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.617187 (+382402us) service_pool.cc:224] Handling call
0709 12:12:01.248728 (+631541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.252271 (+  3543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.049030 (+1796759us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540013fe50. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:03.049182 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408554240}
I20260709 12:12:03.070118 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:03.068043 11288 rpcz_store.cc:276] 0709 12:12:01.825558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.825755 (+   197us) service_pool.cc:224] Handling call
0709 12:12:01.826071 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.797815 (+971744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.050056 (+252241us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003f20d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.050257 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210777984}
I20260709 12:12:03.032323 16823 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.075693 11853 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:03.086894 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1191) took 1477 ms. Trace:
I20260709 12:12:03.128077 16823 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.128623 11292 rpcz_store.cc:276] 0709 12:12:01.609832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.664820 (+ 54988us) service_pool.cc:224] Handling call
0709 12:12:01.723927 (+ 59107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.471161 (+747234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.086647 (+615486us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b5400061dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.086824 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716998016}
I20260709 12:12:03.129539 11291 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:03.130034 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:03.086320 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2469) took 1629 ms. Trace:
I20260709 12:12:03.062294 16789 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.037427 16583 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:03.093432 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:03.094614 16957 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:12:03.037070 16125 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:03.141227 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.095533 16953 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:12:03.107061 16955 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:12:03.108722 16940 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.031225 16856 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.075106 16861 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.127314 16842 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:03.131775 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.132915 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.156780 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.133152 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.131384 11141 rpcz_store.cc:276] 0709 12:12:01.457477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.457655 (+   178us) service_pool.cc:224] Handling call
0709 12:12:01.458025 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.622108 (+164083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.622148 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.622239 (+    91us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.622272 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.085911 (+1463639us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54001176d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.085992 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.086213 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376821632}
I20260709 12:12:03.137941 11288 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:03.145141 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.145787 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.066067 16835 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.147725 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.149187 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.149358 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.152992 16677 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:03.135524 16531 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:03.165083 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.165906 11852 raft_consensus.cc:2410] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:12:03.166214 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.146632 16823 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.169431 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.170015 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.170851 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.154201 16908 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.172711 16717 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.174328 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.177166 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.181798 11858 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:12:03.173096 16531 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.185282 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.186226 11855 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:03.187144 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.187489 16531 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.188043 16835 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.163175 16915 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:03.183297 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.143000 16789 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:12:03.189055 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.189812 16915 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:03.190205 11853 raft_consensus.cc:2376] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16. Re-sending same reply.
I20260709 12:12:03.190315 16915 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:03.191220 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.174533 16917 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.192351 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.163600 16919 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:03.196148 16919 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:03.182756 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.194859 11218 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:03.197312 11858 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.197711 11215 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.193833 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.201246 11852 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:12:03.201704 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.202436 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.203816 16860 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.205190 16798 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.205837 16870 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.183195 16908 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.206374 16870 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.208142 16908 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.208484 16870 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.163021 16861 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.197183 16889 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:12:03.209946 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.210457 16861 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.204849 16939 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.211601 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.213421 16876 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:03.215406 16848 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:03.215919 11854 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:12:03.216516 11135 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3323) took 2811 ms (client timeout 1971 ms). Trace:
I20260709 12:12:03.214455 16919 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.179639 16916 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:03.216912 11135 rpcz_store.cc:269] 0709 12:12:00.405154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.423871 (+ 18717us) service_pool.cc:224] Handling call
0709 12:12:03.216283 (+2792412us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b5400253fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:03.216410 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875318016}
I20260709 12:12:03.217919 11290 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:03.219980 16916 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.222724 16687 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.229303 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2453) took 1810 ms. Trace:
I20260709 12:12:03.229722 11138 rpcz_store.cc:276] 0709 12:12:01.418708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.439740 (+ 21032us) service_pool.cc:224] Handling call
0709 12:12:01.460905 (+ 21165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.741463 (+280558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.229042 (+1487579us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400116cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.229227 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643576704}
I20260709 12:12:03.231073 16939 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.237428 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 2994) took 1375 ms. Trace:
W20260709 12:12:03.239352 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.241061 16916 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:03.243048 16950 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:03.243539 11284 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:03.243968 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.244714 11137 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:03.245595 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.246608 11861 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:12:03.249246 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.251716 11143 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:03.255002 11859 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:03.256302 11136 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:12:03.264922 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.237852 11289 rpcz_store.cc:276] 0709 12:12:01.862584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.862830 (+   246us) service_pool.cc:224] Handling call
0709 12:12:01.863308 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.972242 (+108934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.972277 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:01.972824 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.057505 (+ 84681us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:02.057569 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.236994 (+1179425us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54004259d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.237047 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.237096 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:03.237111 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.237366 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39366,"raft.queue_time_us":44627,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4234,"spinlock_wait_cycles":228167040,"thread_start_us":49639,"threads_started":1,"wal-append.queue_time_us":152770,"wal-append.run_cpu_time_us":1757,"wal-append.run_wall_time_us":1071397}
I20260709 12:12:03.270529 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:03.266048 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.274614 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.275442 11135 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.279225 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.280956 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:03.284588 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.226316 16742 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:03.291253 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:03.291553 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.293108 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.293391 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.296401 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:03.300130 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:03.302565 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:03.303853 16677 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.304534 16677 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.307731 16677 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.290830 16742 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:03.312282 16875 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:03.313331 16875 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.313737 16875 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:03.314800 16940 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.315183 16940 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.316223 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:03.299705 11289 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.324846 11135 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:03.315519 16940 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:03.326403 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.326854 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:03.344231 11292 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.345552 16875 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.347795 16875 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.337679 11137 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:12:03.339358 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:03.377177 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 185088us
I20260709 12:12:03.326480 16931 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.377770 11289 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:03.380936 11213 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:12:03.387110 11289 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:03.387712 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.388274 11289 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:03.379760 11182 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.301040 16845 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 12:12:03.391901 16939 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:03.391952 16931 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.392804 16939 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:03.396332 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.405874 11292 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:03.407464 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.409933 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.400974 16583 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:03.418918 16142 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.424947 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2596) took 1483 ms. Trace:
I20260709 12:12:03.425439 11219 rpcz_store.cc:276] 0709 12:12:01.941693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.180818 (+239125us) service_pool.cc:224] Handling call
0709 12:12:02.877459 (+696641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.880443 (+  2984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.424685 (+544242us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54000276d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:03.424860 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601418112}
I20260709 12:12:03.428275 16743 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.428896 16743 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:03.420858 16583 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:03.438198 16583 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.401750 16939 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.450699 11288 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:03.452144 11288 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:03.452581 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.419242 16830 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.453449 16830 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.454627 16823 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.454972 16919 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:03.455163 16823 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.456140 16830 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.457547 16823 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:03.458951 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 49255.5us
I20260709 12:12:03.462900 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.464028 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.464257 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.464465 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.464716 11138 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:03.465809 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.454185 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.458274 16888 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:03.472431 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.459810 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:03.470281 16908 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:03.474833 16798 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.474375 16742 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.475193 11857 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:03.475783 16742 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.475620 16814 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:03.476763 16965 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.422407 16950 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:03.479911 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:03.467801 11292 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:03.482069 11288 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:12:03.489565 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.487437 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.491178 11142 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:03.493992 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.430097 16743 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.469015 16815 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:03.503916 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.470440 16671 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.479820 16687 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:03.486974 16717 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.470875 16848 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:12:03.520890 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.488601 16835 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.515398 16917 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.526660 16917 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.527027 16917 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.529522 16687 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:03.525266 16919 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.530582 16687 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.531250 16876 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:12:03.514019 16931 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.517158 16916 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.488397 16950 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:03.499202 16830 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.533012 16950 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.518584 16671 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.481197 16965 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.535424 16671 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.535681 16856 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.536023 16965 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.531124 16919 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.538764 16919 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.544312 16815 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.545261 16823 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:03.545760 16823 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.546133 16823 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:03.546723 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.546824 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.554178 16671 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.554632 16815 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.554737 16671 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.555202 16815 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.556985 16827 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.557026 16671 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.557441 16848 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.558956 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.559206 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.560082 11138 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:03.560317 16802 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.558699 16671 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.558122 16848 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.561501 16671 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.556492 16823 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.563412 16848 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.559989 11142 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:03.564282 16671 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.560895 16802 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:03.565043 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.565397 11138 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:12:03.566823 16802 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.536041 16835 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.569526 16830 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.569988 16830 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.570359 16830 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.570829 16583 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.573103 16583 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.574518 16558 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:03.570006 16835 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.576944 16940 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.577378 16558 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:03.576469 11138 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.578297 16558 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.579455 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.579419 16830 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.580231 11144 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.579843 16558 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:03.587554 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2224) took 1322 ms. Trace:
I20260709 12:12:03.588014 11284 rpcz_store.cc:276] 0709 12:12:02.265055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.775892 (+510837us) service_pool.cc:224] Handling call
0709 12:12:03.243189 (+467297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.244059 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.587344 (+343285us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54004259d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:03.587488 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073454464}
I20260709 12:12:03.514850 16677 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.591117 16677 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.591794 16677 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.592164 11143 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.592999 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3007) took 1073 ms. Trace:
I20260709 12:12:03.593395 11291 rpcz_store.cc:276] 0709 12:12:02.519694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.065464 (+545770us) service_pool.cc:224] Handling call
0709 12:12:03.065708 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.129867 (+ 64159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.592758 (+462891us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b540017fcd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.592939 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145931008}
I20260709 12:12:03.594906 11144 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:12:03.514183 16878 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:12:03.488863 16908 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:03.595583 16823 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:03.654917 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.596706 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.655930 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.644475 11289 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.611498 11135 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.625083 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2593) took 2266 ms. Trace:
I20260709 12:12:03.636677 11293 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:03.629243 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2172) took 3395 ms. Trace:
I20260709 12:12:03.497306 16531 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.624656 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.657985 11216 rpcz_store.cc:276] 0709 12:12:00.233851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.242926 (+  9075us) service_pool.cc:224] Handling call
0709 12:12:01.658855 (+1415929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.839565 (+1180710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.594248 (+754683us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002968d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.628989 (+ 34741us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002968d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:03.629172 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5896916608}
W20260709 12:12:03.628499 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.619910 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.656061 11137 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:03.616688 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2227) took 1351 ms. Trace:
I20260709 12:12:03.625962 11292 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:03.664497 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.679700 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.680002 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.680344 11137 raft_consensus.cc:2376] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12. Re-sending same reply.
I20260709 12:12:03.665305 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.665750 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.681295 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.669407 11143 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:03.681548 11859 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 10: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:03.657027 11213 rpcz_store.cc:276] 0709 12:12:01.358731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.369863 (+ 11132us) service_pool.cc:224] Handling call
0709 12:12:01.370380 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.385952 (+2015572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.624718 (+238766us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54002f53d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.625007 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4622765952}
I20260709 12:12:03.682588 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.682691 11137 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:03.671653 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.672549 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:03.673323 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.630352 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:03.683667 11139 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.665940 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.679327 11286 rpcz_store.cc:276] 0709 12:12:02.265668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.792139 (+526471us) service_pool.cc:224] Handling call
0709 12:12:02.792446 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.058431 (+265985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.616421 (+557990us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400426dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.616622 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609921920}
I20260709 12:12:03.590888 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.649434 11211 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:03.515205 16814 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:03.691136 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:03.691973 11140 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:03.693964 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3014) took 1094 ms. Trace:
I20260709 12:12:03.697866 11289 rpcz_store.cc:276] 0709 12:12:02.599477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.389253 (+789776us) service_pool.cc:224] Handling call
0709 12:12:03.389458 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.656601 (+267143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.693676 (+ 37075us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54000622d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:03.693905 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585960832}
W20260709 12:12:03.696342 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 195129us
W20260709 12:12:03.598189 16967 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260709 12:12:03.700496 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:03.649317 16971 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 12:12:03.621260 16968 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:12:03.598527 16893 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:03.650683 16973 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
W20260709 12:12:03.597155 16966 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 12:12:03.514943 16751 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 12:12:03.708439 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.590988 16870 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:03.654449 16830 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.711793 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.702823 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.715893 11144 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:03.621699 16815 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.628683 16886 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.634473 16845 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.692646 16802 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.673993 16125 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:03.672055 16827 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:03.738955 16845 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.738998 16125 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.741475 16845 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.741681 16880 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:03.741700 16125 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.744443 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.745149 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.705643 16814 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.746452 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:03.750038 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 257) took 15312 ms (client timeout 15000 ms). Trace:
I20260709 12:12:03.750762 16531 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:03.751251 16531 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:03.751649 16531 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:03.751881 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39166
I20260709 12:12:03.752188 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.752537 16814 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:03.753242 11860 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
W20260709 12:12:03.755177 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.758915 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.759115 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:03.753362 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.713707 16859 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.702092 16753 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:03.767561 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.768139 16753 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:03.726861 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:03.769913 16583 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:03.770514 16583 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:03.771483 16583 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.727564 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.773986 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.774235 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.775775 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.731474 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.779714 11144 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.516856 16857 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.193s
I20260709 12:12:03.711542 16856 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:12:03.761691 16751 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.784993 16751 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.787372 16751 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.717592 16893 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:03.784372 16830 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.789465 16830 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.760812 11219 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
W20260709 12:12:03.737659 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46616.9us
W20260709 12:12:03.793130 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 90435.3us
I20260709 12:12:03.793974 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.706843 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.696101 16869 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:03.766899 16908 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.784330 16940 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.796511 11138 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:03.713099 16875 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 12:12:03.796602 11139 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:12:03.750520 11039 rpcz_store.cc:269] 0709 12:11:48.438016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.438330 (+   314us) service_pool.cc:224] Handling call
0709 12:12:03.749925 (+15311595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:56.155815 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:56.156498 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:56.156559 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:11:56.156588 (+    29us) tablet.cc:662] Decoding operations
0709 12:11:56.427280 (+270692us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:56.459881 (+ 32601us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:56.517074 (+ 57193us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:11:56.812062 (+294988us) tablet.cc:701] Row locks acquired
0709 12:11:56.812128 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:11:56.812355 (+   227us) write_op.cc:270] Start()
0709 12:11:56.812550 (+   195us) write_op.cc:276] Timestamp: P: 1783599116812270 usec, L: 0
0709 12:11:56.812600 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:11:57.183417 (+370817us) log.cc:844] Serialized 10939 byte log entry
0709 12:11:57.856442 (+673025us) op_driver.cc:464] REPLICATION: finished
0709 12:11:57.886855 (+ 30413us) write_op.cc:301] APPLY: starting
0709 12:11:57.886955 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:58.400451 (+513496us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:58.400582 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:00.209653 (+1809071us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:00.210392 (+   739us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 12:12:00.210507 (+   115us) write_op.cc:312] APPLY: finished
0709 12:12:00.211371 (+   864us) log.cc:844] Serialized 244 byte log entry
0709 12:12:00.495501 (+284130us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:00.558221 (+ 62720us) write_op.cc:454] Released schema lock
0709 12:12:00.558394 (+   173us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:00.559063 (+   669us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:00.559107 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":191178,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":30060,"apply.run_cpu_time_us":82594,"apply.run_wall_time_us":2672126,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121503,"num_ops":28,"prepare.queue_time_us":96159,"prepare.run_cpu_time_us":17518,"prepare.run_wall_time_us":1338485,"raft.queue_time_us":353283,"raft.run_cpu_time_us":7908,"raft.run_wall_time_us":30561,"replication_time_us":1043650,"thread_start_us":467311,"threads_started":5,"wal-append.queue_time_us":540018,"wal-append.run_cpu_time_us":73836,"wal-append.run_wall_time_us":2655747}]]}
I20260709 12:12:03.623713 16915 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.832221 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.833150 11860 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:12:03.750187 16742 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:03.798799 11219 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:12:03.837399 11144 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:03.799997 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:03.721853 16877 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.722151 16870 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:03.840324 16870 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.795703 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:03.803244 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:03.793967 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.802266 16125 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:03.791188 16743 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.762048 16802 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.840833 16974 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:03.841665 16870 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:03.861295 16802 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.861991 11143 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:03.862537 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:03.843091 16877 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.866664 16888 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:03.830287 16939 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:12:03.868103 16939 consensus_queue.cc:1243] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:03.868635 16939 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.868954 16939 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:03.869761 16939 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.834817 11138 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:03.805502 11135 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:12:03.875168 16915 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:03.874897 16751 consensus_queue.cc:1175] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2b4f4725b82b481ab53f0717a429e94a" responder_term: 12 status { last_received { term: 11 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:03.864962 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.843335 16125 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.791549 16830 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:03.885840 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.842696 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 48840.1us
I20260709 12:12:03.836071 11140 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
W20260709 12:12:03.889436 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 93832.1us
I20260709 12:12:03.811391 16862 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:03.761600 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:03.890442 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 87288us
I20260709 12:12:03.847224 16815 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.892586 11859 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:12:03.801658 16814 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:12:03.879431 16877 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.857259 16677 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.927690 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:03.944458 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:03.947110 11136 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:03.930210 11137 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:12:03.914060 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:03.948292 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.895474 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.951193 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.940757 11285 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.937287 11138 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.844833 16875 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:03.950884 11182 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:03.852052 16827 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:03.931690 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.952322 16875 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:03.956782 16869 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:03.957705 16869 consensus_queue.cc:1243] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:03.957576 16875 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.958418 16844 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.958842 16875 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.958971 16789 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:03.959848 16789 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.960194 16789 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:03.960963 16789 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.962112 16789 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.953704 11143 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:03.963178 16893 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.954717 16888 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:03.965206 11219 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:03.965376 16888 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:03.966459 16888 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.953359 16827 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.967891 16917 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.970077 16917 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:03.970763 11288 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:03.972787 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:03.973452 11853 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.974939 16798 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:03.769145 16753 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.951895 11856 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:12:03.958853 16844 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:03.977551 16844 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:03.964365 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.955590 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:03.983668 11143 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:12:03.979089 11135 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:12:03.951797 11139 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:12:03.955185 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:04.005733 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50630.8us
I20260709 12:12:03.982244 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.954645 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:03.986135 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.980403 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:03.981051 11853 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:04.012020 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:04.013219 11137 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:04.006696 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:04.015733 11143 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:04.016446 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.975600 16125 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:03.896643 16829 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:03.964367 16893 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:04.015630 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.018s	sys 0.038s
I20260709 12:12:04.018389 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:03.964612 16677 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:04.015460 16773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.489s	user 0.029s	sys 0.039s
I20260709 12:12:03.979604 16939 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.900007 16974 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.018550 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:04.046008 11286 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 12: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:04.032414 11135 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.021674 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:03.893129 16742 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.953889 16815 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.027904 16844 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.018327 16917 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:03.975603 16802 consensus_queue.cc:1175] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" responder_term: 15 status { last_received { term: 15 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:04.041778 16125 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:03.954519 16531 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.065028 16531 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:04.065879 16974 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:04.030404 16862 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.067184 16829 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:04.068392 16829 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.070835 16862 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:04.072000 16862 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:03.958879 16752 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:12:04.066555 16974 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.017972 16877 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.025463 11825 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:12:04.040179 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.018s	sys 0.038s
W20260709 12:12:04.045095 16773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.030s	sys 0.039s
W20260709 12:12:04.086077 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60722.1us
W20260709 12:12:04.086230 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 592279us
I20260709 12:12:04.088147 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:04.092643 11290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.012s	sys 0.025s
W20260709 12:12:04.094074 11290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.012s	sys 0.025s
I20260709 12:12:04.095520 11286 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:12:04.096024 11142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.024s
W20260709 12:12:04.102970 11142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.016s	sys 0.024s
W20260709 12:12:04.096303 11217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.014s	sys 0.024s
W20260709 12:12:04.105103 11217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.015s	sys 0.024s
I20260709 12:12:04.107131 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.078954 16558 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:04.108125 16558 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.080030 16917 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:04.098133 11135 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:04.112517 16842 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:04.113212 16558 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:04.112588 16917 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.114781 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:04.087085 16845 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:04.084607 11040 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 6 to 7, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 7 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.083518 16815 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:04.084750 16877 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:04.062394 16125 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.157794 16931 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:04.159267 16940 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.159566 16742 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.159910 16940 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:04.160498 16845 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:04.160957 16940 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.161789 16845 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.162847 16940 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.172206 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:04.176790 16125 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:04.177044 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.178512 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:04.150801 16860 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.182533 16860 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:04.183101 16860 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.120004 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.148139 16773 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:04.185515 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65644.2us
I20260709 12:12:04.185046 16877 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.186792 16842 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:04.188093 16842 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:04.188448 16842 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:04.189273 16842 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.190586 16842 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:04.120769 16856 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:12:04.192359 11287 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:04.193229 16856 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:04.193512 11287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 3013) took 1596 ms (client timeout 1996 ms). Trace:
I20260709 12:12:04.193596 16856 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:12:04.193944 11287 rpcz_store.cc:269] 0709 12:12:02.596770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.654068 (+ 57298us) service_pool.cc:224] Handling call
0709 12:12:04.193347 (+1539279us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540041a5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:04.193453 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3526209792}
I20260709 12:12:04.194525 16856 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.195149 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.195662 16856 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.195700 11287 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:04.195972 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:04.196599 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:04.199399 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:04.201627 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:04.202337 11216 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.203332 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:04.205137 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:04.208182 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.198251 16891 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.217321 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:04.214818 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:04.220098 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:04.227212 11213 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:04.227205 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:04.228332 11218 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:12:04.227128 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:04.248525 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61945.8us
I20260709 12:12:04.250092 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:04.262640 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47914.5us
W20260709 12:12:04.266928 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.025s
W20260709 12:12:04.267457 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.014s	sys 0.026s
I20260709 12:12:04.267565 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:04.268056 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 553866us
I20260709 12:12:04.274595 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.275096 16975 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:04.275704 16975 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.276094 16975 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.215946 16798 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:04.154434 16815 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.287904 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:04.306092 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.307122 11287 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:04.258620 16891 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.282400 16859 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.282519 16875 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:04.315229 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.319756 11853 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:04.306268 16842 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:04.285668 16798 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:04.338268 16950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.006s	sys 0.017s
I20260709 12:12:04.328590 16875 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:04.337013 16859 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:04.345852 16950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.006s	sys 0.018s
I20260709 12:12:04.367213 16975 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.369638 16975 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:04.369480 16974 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.371613 16974 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:04.148995 11040 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:04.412289 11040 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 13 to 14, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:12:04.420869 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.422307 11131 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.010s	sys 0.018s
W20260709 12:12:04.422945 11131 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.010s	sys 0.018s
I20260709 12:12:04.214323 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.425006 11141 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:04.427030 11211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.015s	sys 0.025s
W20260709 12:12:04.427594 11211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.015s	sys 0.025s
W20260709 12:12:04.432431 11184 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.007s	sys 0.010s
W20260709 12:12:04.433161 11184 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.007s	sys 0.010s
W20260709 12:12:04.433861 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 762388us
W20260709 12:12:04.437119 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.439472 11215 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:04.440390 11215 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:04.440963 11284 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:04.441555 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.443323 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.445925 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:04.423017 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 478358us
W20260709 12:12:04.451591 11823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.010s	sys 0.014s
W20260709 12:12:04.452052 11823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.010s	sys 0.014s
I20260709 12:12:04.453310 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:04.470290 16687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.012s	sys 0.013s
I20260709 12:12:04.480137 16814 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:04.473337 16798 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.483997 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:04.454592 16558 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.565056 16891 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:04.460847 16671 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:04.488678 16815 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.472322 16742 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:04.588224 16742 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:04.589468 16915 consensus_meta.cc:287] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.694s	user 0.012s	sys 0.000s
W20260709 12:12:04.485140 16687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.020s	sys 0.014s
I20260709 12:12:04.491410 11215 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:12:04.453353 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.592414 11285 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:04.509331 16768 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:04.594475 16882 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:04.595052 16882 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:04.595606 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.513008 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.596657 16882 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.602176 16742 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.604172 16882 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.605973 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:04.606985 16558 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.608119 16768 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.515879 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.517989 16751 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.519778 16842 raft_consensus.cc:2764] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:04.519250 16859 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.486001 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.349838 16875 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.617030 16975 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.625702 16975 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:12:04.440726 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 226349us
I20260709 12:12:04.628753 16975 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:04.465862 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:04.584863 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:04.596226 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.629626 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.610658 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:04.619125 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78243.2us
I20260709 12:12:04.623492 11290 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:04.619055 16751 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.615131 11040 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 10, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 10 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:04.549683 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:04.636621 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:04.636859 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.637362 16751 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:04.637991 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:04.638562 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.639035 16768 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:04.648357 11285 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:04.640429 11182 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2864b976ac5946a7b7a41c9a5e2f7f26. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:04.649988 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 128035us
I20260709 12:12:04.641505 11040 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 9 to 12, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.651093 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:04.652724 11040 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 11 to 12, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.641240 16304 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:04.639052 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 121964us
I20260709 12:12:04.654883 16304 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:04.655525 16304 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.643234 16751 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.646752 16742 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:04.661164 11215 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:04.664284 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.665804 16741 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:04.666502 16741 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:04.668566 16741 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:04.669966 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.670878 16768 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:12:04.673363 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.673704 11287 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:04.672962 11040 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 10 to 11, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 11 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.674876 16125 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:04.675520 16125 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.675989 16125 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:04.676753 11040 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 9 to 12, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 12 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:12:04.667441 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57105.5us
I20260709 12:12:04.679232 16742 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.679489 16815 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.679409 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:04.688992 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.610451 16558 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:04.709728 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:04.719285 16950 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.728570 11290 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:04.739675 11859 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:04.714414 16742 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.751121 11284 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:04.713131 16815 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.745919 16558 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:04.736256 11040 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 12 to 14, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 14 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:04.763880 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84749.4us
I20260709 12:12:04.736925 16950 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:04.777995 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:04.780323 16829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.013s	sys 0.014s
W20260709 12:12:04.789227 16829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.014s	sys 0.014s
I20260709 12:12:04.765930 16558 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:04.790038 16558 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.790936 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:04.791908 11141 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.795431 16687 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.796797 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:04.797124 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82606.7us
I20260709 12:12:04.797793 11290 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:04.798204 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.802788 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:04.803856 11142 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:04.807276 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:04.808514 11136 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:04.810182 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:04.810794 16848 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.811708 16848 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.814585 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:04.815801 11137 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:12:04.814584 16583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.021s	sys 0.042s
W20260709 12:12:04.817065 16583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.021s	sys 0.043s
I20260709 12:12:04.818018 16583 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:04.818631 11216 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.026s
I20260709 12:12:04.796021 16687 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.819123 11216 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:12:04.820055 16856 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.513s	user 0.002s	sys 0.015s
I20260709 12:12:04.820694 16827 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.821285 16687 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:04.821379 16827 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.823249 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:04.823707 16827 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.825207 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:04.829567 16893 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.009s
I20260709 12:12:04.831557 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:04.832733 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:04.834043 16931 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:04.836182 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.837564 16802 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.838055 16802 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:04.838460 16802 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.838140 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.850000 11141 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:12:04.771754 16950 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.852906 11040 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 13 to 14, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:04.861138 16915 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:04.861333 16304 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:04.861717 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 396223us
I20260709 12:12:04.866734 16869 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.868418 16742 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:04.869692 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.880496 11215 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:12:04.814273 16848 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.839999 16768 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:04.905141 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.897337 11215 pending_rounds.cc:85] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 8
I20260709 12:12:04.876562 16915 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.926973 16875 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.928759 16802 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.930621 16940 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.931126 16985 tablet_replica.cc:333] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:12:04.931522 16940 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.928817 11853 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:04.888893 16753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.023s	sys 0.029s
I20260709 12:12:04.941998 16741 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.942909 16815 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.944900 16741 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:04.946480 16939 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.834s	user 0.014s	sys 0.005s
W20260709 12:12:04.946542 11288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.031s	sys 0.031s
W20260709 12:12:04.947333 11288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.031s	sys 0.032s
I20260709 12:12:04.920306 16915 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:04.948094 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 63760.2us
I20260709 12:12:04.949084 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:04.953876 16917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.057s
W20260709 12:12:04.946573 11289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.018s	sys 0.044s
W20260709 12:12:04.956389 11289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.019s	sys 0.044s
I20260709 12:12:04.956637 11138 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:04.957023 11138 pending_rounds.cc:85] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:12:04.957247 11138 pending_rounds.cc:107] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:04.957491 11138 raft_consensus.cc:2889] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:04.959730  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.961272 16558 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:04.962826 16917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.012s	sys 0.057s
W20260709 12:12:04.965752 11855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.023s	sys 0.026s
I20260709 12:12:04.965381 16752 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:04.966166 11855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.024s	sys 0.026s
W20260709 12:12:04.967542 16877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.021s
W20260709 12:12:04.968019 16877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.011s	sys 0.021s
W20260709 12:12:04.970750 16753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.024s	sys 0.029s
I20260709 12:12:04.881894 16827 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.910997 16768 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.973810 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:04.930233 16875 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:04.986241 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51055.4us
I20260709 12:12:04.981921 16869 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.981693 16939 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:04.990116 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 152163us
I20260709 12:12:04.990677 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.992249 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:04.993402 16869 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:04.995111 16802 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:04.995894 16869 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:04.972817 16848 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.998862 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:04.982167 16768 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.975742 16940 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:04.910439 11215 pending_rounds.cc:107] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.9
I20260709 12:12:04.981871 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3028) took 1042 ms. Trace:
I20260709 12:12:05.007887 11215 raft_consensus.cc:2917] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Aborting config change with OpId 14.9: Aborted: Op aborted by new leader
I20260709 12:12:05.009121 11215 raft_consensus.cc:2889] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:05.015305 16975 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.016278 16975 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:04.999202 16558 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.022375 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.030979 16673 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.032128 16974 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.032938 16974 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:05.034567 16860 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.727s	user 0.014s	sys 0.008s
I20260709 12:12:05.035151 16860 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.022078 16802 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:05.039032 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62854.1us
I20260709 12:12:05.040477 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.009774 16917 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.050262 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3032) took 1030 ms. Trace:
W20260709 12:12:05.060989 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68828.7us
I20260709 12:12:05.042477 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:05.079618 11859 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:05.084134 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3367) took 1130 ms. Trace:
I20260709 12:12:05.084761 11138 rpcz_store.cc:276] 0709 12:12:03.953797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.953947 (+   150us) service_pool.cc:224] Handling call
0709 12:12:03.954253 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.957996 (+1003743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.026712 (+ 68716us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003403d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:05.084021 (+ 57309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303698176}
I20260709 12:12:05.087698 16741 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:05.088290 16741 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:05.090832 16802 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.091737 16802 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.004861 11289 rpcz_store.cc:276] 0709 12:12:03.939480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.939655 (+   175us) service_pool.cc:224] Handling call
0709 12:12:03.940003 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.978591 (+ 38588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.978629 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.987542 (+  8913us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.956965 (+969423us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:04.957025 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.957143 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.981504 (+ 24361us) raft_consensus.cc:1685] finished
0709 12:12:04.981526 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.981802 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8012,"raft.queue_time_us":42370,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2779,"thread_start_us":878441,"threads_started":1,"wal-append.queue_time_us":944640}
I20260709 12:12:05.092326 16802 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:05.093932 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 89595.7us
I20260709 12:12:05.003674 16752 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:12:05.057395 11292 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:05.097496 11853 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:05.100175 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3029) took 1160 ms. Trace:
I20260709 12:12:05.100684 11292 rpcz_store.cc:276] 0709 12:12:03.939776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.941000 (+  1224us) service_pool.cc:224] Handling call
0709 12:12:03.941254 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.098675 (+1157421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.099812 (+  1137us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400233cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:05.100073 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565735168}
I20260709 12:12:05.059828 16917 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.047472 16671 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.104499 16671 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.105656 16917 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.059288 16125 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.107524 16304 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.109148 16125 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.111258 16583 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:05.112702 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.115399 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60882 (request call id 7) took 4297 ms. Trace:
I20260709 12:12:05.115968 11215 rpcz_store.cc:276] 0709 12:12:00.817779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.817967 (+   188us) service_pool.cc:224] Handling call
0709 12:12:02.521185 (+1703218us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e3a0a 00007f982f3e3693 00007f982f3e3631 00007f9830b16902 00007f9830b166dd 00007f9830ae1f3f 00007f9830ae16b3 00007f9835aa1d29 00007f982f0201d4 00007f982f020162
0709 12:12:03.648296 (+1127111us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b58006464d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad670a 00007f9830ad776a 00007f9830ad691b 00007f9830ae203c 00007f9830ae16b3 00007f9835aa1d29 00007f982f0201d4 00007f982f020162
0709 12:12:03.750765 (+102469us) log.cc:844] Serialized 506 byte log entry
0709 12:12:05.072941 (+1322176us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":262,"spinlock_wait_cycles":2442078464,"thread_start_us":676924,"threads_started":1,"wal-append.queue_time_us":1134973}
I20260709 12:12:05.117009 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.089637 16741 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:05.016969 16845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.008s	sys 0.020s
I20260709 12:12:05.069038 11288 rpcz_store.cc:276] 0709 12:12:04.019380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.020508 (+  1128us) service_pool.cc:224] Handling call
0709 12:12:04.029057 (+  8549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:04.029429 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.029456 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:04.030136 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 12:12:04.948040 (+917904us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:04.948112 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.948199 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.049866 (+101667us) raft_consensus.cc:1685] finished
0709 12:12:05.049901 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.050148 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23958,"raft.queue_time_us":98,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4153,"thread_start_us":886325,"threads_started":1,"wal-append.queue_time_us":1005392}
W20260709 12:12:05.147348 11219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.033s	sys 0.038s
W20260709 12:12:05.143898 16888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.044s	sys 0.065s
W20260709 12:12:05.148849 16845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.009s	sys 0.020s
I20260709 12:12:05.155730 16673 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:05.152613 11285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.034s
W20260709 12:12:05.178097 11285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.013s	sys 0.034s
W20260709 12:12:05.153188 16882 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.010s
W20260709 12:12:05.180060 11219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.033s	sys 0.039s
I20260709 12:12:05.114365 16677 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:12:05.175872 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.155995 16741 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:05.189258 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.186008 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.002s	sys 0.027s
W20260709 12:12:05.195287 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.002s	sys 0.027s
W20260709 12:12:05.195672 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 907784us
W20260709 12:12:05.197223 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 80457.9us
I20260709 12:12:05.206254 16677 consensus_queue.cc:1243] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:12:05.207120 17002 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 12:12:05.178380 16848 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:05.208652 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.186054 16802 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:05.222724 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 180373us
I20260709 12:12:05.212328 16975 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.215410 16882 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:05.216071 16848 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:05.231349 16848 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:05.234639 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.218276 16888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.044s	sys 0.065s
I20260709 12:12:05.208235 16950 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.229116 16882 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:05.248768 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2622) took 1069 ms. Trace:
I20260709 12:12:05.225119 16915 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.239360 16974 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:05.242004 16859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.021s	sys 0.024s
I20260709 12:12:05.251873 11219 rpcz_store.cc:276] 0709 12:12:04.174322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.174474 (+   152us) service_pool.cc:224] Handling call
0709 12:12:04.174819 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.175068 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.175097 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.175590 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:12:05.228688 (+1053098us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:05.237008 (+  8320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.237081 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.239155 (+  2074us) raft_consensus.cc:1685] finished
0709 12:12:05.239176 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.243877 (+  4701us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1004708,"threads_started":1,"wal-append.queue_time_us":1013620}
I20260709 12:12:05.261590 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.264178 17005 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:05.265286 16827 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.265735 16827 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.266114 16827 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:05.267165 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 2864b976ac5946a7b7a41c9a5e2f7f26: Aborted: Op aborted by new leader
I20260709 12:12:05.239806 16673 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:12:05.273365 16915 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.275307 16882 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.261772 16802 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:12:05.261456 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.007s	sys 0.028s
W20260709 12:12:05.282707 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.008s	sys 0.028s
I20260709 12:12:05.283389 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:05.261343 16859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.021s	sys 0.024s
W20260709 12:12:05.291116 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 493034us
W20260709 12:12:05.292297 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 255c201215d14e89bc735bb8b57682cb: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:05.287818 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1205) took 1446 ms. Trace:
W20260709 12:12:05.282649 16862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.016s	sys 0.029s
I20260709 12:12:05.299654 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:05.302945 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.311383 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:05.316838 11138 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:05.311479 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 216435us
I20260709 12:12:05.315369 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.278264 16827 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:05.313431 16862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.017s	sys 0.029s
I20260709 12:12:05.323001 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.332064 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.314893 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.325191 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.332908 11292 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:05.314904 16752 consensus_queue.cc:1243] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:12:05.334882 11287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.015s
W20260709 12:12:05.339098 11287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.015s
I20260709 12:12:05.294749 11855 rpcz_store.cc:276] 0709 12:12:03.817418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.817622 (+   204us) service_pool.cc:224] Handling call
0709 12:12:03.847263 (+ 29641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.847673 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.847706 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.848223 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.966815 (+1118592us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:05.241798 (+274983us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.247907 (+  6109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.258845 (+ 10938us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.258916 (+    71us) raft_consensus.cc:1685] finished
0709 12:12:05.258935 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.263332 (+  4397us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45435,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7180,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":33702,"thread_start_us":1392350,"threads_started":2,"wal-append.queue_time_us":1212898}
I20260709 12:12:05.337764 11137 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:05.334824 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.311424 16915 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:05.341694 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.338730 11142 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:12:05.323935 16845 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.348896 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.344825 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.353494 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.356935 16860 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.358979 11289 raft_consensus.cc:2410] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:05.356658 16915 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.359895 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:05.361550 16915 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.362782 16875 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.363190 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.363519 16875 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.366777 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.367331 16869 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.367844 16869 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.368943 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.369328 16671 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:05.369665 16845 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.370651 16859 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:05.371037 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:05.371269 16859 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:05.371654 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.372435 16859 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.374255 11286 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:05.374708 11857 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 9.
I20260709 12:12:05.370688 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:05.353338 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:05.380605 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 117784us
I20260709 12:12:05.335184 17005 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.383888 11138 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:05.385409 16915 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.385504 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.386132 16677 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.386260 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:05.369177 17006 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.392900 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:05.395530 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:05.401903 17005 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.404984 17005 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.405763 11139 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
W20260709 12:12:05.410007 17004 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:12:05.411592 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80711.2us
I20260709 12:12:05.411993 16992 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:05.412459 16992 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:05.387246 16875 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.397668 16752 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:05.389814 16768 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.415076 16752 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:05.414925 17006 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.415727 16845 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.416145 16752 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.370153 16869 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.414284 17012 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:05.423274 11853 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.423589 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3040) took 1323 ms. Trace:
I20260709 12:12:05.412245 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.423409 11293 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
W20260709 12:12:05.430389 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96000.4us
I20260709 12:12:05.417735 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.432320 16802 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:05.432780 16974 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.428093 11286 rpcz_store.cc:276] 0709 12:12:04.099914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.102161 (+  2247us) service_pool.cc:224] Handling call
0709 12:12:04.102525 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.374734 (+1272209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.396432 (+ 21698us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540017e8d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:05.423492 (+ 27060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923755264}
I20260709 12:12:05.435083 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.435330 11142 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.427115 16950 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.436035 11138 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:05.390045 16915 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.440441 16981 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:05.433813 16974 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.417104 16768 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.417218 17006 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.448848 17018 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.449544 17018 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.450798 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.451510 11139 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:05.452003 17018 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.446262 16558 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.456436 16827 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:05.457629 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.458128 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.413570 16992 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.441907 16915 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.437371 16860 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:05.453354 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:05.461023 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:05.466167 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51877.4us
I20260709 12:12:05.443042 17005 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.470095 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 83989.8us
I20260709 12:12:05.464557 16975 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.471882 16975 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.473279 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:05.452730 16950 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.456391 16558 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:05.463793 11137 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:05.446826 16981 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:05.475208 11859 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:05.457239 16751 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.474181 16845 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.497705 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:05.474218 16827 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.502081 11139 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:05.505743 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.483659 16950 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.509625 16981 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.511401 16950 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.512079 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:05.513962 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.478957 16829 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.514634 11860 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:05.514676 16558 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:05.515167 16829 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.516438 16583 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:05.516870 16583 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:05.517534 16829 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.478536 16882 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:05.519307 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46134.1us
I20260709 12:12:05.517813 16583 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.521564 11142 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:05.477501 16862 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:05.530725 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141091us
I20260709 12:12:05.539912 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.540940 11142 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:05.542632 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:05.480731 16860 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.550107 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.545197 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:05.551115 11256 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.498582 17005 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.564651 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:05.567683 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.569648 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:05.572810 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.572921 11138 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:12:05.573843 17027 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.574290 17027 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.574817 17027 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.578980 11135 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:05.574332 16583 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.529546 16751 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.542680 16829 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.581830 11825 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:05.586653 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.534673 16845 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.588851 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.567726 16992 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.597587 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.604238 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.604889 11853 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:05.599319 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.536967 16862 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.567473 16304 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:05.605741 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.585515 16827 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.613197 11136 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:05.610828 16859 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.615573 11138 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:05.615873 16751 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.600096 16815 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.616458 16815 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.616976 16815 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.623224 16823 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:05.623687 16823 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.624037 16823 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:05.624936 16815 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.616420 16751 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.627396 16751 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.630036 16751 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.631098 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:05.633292 17016 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.634855 16848 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.635409 16848 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:05.636469 16848 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.639065 17027 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.643254 17027 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.647826 16815 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.649448 16827 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:05.650473 16827 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.598709 17006 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:05.653293 17006 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:05.653599 17028 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:12:05.653672 17006 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:05.660648 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.667523 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:05.668397 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 124952us
I20260709 12:12:05.669997 11142 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:12:05.672273 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:05.673298 11142 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.603154 16950 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:05.670251 11826 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.278s (SENT)
I20260709 12:12:05.606706 16304 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.681180 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:05.681775 11293 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.685540 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.687608 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.687846 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:05.688321 11286 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.670563 16673 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.607191 16829 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.692190 11284 raft_consensus.cc:2410] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:05.676630 16950 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:05.691075 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 110885us
I20260709 12:12:05.682368 16304 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.675643 16975 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.723001 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:05.725601 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91398us
W20260709 12:12:05.728276 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 114980us
I20260709 12:12:05.728806 17017 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:05.733829 16671 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.735337 17005 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.736783 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.737643 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.738322 11138 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:05.686094 17012 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.747016 11293 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:05.748762 11140 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
W20260709 12:12:05.730314 11826 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.291s (SENT) [suppressed 19 similar messages]
I20260709 12:12:05.710191 16950 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.744122 16859 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:05.754607 17020 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:12:05.747105 16752 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.756989 16802 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:05.759894 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.760304 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:05.709263 16815 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.762152 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.787941 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.741822 17002 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:12:05.772931 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.753073 17005 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:05.799439 11142 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:05.786199 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:05.720474 16869 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.763588 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:05.773639 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 209124us
I20260709 12:12:05.803920 11284 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:05.805783 11138 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:05.770695 16917 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.710922 16673 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.784195 16752 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:05.802963 17005 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.820179 11139 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
W20260709 12:12:05.825300 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76649us
I20260709 12:12:05.825519 11853 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:12:05.815047 17005 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.825914 11853 pending_rounds.cc:85] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 11
I20260709 12:12:05.831532 11853 pending_rounds.cc:107] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:05.815057 16860 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.821455 16877 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.832150 11256 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:05.834290 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.834095 16752 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.831920 17034 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.848865 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:05.849710 11219 raft_consensus.cc:606] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.823052 16815 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.814459 16888 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:12:05.852962 16815 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.828955 17033 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.842586 16859 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.853814 17006 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.855274 16862 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.823350 16917 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.826728 16975 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.856526 16975 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.857908 16917 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.845029 16752 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.858672 16845 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:05.861606 17006 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:05.862295 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.831828 11853 raft_consensus.cc:2889] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:05.809695 16869 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.835820 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:05.865417 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45829.5us
I20260709 12:12:05.812748 16823 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.876581 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.877609 11860 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:05.877914 11288 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 10: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:05.878931 16888 consensus_queue.cc:1243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:05.879554 16888 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:05.879891 16888 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:05.890934 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 160661us
I20260709 12:12:05.853991 17033 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.897498 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
W20260709 12:12:05.898931 17041 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:05.880962 16888 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.900907 16888 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.901742 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:05.902798 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:05.903457 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:05.901937 11217 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:05.902931 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:05.904071 11217 pending_rounds.cc:85] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 8
I20260709 12:12:05.890798 17032 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:05.904769 11217 pending_rounds.cc:107] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:05.905128 11217 raft_consensus.cc:2889] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:05.905180 17032 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:05.902936 11210 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:05.903923 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74386.4us
I20260709 12:12:05.907122 16823 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.907771 11218 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:05.908710 16869 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:05.911146 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 81589.7us
I20260709 12:12:05.911322 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.912009 17012 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.912132 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:05.912513 17012 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.912884 17012 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.903620 11853 raft_consensus.cc:2368] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:12:05.902479 11211 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.903648 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:05.918293 11286 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:05.920245 11216 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:05.891865 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.918962 16917 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:05.906384 17032 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.923262 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.923125 16917 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.923429 17017 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:05.924365 17017 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:05.924743 17017 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:05.925009 16829 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.922602 16768 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.923985 11858 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:05.847610 17034 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:05.931658 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:05.935504 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43666.9us
I20260709 12:12:05.936021 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.922374 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:05.939424 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:05.925503 16917 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:05.940059 11218 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:05.942226 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.940500 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.944398 11286 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:05.945818 11854 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:05.944998 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.932230 16815 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.950650 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.957094 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:05.957648 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:05.942741 16860 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.938704 16975 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:05.943354 16869 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:05.946384 16829 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:05.960187 11858 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:05.932828 16823 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:12:05.961704 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.971670 11219 raft_consensus.cc:606] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:05.972270 11219 raft_consensus.cc:614] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.972514 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:05.973245 11853 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:05.955247 16917 raft_consensus.cc:2764] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:05.971606 11854 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:05.975705 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:05.978641 17037 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:05.979277 17037 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:05.980286 17037 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.985998 11211 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:12:05.959647 16860 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.925524 17017 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.949321 16802 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:12:05.961467 16869 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.989224 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:05.969305 16829 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.982597 17042 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.992640 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:05.999497 11137 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:05.994390 11213 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:12:05.994520 16869 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.975929 16815 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:05.995383 16845 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.011938 16845 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:05.997098 16768 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:06.015094 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.001533 11218 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:05.967125 16848 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.017922 16815 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:06.018090 16848 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.020602 11212 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:06.020982 16848 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:06.021348 11137 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:12:06.022424 17034 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:06.023597 17009 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.756s	user 0.002s	sys 0.004s
I20260709 12:12:06.025127 17033 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:06.002342 11217 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:06.027984 11211 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:06.002684 17042 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.031616 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.033125 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:05.993150 17006 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:06.046799 11825 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:05.994154 16915 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.007s
I20260709 12:12:05.990747 16860 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.972755 16975 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:12:06.004261 16829 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.060642 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1212) took 1773 ms. Trace:
W20260709 12:12:06.054744 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 163931us
I20260709 12:12:06.057905 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:06.064313 11137 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:06.048024 17033 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:06.046029 17042 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.048775 17034 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:06.067749 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.064378 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:06.070007 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.072147 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:06.058601 16975 consensus_queue.cc:1243] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:12:06.061203 11285 rpcz_store.cc:276] 0709 12:12:04.287360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.649255 (+361895us) service_pool.cc:224] Handling call
0709 12:12:04.650099 (+   844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.650862 (+   763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.650911 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.651511 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:12:05.178866 (+527355us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:05.178940 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.179069 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.001474 (+822405us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:06.055210 (+ 53736us) raft_consensus.cc:1685] finished
0709 12:12:06.055232 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.060547 (+  5315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3887,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":161,"spinlock_wait_cycles":36267392,"thread_start_us":526709,"threads_started":1,"wal-append.queue_time_us":615486}
I20260709 12:12:06.074930 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.073591 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.088297 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:06.063760 16304 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.089646 11218 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:06.069846 17034 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.090193 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.069605 17033 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:06.095652 17026 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:06.096580 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.090085 17017 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.055559 16915 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.111862 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.116583 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.148175 11218 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.117699 16974 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:06.119038 16304 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:06.119588 16802 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:06.121490 16992 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
W20260709 12:12:06.122402 17051 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:06.122440 11211 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 19. Ops: []
I20260709 12:12:06.125797 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.088212 17027 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:06.079182 16981 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.088533 17005 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:06.176934 17039 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.182s	user 0.000s	sys 0.004s
I20260709 12:12:06.177804 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.107160 16845 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:06.156798 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74091.5us
I20260709 12:12:06.179296 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.180114 11219 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:06.174439 16981 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.181010 16981 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.181327 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.158412 16751 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:06.182780 16974 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:06.182866 16751 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.183512 16974 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.185328 16751 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:06.185719 16974 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:06.162070 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:06.186985 11860 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:12:06.156886 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.187618 16829 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.188833 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.189708 16829 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:06.140231 17034 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.190008 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.179543 11107 leader_election.cc:400] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
W20260709 12:12:06.180060 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.191063 17047 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:12:06.177848 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:06.192404 11291 raft_consensus.cc:2410] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:06.191073 11107 leader_election.cc:403] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:06.192750 11285 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.193444 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:06.194814 16827 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:12:06.195554 16827 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:06.195919 16827 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.196259 16827 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.169785 17027 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.198827 16815 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:06.201745 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:06.204098 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.205470 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.202886 16950 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.192466 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.206640 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:06.207324 11286 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:06.207381 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.207702 16950 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:06.203497 16859 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:06.208597 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.208751 16985 raft_consensus.cc:2243] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:06.209383 16859 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:06.209697 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.209803 16985 raft_consensus.cc:2272] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:06.210335 16859 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:06.205531 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:06.211190 11210 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:06.212332 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.213550 11293 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:06.146875 17033 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:06.217720 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 153678us
I20260709 12:12:06.220498 11218 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:06.212911 11212 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:12:06.230674 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.215332 11214 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:06.198951 17027 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.225456 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.246403 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.253633 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.255019 11288 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:06.174008 17026 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:12:06.257727 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 298794us
I20260709 12:12:06.222635 16829 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.240160 16827 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.217135 16859 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.265026 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:06.273782 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.276772 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.278900 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:06.280915 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.281047 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.282449 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.212037 17012 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.290854 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.292651 11210 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:06.293816 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.291617 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.298065 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.301064 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.303476 17064 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:06.304397 17064 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:06.294533 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.274199 16859 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:06.309171 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:06.310165 11139 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:06.279784 16974 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.313161 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.313730 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.323150 16827 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:06.324048 17026 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.324576 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.325626 11219 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:06.305802 17064 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.329524 16860 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.330837 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.331166 16915 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:06.332010 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.333123 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.315076 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.315793 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.336408 11286 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:06.316063 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.257262 17042 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.317174 11217 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.288316 16992 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.345629 11284 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:06.345789 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96062.8us
I20260709 12:12:06.323252 16974 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:06.319898 11212 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:06.347972 11218 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:06.310680 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 116350us
W20260709 12:12:06.351876 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 105441us
I20260709 12:12:06.355994 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.358078 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:06.360847 11210 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:06.360950 11285 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.361193 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:06.363461 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:06.366853 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.366950 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.367830 11214 raft_consensus.cc:2410] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:12:06.367264 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.364281 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
W20260709 12:12:06.368605 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74198.5us
I20260709 12:12:06.369814 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.372017 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:06.376175 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.381395 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.388517 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.389439 11285 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:06.362298 16974 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.395900 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.397930 16869 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.397965 11214 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.393914 11139 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:12:06.403993 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:06.405427 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.406374 11210 raft_consensus.cc:2410] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:06.416751 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.437186 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.437994 11210 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:12:06.437999 11212 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:06.444945 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:06.411587 16888 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.001s
W20260709 12:12:06.458639 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 77309.7us
I20260709 12:12:06.464922 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:06.460585 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 90902.8us
I20260709 12:12:06.468096 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.468741 11219 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.469213 11216 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:12:06.469565 11216 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 10
I20260709 12:12:06.469764 11216 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:12:06.470000 11216 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.466661 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:06.483201 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.531570 11212 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:06.552891 11287 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:06.573441 16992 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:06.575752 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.488445 16985 ts_tablet_manager.cc:1916] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:06.550704 16869 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:06.517755 16950 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:06.565620 17028 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:06.484745 16862 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:06.484826 16917 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:06.606937 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.607180 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.611644 11218 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:06.507426 17034 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.634632 11210 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:06.641031 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:06.649346 11213 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:06.595954 17069 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.665735 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:06.667551 17071 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:12:06.665423 16741 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:12:06.672114 17061 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:12:06.635119 17012 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:06.675257 16877 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.000s
I20260709 12:12:06.631739 16862 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:06.676899 17034 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:06.684535 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.745708 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.688851 11139 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:06.695571 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.665138 17067 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.646303 17042 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:06.646100 16950 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:06.702543 16981 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.001s
I20260709 12:12:06.656090 17082 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:06.587067 16992 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:06.704869 17060 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:12:06.705124 11286 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.702174 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:06.707238 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.865787 11210 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.636049 16860 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:06.694185 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:06.810035 17086 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:06.813711 17042 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:06.738680 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.720603 16875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.007s
I20260709 12:12:06.751132 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:06.782995 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:06.784624 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:06.882241 11213 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:06.785702 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:06.882809 11287 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.736501 17069 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:06.754334 17067 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.749109 16877 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.750041 16862 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:06.810566 11212 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:06.814471 11211 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:06.896941 17066 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:06.900069 11136 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.816985 11139 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 9. Current term is 10. Ops: []
W20260709 12:12:06.825160 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.811250 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 344711us
W20260709 12:12:06.849644 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 160672us
I20260709 12:12:06.856308 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:06.902964 11138 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16.
W20260709 12:12:06.714907 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52937.9us
I20260709 12:12:06.905095 11185 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:06.667573 17059 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:06.874833 16673 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:06.906682 17059 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:06.907091 17059 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:06.907579 16677 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.820420 16981 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.911290 16981 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:06.876612 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 182487us
W20260709 12:12:06.883154 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 132118us
I20260709 12:12:06.917711 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:06.883332 17042 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:06.879959 16875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.008s
W20260709 12:12:06.919721 17033 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.653s	user 0.002s	sys 0.009s
I20260709 12:12:06.920159 17033 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:06.923127 17087 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:12:06.923820 11137 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:06.923859 11854 raft_consensus.cc:606] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:06.924481 11854 raft_consensus.cc:614] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:06.924980 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:06.709134 17070 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:12:06.899997 17066 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:06.931952 11287 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:06.939096 11857 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:06.872635 17086 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:06.915095 16848 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:06.944947 11219 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:06.879498 17082 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:06.883977 17037 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.971752 11215 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.972105 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:06.983667 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:06.983538 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:06.974915 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68470.5us
W20260709 12:12:06.984936 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.985697 11138 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 12:12:06.987699 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71531.7us
I20260709 12:12:06.988507 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:06.898424 17067 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.992165 17082 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.993312 17086 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:06.994571 17037 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:06.994791 16848 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.995218 17037 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.894459 17069 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.997160 11853 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:07.000113 11185 leader_election.cc:400] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:07.000487 11185 leader_election.cc:403] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:07.001233 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.001588 17079 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:07.002100 17016 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:07.002810 17016 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.004848 17055 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:07.006837 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:07.011264 17027 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.000s
I20260709 12:12:07.011767 17027 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:06.995168 17017 consensus_meta.cc:287] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.000s
I20260709 12:12:07.012564 17042 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.012723 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:07.013187 11859 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:07.014187 11218 raft_consensus.cc:2410] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:07.015326 16950 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.016865 17079 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:07.015214 17075 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:07.017474 17079 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.994598 17086 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.019860 11861 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:07.021698 17066 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.015666 17059 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.026532 16877 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:07.027240 17059 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.016360 16950 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:06.982968 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.037418 11210 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:07.041049 11142 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:12:07.017831 17075 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:06.986065 11138 pending_rounds.cc:85] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
W20260709 12:12:07.041739 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.042207 11138 pending_rounds.cc:107] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:12:07.042718 11138 raft_consensus.cc:2889] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.044456 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.050917 11184 leader_election.cc:400] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16.
I20260709 12:12:07.051291 11184 leader_election.cc:403] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:07.041543 11142 pending_rounds.cc:85] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 6
I20260709 12:12:07.053427 11142 pending_rounds.cc:107] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:12:07.053696 11142 raft_consensus.cc:2889] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.942310 17033 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.057363 11858 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:07.014130 17027 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:07.061679 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:07.062645 11853 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:06.997219 16848 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.064684 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:07.051453 17090 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:12:07.046986 16859 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.004s
I20260709 12:12:07.074280 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:07.046728 17042 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.080931 11137 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
W20260709 12:12:07.082680 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 380568us
I20260709 12:12:07.056511 16741 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16.
I20260709 12:12:07.086737 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.087643 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.059228 16677 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.086447 11137 pending_rounds.cc:85] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 10
I20260709 12:12:07.108752 11137 pending_rounds.cc:107] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:07.114183 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.114513 11137 raft_consensus.cc:2889] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:07.115938 17078 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:12:07.116592 16677 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.118041 17079 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.115834 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.118954 11138 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:07.115978 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.120822 11852 raft_consensus.cc:2410] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:07.052136 17055 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:12:07.052407 17026 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:12:07.072881 16848 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.146533 16848 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.149597 16848 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.046922 17012 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:12:07.086755 17033 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:07.135250 16677 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.107362 17093 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:07.153301 11858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
W20260709 12:12:07.126624 17081 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:12:07.107134 11140 raft_consensus.cc:2376] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15. Re-sending same reply.
I20260709 12:12:07.165223 11858 raft_consensus.cc:606] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:07.061592 16950 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:07.177215 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 266703us
I20260709 12:12:07.181586 11138 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:07.191298 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.192135 11137 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:07.195420 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:07.198294 11139 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.168901 17079 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:07.201957 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87900.4us
I20260709 12:12:07.202796 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.113662 16859 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:07.177731 17093 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:07.189494 16848 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.185025 17055 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:07.167376 17033 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.227368 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 921) took 1170 ms. Trace:
I20260709 12:12:07.229645 11289 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:12:07.227896 11217 rpcz_store.cc:276] 0709 12:12:06.057062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.063565 (+  6503us) service_pool.cc:224] Handling call
0709 12:12:06.065578 (+  2013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.343999 (+278421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.227018 (+883019us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54003c50d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:07.227285 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578071424}
I20260709 12:12:07.208105 16815 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.232362 11288 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:07.232877 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3056) took 1058 ms. Trace:
I20260709 12:12:07.232803 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.181124 16741 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:12:07.240599 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.250058 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.237170 11290 rpcz_store.cc:276] 0709 12:12:06.174834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.175019 (+   185us) service_pool.cc:224] Handling call
0709 12:12:06.175380 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.215523 (+ 40143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.215552 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.266364 (+ 50812us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.479728 (+213364us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:06.479777 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.479848 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.232654 (+752806us) raft_consensus.cc:1685] finished
0709 12:12:07.232682 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.232816 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7571,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":13625,"thread_start_us":134379,"threads_started":1,"wal-append.queue_time_us":438050}
I20260709 12:12:07.224339 17059 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:12:07.245688 16802 consensus_meta.cc:287] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.081s	user 0.009s	sys 0.004s
I20260709 12:12:07.260095 11861 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.246090 17027 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:12:07.262964 17075 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.264405 16950 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.265533 17106 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:12:07.262295 17076 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
I20260709 12:12:07.266304 17106 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.262333 16802 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.269374 17106 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.231675 17055 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.272805 17055 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.229279 17037 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.275563 17037 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.275667 17105 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.277248 17105 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.250919 17079 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.283867 16875 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.284670 16875 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.295055 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2640) took 1334 ms. Trace:
I20260709 12:12:07.295608 11216 rpcz_store.cc:276] 0709 12:12:05.960209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.969627 (+  9418us) service_pool.cc:224] Handling call
0709 12:12:05.983072 (+ 13445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.479060 (+495988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.294728 (+815668us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002f53d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:07.294979 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108074880}
W20260709 12:12:07.304543 17091 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
W20260709 12:12:07.306833 17063 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.013s	user 0.007s	sys 0.004s
I20260709 12:12:07.316045 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.318188 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:07.318917 11216 raft_consensus.cc:606] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:07.320662 16917 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:07.321214 16917 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.321636  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:12:07.322162 16974 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.000s
W20260709 12:12:07.323773 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 25bbe9f3cd6e42aca82fdba9812b235c: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:07.325527 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.326365 17059 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.328337 17069 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.328684 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.329644 11292 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.330665 17066 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.331430 17066 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.328719 17105 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.335968 16875 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.336303 17033 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:07.339450 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet ddd0a7b2bb3645519f8c5c9bf85633d9: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:07.340301 11136 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:07.340097 17067 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:07.343317 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.344014 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.343824 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.365317 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:07.362382 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 333629us
W20260709 12:12:07.368804 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 128307us
I20260709 12:12:07.372637 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.375350 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.381031 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.381855 11290 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:07.378324 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:07.384964 11138 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:07.385370 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.364033 17067 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.393514 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:07.388499 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:07.408329 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77923.5us
I20260709 12:12:07.411124 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.364715 16848 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:07.364701 17075 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.413156 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.375679 17055 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.375473 16950 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:07.435842 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.417212 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.416769 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.415259 11219 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:07.417900 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:07.451368 11214 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:07.259500 17095 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.128s
I20260709 12:12:07.418172 11213 pending_rounds.cc:85] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 8
I20260709 12:12:07.451992 11213 pending_rounds.cc:107] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:07.452355 11213 raft_consensus.cc:2889] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.416648 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.451181 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:07.454294 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:07.455106 11216 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.409634 17079 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:07.386086 16875 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.459936 11289 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:07.420148 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.466868 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.372102 17064 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.472532 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.470505 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:07.365317 16974 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.476528 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.480180 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.482393 16741 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.483099 16741 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.447973 17106 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:07.489702 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.417424 17105 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.494320 11217 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:12:07.413496 16673 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:12:07.504310 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.482259 17012 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:07.460417 17026 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:07.499661 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.545452 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1220) took 1593 ms. Trace:
I20260709 12:12:07.500264 17109 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.501946 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.545955 11284 rpcz_store.cc:276] 0709 12:12:05.951862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.952149 (+   287us) service_pool.cc:224] Handling call
0709 12:12:05.959707 (+  7558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.346071 (+386364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.545187 (+1199116us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540017f7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:07.545388 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887117056}
I20260709 12:12:07.384651 17070 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 12:12:07.506197 11285 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.519745 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.478734 17037 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.523229 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.505508 16815 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.460346 17055 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.551774 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:07.552621 11284 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.553592 17055 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:07.458899 16848 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.556547 16848 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.448627 17075 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.415273 17093 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.558807 17075 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:07.547320 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45474.1us
I20260709 12:12:07.559806 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.561672 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.563138 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.566980 17042 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:07.567901 17042 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.568527 17042 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.568742 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.568998 17042 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.534504 17105 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.570833 17079 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:07.571934 17105 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.572064 17042 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:07.573230 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.457896 17033 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:12:07.527639 16950 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:07.574252 17033 consensus_queue.cc:1243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:07.574437 16950 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.571978 17079 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:07.576685 16950 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.578606 16827 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.579362 16768 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:07.579871 16768 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:07.580132 11291 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:07.579526 17026 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.581175 17109 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.583710 17017 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:07.584024 17109 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.584975 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.587903 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.589807 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.595005 11144 raft_consensus.cc:2393] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:07.590755 11861 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:07.600803 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.606159 11142 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:07.486863 17064 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.579392 16827 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.602901 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.611485 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.612972 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.525034 16985 ts_tablet_manager.cc:1929] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
W20260709 12:12:07.604126 17099 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.601s	user 0.002s	sys 0.000s
I20260709 12:12:07.601536 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:07.615587 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
W20260709 12:12:07.626657 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 103938us
I20260709 12:12:07.630887 17113 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:07.607039 11216 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:07.633786 17113 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:07.608647 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.603394 17107 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:07.639461 17107 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.640352 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.572064 17082 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.641812 11142 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:07.649674 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:07.584127 17017 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:07.642443 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:07.653048 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.654224 11144 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:07.652278 11138 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:07.655361 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:07.612150 16848 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:07.528151 17106 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.638048 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.657518 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.665591 11219 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:07.659297 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:07.666867 11142 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:07.667094 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:07.667925 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:07.652506 16862 consensus_meta.cc:287] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.707s	user 0.014s	sys 0.000s
I20260709 12:12:07.610780 16815 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.686203 11289 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:07.674165 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.008s	sys 0.004s
I20260709 12:12:07.658428 16985 log.cc:1199] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/1b238aa9f5b8450ca03fed7b6a294cf3
W20260709 12:12:07.688565 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.009s	sys 0.004s
W20260709 12:12:07.689049 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 628987us
I20260709 12:12:07.677464 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.695040 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:07.668681 11142 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.661191 16848 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:07.644445 17012 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.666793 17066 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.663679 17110 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:07.693011 16845 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.726614 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.730312 17012 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.715874 17017 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.685940 17055 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:07.687783 17090 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:07.716174 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.739418 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.743412 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.716502 17082 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:07.725886 17113 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:07.684577 16862 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.749939 11144 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 10: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:07.733930 17006 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:07.738806 16304 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.817373 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.818747 11216 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:07.819199 11284 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:07.741775 17110 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.821179 11142 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:07.727392 17068 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:12:07.750339 17082 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.751936 17113 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:07.751583 17055 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:07.814158 16304 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:07.822131 16917 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.004s
I20260709 12:12:07.837139 11291 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:07.816507 17017 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:07.782987 17066 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:07.829849 17114 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:07.830137 17107 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:07.846843 11856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.020s	sys 0.014s
I20260709 12:12:07.849784 16304 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.834995 16974 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:07.837620 17108 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:07.855053 11856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.021s	sys 0.014s
I20260709 12:12:07.752605 16845 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.840189 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:07.853662 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.890504 11216 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:12:07.891902 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:07.892680 11216 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.833709 17006 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:07.843432 17082 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:07.885779 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 238101us
W20260709 12:12:07.850664 17089 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.962s	user 0.003s	sys 0.002s
W20260709 12:12:07.886627 17111 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:12:07.839206 17110 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:07.898614 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:07.907976 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:07.828269 16848 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.852968 16917 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.897365 17114 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.901909 17064 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.858342 17066 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:07.915984 11852 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:07.909451 17095 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:07.929212 11216 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:07.932752 11858 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:07.945842 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:07.946719 11216 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:07.893771 17108 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:07.946424 17115 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:12:07.932150 16848 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.930452 17095 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:07.933122 17131 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.948922 16815 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:07.929347 17114 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.909554 17113 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:07.959074 16974 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:12:07.993188 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.928326 17055 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:08.006253 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.971009 17123 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.009969 11290 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:08.003001 17119 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:12:08.013028 16985 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39166 (request call id 1) took 4233 ms. Trace:
W20260709 12:12:08.014410 17130 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:08.013530 16985 rpcz_store.cc:276] 0709 12:12:03.751198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.751557 (+   359us) service_pool.cc:224] Handling call
0709 12:12:04.930368 (+1178811us) ts_tablet_manager.cc:1151] Deleting tablet 1b238aa9f5b8450ca03fed7b6a294cf3
0709 12:12:04.930529 (+   161us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:12:07.174250 (+2243721us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:07.504040 (+329790us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:07.984719 (+480679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1202664,"tablet-delete.queue_time_us":1177612,"thread_start_us":670516,"threads_started":1}
I20260709 12:12:07.979331 16862 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.019793 17123 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.010743 17131 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:12:08.022992 17131 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:08.023416 17131 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:08.024102 17123 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:08.024497 17121 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:12:08.024973 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:08.025409 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.026512 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:08.026719 11213 pending_rounds.cc:85] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 8
I20260709 12:12:08.027220 11213 pending_rounds.cc:107] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:08.027522 11213 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.027722 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:08.028406 11141 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:08.022220 17117 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
I20260709 12:12:08.026754 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:08.027523 17129 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:08.033242 17124 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:12:08.009258 16974 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.036191 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.036854 16974 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.037525 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.038282 11140 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:08.038702 17128 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:08.039187 17066 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.024503 17131 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.039321 17128 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:08.041185 17118 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260709 12:12:08.041873 17128 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:07.964171 17006 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:08.046123 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.045851 17131 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:08.046535 17135 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:12:08.061975 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53752.5us
I20260709 12:12:08.060022 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:08.032238 17034 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:08.063926 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.072490 17012 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:08.080094 11211 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:08.064653 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:08.087164 11211 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:08.074393 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:08.051599 16815 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:08.101588 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 143295us
I20260709 12:12:08.094049 11290 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:08.108157 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.047219 17123 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:12:08.112649 11211 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.084667 16992 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:08.113206 17134 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:12:08.113562 16877 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.131511 11211 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.135378 16917 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.136032 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.114275 16673 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:08.137398 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.138029 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.126158 16815 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.149081 17108 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.151005 16815 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.151886 17082 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.152412 17084 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:08.152998 11144 raft_consensus.cc:2410] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 12:12:08.153877 17133 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:12:08.154136 17082 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.132042 16992 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:08.154843 16992 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.137629 16974 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:08.144213 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.086635 17113 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.127748 16862 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.152917 17084 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:08.090638 17034 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.155963 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.142158 17114 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.095005 17012 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.115301 16671 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:12:08.162570 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57446.6us
I20260709 12:12:08.175604 11184 leader_election.cc:400] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:08.176110 11211 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:08.171976 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.148813 11141 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:08.165884 11290 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:08.166154 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71295.7us
I20260709 12:12:08.183784 11211 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 12:12:08.183692 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.185037 11141 raft_consensus.cc:2410] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:12:08.186254 11290 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:08.186883 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:08.143589 16877 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.168092 17084 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.176121 17093 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.192772 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.197611 11211 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:08.065145 17079 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:12:08.191102 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:08.190095 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.202562 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:08.161280 16974 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.204541 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.195338 17082 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.208683 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.211052 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:08.175693 17123 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:08.213858 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:08.198262 17147 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:08.218189 17146 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:08.222540 17146 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.222904 17146 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:08.226660 17093 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:08.203742 17090 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:08.199218 17141 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:08.206368 17148 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.233368 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:08.210088 16862 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.209657 17055 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.199393 17149 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:12:08.214771 16917 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.218798 16823 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:08.228011 17012 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.219367 17147 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.246083 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2236) took 1661 ms. Trace:
I20260709 12:12:08.251765 11218 rpcz_store.cc:276] 0709 12:12:06.583650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.640342 (+ 56692us) service_pool.cc:224] Handling call
0709 12:12:08.244814 (+1604472us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54003c46d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:08.244969 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671047424}
W20260709 12:12:08.253417 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49057.5us
I20260709 12:12:08.245548 17093 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:08.237746 16862 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:08.253512 17147 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:08.256794 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:08.270750 16877 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.270903 17146 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:08.273460 17146 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:08.277307 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.280617 11138 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:08.282166 11138 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:12:08.270758 17143 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
W20260709 12:12:08.283165 11859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 764) took 1925 ms (client timeout 2062 ms). Trace:
I20260709 12:12:08.284138 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2268) took 1925 ms. Trace:
I20260709 12:12:08.322789 11286 rpcz_store.cc:276] 0709 12:12:06.358504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.407103 (+ 48599us) service_pool.cc:224] Handling call
0709 12:12:06.436474 (+ 29371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.865351 (+428877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.283857 (+1418506us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400061dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:08.284067 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617392512}
I20260709 12:12:08.294049 16974 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.295084 17034 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.252490 17148 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:12:08.253082 16823 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:08.305157 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48622.4us
I20260709 12:12:08.341320 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.317237 11290 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:08.318228 11859 rpcz_store.cc:269] 0709 12:12:06.357499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.357689 (+   190us) service_pool.cc:224] Handling call
0709 12:12:08.282900 (+1925211us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54002cfe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:08.283057 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504725888}
I20260709 12:12:08.298661 16862 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.316125 17079 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:08.315642 17141 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:08.340343 16823 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:08.339295 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 134058us
I20260709 12:12:08.343312 17034 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.354416 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:08.355547 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:08.352550 11138 pending_rounds.cc:85] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 6
I20260709 12:12:08.362679 17034 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.365240 17034 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.349283 16671 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.365770 17116 raft_consensus.cc:993] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:08.370438 17059 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.373703 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3072) took 2039 ms. Trace:
I20260709 12:12:08.366130 16671 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.376488 16671 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.377669 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.335420 17110 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.362115 11138 pending_rounds.cc:107] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:12:08.378993 11138 raft_consensus.cc:2889] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.380254 17110 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.350837 17159 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:12:08.378953 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:08.382891 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.374099 11285 rpcz_store.cc:276] 0709 12:12:06.334169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.402731 (+ 68562us) service_pool.cc:224] Handling call
0709 12:12:06.415555 (+ 12824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.573897 (+1158342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.373454 (+799557us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400060ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:08.373638 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507830656}
W20260709 12:12:08.393280 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.394063 11140 raft_consensus.cc:2368] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20.
I20260709 12:12:08.394852 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.403406 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.404115 11858 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:08.407402 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.410192 11286 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:08.394416 17123 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.420163 11859 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:08.413342 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:08.418891 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:08.431888 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.353098 17079 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.411689 17053 raft_consensus.cc:1081] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:08.481990 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.488691 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.413311 17131 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:12:08.492013 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:08.492718 11218 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
W20260709 12:12:08.482626 16304 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.593s	user 0.003s	sys 0.009s
I20260709 12:12:08.503515 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:08.504338 11218 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:08.506596 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.508011 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:08.509027 16827 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.509402 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.515291 11855 pending_rounds.cc:85] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 12
I20260709 12:12:08.515673 11855 pending_rounds.cc:107] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:08.515918 11855 raft_consensus.cc:2889] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.506644 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.518805 11142 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:08.505353 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:08.521551 11859 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:08.524580 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.529295 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.490906 17147 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.529479 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:08.529935 11289 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:08.533143 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.535354 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:08.536913 11218 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:08.538520 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.539738 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:08.540297 11856 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:08.492630 17084 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.538043 11218 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 9
I20260709 12:12:08.544545 11218 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:08.497892 16304 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.538071 16859 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:08.544951 11218 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:08.543287 11286 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:08.550022 11256 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:08.540905 16992 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.554826 11142 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:08.556445 17082 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:12:08.532044 17066 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:12:08.555540 17034 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:08.569929 17079 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.568847 11219 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:08.570662 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2250) took 1100 ms. Trace:
W20260709 12:12:08.564514 17163 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:12:08.608063 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.617597 16304 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:08.605263 17164 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:12:08.619310 11142 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:08.620221 11210 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:08.620679 11144 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:08.623993 16992 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.625090 17084 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.533171 17068 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 12:12:08.631124 17167 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:12:08.638556 17026 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.639546 11214 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:08.640563 11288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 3068) took 2307 ms (client timeout 1810 ms). Trace:
I20260709 12:12:08.645609 17093 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:08.648113 16862 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.650250 11213 rpcz_store.cc:276] 0709 12:12:07.470208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.338000 (+867792us) service_pool.cc:224] Handling call
0709 12:12:08.346918 (+  8918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.353696 (+  6778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.353724 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.354158 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.493904 (+139746us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:08.506807 (+ 12903us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.507298 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.507369 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.570301 (+ 62932us) raft_consensus.cc:1685] finished
0709 12:12:08.570337 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.570580 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39097,"prepare.queue_time_us":26785,"prepare.run_wall_time_us":45,"raft.queue_time_us":7626,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":11942,"spinlock_wait_cycles":2530688,"thread_start_us":139488,"threads_started":1,"wal-append.queue_time_us":188014}
I20260709 12:12:08.661269 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2557) took 1076 ms. Trace:
I20260709 12:12:08.652027 11856 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
W20260709 12:12:08.674630 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 64441us
W20260709 12:12:08.685065 11288 rpcz_store.cc:269] 0709 12:12:06.333080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.345061 (+ 11981us) service_pool.cc:224] Handling call
0709 12:12:08.640262 (+2295201us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540015c054. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:08.640427 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976339328}
I20260709 12:12:08.686379 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2675) took 1291 ms. Trace:
I20260709 12:12:08.653702 17034 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:08.694896 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:08.689922 11137 rpcz_store.cc:276] 0709 12:12:07.585135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.216461 (+631326us) service_pool.cc:224] Handling call
0709 12:12:08.237311 (+ 20850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.237559 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:08.254235 (+ 16676us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.409676 (+155441us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.410832 (+  1156us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.617877 (+207045us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b18003b29c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:12:08.660325 (+ 42448us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b18003b29c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f982d9f0a40 00007f982d9eb4e4 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf 00007f9830af5038
0709 12:12:08.660585 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.660817 (+   232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.660884 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:08.660949 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.661044 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.661193 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71105,"prepare.queue_time_us":16999,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":14712,"raft.queue_time_us":13478,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":9782,"spinlock_wait_cycles":55014016,"thread_start_us":138879,"threads_started":1,"wal-append.queue_time_us":180252}
I20260709 12:12:08.692272 11211 rpcz_store.cc:276] 0709 12:12:07.395069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.204361 (+809292us) service_pool.cc:224] Handling call
0709 12:12:08.204575 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.339646 (+135071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.339676 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.347798 (+  8122us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.478043 (+130245us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:08.636580 (+158537us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.686046 (+ 49466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.686154 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.686206 (+    52us) raft_consensus.cc:1685] finished
0709 12:12:08.686221 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.686330 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67772,"prepare.queue_time_us":6748,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":91092,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":4003,"thread_start_us":360244,"threads_started":3,"wal-append.queue_time_us":106130}
I20260709 12:12:08.695585 11142 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
W20260709 12:12:08.687609 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 209158us
I20260709 12:12:08.693892 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:08.651103 16823 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.686570 17141 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:08.700165 17104 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.719744 17104 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.724908 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 766) took 1978 ms. Trace:
I20260709 12:12:08.724675 17095 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.725335 11855 rpcz_store.cc:276] 0709 12:12:06.746881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.747598 (+   717us) service_pool.cc:224] Handling call
0709 12:12:08.514824 (+1767226us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:12:08.515057 (+   233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.516492 (+  1435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.516528 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.517003 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.643734 (+126731us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:08.643771 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.643858 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.724578 (+ 80720us) raft_consensus.cc:1685] finished
0709 12:12:08.724607 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.724841 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174094080,"thread_start_us":126311,"threads_started":1,"wal-append.queue_time_us":170191}
W20260709 12:12:08.705366 17136 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.735s	user 0.003s	sys 0.000s
I20260709 12:12:08.706291 16845 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.707680 16862 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.700621 16992 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:08.713174 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3082) took 1083 ms. Trace:
I20260709 12:12:08.713531 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:08.731069 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.717149 17069 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:08.729313 11291 rpcz_store.cc:276] 0709 12:12:07.629790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.629989 (+   199us) service_pool.cc:224] Handling call
0709 12:12:07.630392 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.850216 (+219824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.712965 (+862749us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400060254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:08.713121 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471169280}
I20260709 12:12:08.738881 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2670) took 1345 ms. Trace:
I20260709 12:12:08.728101 11144 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.732438 16992 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:08.732911 16869 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:08.697420 17147 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.733176 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.734733 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.735885 17005 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:08.736922 11136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3377) took 1805 ms (client timeout 2375 ms). Trace:
I20260709 12:12:08.737473 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.749788 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.696990 17034 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.738834 11135 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:08.739485 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3083) took 1104 ms. Trace:
I20260709 12:12:08.733245 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:08.742774 17170 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 12:12:08.742956 11141 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:08.746198 11140 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:08.728893 17095 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:08.749181 11136 rpcz_store.cc:269] 0709 12:12:06.931293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.931422 (+   129us) service_pool.cc:224] Handling call
0709 12:12:08.736683 (+1805261us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54002c1354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:08.736829 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550238592}
I20260709 12:12:08.744097 11212 rpcz_store.cc:276] 0709 12:12:07.393641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.034677 (+641036us) service_pool.cc:224] Handling call
0709 12:12:08.035033 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.035273 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.035300 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.540130 (+504830us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:12:08.540680 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.664902 (+124222us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:08.664953 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.665044 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.738561 (+ 73517us) raft_consensus.cc:1685] finished
0709 12:12:08.738581 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.738794 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29085440,"thread_start_us":123720,"threads_started":1,"wal-append.queue_time_us":193959}
W20260709 12:12:08.752331 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 221908us
I20260709 12:12:08.722369 17104 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.743886 11137 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:08.758154 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.751716 11292 rpcz_store.cc:276] 0709 12:12:07.635611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.635817 (+   206us) service_pool.cc:224] Handling call
0709 12:12:07.636301 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:07.636816 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.636847 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:07.637606 (+   759us) log.cc:844] Serialized 52 byte log entry
0709 12:12:07.889741 (+252135us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:07.889794 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.889869 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.704798 (+814929us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:08.739209 (+ 34411us) raft_consensus.cc:1685] finished
0709 12:12:08.739235 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.739429 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":11053824,"thread_start_us":251626,"threads_started":1,"wal-append.queue_time_us":318424}
I20260709 12:12:08.746551 16869 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:08.768498 16869 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.767513 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:08.747071 16671 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:08.775270 17066 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.775801 17066 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:08.776201 17066 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.776827 11140 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:08.770164 17005 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:12:08.778584 17026 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:08.778806 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:08.757454 16859 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 12:12:08.771236 17088 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.712s	user 0.008s	sys 0.005s
W20260709 12:12:08.784572 17088 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.732s	user 0.008s	sys 0.006s
I20260709 12:12:08.788520 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.757949 17084 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:12:08.791971 16992 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:08.792910 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.796278 17113 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.796779 17113 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:08.798029 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 923b3bc9b7424aa9bdc5a7952136dbba: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:08.782330 17106 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.816232 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 919) took 2798 ms. Trace:
I20260709 12:12:08.816674 11215 rpcz_store.cc:276] 0709 12:12:06.014181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.014313 (+   132us) service_pool.cc:224] Handling call
0709 12:12:06.014754 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.983183 (+968429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.812585 (+1829402us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b5400011dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:08.812854 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194986368}
I20260709 12:12:08.817200 11289 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:12:08.775295 16671 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.822046 16671 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.826048 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:08.852736 17116 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:08.853225 17116 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:08.860018 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.837793 17064 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:08.870754 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 776da81ff0064a87b29c2949e7bc5291: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:08.874873 16768 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.877429 17064 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.880704 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2684) took 1292 ms. Trace:
I20260709 12:12:08.881071 11218 rpcz_store.cc:276] 0709 12:12:07.588425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.537517 (+949092us) service_pool.cc:224] Handling call
0709 12:12:08.537841 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:08.549083 (+ 11242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.549112 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:08.549640 (+   528us) log.cc:844] Serialized 52 byte log entry
0709 12:12:08.773920 (+224280us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:08.774541 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.774647 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.875791 (+101144us) raft_consensus.cc:1685] finished
0709 12:12:08.875810 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.880639 (+  4829us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4482,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8135,"thread_start_us":169504,"threads_started":1,"wal-append.queue_time_us":292050}
W20260709 12:12:08.912151 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:08.929602 17194 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:12:08.932104 16888 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:08.932812 16888 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:08.955250 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.881603 16768 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.960868 16888 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.879992 17113 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:08.935062 16869 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:08.970368 17016 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:08.974660 17016 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:08.972748 17182 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:12:08.854076 17116 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:08.991449 16869 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.995405 17116 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:09.000694 17064 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.009500 16869 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:09.013986 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 765) took 2267 ms. Trace:
I20260709 12:12:09.014451 11860 rpcz_store.cc:276] 0709 12:12:06.746477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.753609 (+  7132us) service_pool.cc:224] Handling call
0709 12:12:06.868468 (+114859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.941218 (+ 72750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.941273 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.641799 (+1700526us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b18003f20e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a
0709 12:12:08.642240 (+   441us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b2c00012458. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:12:08.642762 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.700208 (+ 57446us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:08.700255 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.700329 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.013660 (+313331us) raft_consensus.cc:1685] finished
0709 12:12:09.013695 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.013896 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56387,"raft.queue_time_us":56691,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16015,"spinlock_wait_cycles":121081984,"thread_start_us":56835,"threads_started":1,"wal-append.queue_time_us":165717}
W20260709 12:12:09.018564 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50873.9us
I20260709 12:12:09.004165 17016 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:08.994781 17034 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.036429 16875 raft_consensus.cc:993] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:09.037051 16875 raft_consensus.cc:1081] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:09.040386 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3392) took 1727 ms. Trace:
I20260709 12:12:09.040740 17034 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.040966 17027 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.041368 17027 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:09.042280 17027 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.043551 17027 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.043252 17066 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.040771 11135 rpcz_store.cc:276] 0709 12:12:07.312978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.313765 (+   787us) service_pool.cc:224] Handling call
0709 12:12:08.738475 (+1424710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.751619 (+ 13144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.040206 (+288587us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002c1350. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:09.040331 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3275730816}
I20260709 12:12:09.046342 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1229) took 1844 ms. Trace:
I20260709 12:12:09.046861 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.048979 11135 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.046784 11293 rpcz_store.cc:276] 0709 12:12:07.201879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.202031 (+   152us) service_pool.cc:224] Handling call
0709 12:12:07.202331 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.274250 (+ 71919us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:07.274698 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 12:12:07.678209 (+403511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:07.678269 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:07.678331 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.620750 (+942419us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18003551e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419
0709 12:12:09.046097 (+425347us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54003f1bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:09.046151 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.046284 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3500,"prepare.queue_time_us":825,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":3635,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9021,"spinlock_wait_cycles":176037376,"thread_start_us":399468,"threads_started":1,"wal-append.queue_time_us":547926,"wal-append.run_cpu_time_us":1301,"wal-append.run_wall_time_us":1014724}
I20260709 12:12:09.053601 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3379) took 2110 ms. Trace:
I20260709 12:12:09.054066 11139 rpcz_store.cc:276] 0709 12:12:06.942048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.942194 (+   146us) service_pool.cc:224] Handling call
0709 12:12:06.996405 (+ 54211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.199208 (+202803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.051989 (+1852781us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002530d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:09.052195 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439424896}
I20260709 12:12:09.069106 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:09.069911 17132 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.071156 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:09.076972 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.078903 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.079763 17132 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.081617 16741 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.083868 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:09.088047 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:09.085135 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.089252 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.085482 11219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2682) took 1518 ms (client timeout 2009 ms). Trace:
W20260709 12:12:09.089735 11219 rpcz_store.cc:269] 0709 12:12:07.567171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.715285 (+148114us) service_pool.cc:224] Handling call
0709 12:12:09.085256 (+1369971us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002954d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:09.085425 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886489984}
I20260709 12:12:09.091671 11215 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.092108 11211 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.093822 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.094882 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.096025 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.101308 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:09.102384 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.104249 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.104292 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:09.105325 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.107702 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.108834 11219 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:09.112941 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.113744 11141 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:09.115501 11213 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:09.116111 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.117897 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:09.087255 17132 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:09.087426 17102 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:09.103281 16671 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:09.103207 17147 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:12:09.118387 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.095002 16869 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.104519 17064 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:09.125432 11215 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:09.095752 17110 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:09.104751 17104 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:09.130574 11141 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:09.112252 17088 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.098702 17106 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:12:09.123744 17075 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.119038 16802 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.125309 17132 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.124022 16862 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.125643 16671 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:09.129182 16875 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:09.144213 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:09.144546 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48146.4us
I20260709 12:12:09.148648 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.125198 17145 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:12:09.145217 16671 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:09.160272 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.168493 11141 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:09.169348 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.170533 17147 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:12:09.171516 17116 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.172171 17116 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.172887 17066 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.137923 17064 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:09.174798 17064 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.175918 17116 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.145574 17104 raft_consensus.cc:2764] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:09.178611 11141 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:12:09.182596 11135 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:09.145524 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:09.185089 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:09.185276 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:09.185931 11215 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.186619 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:09.188273 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.188412 11825 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:09.192149 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:09.193051 11210 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:09.145574 16875 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:09.194156 11217 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:09.202754 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:09.193962 11215 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:09.202566 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.208181 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:09.210197 11293 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:09.186595 16802 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:09.208689 17189 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:12:09.214658 16845 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:09.217679 17107 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.209700 17066 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:09.218530 17107 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:09.219321 17066 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:09.220398 17066 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.209883 17027 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:12:09.223047 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.223683 17059 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:09.180588 16827 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.233446 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:09.151561 16862 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.195035 17116 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:09.250730 11285 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.183995 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:12:09.240885 11860 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:09.241025 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:09.244849 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.227675 17104 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:09.231778 16802 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:09.246927 16875 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.251572 11141 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.256731 11141 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.263664 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:09.267057 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:09.246078 17084 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:12:09.241786 16845 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:09.272775 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.242987 17059 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:09.283465 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 86558.4us
I20260709 12:12:09.288197 11289 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:09.237263 16827 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.288861 11141 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.293905 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.296087 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.296850 11287 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.305685 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.306890 11289 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:09.262588 16671 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:09.303287 17197 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:12:09.295193 16845 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:09.349704 11141 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.309309 17093 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.355868 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2560) took 1707 ms. Trace:
I20260709 12:12:09.356488 11138 rpcz_store.cc:276] 0709 12:12:07.648421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.346421 (+698000us) service_pool.cc:224] Handling call
0709 12:12:08.352322 (+  5901us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:08.379789 (+ 27467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.379819 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:08.380476 (+   657us) log.cc:844] Serialized 78 byte log entry
0709 12:12:08.530719 (+150243us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:09.195119 (+664400us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.345478 (+150359us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.355386 (+  9908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.355480 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.355545 (+    65us) raft_consensus.cc:1685] finished
0709 12:12:09.355564 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.355766 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":815542,"prepare.queue_time_us":805615,"raft.queue_time_us":16118,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":18005,"thread_start_us":149884,"threads_started":1,"wal-append.queue_time_us":225627}
W20260709 12:12:09.362665 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107842us
I20260709 12:12:09.363662 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:09.373023 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.305980 16859 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:12:09.349287 16802 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:09.378754 17199 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:12:09.380759 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.381647 11139 raft_consensus.cc:2410] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:12:09.382064 16671 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:09.383208 17198 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:12:09.383087 17209 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.361004 17075 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.365263 17088 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.385921 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.390508 11139 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.392064 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.395838 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:09.397635 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.398679 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.389741 17104 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.406572 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.365634 17093 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.390100 17106 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:09.392707 17201 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.423604 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.388398 17082 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:12:09.401341 17200 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.429168 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:09.425098 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.427959 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.428252 11140 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:09.407617 17204 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.386044 17209 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.437369 11139 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:09.391295 17075 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.385833 17059 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.445675 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.447180 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:09.447839 11138 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:09.452428 17209 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.454139 17093 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.455698 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.456692 11140 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:09.457443 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3388) took 2212 ms. Trace:
I20260709 12:12:09.459352 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:09.461331 11140 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: [15.7-15.7]
W20260709 12:12:09.465269 17202 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:09.423270 17210 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:12:09.429769 17201 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.471165 17201 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.469548 11141 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:09.438789 16862 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.407986 17104 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.482592 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3407) took 1092 ms. Trace:
I20260709 12:12:09.424834 17106 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.490252 11137 rpcz_store.cc:276] 0709 12:12:08.390123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.770280 (+380157us) service_pool.cc:224] Handling call
0709 12:12:08.801741 (+ 31461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.814653 (+ 12912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.814684 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.827188 (+ 12504us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.175933 (+348745us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800364b40. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:12:09.255626 (+ 79693us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:09.425731 (+170105us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.425960 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.426040 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.464681 (+ 38641us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:09.482275 (+ 17594us) raft_consensus.cc:1685] finished
0709 12:12:09.482317 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.482515 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125929,"prepare.queue_time_us":182895,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1596,"raft.queue_time_us":16567,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":22130,"spinlock_wait_cycles":9135104,"thread_start_us":149728,"threads_started":2,"wal-append.queue_time_us":464237}
I20260709 12:12:09.457835 11143 rpcz_store.cc:276] 0709 12:12:07.245060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.250624 (+  5564us) service_pool.cc:224] Handling call
0709 12:12:07.251013 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.386219 (+135206us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:07.415327 (+ 29108us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.381073 (+965746us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18003ec6e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf 00007f9830af5038
0709 12:12:08.492025 (+110952us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.661960 (+169935us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.179876 (+517916us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.180102 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.180162 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:09.180219 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.457193 (+276974us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b54001261d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:09.457246 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.457382 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713787,"prepare.queue_time_us":593157,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":132,"raft.queue_time_us":30506,"raft.run_cpu_time_us":435,"raft.run_wall_time_us":13739,"spinlock_wait_cycles":41319552,"thread_start_us":455501,"threads_started":2,"wal-append.queue_time_us":462251}
I20260709 12:12:09.512009 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3404) took 1122 ms. Trace:
I20260709 12:12:09.546657 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:09.515589 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113615us
I20260709 12:12:09.519773 17075 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.524482 16823 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:09.527000 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:09.527568 17088 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:09.528546 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:09.531172 11287 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.422717 16845 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.514036 16869 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.558729 17088 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.558890 16869 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.562039 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:09.562019 16869 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:09.541782 17106 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.547909 11854 raft_consensus.cc:2410] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:12:09.548601 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:09.577337 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 149444us
I20260709 12:12:09.605459 11138 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:09.546473 11144 rpcz_store.cc:276] 0709 12:12:08.389129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.767841 (+378712us) service_pool.cc:224] Handling call
0709 12:12:08.775748 (+  7907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.776110 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.776139 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.776555 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.838627 (+ 62072us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:09.349326 (+510699us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.511560 (+162234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.511659 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.511718 (+    59us) raft_consensus.cc:1685] finished
0709 12:12:09.511735 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.511926 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":449287,"prepare.queue_time_us":528842,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":93,"raft.queue_time_us":58361,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":5694,"thread_start_us":267679,"threads_started":3,"wal-append.queue_time_us":87692}
W20260709 12:12:09.608433 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59914.8us
I20260709 12:12:09.612964 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:09.612426 17225 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:09.634347 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:09.635459 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 251520us
I20260709 12:12:09.643064 11285 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:09.644857 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:09.628324 17075 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:09.680683 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:09.615077 17213 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:12:09.638070 17006 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.687796 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:09.689733 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:09.700423 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:09.637588 17106 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:12:09.685990 17204 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.677290 17220 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:09.630661 17221 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 12:12:09.708386 17218 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:09.708597 16845 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:09.696990 17104 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.697225 17006 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.737031 11859 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.734378 17204 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.741027 17088 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.736706 16827 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.747089 17106 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:09.687141 17090 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 12:12:09.738029 17132 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.002s
I20260709 12:12:09.775076 17204 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.777055 17106 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:09.788753 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.787009 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 219141us
I20260709 12:12:09.785384 16992 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:09.796257 17006 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.782388 17132 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.795131 17213 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:09.823982 11858 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.825047 17213 consensus_queue.cc:1243] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:09.816370 17106 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.836311 17106 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.844525 17088 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:09.846311 16981 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.847443 16981 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:09.849449 17195 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.669s	user 0.002s	sys 0.014s
I20260709 12:12:09.850976 16981 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.851522 17132 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:09.852624 17132 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.853243 17132 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.855669 17204 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.856441 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.857158 11285 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:09.857913 17204 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.859462 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.860189 11287 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:09.860819 11859 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:09.861348 17132 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.862890 17069 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:09.870850 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:09.875451 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:09.873976 16981 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.879845 16869 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:09.885412 16869 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.885637 17016 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.885866 16869 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.885767 16981 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.876385 17236 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:09.893710 17124 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.890890 17141 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:09.893765 17161 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.905993 17124 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.899573 17059 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.906281 17161 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.907383 17059 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.908860 17161 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.890610 17116 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:09.891626 17213 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.886480 17016 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:09.894587 17113 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.896420 17142 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.897782 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.893522 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:09.894421 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.912324 11219 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.894112 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.913497 11216 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:12:09.893882 16304 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:09.896247 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2242) took 2434 ms. Trace:
I20260709 12:12:09.907008 17026 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:09.893570 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.879281 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:09.919445 11217 rpcz_store.cc:276] 0709 12:12:07.461696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.287694 (+825998us) service_pool.cc:224] Handling call
0709 12:12:08.287997 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.206424 (+918427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.640566 (+434142us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b54002259a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830adea02 00007f9830adadd6 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:12:09.895931 (+255365us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54002959d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:09.896171 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088781952}
W20260709 12:12:09.923554 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44387.6us
I20260709 12:12:09.926410 11289 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.927875 16823 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.928640 16823 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.932770 16823 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:09.941131 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.942384 11218 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:09.944742 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.945582 11287 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:09.946406 11289 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.947481 11211 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:09.948669 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.948830 11289 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.949227 11289 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:09.910892 17113 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.949925 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.909755 17059 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:09.950033 11289 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.957788 11289 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.961417 11219 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:09.962659 11216 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:12:09.892691 17236 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:09.964159 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.888273 16981 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.919983 16768 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.964735 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.901342 17093 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:09.981659 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.922139 17026 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:09.982101 11291 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.969235 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:09.970636 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.972558 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:09.897953 16741 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:09.911319 17142 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.906248 17141 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.964597 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.986999 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.975971 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:09.908881 17124 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:09.979110 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:09.987694 11214 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:09.979707 11285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:09.988320 11290 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:09.949620 17006 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.985090 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:09.987689 11218 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
W20260709 12:12:09.974838 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62211.4us
I20260709 12:12:09.919055 16974 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:09.988699 11287 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:12:09.990630 11292 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:09.990381 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:09.992794 11285 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.909843 17213 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.993448 11285 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:09.994479 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:09.910037 17116 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:09.998638 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.937270 16304 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.996155 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:10.003444 17145 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:10.003997 17145 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.004462 17145 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:09.985390 16768 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:09.968660 16823 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:10.008245 17228 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:12:10.021313 16869 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.022045 17141 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.022663 17141 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.023175 17027 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:09.911155 17016 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.023602 17027 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.023873 17236 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.981346 17093 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:10.030867 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3408) took 1640 ms. Trace:
I20260709 12:12:10.030421 17093 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.032326 17093 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:10.031311 11136 rpcz_store.cc:276] 0709 12:12:08.390433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.771658 (+381225us) service_pool.cc:224] Handling call
0709 12:12:08.771991 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.823070 (+ 51079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.823107 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.823653 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.053081 (+229428us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:09.503701 (+450620us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.504280 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.848740 (+344460us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:10.030069 (+181329us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b180043f2a0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419
0709 12:12:10.030539 (+   470us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54000910d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:10.030585 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.030633 (+    48us) raft_consensus.cc:1685] finished
0709 12:12:10.030647 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.030800 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267300,"prepare.queue_time_us":374060,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":3215,"raft.queue_time_us":166,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":7778,"spinlock_wait_cycles":135209088,"thread_start_us":415810,"threads_started":2,"wal-append.queue_time_us":308203}
I20260709 12:12:10.034703 17109 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:10.035141 17109 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:09.984293 16741 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.036012 17109 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:09.999914 17124 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:12:10.037600 17109 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.992596 17059 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.985203 16888 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.989634 17006 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.039002 17006 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.039520 11217 raft_consensus.cc:2410] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:10.040723 16888 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.008832 16974 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:10.042563 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.024062 17027 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.044915 16862 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:10.038170 17244 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.046653 17244 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:10.047622 17244 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.051415 17213 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.052270 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.016856 11286 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.055423 11210 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:10.055713 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.017597 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.018689 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.059727 11292 raft_consensus.cc:2410] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:12:10.034183 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.038892 17059 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.064126 11291 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:10.076907 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:10.089675 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.091342 11290 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:10.078045 11859 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:10.097152 16875 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.098246 17110 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.098882 17110 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.101258 17110 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.012379 16768 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.104357 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.106423 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:10.121039 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.125164 11140 raft_consensus.cc:2410] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:12:10.045519 16862 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.127173 11136 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:10.127988 11139 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.017627 17161 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.129745 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:10.128299 11285 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.142385 11143 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:10.121464 16859 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:10.151515 16859 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:10.137265 17161 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:10.171800 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 248666us
I20260709 12:12:10.157023 16741 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.157720 16845 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:12:10.157544 16981 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 12:12:10.191412 16981 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:10.191955 16981 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:10.193063 16981 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.173632 16888 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.198987 16869 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.200768 16974 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:10.203065 17242 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.003s
I20260709 12:12:10.193199 11285 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:10.223090 11289 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:10.173664 16304 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.228538 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:10.173997 16859 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:10.234699 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 236548us
I20260709 12:12:10.238142 11136 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:10.244403 11143 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:10.245085 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.247362 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.248497 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.249271 11215 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:12:10.250108 11210 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:10.245723 11140 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:12:10.256353 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.247965 11216 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:10.246805 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:10.230408 17055 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.262290 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:10.264039 11258 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.532s (SENT)
I20260709 12:12:10.264560 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:10.267148 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:10.247051 16768 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.273824 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.275146 11141 raft_consensus.cc:2410] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:10.242102 17113 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.273689 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.291806 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:10.286746 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.293164 11138 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:10.287369 17247 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.287777 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.295861 11136 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:10.239382 16981 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.237619 17005 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:10.300925 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.309370 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3398) took 2346 ms. Trace:
I20260709 12:12:10.273200 17132 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:10.274427 17107 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:10.310606 11144 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:10.311434 11142 rpcz_store.cc:276] 0709 12:12:07.963208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.712584 (+749376us) service_pool.cc:224] Handling call
0709 12:12:08.744122 (+ 31538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.744837 (+   715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.744880 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.754887 (+ 10007us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.861152 (+106265us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:10.191390 (+1330238us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18001a8600. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f98344d33c7 00007f9830ae59a7 00007f9830af50bf
0709 12:12:10.191563 (+   173us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.296423 (+104860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.296554 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.296650 (+    96us) raft_consensus.cc:1685] finished
0709 12:12:10.309082 (+ 12432us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.309295 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396254,"prepare.queue_time_us":522831,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":2567,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":18000,"spinlock_wait_cycles":4193536,"thread_start_us":293351,"threads_started":3,"wal-append.queue_time_us":90249,"wal-append.run_cpu_time_us":2150,"wal-append.run_wall_time_us":1004186}
I20260709 12:12:10.360432 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.356050 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.289765 16888 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.290741 16768 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.301883 17228 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.363744 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.363320 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.314522 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:10.393962 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.397284 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.412297 11138 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:10.389619 11136 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:10.411415 11218 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.313571 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:10.415402 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 101924us
I20260709 12:12:10.416196 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:10.322846 11258 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.589s (SENT)
I20260709 12:12:10.282549 17055 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.298892 17217 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.419034 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:10.420979 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:10.311079 16741 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.301944 17247 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.302064 17058 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.135s
W20260709 12:12:10.409143 17205 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:12:10.455643 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.475303 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:10.430168 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.428047 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.395318 17251 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:12:10.357931 17244 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.313213 17249 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.368464 16304 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.313266 17233 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:10.528043 11855 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:10.468300 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.549978 11213 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:10.439695 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 116911us
I20260709 12:12:10.504742 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.470470 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:10.552623 11215 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:10.561561 11858 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:10.561156 11285 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:10.565057 11210 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:10.314383 17132 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:10.469534 17246 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.426s	user 0.000s	sys 0.004s
W20260709 12:12:10.483103 17252 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:12:10.475242 17059 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.432118 17113 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.479852 17142 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.580340 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.580395 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.472690 17055 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.482195 17161 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.423534 17257 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.435355 17253 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.586129 11292 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:10.385181 17106 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:10.513725 17247 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.605005 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.518046 16859 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.482402 16673 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 12:12:10.612540 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.566396 17110 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:10.615047 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:10.617235 11213 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:10.622750 11285 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:10.619125 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:10.577288 17132 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.588971 11218 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:10.423650 16888 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.511307 16741 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.629210 11287 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
W20260709 12:12:10.630936 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.588377 17113 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:10.634898 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.636082 11218 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:10.637477 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.637812 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.632090 11219 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:10.639053 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.571913 17249 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.431975 17026 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.616798 17257 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.641773 11288 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:10.576596 16304 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.570662 17095 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:12:10.576838 17233 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.644480 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.649582 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:10.651448 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:10.639794 17113 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.657209 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:10.643183 17027 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.599s	user 0.026s	sys 0.005s
I20260709 12:12:10.668761 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:10.656426 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.671187 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.672930 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:10.674111 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:10.642205 17107 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:10.624756 17106 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.630997 17110 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.694056 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.662796 17257 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:10.716256 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 295326us
I20260709 12:12:10.718106 11212 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:10.717375 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:10.720366 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:10.688167 17027 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:10.728720 17145 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.724s	user 0.018s	sys 0.000s
I20260709 12:12:10.703258 17254 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:10.711866 16845 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.736173 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.725629 17142 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:10.734789 17093 consensus_meta.cc:287] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.002s
I20260709 12:12:10.761106 11860 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:10.764597 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.734324 17250 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:10.732946 16768 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.773837 11284 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:12:10.775935 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:10.753659 17006 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.009s
I20260709 12:12:10.741535 17247 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.779247 11284 pending_rounds.cc:85] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 13
I20260709 12:12:10.782235 11284 pending_rounds.cc:107] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:12:10.782536 11284 raft_consensus.cc:2889] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.742630 16875 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.791630 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.792464 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:10.807128 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.809048 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:10.758783 17142 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:10.740238 17145 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.836179 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:10.742763 17254 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.842363 11288 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:10.793103 17247 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:10.806206 16768 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:10.780669 17249 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.850600 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:10.854360 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.996s (SENT) [suppressed 26 similar messages]
I20260709 12:12:10.750805 16845 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.827086 17142 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.854575 11212 raft_consensus.cc:2376] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15. Re-sending same reply.
I20260709 12:12:10.814522 16875 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.792804 17250 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:10.880776 16304 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:10.886677 17110 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.889293 16888 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.840902 17059 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.853462 17247 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.002511 17059 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:10.925702 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.005589 17264 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.006085 17264 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:10.805986 17006 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.008850 11859 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:11.008821 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.012495 17005 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:11.013473 11213 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:12:10.860184 16741 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:10.869884 16859 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:10.977298 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 171696us
W20260709 12:12:10.970345 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 250050us
I20260709 12:12:10.992092 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:10.852022 17263 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:10.996125 11110 connection.cc:256] RPC call timeout handler was delayed by -1.2656821230000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 12:12:10.996711 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 287940us
I20260709 12:12:11.012534 17006 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.028055 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:10.753142 17107 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.018069 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.018707 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.018698 11861 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:12:11.032538 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:11.034152 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.034474 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.037283 11856 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:12:11.042616 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.031523 17106 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.042873 17251 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:11.068121 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 200928us
I20260709 12:12:11.043231 16741 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.070995 17257 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.075852 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.059192 17266 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:12:11.081139 17116 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:11.067541 17271 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 12:12:11.084532 17109 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.046s	user 0.013s	sys 0.009s
I20260709 12:12:11.086848 11182 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.089320 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:11.089514 16862 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.090668 17027 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.098002 11215 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:12:11.094122 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.043290 17272 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:11.097131 11859 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:11.039647 17270 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:11.085628 16768 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:12:11.065335 17264 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.115218 17264 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.115585 17026 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.103726 17260 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:11.117980 17260 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.107483 17132 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.122891 11853 raft_consensus.cc:2368] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
W20260709 12:12:11.109938 17244 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
I20260709 12:12:11.124534 17250 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.099421 17145 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:11.110839 16981 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.798s	user 0.017s	sys 0.002s
I20260709 12:12:11.111862 17254 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:11.112376 17255 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.665s	user 0.004s	sys 0.000s
I20260709 12:12:11.105614 17270 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.094935 17116 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.131866 17016 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.132814 17233 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.134212 16875 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.117904 17247 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.137864 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:11.138720 11856 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:11.141538 11217 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:11.139891 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.146065 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:11.148873 16862 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:11.149389 16862 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:11.149834 16862 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.152213 11854 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:11.131912 17116 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.154836 17116 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.158565 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:11.159205 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.160943 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.161655 11135 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:11.161655 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.163097 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.163774 11140 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:11.164748 16802 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:11.163120 11143 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:11.168398 11214 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.169255 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.170950 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.165267 16802 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.104415 17272 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.176752 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.176777 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.179987 11140 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:11.180799 16802 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.169886 17142 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.181994 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:11.185483 11855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 787) took 1835 ms (client timeout 1635 ms). Trace:
W20260709 12:12:11.186017 11855 rpcz_store.cc:269] 0709 12:12:09.350592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.350924 (+   332us) service_pool.cc:224] Handling call
0709 12:12:11.185260 (+1834336us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54004dc6d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:11.185385 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995870976}
I20260709 12:12:11.189453 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:11.191346 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.191443 17113 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.192128 11211 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:11.193432 11216 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.194657 17113 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.195042 16845 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.192217 11136 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.201848 17142 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:11.202050  9943 debug-util.cc:398] Leaking SignalData structure 0x7b080017bcc0 after lost signal to thread 11028
I20260709 12:12:11.203295 11107 leader_election.cc:400] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:12:11.203594 11107 leader_election.cc:403] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:11.206154 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.206816 11143 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:11.203088 17266 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:11.211059 17093 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.205739 17109 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.225350 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.226150 11136 raft_consensus.cc:2410] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:12:11.225989 11210 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:11.204516  9943 kernel_stack_watchdog.cc:198] Thread 11028 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 2161ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:12:11.229238 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.233495 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:11.222690 17266 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:11.239637 11210 raft_consensus.cc:2410] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:12:11.242195 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.242777 11210 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.222750 17093 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.233677 17272 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.246712 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.249586 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.250420 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.251065 11136 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:11.251163 11210 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:11.248966 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:11.254666 17058 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.254472 17266 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.256034 11215 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:12:11.255096 17058 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:11.257598 17058 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.258749 17132 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:11.263805 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:11.275950 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.270579 17066 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.276899 17066 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:11.277267 17066 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.272054 17247 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.284073 16859 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.279980 17270 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.270280 16802 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:12:11.291707 17279 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:12:11.335945 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.308545 17059 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:11.318526 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.337105 11289 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.339944 17269 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.318922 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.343161 11284 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:11.320927 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.344269 11287 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.322992 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.325322 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.325793 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2261) took 1383 ms. Trace:
I20260709 12:12:11.326615 16859 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.347615 11211 rpcz_store.cc:276] 0709 12:12:09.942292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.984833 (+ 42541us) service_pool.cc:224] Handling call
0709 12:12:11.325582 (+1340749us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001dfe54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:11.325720 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745195392}
I20260709 12:12:11.347656 11292 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:11.349422 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:11.350409 17270 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:11.350935 17270 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:11.351795 17270 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.354351 17058 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.358311 17058 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.328140 17257 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.329487 11213 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:11.359618 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.366788 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:11.367878 11287 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:11.329388 17093 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:11.370357 17248 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.380487 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.371531 11289 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:11.373054 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.386169 11292 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:11.390283 16859 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.391957 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:11.370783 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 109002us
I20260709 12:12:08.025008 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 1b238aa9f5b8450ca03fed7b6a294cf3 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
W20260709 12:12:11.399385 11028 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 3.37431e+06us
I20260709 12:12:11.401551 11038 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 8 to 12, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.403544 17066 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.403960 11038 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.435971 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2697) took 1042 ms. Trace:
I20260709 12:12:11.414197 17147 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.479386 17058 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:11.479481 17147 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:11.413923 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 319846us
W20260709 12:12:11.437422 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64429.7us
I20260709 12:12:11.378944 17095 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:11.488366 17095 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:11.488898 17095 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.488830 17124 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:11.481835 17116 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.491214 17116 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.491772 17116 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.491146 17124 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.481331 17106 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:12:11.480505 17058 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:11.495675 17058 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.450621 11135 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:11.496726 16888 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:11.497538 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:11.498716 17005 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:11.498828 17106 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:11.499357 17005 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:11.500634 17005 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:11.423571 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 176981us
I20260709 12:12:11.499428 17106 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:11.497689 16768 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:11.443879 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48873.1us
I20260709 12:12:11.512543 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.414510  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:11.513780 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.513900 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.514398 11212 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.514532 11140 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.484441 11216 rpcz_store.cc:276] 0709 12:12:10.393618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.560567 (+166949us) service_pool.cc:224] Handling call
0709 12:12:10.561168 (+   601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.193847 (+632679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.435553 (+241706us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003052d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:11.435878 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453575040}
W20260709 12:12:11.413407 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 326609us
I20260709 12:12:11.511332 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.516947 11136 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.480613 17147 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.514945 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.519304 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:11.519336 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.531121 11854 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:11.519969 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:11.521245 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.513278 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.415550 17263 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:11.536574 17263 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.536958 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.537600 17263 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.538379 17066 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:11.541564 16862 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.415019 17260 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:11.543903 16862 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.544382 17142 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:11.544840 17142 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.545197 17142 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:11.414434 17275 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.549294 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:11.549535 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.543272 11038 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.546523 11290 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:11.412688 17248 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:11.551901 17248 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.552287  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:11.548394 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:11.414306 17109 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:12:11.412947 17271 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:11.536152 11138 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.558877 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.549809 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:11.564649 11040 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 253) took 35120 ms (client timeout 15000 ms). Trace:
I20260709 12:12:11.565948 11038 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 14 to 16, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:11.520742 16768 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.515966 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.524713 17273 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:11.601864 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:39166
W20260709 12:12:11.612185 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 53384us
I20260709 12:12:11.612931 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.613126 11140 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:11.590407 11136 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:11.571846 11854 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:11.615512 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.569387 11212 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
W20260709 12:12:11.565106 11040 rpcz_store.cc:269] 0709 12:11:36.444571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.444940 (+   369us) service_pool.cc:224] Handling call
0709 12:12:11.564530 (+35119590us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:05.502722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:05.730545 (+227823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:05.730631 (+    86us) write_op.cc:435] Acquired schema lock
0709 12:12:05.730708 (+    77us) tablet.cc:662] Decoding operations
0709 12:12:05.732318 (+  1610us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:05.732451 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:05.732494 (+    43us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:12:05.733764 (+  1270us) tablet.cc:701] Row locks acquired
0709 12:12:05.733827 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:12:05.734061 (+   234us) write_op.cc:270] Start()
0709 12:12:05.734259 (+   198us) write_op.cc:276] Timestamp: P: 1783599125733974 usec, L: 0
0709 12:12:05.734291 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:12:05.759228 (+ 24937us) log.cc:844] Serialized 4019 byte log entry
0709 12:12:05.996486 (+237258us) op_driver.cc:464] REPLICATION: finished
0709 12:12:06.161741 (+165255us) write_op.cc:301] APPLY: starting
0709 12:12:06.177877 (+ 16136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:06.669057 (+491180us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:06.669189 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:07.150742 (+481553us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:07.151120 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:12:07.151186 (+    66us) write_op.cc:312] APPLY: finished
0709 12:12:07.151606 (+   420us) log.cc:844] Serialized 97 byte log entry
0709 12:12:07.151875 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.152033 (+   158us) write_op.cc:454] Released schema lock
0709 12:12:07.157324 (+  5291us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:07.225370 (+ 68046us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:07.226998 (+  1628us) write_op.cc:454] Released schema lock
0709 12:12:08.292101 (+1065103us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180013ca20. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
Metrics: {"mutex_wait_us":117746,"reported_tablets":50,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":77029,"apply.run_cpu_time_us":23151,"apply.run_wall_time_us":1097871,"cfile_cache_hit":42,"cfile_cache_hit_bytes":46047,"num_ops":10,"prepare.queue_time_us":276383,"prepare.run_cpu_time_us":19725,"prepare.run_wall_time_us":355020,"raft.queue_time_us":93601,"raft.run_cpu_time_us":16809,"raft.run_wall_time_us":65836,"replication_time_us":262002,"spinlock_wait_cycles":25185152,"thread_start_us":324650,"threads_started":4,"wal-append.queue_time_us":1246855,"wal-append.run_cpu_time_us":23041,"wal-append.run_wall_time_us":2108776}]]}
W20260709 12:12:11.619432 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 69273.8us
I20260709 12:12:11.556948 17124 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.628384 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.568087 17257 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:12:11.556952 17271 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.619721 17273 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.619863 17249 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.610510 17264 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.659602 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:11.631664 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.661067 11142 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.654568 17027 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:12:11.627816 11138 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:11.669195 11143 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:11.669971 11142 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:11.619859 17106 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:12:11.571516 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58380.8us
I20260709 12:12:11.627604 17107 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.630739 17095 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:11.643574 11259 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 2.009s (SENT)
W20260709 12:12:11.644100 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 94387.1us
I20260709 12:12:11.646006 16862 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.640529 17269 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:11.657670 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44808.9us
I20260709 12:12:11.565430 16741 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.699012 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:11.707863 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.708825 11290 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:11.709489 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.710093 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.710969 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.711130 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.713315 11852 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.659785 17264 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:11.717067 11212 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:12:11.637352 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.639319 11135 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.658732 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.717844 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.718109 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:11.718454 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59822.6us
I20260709 12:12:11.676570 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:11.656934 17244 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.682781 17107 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.685299 16768 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.674571 17270 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:12:11.691381 11859 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:11.692576 17095 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:11.729133 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.672863 17275 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:11.693617 16862 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:11.731160 16862 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.678432 16888 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:11.677495 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.675328 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:11.735587 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60342.2us
I20260709 12:12:11.736259 17270 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.737164 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:11.719368 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.739403 17110 raft_consensus.cc:2764] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:12:11.741250 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63873.8us
I20260709 12:12:11.720014 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.737712 17270 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:11.722344 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.744617 11290 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.715678 16741 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:11.723596 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80057.5us
I20260709 12:12:11.723402 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.723234 17027 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.728012 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.751718 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:11.728214 11214 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:11.693018 17269 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:11.729997 17106 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:11.728698 17059 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.721489 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.753829 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.755735 11284 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:11.756558 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.757966 11216 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.754278 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.743850 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:11.760231 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:11.745697 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.672432 17247 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:12:11.717407 17264 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.746268 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.748826 11289 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:11.725778 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.750478 11138 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:11.721210 17244 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.757987 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:11.752632 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.762265 11135 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:12:11.746069 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.764313 11293 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:11.761528 11288 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:11.770699 11290 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:11.771942 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.773073 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.773816 11210 raft_consensus.cc:2368] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:12:11.775614 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.777328 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.734555 16888 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.805721 11291 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:11.774564 11258 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.093s (SENT)
I20260709 12:12:11.764592 17109 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:11.810384 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.807931 11213 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:11.811062 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.811945 11217 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:11.811062 11212 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:11.808754 11285 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:11.813589 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.752113 17027 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.826665 17027 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.828073 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.830149 17161 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:11.830638 17161 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.831616 17161 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.833340 17161 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.835433 11141 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.836400 17254 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:11.837121 17254 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.823876 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.839529 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:11.840214 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.841467 11288 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:11.814465 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:11.809182 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.816753 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.817024 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.752873 16304 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:11.842549 11211 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:11.843538 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.844303 11211 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:11.845315 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.818733 11216 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:11.821656 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.845929 11211 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:11.822992 17066 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:12:11.823653 11140 raft_consensus.cc:1217] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 13.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 12:12:11.824103 17095 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:11.825274 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.851514 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.763592 16768 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.855126 17249 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:11.856108 17249 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:11.856449 17249 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.857306 17249 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.825579 11138 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:12:11.811167 17110 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:11.859066 17110 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.859948 17107 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:11.860117 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 102215us
I20260709 12:12:11.861503 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:11.861786 17110 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:11.862227 17275 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:11.862706 17269 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.863358 17095 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:11.864323 17095 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.808478 16869 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:11.867055 16869 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:11.868284 11138 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.867998 16869 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.868511 17248 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.870791 16888 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.871968 16888 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.839450 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.728960 17271 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.875180 11210 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:11.876238 17142 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.877749 11141 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:11.877997 17257 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.841524 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.818899 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.820879 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:11.822386 11143 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.887661 11213 raft_consensus.cc:2368] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:11.823715 17263 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:11.891136 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.877774 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.898677 11214 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:11.900521 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.894304 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.906385 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:11.903146 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 138989us
I20260709 12:12:11.907464 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:11.846443 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.912285 11216 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:11.846660 11135 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:11.849218 11140 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:12:11.752794 17116 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.921186 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.850831 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.852238 11217 raft_consensus.cc:2376] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18. Re-sending same reply.
I20260709 12:12:11.780158 17262 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:11.934664 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.779207 17244 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.769537 17251 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.852263 11142 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:12:11.853917 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 73403.5us
I20260709 12:12:11.880332 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 1b238aa9f5b8450ca03fed7b6a294cf3 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
W20260709 12:12:11.941418 11028 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61113.7us
I20260709 12:12:11.915961 11288 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:11.916160 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.919308 17257 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:11.908021 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:11.922968 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.951280 11141 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:11.923789 11292 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:11.924819 11290 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:11.926415 11140 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:12:11.953926 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45987.3us
I20260709 12:12:11.939260 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:11.848999 16304 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:11.944273 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:11.935738 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:11.962273 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.962636 17257 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.962996 11140 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:11.963966 17257 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.966274 17275 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:11.961671 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.966939 17275 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:11.967655 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.968850 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.969343 17260 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.970124 17260 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.970582 17260 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.969434 11143 raft_consensus.cc:2376] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15. Re-sending same reply.
I20260709 12:12:11.974642 16304 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.975250 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.976406 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.950335 16859 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:11.977422 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.978232 11143 raft_consensus.cc:2410] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:11.979507 17271 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.980584 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.981825 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.982097 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:11.982980 17262 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:11.983873 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.984025 17262 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.968313 17275 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.939842 17147 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:11.988332 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.984668 11138 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:11.989468 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.990115 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:11.907459 17016 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:11.992468 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56824.3us
I20260709 12:12:11.993323 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:11.990360 11141 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:11.966881 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:11.994926 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet ddd0a7b2bb3645519f8c5c9bf85633d9: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:11.996273 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:11.996537 11140 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:11.997026 11135 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:12.003309 11218 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:11.998598 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:12.005300 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:12.007241 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 199149us
I20260709 12:12:11.933813 17124 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:11.849217 17109 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:11.950258 17249 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.020515 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:12.044199 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:12.045396 11140 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:12.049407 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.050149 11219 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:12.004053 17217 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.004051 17282 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:12.052763 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:12.063447 11142 raft_consensus.cc:2468] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:12.070182 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:12.070844 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.003584 17016 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.093035 11218 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:12:12.018745 17059 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.077872 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:12.104940 11141 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.086578 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:12.092412 11852 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:12.093415 11218 pending_rounds.cc:85] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 9
I20260709 12:12:12.112149 11218 pending_rounds.cc:107] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:12:12.112416 11218 raft_consensus.cc:2889] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.075845 11215 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
W20260709 12:12:12.095058 17309 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:12:12.050135 17124 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.124967 11141 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
W20260709 12:12:12.126171 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.127336 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 117778us
I20260709 12:12:12.128158 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:12.042294 17287 consensus_queue.cc:1059] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 12:12:12.133296 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.138698 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.142023 17275 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.142892 17275 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.143494 17275 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:12.143044 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70079.6us
I20260709 12:12:12.144420 17275 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.123311 17264 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.145279 17116 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.147297 17264 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.147552 17142 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.150593 17147 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:12.153877 17275 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.157469 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.050132 17027 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:12.167151 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.130431 17262 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.172686 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.158246 17113 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:12.160317 17147 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.156203 17275 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.201463 17059 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:12.202634 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57058.7us
W20260709 12:12:12.219472 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46886.3us
I20260709 12:12:12.198944 17262 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:12.211315 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 124834us
I20260709 12:12:12.223155 17262 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.224506 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:12.224984 11213 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:12.225777 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:12.227880 11138 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:12.229317  9943 debug-util.cc:398] Leaking SignalData structure 0x7b0800351d80 after lost signal to thread 11028
I20260709 12:12:12.173636 17251 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:12.160542 17272 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:12.245931 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:12.175076 16741 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:12.249583 11858 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:12.194885 16304 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.231997 17270 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.231405 17113 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.260676 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:12.261000 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:12.261085 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:12.280426 11293 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:12.261830 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:12.262574 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:12.282094 11285 raft_consensus.cc:2393] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:12.236837 17116 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.260200 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:12.283658 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 182867us
W20260709 12:12:12.285398 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.290956 17248 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:12.293067 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64157.5us
I20260709 12:12:12.296629 17254 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:12.253749 17147 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:12.306725 17302 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:12:12.304870 16862 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:12.171223 17016 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:12.322592 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 164642us
I20260709 12:12:12.350150 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:12.322923 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79872.4us
I20260709 12:12:12.326930 11292 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:12.304556 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:12.329687 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:12.355880 11289 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.332080 11210 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:12.304754 17109 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.334327 11212 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:12:12.335523 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 72175.4us
I20260709 12:12:12.336256 16304 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.259510 17141 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:12:12.253147 17317 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.318208 17116 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.370275 17116 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.370843 17113 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.234576 17315 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:12:12.307093 17217 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:12:12.381477 17327 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:12.383363 17315 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:12.384210 17315 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:12.384555 17217 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:12.384969 17217 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:12.385177 17315 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.385792 17217 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.269721 17059 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.389086 11214 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:12.358677 17147 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.390796 17314 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:12.383272 17027 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.391724 17147 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.366525 11137 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:12.382318 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:12.394807 17282 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:12.369230 17330 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:12.258831 17318 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.114s
I20260709 12:12:12.399549 11289 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:12.369738 17310 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:12:12.238055 17124 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.357034 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:12.375545 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet d969a53adb784388b9e0819cd9786e2f: Illegal state: Replica ba2779405e8d452e95f42421b2b60928 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:12.365864 11859 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:12.353278 16859 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:12:12.353617 17319 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:12:12.392478 17269 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.392604 11138 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:12.395913 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:12.366995 17312 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:12:12.436725 11138 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:12.397840 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:12.398254 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.400278 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.362550 17287 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:12.316668 17270 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.403278 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.442024 11218 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:12.446434 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:12.446911 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49157.1us
W20260709 12:12:12.423506 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 66578.6us
I20260709 12:12:12.425364 11216 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:12:12.426525 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.449642 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.383677 17141 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:12.411402 17315 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:12.397637 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 266068us
I20260709 12:12:12.438153 11211 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:12.453194 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.463635 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.440274 17317 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:12.399214 17330 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:12.395277 17282 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:12.455351 17141 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.440883 11138 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:12.432133 17272 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.465333 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.450261 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:12.472211 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.451470 16859 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:12.474813 16802 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.480024 11139 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:12.474123 17109 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:12:12.458097 17326 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:12.448638 17269 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:12.500249 11138 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.468093 17317 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:12.510746 16304 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.515132 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.431316 17322 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:12:12.454993 17319 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:12.499650 17244 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 12:12:12.474431 17110 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:12.563818 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 809626de5a674cba911a83815f1e05ca: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } }
I20260709 12:12:12.486028 17282 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.575204 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:12.466255 17305 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
W20260709 12:12:12.572208 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57176.7us
I20260709 12:12:12.536392 11182 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.503052 16859 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:12.604091 16304 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:12.598321 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.579701 11139 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:12.571241 17109 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.574994 17331 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:12.560608 17326 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:12.584656 17275 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:12.599865 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 100270us
I20260709 12:12:12.578640 16802 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:12.614843 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 78582us
W20260709 12:12:12.500880 17287 consensus_queue.cc:1175] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2b4f4725b82b481ab53f0717a429e94a" responder_term: 21 status { last_received { term: 21 index: 15 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:12.576649 17244 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.622553 17326 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:12.627486 16802 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.627908 17270 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.624621 17331 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.575702 16862 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:12:12.568946 17323 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:12:12.608038 17329 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.688074 17217 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:12.640095 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 174854us
I20260709 12:12:12.691327 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.633759 17110 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:12:12.637270 17260 consensus_meta.cc:287] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 12:12:12.634662 17275 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.647934 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.606173 17330 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.641095 16859 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.660442 17273 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:12.633395 17317 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:12.663183 17338 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:12.667933 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.642941 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:12.696202 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 48390.7us
I20260709 12:12:12.699401 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:12.747462 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48207.7us
I20260709 12:12:12.749174 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:12.751348 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83539.1us
I20260709 12:12:12.753762 11110 leader_election.cc:400] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14.
I20260709 12:12:12.757573 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:12.759025 16859 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.694043 17110 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:12.764839 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 121997us
I20260709 12:12:12.765874 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:12.698352 17124 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:12.770066 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.745913 17229 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.757123 17344 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.758567 17273 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.700562 17348 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:12.759493 17270 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:12.762552 17271 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.697876 17260 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:12.745016 17314 consensus_queue.cc:1175] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" responder_term: 17 status { last_received { term: 16 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:12.770386 17330 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.769189 17329 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:12.779632 17110 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.781008 17229 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:12.790380 17059 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.815327 17257 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.815568 17059 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.816236 17059 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.791127 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.791432 17271 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:12.816829 17229 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:12.790918 17260 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.800185 17244 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.800383 11858 raft_consensus.cc:2368] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17.
I20260709 12:12:12.807061 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:12.807709 17331 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.810928 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:12.774693 17327 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:12.815958 17257 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.798696 17269 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.824936 17329 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.832798 17110 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.798812 17275 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.820863 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:12.818342 17271 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:12.793911 17116 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:12.848924 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 93838.2us
I20260709 12:12:12.856940 11284 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:12.820114 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:12.858111 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:12.858824 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:12.839983 17329 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:12.860741 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:12.861750 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:12.845045 17282 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:12.863725 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43701.8us
I20260709 12:12:12.867062 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:12.868674 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.866205 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:12.871150 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.871368 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:12.871874 11212 raft_consensus.cc:2376] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17. Re-sending same reply.
I20260709 12:12:12.871979 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.872654 11218 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:12.872896 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.873739 11210 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:12.874531 11259 leader_election.cc:400] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:12.875267 11259 leader_election.cc:403] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.863420 17344 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.874701 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.875068 11213 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:12.864414 17348 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.880961 17348 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:12.882036 17348 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.883435 17257 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.862923 16888 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:12.885305 16888 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.885699 16888 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:12.864848 17346 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:12.888309 17346 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:12.888851 17346 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:12.890709 17355 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:12:12.863692 17329 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.873124 17327 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:12.898900 17327 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:12.899335 17327 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.867204 17349 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.906785 17349 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.907137 17349 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.911088 11290 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:12.912642 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.913866 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.913540 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:12.916280 11210 raft_consensus.cc:2410] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:12.875324 17315 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.863133 17270 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:12:12.923780 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:12.923300 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50721.8us
I20260709 12:12:12.929296 16859 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:12.867085 17272 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:12:12.945004 11293 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:12.951730 17331 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:12.939926 16888 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:12.948458 11292 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:12.930423 17344 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.933820 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.956513 11289 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:12:12.956962 11289 pending_rounds.cc:85] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 7
I20260709 12:12:12.957161 11289 pending_rounds.cc:107] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:12:12.957381 11289 raft_consensus.cc:2889] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.957521 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:12.959432 16888 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:12.959517 17346 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.961035 17344 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:12.961639 17346 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.963228 17344 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.967075 17327 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:12.969935 17282 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:12.971186 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:12.973034 17116 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:12.978199 17249 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:12.978818 17249 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:12.979619 17249 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:12.980782 17249 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.983793 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2738) took 1083 ms. Trace:
I20260709 12:12:12.984299 11214 rpcz_store.cc:276] 0709 12:12:11.900056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.900237 (+   181us) service_pool.cc:224] Handling call
0709 12:12:12.983609 (+1083372us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400385254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:12.983730 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121979264}
I20260709 12:12:13.000295 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:13.002866 17351 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:13.003616 17351 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:13.003742 17315 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.004593 17351 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.002102 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:13.010565 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:13.011173 11284 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:13.011621 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:13.013315 17217 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.013648 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:13.013706 17217 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:13.014720 17217 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.016899 16862 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:13.017704 16862 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:13.019527 17317 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:13.021341 11284 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:13.021073 17141 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.024580 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:13.027769 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:13.029294 17345 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.029724 17345 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:13.030081 17345 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.995580 17319 raft_consensus.cc:2764] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:13.037366 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:13.037708 11285 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:13.038743 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.056238 11210 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:13.039987 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.056773 11215 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:13.040545 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.057657 11218 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:13.041087 11216 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.042317 11212 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:13.043120 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.060148 11219 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.996088 17327 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.075338 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.047637 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.076560 11284 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:12:13.048280 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.049517 11286 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.051404 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:13.054134 11291 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:12.996627 17244 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.066615 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.088135 11212 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:13.069484 11218 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.072620 11215 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:13.026952 17027 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:13.028405 17273 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:13.055507 17161 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.091845 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.075640 17315 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.076825 17116 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.102862 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:13.094427 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:13.060667 16888 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:12:13.121919 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.129914  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:13.195510 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.199159 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.189901 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 984) took 1229 ms. Trace:
I20260709 12:12:13.156327 11216 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:13.027408 17326 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.097149 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.107450 17315 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.099491 16869 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 12:12:13.103921 17027 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.093142 17059 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.236723 17027 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.238039 17059 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:13.238986 11293 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:13.092263 17005 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 12:12:13.089743 17257 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:12:13.192474 17106 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.228716 17326 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.234818 17315 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:13.239797 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 142723us
I20260709 12:12:13.152419 11219 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:13.254457 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.214664 11211 rpcz_store.cc:276] 0709 12:12:11.960946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.981835 (+ 20889us) service_pool.cc:224] Handling call
0709 12:12:13.189686 (+1207851us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400385c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:13.189822 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958127360}
I20260709 12:12:13.192932 17273 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:13.255410 17346 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.255843 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.256121 17273 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:13.243572 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.257071 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.257227 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:13.093663 17244 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.243945 11854 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.258733 17272 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.245261 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.259966 17244 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.260128 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.260223 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.261041 17272 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.093453 17329 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.079974 16862 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:13.243171 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 148838us
I20260709 12:12:13.157546 17161 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.256671 17346 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.263175 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.263952 11138 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:13.251220 17344 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:13.272583 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:13.268338 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.269439 11211 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:13.194808 17116 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.262409 17272 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:13.241621 17320 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.246881 17327 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:13.279341 16802 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:13.282825 16802 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.270435 17270 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.243691 17359 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.197847 16888 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.191584 17349 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.283435 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.266927 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:13.288628 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:13.281486 17264 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 12:12:13.328056 16888 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.270831 17110 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:13.329008 17110 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.330101 17161 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.321367 17345 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.331295 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:13.332449 17353 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.564s	user 0.015s	sys 0.003s
I20260709 12:12:13.334427 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:13.335487 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.332461 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.336454 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.337396 11287 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:13.275079 17326 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:13.343245 17326 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.342206 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:13.345332 17326 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.345670 11291 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:13.291565 17217 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.351719 11291 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:13.352388 17217 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:13.352972 17264 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:13.353181 11291 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.353500 17264 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.355603 17264 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.356741 17345 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.331096 17110 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.354278 11291 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.281260 17320 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.359666 17320 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:13.359786 11258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.003s	sys 0.031s
W20260709 12:12:13.360297 11258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.003s	sys 0.031s
W20260709 12:12:13.360903 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 910657us
I20260709 12:12:13.297042 11213 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:13.253206 17106 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:13.361820 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:13.294731 17270 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.304261 11210 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:13.304886 11854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:13.364475 11854 raft_consensus.cc:606] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:13.364852 11854 raft_consensus.cc:614] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:13.305518 17334 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:13.276678 11219 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:13.282205 17344 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.387990 11139 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:13.317063 17116 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.288121 17327 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.319175 17269 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.321018 17349 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.321587 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:13.322175 11288 raft_consensus.cc:2393] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:13.322316 17107 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:13.323890 17329 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:13.324069 17006 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:13.324358 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.323901 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:13.326347 11215 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.340829 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.341379 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.292128 16802 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.365321 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:13.369120 17270 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.370749 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.371776 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:13.415889 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.432085 11286 raft_consensus.cc:1240] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:12:13.416061 11293 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:13.372925 17360 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
W20260709 12:12:13.452415 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 87200.3us
I20260709 12:12:13.373806 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.454551 11287 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:13.382427 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:13.383970 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.378757 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.391382 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.390763 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:13.409226 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.459153 11293 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:13.459667 11135 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:12:13.410346 11141 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:13.454070 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:13.419379 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.459211 11139 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.423439 11289 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:12:13.414062 11212 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:13.433413 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 156985us
I20260709 12:12:13.410370 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.433365 11286 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:13.417404 11290 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:12:13.414062 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 90220.6us
I20260709 12:12:13.463413 11288 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:13.452585 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:13.457888 11284 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:12:13.458602 11138 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:13.392794 11137 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:13.464622 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.467914 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.468781 11216 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:12:13.470230 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.484200 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:13.484485 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:13.484648 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.487059 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.487818 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.488363 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.488680 11288 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:13.496652 11212 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:13.497088 11290 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:13.385277 17345 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.502040 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.503062 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.412335 17344 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.519158 11142 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:12:13.545078 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60980.2us
I20260709 12:12:13.537622 11139 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:13.550426 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 168075us
I20260709 12:12:13.407106 17269 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.451612 17359 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.413488 17366 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 12:12:13.401942 17317 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 12:12:13.454057 17314 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:13.557277 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:13.492897 17006 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:13.492983 17282 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.497756 16859 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:13.512677 17334 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.402345 17113 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:12:13.452805 17305 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 12:12:13.555887 17344 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.574036 17272 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.515591 17109 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.545612 17264 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:13.619699 11139 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:13.640384 11289 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:13.561882 17365 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.644907 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.570878 17269 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.605824 17314 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:13.651378 17314 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.648702 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.653178 11137 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 10.
I20260709 12:12:13.652650 17314 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.564868 17027 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.076s
I20260709 12:12:13.656973 17027 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:13.657426 17027 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:12:13.652083 17351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.007s	sys 0.008s
I20260709 12:12:13.641402 17344 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:13.658800 17351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.008s
I20260709 12:12:13.659222 17106 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:13.661062 17344 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.665199 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.666059 11852 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:13.637604 17323 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:13.666991 17027 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.667218 17323 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.668428 11211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "809626de5a674cba911a83815f1e05ca"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:13.669050 11211 raft_consensus.cc:606] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.669528 17327 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.675064 16741 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:13.675524 16741 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:13.617770 17326 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:13.676144 17326 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.676378 16741 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.677780 16741 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.622607 17359 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:12:13.679543 17287 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.679929 17287 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:13.681077 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.572451 16869 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:12:13.681910 11210 raft_consensus.cc:2393] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:13.622402 17334 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:13.680061 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.686446 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:13.721134 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.573330 17349 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.725418 11135 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.725939 11135 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:13.684060 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:13.721346 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.726925 11135 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.733741 11135 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.732834 11214 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:12:13.685055 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.734967 11137 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 11: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:12:13.725958 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 147844us
I20260709 12:12:13.735378 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.744341 11214 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:13.722707 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.747109 11140 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:13.682416 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.736294 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.684592 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.736884 11138 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:12:13.737011 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53039.7us
W20260709 12:12:13.738046 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 172091us
I20260709 12:12:13.680416 17323 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.743120 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:13.678408 17326 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.687019 11139 raft_consensus.cc:2410] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 12:12:13.760942 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.765553 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:13.638695 16862 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 12:12:13.680943 17287 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.724146 17244 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:13.782755 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.783396 11211 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:13.786437 11135 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:13.644572 17005 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:12:13.789002 17305 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:13.744050 17368 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:13.790868 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 35f8f77c6e8c4a66b41088646a9c8c90: Illegal state: Replica 018d40ceb45d4447aa293f4c1d929bb8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:13.791661 17217 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.770748 17366 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.716862 16802 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.849819 11138 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:13.802683 17260 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:12:13.803283 17141 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.738173 17116 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:13.729197 17319 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:12:13.808401 11135 pending_rounds.cc:85] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:12:13.859071 11135 pending_rounds.cc:107] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:13.859377 11135 raft_consensus.cc:2889] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:13.827371 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:13.770429 17027 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:13.864802 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 346744us
I20260709 12:12:13.796175 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:13.835326 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 283781us
I20260709 12:12:13.865850 11142 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:13.845579 17058 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:13.854066 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:13.866577 11256 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:13.867039 11210 raft_consensus.cc:606] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:13.866199 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.867596 11210 raft_consensus.cc:614] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:13.653307 17315 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:13.778762 17264 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.835048 17217 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:13.881579 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:13.885202 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:13.887653 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:13.888434 11211 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.868582 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.835614 17368 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.856473 17006 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:13.828670 17244 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.883136 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:13.894580 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.916903 17109 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.919168 17109 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:13.919734 17113 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:13.909554 11182 leader_election.cc:400] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17.
I20260709 12:12:13.920238 17113 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.920310 17109 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.913071 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:13.877727 17344 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:13.920863 17113 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:13.912251 11286 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:13.920253 11284 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
I20260709 12:12:13.920397 11182 leader_election.cc:403] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:13.919235 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:13.923445 11290 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:13.883416 17107 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:13.891913 17346 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:13.882208 16862 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.920713 17270 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:13.891768 17378 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:13.935942 11287 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:13.946683 11292 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:13.891755 17161 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.914819 17106 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.948460 17107 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:13.963749 17244 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.967531 17315 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:13.952061 17346 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:13.883263 17264 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:13.977344 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 83472.6us
I20260709 12:12:13.979725 17257 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:13.980916 17273 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17.
I20260709 12:12:13.986410 17058 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:13.987433 11212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
W20260709 12:12:13.989847 17372 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:12:13.885860 17326 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.921617 17349 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.893079 17368 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.886406 17142 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:12:13.993122 16802 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:13.892241 17229 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:12:13.993777 17272 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:13.994520 17320 consensus_meta.cc:287] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
I20260709 12:12:13.998999 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:13.866014 17116 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:13.932446 17370 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:14.004200 11139 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:14.001554 17161 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.995476 17378 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:14.010449 17107 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:14.040580 11212 raft_consensus.cc:606] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.015797 17317 consensus_queue.cc:1243] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:13.994906 17217 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.041857 17058 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.081813 17161 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.045099 17006 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.089180 17379 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:12:14.035969 17275 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 12:12:14.078811 17345 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.002s
I20260709 12:12:14.039780 17257 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.047734 17349 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.076922 17370 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:14.135927 11139 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
W20260709 12:12:14.136457 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 253391us
I20260709 12:12:14.137339 11139 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 11
I20260709 12:12:14.138621 11139 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:12:14.139602 11139 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.046623 17326 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.145601 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:14.149129 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 199999us
I20260709 12:12:14.149410 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:14.140555 17345 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:14.150695 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.157594 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.076011 17320 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.155292 17272 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:14.153286 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:14.164038 11215 raft_consensus.cc:606] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:14.164510 11215 raft_consensus.cc:614] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:14.159843 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 162608us
I20260709 12:12:14.054304 17346 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.161518 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.090382 17378 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.169518 11293 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:14.174048 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.184778 11854 raft_consensus.cc:2368] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:14.156423 16741 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:14.160175 16802 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:14.158648 17273 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:14.197562 17273 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:14.198114 17273 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:14.200181  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:14.188856 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:14.196671 17346 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.168227 17348 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:14.150107 17244 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:14.190783 16741 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.390594 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:14.303311 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 125299us
I20260709 12:12:14.385483 11826 leader_election.cc:400] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
I20260709 12:12:14.430095 11292 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.437729  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:14.218063 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 189325us
W20260709 12:12:14.296334 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 107578us
I20260709 12:12:14.439653  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:14.236794 11288 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:14.442605 11288 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:14.442653 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.443516 11289 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:14.443761 11284 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:14.446036 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:14.446275 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.447147 11290 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:14.446267 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.447570 11138 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: [15.8-17.9]
I20260709 12:12:14.448249 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:14.449101 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:14.449597 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:14.450728 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:14.451045 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.287598 11217 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:14.451989 11136 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.452126 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:14.453404 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:14.456059 11256 leader_election.cc:400] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:14.200476 17270 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:14.456468 11256 leader_election.cc:403] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:14.440927 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.457026 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:14.435461 16741 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.463959 11144 raft_consensus.cc:2410] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:14.464092 11143 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:14.464778 11291 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:14.456862 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71641.1us
I20260709 12:12:14.395802 17217 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:14.220376 17374 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
W20260709 12:12:14.341656 17269 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.617s	user 0.014s	sys 0.000s
I20260709 12:12:14.459903 11141 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:14.239197 17287 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.312858 16802 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:14.295310 17323 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.216375 17378 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.449200 11288 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.237017 17394 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:14.498287 11288 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.457474 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.468214 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:14.380256 17387 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.285s	user 0.004s	sys 0.002s
W20260709 12:12:14.470927 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2282) took 1604 ms (client timeout 1755 ms). Trace:
I20260709 12:12:14.242033 17275 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.419811 17344 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.473971 11136 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:14.460004 11135 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:14.217046 17348 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:14.354055 17326 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:14.475569 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:14.476913 11859 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:14.321024 17107 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.286506 17161 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.357400 17264 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.220919 17320 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.214108 17315 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.236644 17116 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:14.492661 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53052.4us
I20260709 12:12:14.532856 17344 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.543087 11852 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.544667 17107 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.545130 17344 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.245769 17334 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:14.547600 17161 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.549515 16741 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.250015 17257 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.246680 17349 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:14.231571 17141 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.244s
I20260709 12:12:14.356208 17322 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.504416 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:14.498035 17409 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.222891 17400 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.275s
I20260709 12:12:14.536921 17110 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:14.509243 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:12:14.510325 11217 rpcz_store.cc:269] 0709 12:12:12.866463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.866669 (+   206us) service_pool.cc:224] Handling call
0709 12:12:14.470695 (+1604026us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000271d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:14.470848 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3136132480}
I20260709 12:12:14.237358 17396 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.269s
I20260709 12:12:14.316118 17113 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.516088 11292 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:14.234581 17142 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.263s
I20260709 12:12:14.205632 17370 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.538522 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:14.490940 17269 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.552800 11852 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:14.540446 17244 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:14.603672 17409 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.630117 11855 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:14.632057 17409 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:14.632208 17269 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:14.635154 17329 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.635679 17329 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:14.637795 17329 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:14.520253 17348 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:14.564193 17264 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:12:14.568361 17368 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 12:12:14.639313 17368 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.629554 17400 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.640503 17400 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:14.582106 17386 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:12:14.641549 17368 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:14.518016 17275 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.506958 17394 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:14.513288 17346 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.506278 17323 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.580060 17407 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:14.581100 17334 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.586571 11137 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:14.645164 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:14.650029 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 111572us
I20260709 12:12:14.651104 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.653663 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:14.654419 11859 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:14.493286 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 338859us
I20260709 12:12:14.463133 17270 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:14.637830 11288 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:14.639652 17058 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.565501 17315 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.577987 17273 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.645116 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:14.666843 11288 pending_rounds.cc:85] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 8
I20260709 12:12:14.715142 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 811) took 1299 ms. Trace:
I20260709 12:12:14.715370 11288 pending_rounds.cc:107] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:14.669749 11182 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:14.671831 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.715674 11288 raft_consensus.cc:2889] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:14.716410 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65438.2us
W20260709 12:12:14.718979 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.715143 11858 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.674376 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:14.712194 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44398.5us
I20260709 12:12:14.715530 11855 rpcz_store.cc:276] 0709 12:12:13.415550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.415954 (+   404us) service_pool.cc:224] Handling call
0709 12:12:13.416226 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.630676 (+1214450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.714913 (+ 84237us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540067ff54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:14.715084 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791300992}
I20260709 12:12:14.727830 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:14.732358 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:12:14.738603 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 68957.9us
I20260709 12:12:14.739714 11284 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:14.604250 17257 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.642897 17382 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:14.772853 17409 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:14.772584 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 263425us
I20260709 12:12:14.774895 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:14.775704 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:14.776387 11136 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:14.776675 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:14.777472 11215 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.778591 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:14.779238 11217 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:14.780134 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:14.780406 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:14.781049 11217 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.768709 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.783531 11292 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:14.782852 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:14.785643 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:14.782135 11219 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:14.604852 17110 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:14.711069 17314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.043s	sys 0.029s
I20260709 12:12:14.791524 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:14.711668 17270 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.805076 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:14.714586 17264 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:14.768131 16859 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:12:14.799021 11853 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:14.643330 17394 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:14.809386 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:14.798035 11858 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:14.813302 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:14.818184 11290 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.817752 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:14.819890 11292 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.816607 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:14.815415 11210 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:12:14.743010 17330 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:14.604022 17322 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:14.802703 17314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.044s	sys 0.030s
I20260709 12:12:14.738235 17249 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 12:12:14.845801 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:14.737944 16802 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:14.773303 17409 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.738260 17116 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.828684 17406 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:12:14.647024 17346 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.806787 17161 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:14.799949 11217 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:14.714241 17244 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:12:14.808841 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:14.898988 11291 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:12:14.900506 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:14.798691 17344 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:14.802448 17110 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.809120 17391 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:14.824703 17399 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:12:14.860491 11292 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:14.865120 11215 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:14.769728 17349 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:12:14.873482 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.711683 17407 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:14.796926 17257 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.876695 17359 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:14.878661 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.880590 17142 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.814075 17264 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.711530 17334 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.874074 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:14.827436 17329 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:14.828935 17386 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:14.641582 17400 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.847069 17326 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.953042 11290 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:14.953296 11211 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:14.953141 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.002107 11292 raft_consensus.cc:2410] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:14.955564 17217 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.885596 17409 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:14.964883 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 242384us
I20260709 12:12:14.867710 17027 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:14.846735 17330 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.905654 17058 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.812897 17397 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.197s
I20260709 12:12:14.963308 17344 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:14.969311 17322 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:14.992300 17142 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.904349 17116 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:14.997946 17391 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:14.993117 17264 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.998358 16741 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:14.992707 17287 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:14.910701 17161 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:15.023305 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 149296us
I20260709 12:12:15.015729 17027 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.003796 17365 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:15.024587 17426 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:12:15.030246 17161 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.010845 17386 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:15.029992 17334 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.024371 17142 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.027034 17359 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:15.024219 17275 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.008492 17326 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.011063 17217 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.034848 17392 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.037041 17323 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.038554 17315 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.035254 17287 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.055008 17346 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.045931 17273 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.167018 17397 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.167701 17257 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.168689 17257 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:15.110111 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 264227us
I20260709 12:12:15.168365 17397 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.169715 17323 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:15.170316 17287 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.171036 17161 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:15.172127 17397 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.173477 17287 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:15.175238 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.121085 11213 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:15.121376 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3176) took 1208 ms. Trace:
I20260709 12:12:15.009563 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:15.172117 17161 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:15.181700 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 172137us
I20260709 12:12:15.183524 17323 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.033533 17113 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.187459 17113 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:15.187144 17348 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.188424 17113 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.180354 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.190048 11288 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:15.190786 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:15.192727 17315 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.128746 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.131704 16741 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:12:15.137434 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 109425us
I20260709 12:12:15.052105 17344 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.232197 17397 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.047324 17359 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:15.233474 17397 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.040050 17365 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.061790 17386 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.059002 17391 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.061234 17394 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.264114 17394 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.056737 17392 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:15.058952 17407 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.044032 17410 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:12:15.067032 17409 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.275708 11219 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:15.277906 17409 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.027159 17244 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:12:15.279340 17445 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:15.148886 17027 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.055423 17326 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.155360 17346 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:15.154065 17217 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.162936 17432 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.975383 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:15.193951 17315 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.194239 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:15.179378 11285 rpcz_store.cc:276] 0709 12:12:13.913024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.913159 (+   135us) service_pool.cc:224] Handling call
0709 12:12:13.946895 (+ 33736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.153238 (+206343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.153267 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.387163 (+233896us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:12:14.387737 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.740627 (+352890us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:14.740669 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.740766 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.120399 (+379633us) raft_consensus.cc:1685] finished
0709 12:12:15.120457 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.121040 (+   583us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6073,"raft.queue_time_us":14337,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":18248576,"thread_start_us":552354,"threads_started":2,"wal-append.queue_time_us":570435}
I20260709 12:12:15.214819 16741 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.216785 11286 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.238119 11037 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.288139 17346 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.205736 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.291343 11289 raft_consensus.cc:2410] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:15.290710 17432 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:15.225982 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 376116us
I20260709 12:12:15.297686 16741 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.231382 11288 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
W20260709 12:12:15.299568 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 105592us
I20260709 12:12:15.244189 17359 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.168330 17275 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:15.248812 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76142.1us
I20260709 12:12:15.194056 17270 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.231382 17142 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.169768 17257 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.257728 17421 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.267963 17113 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.268035 17392 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.325973 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:15.273206 17319 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.253999 17323 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.278091 17330 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.264146 17365 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.306779 17282 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:15.307644 17359 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:15.308380 17142 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.325598 17421 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.326515 17446 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:15.269529 17397 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.328763 17257 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:15.331072 17414 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 12:12:15.330956 16802 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:15.304515 17432 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.323370 17348 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.334548 17161 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.322082 16741 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.332700 17319 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:15.361080 17270 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.362627 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.370783 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:15.374450 17370 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.423979 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:15.376377 17415 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.481s	user 0.003s	sys 0.000s
I20260709 12:12:15.377485 16802 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.425877 16802 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:15.377997 17346 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.378235 17275 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.373960 17421 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.429931 17275 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:15.380846 17416 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
W20260709 12:12:15.416303 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64340.2us
W20260709 12:12:15.419095 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 69839.5us
W20260709 12:12:15.422856 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97148.2us
W20260709 12:12:15.399000 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.287006 17445 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.422667 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:15.408164 11038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 136) took 30724 ms (client timeout 15000 ms). Trace:
W20260709 12:12:15.382851 17443 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
W20260709 12:12:15.430684 17420 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.415s	user 0.002s	sys 0.001s
W20260709 12:12:15.394235 17418 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:12:15.421741 17270 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:15.460386 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.460556 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.460824 17396 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:15.401137 17287 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:15.463028 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1294) took 1366 ms. Trace:
I20260709 12:12:15.464350 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:15.466537 11286 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:15.472795 11285 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:15.402675 11037 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 15, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.474738 17396 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.475490 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.476565 11037 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.385946 17116 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.477789 17396 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.478667 17317 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:12:15.479245 16802 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.385682 16741 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.392006 17319 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:15.481079 17442 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:12:15.421449 17110 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.483423 17287 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.484555 17264 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.484580 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.479782 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.497390 17317 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:15.501657 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:15.501794 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.502539 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:15.502792 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2338) took 1059 ms. Trace:
I20260709 12:12:15.503227 17348 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:15.504036 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:15.504345 17391 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:15.501833 11037 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.506441 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2639) took 1048 ms. Trace:
I20260709 12:12:15.510299 17365 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.511497 16802 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.512205 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:15.518707 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54611.3us
I20260709 12:12:15.519384 17257 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.469887 11287 rpcz_store.cc:276] 0709 12:12:14.096531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.096676 (+   145us) service_pool.cc:224] Handling call
0709 12:12:14.129695 (+ 33019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.154860 (+ 25165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.154887 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.401745 (+246858us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:12:14.402299 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.679729 (+277430us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:14.679782 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.770204 (+ 90422us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54003f1bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:14.770265 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.379740 (+609475us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:15.462567 (+ 82827us) raft_consensus.cc:1685] finished
0709 12:12:15.462588 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.462848 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8368,"raft.queue_time_us":7249,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5220,"spinlock_wait_cycles":116030336,"thread_start_us":277015,"threads_started":1,"wal-append.queue_time_us":464809}
I20260709 12:12:15.522899 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.523533 17270 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.544433 11853 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:15.528299 11291 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:12:15.547727 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88189.2us
W20260709 12:12:15.454694 11038 rpcz_store.cc:269] 0709 12:11:44.683271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.684771 (+  1500us) service_pool.cc:224] Handling call
0709 12:12:15.407785 (+30723014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:12.166159 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:12.358570 (+192411us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:12.362049 (+  3479us) write_op.cc:435] Acquired schema lock
0709 12:12:12.363526 (+  1477us) tablet.cc:662] Decoding operations
0709 12:12:12.395324 (+ 31798us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:12.395392 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:12.399062 (+  3670us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:12.475300 (+ 76238us) tablet.cc:701] Row locks acquired
0709 12:12:12.479299 (+  3999us) write_op.cc:260] PREPARE: finished
0709 12:12:12.479527 (+   228us) write_op.cc:270] Start()
0709 12:12:12.479680 (+   153us) write_op.cc:276] Timestamp: P: 1783599132479433 usec, L: 0
0709 12:12:12.479705 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:12:12.480481 (+   776us) log.cc:844] Serialized 1686 byte log entry
0709 12:12:12.958567 (+478086us) op_driver.cc:464] REPLICATION: finished
0709 12:12:13.269947 (+311380us) write_op.cc:301] APPLY: starting
0709 12:12:13.273793 (+  3846us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:13.312649 (+ 38856us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:13.312778 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:13.342123 (+ 29345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:13.342407 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:12:13.342478 (+    71us) write_op.cc:312] APPLY: finished
0709 12:12:13.342826 (+   348us) log.cc:844] Serialized 49 byte log entry
0709 12:12:13.344064 (+  1238us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:13.344182 (+   118us) write_op.cc:454] Released schema lock
0709 12:12:13.344243 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:13.344918 (+   675us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:13.357388 (+ 12470us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":165396,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":286311,"apply.run_cpu_time_us":9085,"apply.run_wall_time_us":90624,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20895,"num_ops":4,"prepare.queue_time_us":498457,"prepare.run_cpu_time_us":24179,"prepare.run_wall_time_us":443540,"raft.queue_time_us":260564,"raft.run_cpu_time_us":42641,"raft.run_wall_time_us":130602,"replication_time_us":476816,"thread_start_us":524932,"threads_started":4,"wal-append.queue_time_us":152392,"wal-append.run_cpu_time_us":8089,"wal-append.run_wall_time_us":1710882}]]}
I20260709 12:12:15.536556 17317 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:15.537266 11293 rpcz_store.cc:276] 0709 12:12:14.443653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.444666 (+  1013us) service_pool.cc:224] Handling call
0709 12:12:14.444972 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:14.445335 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.445364 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:14.459526 (+ 14162us) log.cc:844] Serialized 52 byte log entry
0709 12:12:14.800225 (+340699us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:15.004855 (+204630us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.014048 (+  9193us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.021297 (+  7249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.021389 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.309443 (+288054us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:15.378857 (+ 69414us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180024e0e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:12:15.502295 (+123438us) raft_consensus.cc:1685] finished
0709 12:12:15.502323 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.502582 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29701,"prepare.queue_time_us":575042,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":16908,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":19407,"spinlock_wait_cycles":9966080,"thread_start_us":476152,"threads_started":2,"wal-append.queue_time_us":412424}
I20260709 12:12:15.540119 11284 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:12:15.544510 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:15.547237 11144 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:15.520676 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.551625 11286 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:15.542363 11138 rpcz_store.cc:276] 0709 12:12:14.457919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.458031 (+   112us) service_pool.cc:224] Handling call
0709 12:12:14.458302 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:14.466982 (+  8680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.467028 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:14.467712 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 12:12:14.563726 (+ 96014us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:12:14.770032 (+206306us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:14.770088 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.770169 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.393151 (+622982us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:15.486724 (+ 93573us) raft_consensus.cc:1685] finished
0709 12:12:15.486754 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.506253 (+ 19499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8296,"raft.queue_time_us":12057,"raft.run_cpu_time_us":2095,"raft.run_wall_time_us":88306,"spinlock_wait_cycles":36103680,"thread_start_us":269159,"threads_started":1,"wal-append.queue_time_us":371099}
I20260709 12:12:15.548069 17319 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.564643 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:15.564162 11211 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:15.550195 17446 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.578821 17314 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:15.582402 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 80885.4us
I20260709 12:12:15.583541 17344 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:15.584082 17344 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.584538 17344 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:15.586882 17365 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.587977 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:15.588816 11853 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.591456 17317 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.587108 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:15.589548 17365 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.601799 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:15.547297 17391 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.592226 17446 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:15.603928 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.569182 17348 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.606669 11858 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:15.612365 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:15.574906 17270 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.606452 17446 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.609513 11037 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 10, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.636341 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:15.644459 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 174310us
I20260709 12:12:15.625381 17330 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.628839 17432 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:15.613852 17257 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:12:15.654971 17260 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:15.655561 17260 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.655941 17260 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.656569 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:15.657771 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.641317 17317 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.625484 17348 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.663750 17330 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.671188 16741 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.641216 17107 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.636075 11037 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.675348 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.666823 17432 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:15.677316 17432 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.678835 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.676891 11037 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 8 to 16, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 16 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:15.680576 17334 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.681334 17334 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.681115 11037 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.680573 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.680656 11211 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:15.688684 11853 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:15.691771 17330 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.692268 17334 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.694530 17359 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:15.696605 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1171) took 1051 ms. Trace:
I20260709 12:12:15.664072 17388 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260709 12:12:15.701095 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 139361us
I20260709 12:12:15.701977 11144 rpcz_store.cc:276] 0709 12:12:14.644757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.646192 (+  1435us) service_pool.cc:224] Handling call
0709 12:12:14.647481 (+  1289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:15.564558 (+917077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.696296 (+131738us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54001243d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:15.696521 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054459264}
W20260709 12:12:15.708781 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46428.5us
I20260709 12:12:15.685024 17445 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.682888 17264 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.718014 17330 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:15.723141 11037 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.761153 11037 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 15, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 15 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:15.701882 17359 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:15.763300 17359 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.764453 17359 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:15.731609 17391 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:15.689579 17287 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.763163 11037 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.728083 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:15.732086 17348 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:15.777729 17449 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.206s	user 0.005s	sys 0.004s
W20260709 12:12:15.779199 17454 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:12:15.780299 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:15.791834 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 63993.2us
W20260709 12:12:15.793707 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 144698us
W20260709 12:12:15.798081 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.764431 17330 consensus_queue.cc:1243] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:15.742442 17334 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:12:15.798714 17391 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:15.774195 17260 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.815415 17410 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:15.815964 17410 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:15.814311 11182 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:15.816913 17270 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.817071 17407 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.813664 17116 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:12:15.818444 11037 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.820430 11037 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 13, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 13 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.818522 17257 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.823135 17257 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:15.823589 17365 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:12:15.824234 17257 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.816640 16869 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:15.817793 17407 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:15.816710 17410 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.813962 17110 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.826983 17391 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.839221 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:15.848852 11142 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:15.845283 17330 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:15.845893 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.843200 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.827165 17314 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:15.851941 11853 raft_consensus.cc:2393] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:15.856815 17457 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:12:15.857169 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.857877 11284 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.859692 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:15.861824 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.861192 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:15.864662 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.850919 17391 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:15.867890 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.863547 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.869632 11855 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.869701 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:15.852684 17314 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:15.891269 11293 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:15.891897 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:15.881115 17458 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:12:15.899669 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.822331 11037 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 15, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 15 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:15.906450 17314 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.933207 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.934007 17314 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.934620 17282 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:15.934192 11037 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 15, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 15 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:15.908638 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2633) took 1460 ms. Trace:
I20260709 12:12:15.908109 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:15.917634 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.935575 11142 rpcz_store.cc:276] 0709 12:12:14.448038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.450381 (+  2343us) service_pool.cc:224] Handling call
0709 12:12:15.908390 (+1458009us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400264654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:15.908547 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729124352}
I20260709 12:12:15.918177 17382 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:12:15.918913 17116 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.919287 17386 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.927867 17229 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:15.929329 17407 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:15.930976 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.931102 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:15.932487 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.935077 17282 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:15.915405 17260 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:15.937924 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.938598 11290 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:15.950578 17386 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.951303 17116 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:15.960619 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83979.8us
I20260709 12:12:15.961279 11289 raft_consensus.cc:2410] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 19 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:15.961532 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:15.954178 16802 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:15.962591 16802 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:15.963196 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:15.949222 17359 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.960664 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.976181 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:15.948949 17229 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:15.978088 11141 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.955432 17282 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:15.981626 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.984638 11293 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.987651 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.988207 11286 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:15.997808 11853 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:15.998811 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.998968 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:15.999666 11289 raft_consensus.cc:2368] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:12:16.000890 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:15.983506 17270 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:16.003852 17270 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.005545 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.006036 17270 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.006258 11143 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:16.007058 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.006179 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.009157 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.011627 17264 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.012284 17264 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.007980 11137 raft_consensus.cc:2410] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:12:16.014711 16741 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:16.015295 16741 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:16.015177 17116 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.015776 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.016624 11137 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:16.016360 16741 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.017611 11143 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:12:16.019037 11138 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:16.010387 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.018636 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.039253 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.040220 11143 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:15.953944 17344 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:16.052600 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.057775 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 91731.6us
I20260709 12:12:16.018638 17319 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:16.063256 11284 raft_consensus.cc:2410] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:16.014426 17264 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.064805 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.071662 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.069758 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.074591 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.075284 11143 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.070458 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:16.082664 17326 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.083544 17326 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.065059 17270 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.087178 17270 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.088363 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:16.090688 17432 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.091902 16802 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.091604 17432 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.089543 17270 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.094939 11137 raft_consensus.cc:2368] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12.
I20260709 12:12:16.058409 17359 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.086663 11037 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 17, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 17 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:16.075845 17260 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.094285 17382 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:16.111096 17260 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.111467 17382 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.112972 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.113795 17382 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:16.115127 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.039543 17334 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:12:16.116590 17359 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.059067 17396 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.118669 11136 raft_consensus.cc:2410] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:16.119956 11287 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:16.086359 17326 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.129817 11291 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17.
I20260709 12:12:16.132458 11141 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:16.133652 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.136951 17391 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.128537 17264 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.117622 16802 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.113866 17260 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.147871 17264 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.148765 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.150199 17391 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.171041 11285 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:16.151743 17386 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.152971 17407 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:16.183351 17407 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.185214 17270 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.185807 17407 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.186028 17270 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.186761 17317 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:16.187400 17317 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.153607 17257 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.189512 17257 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.190212 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.191581 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.154919 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:16.192384 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.192739 11284 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:16.193014 17446 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.001s
I20260709 12:12:16.193413 17446 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.158011 17396 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.194949 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.195713 11855 raft_consensus.cc:2393] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:16.196259 17396 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.196985 17432 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.196938 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.193019 11139 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:12:16.200595 11139 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:16.200903 17257 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.201560 16802 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.202586 16741 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:16.203171 16741 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:16.203652 16802 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.204344 16741 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.156149 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.157949 17326 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.161163 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:16.161664 17344 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.162912 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.163931 11286 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.164561 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.166533 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.177490 11143 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
W20260709 12:12:16.217350 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50904.9us
I20260709 12:12:16.104508 17410 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.182677 17275 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.188966 17270 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.196488 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.228338 11141 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:16.214380 11858 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:16.158679 11037 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 10, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 10 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:16.219515 17326 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.216699 11289 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:16.189529 17317 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.220410 17282 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:16.231724 11284 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:16.226662 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.232146 11110 leader_election.cc:400] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:12:16.116864 17229 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.225165 17386 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:16.247975 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.271831 11110 leader_election.cc:403] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:12:16.253857 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.273869 11142 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:16.258212 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.277318 11858 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:16.236415 17326 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:16.241170 17473 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:16.307649 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:16.249933 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.236s (SENT) [suppressed 21 similar messages]
W20260709 12:12:16.334775 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.255771 17264 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.327224 11286 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:16.337554 17270 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 11. Current term is 12.
I20260709 12:12:16.340981 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.343909 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.344622 11218 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.347604 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.348065 17410 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.348515 11215 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
I20260709 12:12:16.335690 17407 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:16.349501 17407 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.350921 11213 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:16.351291 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.352070 17407 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.352387 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.353281 11217 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:16.353760 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.354450 11210 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:16.356559 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.357115 11210 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.270555 17386 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.323562 11293 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:16.250108 16869 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 12:12:16.322214 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103780us
I20260709 12:12:16.235419 17365 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:16.352782 11215 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.313843 17382 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:16.367578 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 306566us
I20260709 12:12:16.369203 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.363183 17396 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.376680 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:16.234617 17275 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.378394 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.377540 11853 raft_consensus.cc:2368] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:16.367287 17386 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.380301 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.385802 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.386837 17027 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:16.377055 17446 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.388622 11110 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17.
I20260709 12:12:16.367017 17319 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:16.403689 11110 leader_election.cc:403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:16.379199 17326 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.391831 17344 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.406904 17344 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:16.407315 17344 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.407203 17319 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.411888 17282 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:16.417477 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.369402 17365 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:16.418788 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.388808 11210 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:16.390766 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.368693 17382 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.389935 11218 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:16.394505 11037 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 15, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.423971 11182 leader_election.cc:400] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:16.429647 11182 leader_election.cc:403] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:16.428917 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.429680 11219 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:16.429003 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 179096us
W20260709 12:12:16.432420 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58272.1us
I20260709 12:12:16.430873 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.388370 17396 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.435566 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.464854 11037 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 15, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:16.469127 11215 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:12:16.470086 17476 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:16.470924 17275 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:16.471184 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65704.4us
I20260709 12:12:16.471480 17410 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:16.471267 17483 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:16.472143 17483 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.472474 17476 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:16.472986 17382 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:16.472581 17483 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.427124 17287 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:16.480160 11143 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:16.430262 17270 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17.
I20260709 12:12:16.430836 17282 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:16.485298 17334 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.488915 17334 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:16.489934 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet ddd0a7b2bb3645519f8c5c9bf85633d9: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:16.434681 17027 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:16.499289 17282 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:16.429212 17110 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:12:16.503309 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.504698 16869 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:16.504978 17282 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.506860 17334 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:16.507916 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:16.511647 17314 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 12:12:16.504609 11286 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:16.486868 17287 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.514922 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.518850 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.521066 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:16.522799 17027 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.523999 17396 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.526858 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.493878 11037 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.528313 11037 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 16, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.530076 11037 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 15, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:16.531626 11037 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:16.534852 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.535738 11288 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:16.537487 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.542747 11285 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:16.512036 17344 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.545028 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.546926 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.549897 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.550518 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:16.551198 11290 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:16.516709 17287 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.553021 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.556469 11853 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:16.558048 17110 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:16.550557 17365 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.559566 17365 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.560571 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.561241 11291 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:16.562278 11826 leader_election.cc:400] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
I20260709 12:12:16.562636 11826 leader_election.cc:403] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 12:12:16.562830 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 129873us
W20260709 12:12:16.557953 17481 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.143s	user 0.004s	sys 0.012s
I20260709 12:12:16.566061 11288 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:16.565099 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.565099 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.473732 17476 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.573256 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.573724 11289 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:16.573333 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.575775 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.576191 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.563584 17396 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:16.578258 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.581211 17410 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:16.581918 17410 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.582374 17410 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.583851 17257 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.584916 17480 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.585446 17480 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.586462 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.587949 17480 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:16.588635 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.588907 17344 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.589345 17110 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.589656 11219 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:16.589891 17110 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.592427 17110 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:16.593411 11219 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:16.593672 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.594373 11859 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:16.595808 17466 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.596624 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:16.597628 11107 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:16.597898 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:16.598188 17466 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.598968 17110 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:16.599540 17110 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.599968 17110 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.602135 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.563755 17314 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:16.604894 17314 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.606685 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.606837 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.607690 17314 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:16.610194 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 35f8f77c6e8c4a66b41088646a9c8c90: Illegal state: Replica 018d40ceb45d4447aa293f4c1d929bb8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:16.610586 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:16.611296 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57906us
I20260709 12:12:16.612519 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.612550 17474 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:16.611483 17482 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 12:12:16.614537 17474 raft_consensus.cc:2764] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 12:12:16.615525 17487 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:12:16.619228 17229 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.608598 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.620785 11137 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:16.621382 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:16.625092 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.625280 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.632236 11852 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:16.634548 11218 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:16.647675 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.648252 11211 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
W20260709 12:12:16.660128 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.666558 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 68727.1us
I20260709 12:12:16.668887 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.639220 17388 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 13. Current term is 14.
I20260709 12:12:16.639806 17396 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:16.731534 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.732129 11290 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
W20260709 12:12:16.732180 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62181.8us
I20260709 12:12:16.736357 11213 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:16.665946 17391 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.650352 17407 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
W20260709 12:12:16.786254 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118790us
I20260709 12:12:16.786532 11212 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.793807 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.794759 11141 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:16.773913 17314 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:16.797022 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.797782 11214 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:16.672605 17410 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.801491 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.724318 17483 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:16.809788 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.805747 11135 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:16.809123 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.633371 11037 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 18. New cstate: current_term: 18 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:12:16.841270 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50387.6us
I20260709 12:12:16.843186 11215 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:16.784835 17391 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.844291 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.799425 17386 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.851209 17483 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.861127 11135 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:16.860867 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:16.863276 17491 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:12:16.819284 17314 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:16.873549 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.863304  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:16.876754 11142 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:16.878095 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.889001 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:16.892220 17116 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:16.895773 17410 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:16.901654 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.915648 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:16.919149 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:16.883872 17396 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:16.920498 17396 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:16.920926 17396 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.925750 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.927567 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.928699 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.925844 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.923947 11037 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 20, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 20 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:16.937878 11037 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:16.938717 11284 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:16.939340 11037 catalog_manager.cc:5697] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.940925 11037 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:16.942868 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.944183 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.945272 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.945488 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.946257 11291 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:16.946655 11216 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:16.947759 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.947870 11290 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:12:16.948323 11290 pending_rounds.cc:85] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 8
I20260709 12:12:16.948653 11290 pending_rounds.cc:107] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:12:16.948927 11290 raft_consensus.cc:2889] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:16.948994 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.950810 17365 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:16.952570 17499 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
W20260709 12:12:16.955474 17505 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:16.956079 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.957345 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.987613 11141 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:16.950217 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:16.958737 11288 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.958833 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.989902 11137 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:16.959638 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.960945 17319 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:16.961355 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:16.963234 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.964315 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:16.964694 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:16.965400 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:16.885515 17391 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:16.972841 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53827.1us
I20260709 12:12:16.996059 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:16.974516 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:16.946370 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.948369 11216 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:16.991286 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:16.991010 11144 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:16.994637 11135 raft_consensus.cc:2376] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17. Re-sending same reply.
I20260709 12:12:16.992095 17365 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:16.999940 11853 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:17.001209 11214 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:17.005719 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.003659 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:17.014072 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.016037 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.006655 11219 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:17.019495 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.019547 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:16.987370 17466 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.019333 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:17.024077 11288 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:17.025491 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.027678 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:17.028861 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.029182 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.029532 11212 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:17.030714 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.030843 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.030344 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.031399 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.031680 11217 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:17.030315 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.033743 11292 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.034611 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:17.041086 11215 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:17.042892 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.043882 11293 raft_consensus.cc:2368] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:17.039722 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:17.000730 17282 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.063524 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.012203 17407 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:17.067966 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:17.068785 11212 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:17.072983 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.076187 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:17.076774 11214 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:17.072618 17275 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:17.078718 17275 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.079092 17275 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.072781 17466 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:12:17.083427 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.083912 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.086225 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.093729 17475 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.093603 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.093564 17466 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:17.095722 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.097069 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.096414 11213 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:17.004745 17287 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.066038 17282 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.106129 11288 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:17.106971 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.110848 11217 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:17.057598 17410 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:17.132169 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48349.5us
I20260709 12:12:17.023461 17110 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:17.106433 17446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.034s	sys 0.037s
W20260709 12:12:17.136366 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 142140us
I20260709 12:12:17.156612 11212 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:17.158417 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.155793 17386 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.104104 17466 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:17.164896 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.166128 11184 leader_election.cc:400] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 11 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12.
I20260709 12:12:17.130959 17282 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:17.168812 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 249012us
W20260709 12:12:17.161464 17446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.034s	sys 0.037s
I20260709 12:12:17.130772 17319 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.138609 17476 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.175688 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.108522 17257 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 12:12:17.178691 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 174416us
I20260709 12:12:17.179972 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.168355 17161 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.187717 11292 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
W20260709 12:12:17.197041 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63840.3us
I20260709 12:12:17.164255 17407 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:12:17.198113 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.188354 17116 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.202165 11292 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:17.175627 17410 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:17.247107 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49087.7us
I20260709 12:12:17.248461 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.196342 17314 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:17.283231 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet f1f091d9f19d495da80e2f33e1044577: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:12:17.283136 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 308728us
I20260709 12:12:17.229785 17365 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:17.306752 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58401.8us
I20260709 12:12:17.339443 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:17.354751 17314 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.331393 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
W20260709 12:12:17.358518 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 384935us
W20260709 12:12:17.359127 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 339710us
I20260709 12:12:17.359985 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.360881 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.361804 17386 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:17.362224 17386 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:17.362648 17386 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:17.360898 17264 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.362685 17370 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:17.363972 17370 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.364404 17370 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.364126 17466 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.365638 17466 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.362314 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.344705 17260 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.367092 17260 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:17.369472 17260 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.370657 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.321862 17116 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:17.373819 17229 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.002s
I20260709 12:12:17.375735 17326 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:17.380193 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:17.381062 11137 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
W20260709 12:12:17.310045 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.388500 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:17.340835 17161 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.336469 17476 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:17.370805 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.400192 17519 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:17.400777 11855 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:17.401559 17519 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:17.401918 17519 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:17.391175 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50121.5us
I20260709 12:12:17.403694 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:17.389020 17504 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.526s	user 0.003s	sys 0.001s
I20260709 12:12:17.408932 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:17.410831 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 230930us
W20260709 12:12:17.428725 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 253107us
I20260709 12:12:17.429949 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.408144 11216 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:12:17.435271 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64686.6us
I20260709 12:12:17.439901 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.440903 17392 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.443158 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.410192 17326 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:17.445647 17326 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.446151 17326 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.450692 17379 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.451526 17379 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:17.406323 17110 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:17.396023 17287 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.411872 17264 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:17.464637 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.326443 17275 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.472152 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.412206 17476 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:17.427023 17270 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.392544 17386 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.464308 17391 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.471279 17264 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.474864 17407 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:17.403144 17519 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:17.518801 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.467762 17326 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.489053 17410 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.486506 17257 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:17.524427 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83366.3us
W20260709 12:12:17.529625 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 116410us
W20260709 12:12:17.530202 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 87172.1us
I20260709 12:12:17.531329 11290 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:17.513672 17264 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.510197 17475 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.488713 17287 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:12:17.534888 11825 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:17.515887 17407 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.543226 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.544216 11285 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:17.536983 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.508659 17110 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:17.521770 17480 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.554872 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.501850 17520 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:12:17.561797 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.562381 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:17.552069 17396 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.002s
I20260709 12:12:17.563308 11290 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.548491 17287 consensus_queue.cc:1243] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:12:17.559661 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 131596us
I20260709 12:12:17.537520 17319 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:17.566370 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.551728 17407 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.568115 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:17.559917 17506 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.696s	user 0.004s	sys 0.000s
I20260709 12:12:17.562254 17534 raft_consensus.cc:2764] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 12:12:17.580943 17500 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.716s	user 0.004s	sys 0.000s
I20260709 12:12:17.570837 17396 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.557042 17270 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:17.584260 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:17.585083 11289 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:12:17.559077 17229 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:17.587613 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:17.583580 17365 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:12:17.560789 17476 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:17.604018 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.601508 11140 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:17.617779 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.616182 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.562414 17110 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.583338 17520 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:17.627853 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.588109 17229 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.601773 17326 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.583985 17319 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:17.667032 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49364.3us
I20260709 12:12:17.665745 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.597581 17282 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.677613 11135 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
W20260709 12:12:17.680907 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 208836us
I20260709 12:12:17.692611 11185 leader_election.cc:400] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19.
I20260709 12:12:17.647442 17344 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:17.664053 17506 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:12:17.592175 17480 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.627440 17270 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:17.696228 17365 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.686650 11290 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:17.631034 17520 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:17.690433 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.693802 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.664347 17535 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.696446 11219 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:17.690943 17370 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.723970 11293 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:17.724969 17282 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:17.725471 17370 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.677472 17534 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:12:17.727250 17370 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:17.727636 17370 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:17.717188 17110 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.714159 17116 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.719293 17270 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.721678 17520 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.707365 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.729049 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.689303 17229 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.696817 17326 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.693606 17275 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:17.751932 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44670.3us
I20260709 12:12:17.752548 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.752758 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:17.745242 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51538.9us
I20260709 12:12:17.756415 11219 raft_consensus.cc:2410] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:12:17.750749 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.758383 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:17.706987 17386 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.764673 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.734789 17282 raft_consensus.cc:2764] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:17.766413 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.770577 11217 raft_consensus.cc:2376] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17. Re-sending same reply.
I20260709 12:12:17.771008 17344 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:17.768325 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:17.773306 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.774114 17370 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.756681 17515 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:17.771111 17526 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:17.775780 17526 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:17.776209 17526 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.775942 17264 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.778234 17264 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.782441 17526 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.782670 17275 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:17.784266 17275 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:17.784627 17275 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:17.784765 17526 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:17.786099 17523 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:17.786178 17522 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:17.786696 17523 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:17.769260 11218 raft_consensus.cc:606] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.787140 17523 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:17.787242 11218 raft_consensus.cc:614] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:17.785522 17275 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:17.788630 17275 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:17.758667 17161 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.792407 17396 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:17.792821 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.793730 17480 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.794124 17480 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.794457 17480 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.769373 17326 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.796607 11137 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:17.797017 17370 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.797502 11139 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:17.796459 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:17.799631 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:17.800226 11143 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.803184 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.804097 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.808458 11139 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:17.814468 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.768298 17534 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.819818 11136 raft_consensus.cc:1240] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:17.821030 17386 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.812925 17319 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:17.823074 17520 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:17.826083 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67768.3us
I20260709 12:12:17.826700 11143 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:17.826105 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.831724 11140 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:17.830165 17541 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:12:17.834142 11293 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:17.835691 11284 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:17.836122 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.836934 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.837591 11292 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.847086 17326 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:17.847259 17534 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.849824 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.843026 17396 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:17.859557 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:17.863649 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.864566 11216 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:17.868973 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.870752 11292 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:17.766398 17407 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:17.878098 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:17.857424 17270 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:17.883585 11214 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:17.886353 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.887300 11212 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.888978 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:17.890268 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.891067 11217 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:12:17.861405 17514 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.448s	user 0.000s	sys 0.004s
I20260709 12:12:17.880681 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.894887 11136 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:12:17.896472 11136 pending_rounds.cc:85] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 7
I20260709 12:12:17.896791 11136 pending_rounds.cc:107] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:12:17.897097 11136 raft_consensus.cc:2889] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.895124 11213 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:17.874673 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.856666 17526 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.902809 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.903926 17110 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:17.904618 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.899397 17526 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:17.866062 17396 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:17.911398 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.912207 11292 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.915162 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:17.915490 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 112391us
I20260709 12:12:17.916182 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.916306 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.915225 11284 pending_rounds.cc:85] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 8
I20260709 12:12:17.916779 11286 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.917044 11284 pending_rounds.cc:107] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 12:12:17.917557 11284 raft_consensus.cc:2889] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.918064 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:17.918727 11138 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:17.894531 17535 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.894731 17270 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:17.922573 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.926813 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:17.927456 11214 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:17.924538 11136 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:17.857240 17523 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:17.925225 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.932194 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:17.904605 17110 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.876121 17326 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:12:17.906175 17264 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.931053 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:17.921554 16741 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:12:17.933108 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.977110 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:17.977789 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46896.1us
W20260709 12:12:17.979497 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46516.3us
I20260709 12:12:17.980669 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:17.928647 17270 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:17.941552 17534 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.929018 17515 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.999951 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:17.915220 17344 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:12:17.949853 17319 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.923499 17391 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:12:17.928412 17257 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:12:17.951948 17110 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.005661 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:17.933030 17541 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:12:17.995556 17386 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.017920 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:17.995904 17522 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.997723 17314 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:18.027283 11214 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.022439 11292 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
W20260709 12:12:18.036885 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58259.8us
I20260709 12:12:18.038100 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.014101 17319 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:18.007279 17287 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:12:18.042203 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.018930 17282 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.010303 17534 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.054841 17264 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:18.054616 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:18.066895 17548 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:12:18.043588 17319 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.042908 17386 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:18.075883 17523 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.076620 17407 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:18.029578 17229 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.078637 17526 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:18.052902 17554 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:18.030987 17396 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.035171 17314 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.138674 17314 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.119799 17270 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:18.141415 17544 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260709 12:12:18.141520 17270 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:18.089926 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.143170 11219 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.102409 17480 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.127226 17287 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:18.146800 11135 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.147169 17287 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.148380 17480 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:18.148550 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3223) took 1181 ms. Trace:
I20260709 12:12:18.149307 17287 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:18.104327 17379 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:18.149006 11288 rpcz_store.cc:276] 0709 12:12:16.967244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.128156 (+160912us) service_pool.cc:224] Handling call
0709 12:12:17.128429 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.191240 (+ 62811us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:17.413538 (+222298us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.611789 (+198251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:17.611855 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:17.611914 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.148263 (+536349us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b540031a6d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:18.148319 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.148482 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71841,"prepare.queue_time_us":54331,"prepare.run_cpu_time_us":3854,"prepare.run_wall_time_us":26165,"raft.queue_time_us":71956,"spinlock_wait_cycles":160069632,"thread_start_us":337149,"threads_started":2,"wal-append.queue_time_us":200255}
I20260709 12:12:18.108755 11214 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:18.152467 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.152983 11214 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.155793 17534 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:18.115175 11217 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:18.115558 11212 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
W20260709 12:12:18.117214 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62734us
I20260709 12:12:18.119158 17344 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:18.119987 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 120133us
I20260709 12:12:18.157266 17229 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:18.157678 11212 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:18.158262 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.160537 17520 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.161172 17282 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:18.161686 17282 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:18.162037 17520 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:18.126339 11216 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:18.120340 17264 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:18.157060 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.179586 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:18.180263 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:18.180644 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.181274 11292 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:18.180315 11288 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
W20260709 12:12:18.183161 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 263247us
I20260709 12:12:18.186996 11135 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:18.188999 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:18.190160 11217 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:18.192109 11214 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:18.193526 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.194778 11214 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:12:18.162045 17282 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.198153 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.175709 17386 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:18.199498 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.201957 11293 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:18.175171 17270 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.199164 11216 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.204263 17161 consensus_queue.cc:1059] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.204536 17521 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:18.206151 17275 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:18.176132 17520 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:18.207598 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.197496 17561 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.182700 17344 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:18.146415 17110 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.220711 11219 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:18.208155 17407 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:18.228713 11214 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:18.191215 17319 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.224036 17534 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.234074 11216 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:18.246991 17520 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:18.235283 17538 raft_consensus.cc:3055] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:18.235689 17521 consensus_queue.cc:1243] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:12:18.273970 17519 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.276988 17314 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.279732 17466 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:18.280118 17466 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:18.280920 17466 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.282081 17466 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.221264 17270 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.269804 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:18.288606 11216 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:18.313243 17410 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:18.313767 17410 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:18.314113 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:18.314862 11216 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:18.253513 17561 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.319289 17314 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:18.320618 17344 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.323484 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.263970 17538 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:18.327293 17538 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.328600 17538 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:18.329265 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 758646us
I20260709 12:12:18.331528 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.333734 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:18.334357 11285 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.334738 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.336405 11139 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:18.338645 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:18.339336 11859 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.349471 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.349975 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.350775 11284 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:18.349471 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:18.351631 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.350371 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.350323 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.250869 17534 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.357851 11144 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:18.360474 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.239260 17264 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.367539 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.368230 11140 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.369163 11142 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:18.351222 17161 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.373327 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:18.354965 17521 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.373981 11142 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
W20260709 12:12:18.377754 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45849.9us
I20260709 12:12:18.354311 17541 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:18.383780 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.385402 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.311617 17386 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.387236 11142 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.391049 11284 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:18.391175 17519 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.391978 17519 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.392326 17519 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:18.389133 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.393142 17520 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:18.393601 17520 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:18.393991 17520 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.395061 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:18.395756 11858 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:18.397389 17270 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.400002 11142 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:18.393137 17519 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.404927 17519 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.389213 17275 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:18.411396 17275 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:18.412381 17275 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.413398 17520 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.415783 17534 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.420039 17520 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:18.375691 17571 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:18.422422 17319 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:18.423741 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63372us
W20260709 12:12:18.427455 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.431226 11140 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:18.457062 11136 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:18.425132 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.468192 11110 leader_election.cc:400] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:12:18.468506 11110 leader_election.cc:403] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:18.314802 17410 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:18.465534 17527 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.936s	user 0.002s	sys 0.002s
I20260709 12:12:18.474221 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.473693 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:18.475468 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:18.475699 17511 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.058s	user 0.013s	sys 0.007s
I20260709 12:12:18.475595 17287 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:12:18.476854 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:18.462731 17319 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.380414 17521 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.478974 11215 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:18.478528 11858 raft_consensus.cc:2368] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
W20260709 12:12:18.484386 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103202us
I20260709 12:12:18.472308 17270 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.486557 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.490751 11256 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:18.489974 11853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:18.496426 11853 raft_consensus.cc:606] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.496848 11853 raft_consensus.cc:614] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:18.503675 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:18.505684 11256 leader_election.cc:400] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
I20260709 12:12:18.506147 11256 leader_election.cc:403] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:18.484509 17534 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.510581 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:18.519243 17507 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:12:18.523434 17524 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:18.524116 17524 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.524610 17524 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.491158 17270 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:18.535430 17517 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.027s	user 0.004s	sys 0.000s
I20260709 12:12:18.537101 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1295) took 1565 ms. Trace:
W20260709 12:12:18.537344 17525 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 1.118s	user 0.002s	sys 0.006s
I20260709 12:12:18.537550 11852 rpcz_store.cc:276] 0709 12:12:16.971325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.973542 (+  2217us) service_pool.cc:224] Handling call
0709 12:12:16.992352 (+ 18810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.999254 (+  6902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.999303 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:16.999864 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.178435 (+178571us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:17.178492 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.178634 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.474676 (+1296042us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:18.536744 (+ 62068us) raft_consensus.cc:1685] finished
0709 12:12:18.536770 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.537011 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8502,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":16837,"spinlock_wait_cycles":84166016,"thread_start_us":178121,"threads_started":1,"wal-append.queue_time_us":405323}
I20260709 12:12:18.546630 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.498899 17579 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:18.558533 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 73476.3us
I20260709 12:12:18.515467 17534 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:18.486718 17319 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.562093 17575 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.546160 17270 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:18.562381 17531 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.137s	user 0.004s	sys 0.006s
I20260709 12:12:18.554476 17579 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.571398 17575 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.563534 17534 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:18.583472 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 102228us
I20260709 12:12:18.584848 17287 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:18.550995 17379 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:18.586593 11216 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:12:18.589593 11216 pending_rounds.cc:85] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 6
I20260709 12:12:18.589917 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.589939 11216 pending_rounds.cc:107] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:12:18.591239 11216 raft_consensus.cc:2889] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:18.587751 11258 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.592804 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.604476 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.582579 17579 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:18.617247 11136 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
W20260709 12:12:18.608552 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 103785us
I20260709 12:12:18.598460 17480 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:18.598058 17314 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:18.621673 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.621467 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:18.627703 17552 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.591s	user 0.005s	sys 0.001s
I20260709 12:12:18.631028 17480 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:18.639333 17576 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:18.639954 17575 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.641878 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:18.642549 17564 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.643882 11285 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:18.660076 11859 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:18.626065 17523 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:18.646610 17526 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
W20260709 12:12:18.691286 17517 log.cc:927] Time spent T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:12:18.742251 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 134205us
I20260709 12:12:18.643186 17564 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:18.747038 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 79949.8us
I20260709 12:12:18.725338 17521 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.725839 17282 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.745489 17523 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:18.757560 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:18.770118 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:18.758319 17257 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.691039 17480 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.791106 11143 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:18.787016 17257 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.796260 17319 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.796878 17319 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:18.787750 17388 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.011s
I20260709 12:12:18.777043 17314 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:18.818738 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61245.7us
I20260709 12:12:18.825748 17257 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:18.827126 17584 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:12:18.829051 17116 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.829756 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.829713 17116 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.831712 17539 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.831185 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.833170 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.833873 17386 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:18.834138 17116 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.831405 11213 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:18.834638 17386 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:18.835093 17386 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:18.835825 17564 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:18.841401 17561 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.842156 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:18.843146 17568 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:18.843708 17568 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:18.844275 17595 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:18.844846 17595 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:18.844621 17568 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.847656 17282 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:18.836026 17386 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.852854 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.853025 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.853603 11140 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.853752 17539 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.856472 11110 leader_election.cc:400] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 14. Current term is 15.
I20260709 12:12:18.859037 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:18.860670 11288 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:18.864770 11286 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:18.901067 11290 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:18.904729 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.905652 11290 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:18.909649 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:18.910739 11292 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:18.815757 17588 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:18.924013 11291 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:18.924510 11291 pending_rounds.cc:85] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 12
I20260709 12:12:18.924793 11291 pending_rounds.cc:107] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:12:18.925088 11291 raft_consensus.cc:2889] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:18.859351 17538 consensus_meta.cc:287] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.530s	user 0.014s	sys 0.001s
I20260709 12:12:18.927413 11286 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.935643 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:18.936375 11213 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:18.936525 17287 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:12:18.937577 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 116335us
I20260709 12:12:18.938246 17326 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.926338 17539 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:12:18.938969 17326 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:18.939599 17539 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:18.939985 17539 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:18.940764 17539 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.941861 17326 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:18.942054 17539 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.922693 17564 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:18.947005 17564 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.947517 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:18.948341 11143 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:18.950142 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:18.950765 11143 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.933104 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.951741 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:18.952124 11288 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:18.938553 17575 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:12:18.958587 17396 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:18.959264 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:18.960433 17590 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:18.960994 17590 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:18.962054 17590 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:18.969647 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 348548us
I20260709 12:12:18.986903 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:18.930332 17116 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:18.926641 17520 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:18.984318 11107 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:18.994959 11140 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:18.996158 11285 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:18.845975 17595 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.971071 17541 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:19.001946 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:18.978457 17476 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:19.019556 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:18.934547 17275 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:12:18.911486 17523 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:18.972033 17334 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 12:12:18.982532 17466 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:12:19.063917 17541 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.063613 17568 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:19.064674 17476 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.067174 17386 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.066452 17446 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:19.093695 17559 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:12:19.000555 17116 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.130827 11216 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:19.001448 17520 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.120800 17476 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:19.145341 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:19.146396 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:18.997994 17579 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.098407 17595 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.145386 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.155036 11211 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:19.099169 17564 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.117969 17541 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.102583 17319 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.066798 17524 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:19.178959 17581 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:12:19.173930 17583 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.192s
I20260709 12:12:19.181888 17520 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.069435 17314 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:19.217111 17544 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:12:19.182807 17282 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.140791 17446 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.247942 17396 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:19.248533 17396 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:19.249472 17396 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.222208 17319 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.264263 17275 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:19.265599 17534 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
W20260709 12:12:19.266525 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 142237us
I20260709 12:12:19.279057 17466 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.279681 17466 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.281786 17466 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.283973 17116 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.284233 17524 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.285465 17319 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.266106 17534 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.256983 17282 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.289776 17282 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.290977 17541 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.345000 11217 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 12:12:19.294754 17582 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:19.346323 17541 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.297876 17579 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:19.300457 17270 consensus_meta.cc:287] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.721s	user 0.013s	sys 0.000s
I20260709 12:12:19.347486 17270 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.349952 17270 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.301426 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:19.352275 11292 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.275239 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:19.307106 11211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:19.359073 11211 raft_consensus.cc:606] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:19.359522 11211 raft_consensus.cc:614] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:19.360335 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85201.5us
I20260709 12:12:19.366295 11292 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:19.372503 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:19.312629 17476 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:19.403182 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 488206us
I20260709 12:12:19.321919 17539 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.331538 17568 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.404088 17568 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:19.293061 17534 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.296435 17446 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.301642 17396 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.408049 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:19.414304 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:19.417562 11216 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:19.418941 11286 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:19.427026 11287 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:19.427541 11214 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:19.382201 17561 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.382822 17582 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:19.439814 11218 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:12:19.437048 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:19.440460 11286 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:19.444967 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:19.416440 17579 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:19.467327 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:19.467908 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.415787 17476 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.473152 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:19.433483 17534 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.416972 17539 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.480103 11286 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:19.440132 17582 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.449517 17595 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:19.483055 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.487422 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:19.506362 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.465503 17590 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:19.505337 11286 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:19.467527 17386 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.446354 17561 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.512791 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:19.476403 17579 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:19.606177 11288 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:19.631803 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:19.611243 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:19.481523 17282 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:19.479535 17388 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.636627 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.504841 17582 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.640372 11288 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:19.510366 17523 raft_consensus.cc:2764] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:12:19.624039 17538 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:19.597522 17539 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.510756 17612 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.513434 17568 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.518440 17520 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.486109 17534 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.510512 17319 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.651620 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.648219 17603 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:12:19.596405 17615 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.138s
I20260709 12:12:19.646966 17538 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:19.661115 11286 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:19.635530 17386 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.557123 17590 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.669052 11290 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:19.644382 17282 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:19.673172 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.659286 17520 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.671063 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.643525 17388 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.688946 11288 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:19.690548 17523 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.692116 17520 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.654529 17612 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.684633 17319 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.694798 17538 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:19.687740 17616 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:19.697670 17386 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.699332 17590 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.705971 17534 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.712742 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.716415 17568 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.716391 17603 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:12:19.733495 17410 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:19.733908 17612 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.734014 17603 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:19.734355 17319 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.734637 17603 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:19.722887 17595 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.735498 17595 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.735598 17603 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.736732 17603 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:19.736389 17388 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.729091 17538 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:19.742403 17561 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.687160 17579 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.729171 17568 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.744747 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.745174 17568 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.713964 17523 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:19.719949 17264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.015s	sys 0.015s
I20260709 12:12:19.731319 17615 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.746382 17282 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.761518 17523 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.758371 17595 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:19.750087 17264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.019s	sys 0.015s
I20260709 12:12:19.766129 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:19.772868 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.774775 17110 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.772046 17561 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:19.758651 17615 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:19.780493 17615 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:19.767138 17568 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:19.781675 17568 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.804967 11854 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:12:19.808913 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.809674 11285 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:19.809942 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.810437 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.811482 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.813640 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.815263 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.815662 17568 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:19.817201 17604 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.821s	user 0.000s	sys 0.024s
I20260709 12:12:19.817839 17568 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:19.820487 17613 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:12:19.823171 17264 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:19.829595 17601 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.645s	user 0.000s	sys 0.011s
I20260709 12:12:19.832080 17516 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:19.832561 17516 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:19.833519 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:19.833402 17516 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.834985 17516 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.836021 17582 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:19.844211 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 419691us
I20260709 12:12:19.847174 17476 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.847663 17476 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.848028 17541 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.848481 17541 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.849493 17568 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.849681 17476 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.850174 17568 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.852392 17568 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.854642 17161 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.855140 17161 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.855746 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.857113 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.857744 11860 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:19.859026 17571 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.859556 17571 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.861838 17571 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.829519 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:19.863516 11290 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:19.863639 17568 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:19.864217 17568 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:19.864969 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.866675 17287 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.867051 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:19.867167 17287 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.867645 11144 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.867908 17561 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:19.868393 17561 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.869179 17287 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.871395 11143 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:19.872067 17591 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.949s	user 0.005s	sys 0.010s
I20260709 12:12:19.872357 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:19.873108 17110 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.873658 17110 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:19.874540 17110 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:19.877199 17534 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.877746 17534 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.878253 17534 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:19.881055 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.877576 17536 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:19.882629 17396 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.882998 17536 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:19.883504 17536 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:19.883153 17396 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:19.884631 17562 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.884723 17536 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.886636 17609 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.886972 17475 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.887145 17609 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.887809 11293 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:19.886027 17396 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:19.888628 17396 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:19.889361 17609 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.889859 17609 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.885279 17562 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.892602 17568 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:19.892892 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.893503 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:19.894058 11210 raft_consensus.cc:606] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:19.857139 17161 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.850374 17541 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:19.895311 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.896323 11218 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:19.896739 11212 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:19.887567 17475 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.898849 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.899103 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.899698 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.900068 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.900902 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.887039 17536 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.903724 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.902534 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:19.894366 11210 raft_consensus.cc:614] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:19.904512 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.904512 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.907377 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.907722 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:19.908380 11136 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
I20260709 12:12:19.908507 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.909879 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.902729 17287 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:19.889091 17396 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.838265 17582 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.906673 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:19.814706 11853 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 10.
I20260709 12:12:19.930912 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.931907 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.932106 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.918457 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.919064 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:19.934902 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:19.927464 11143 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:19.917620 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:19.900017 17475 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.932247 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.940241 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.944734 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.945559 11217 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:19.946758 11216 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:19.948607 11140 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.850253 17476 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:19.928041 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:19.960021 11136 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:12:19.888245 11293 pending_rounds.cc:85] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 9
I20260709 12:12:19.936874 11284 raft_consensus.cc:2410] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:19.937340 11219 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:19.938251 11143 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:19.940220  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:19.890290 17609 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:19.919031 17595 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.974915 11136 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:19.975564 11143 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:19.952373 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:19.870361 17561 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.954659 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.980223 11853 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:19.960767 11293 pending_rounds.cc:107] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:19.962244 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.980768 11293 raft_consensus.cc:2889] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:19.980549 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:19.982342 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:19.965232 11139 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:19.966274 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.983073 11858 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
W20260709 12:12:19.968668 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51186.4us
I20260709 12:12:19.949620 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.903725 11144 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:19.970347 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:19.924943 17523 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.977555 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:19.980974 11216 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:19.989048 17319 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:19.993232 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.936810 17526 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.995157 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.002911 11136 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:20.000078 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:19.995610 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:19.926730 17264 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.063s
I20260709 12:12:20.006184 11135 raft_consensus.cc:2368] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20.
I20260709 12:12:19.992897 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:19.992799 17319 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:19.993722 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.020421 11143 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:19.977463 17612 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.012302 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:19.970432 17579 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:20.021409 11211 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:19.992733 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:20.007884 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:20.006739 11182 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 255c201215d14e89bc735bb8b57682cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:20.011765 11140 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:20.039214 11107 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:19.970546 17582 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.068862 11142 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:12:19.978789 17519 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:20.070013 17579 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.070614 17519 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.072978 17579 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.073412 17519 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:19.994750 17524 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:20.042870 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:20.075860 11210 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:20.048501 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.084110 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:20.085350 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.048781 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.087164 11140 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:20.054978 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.089411 11293 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:20.049070 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.091374 11138 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:20.018637 17526 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.000533 17523 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:20.038473 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 68870.9us
I20260709 12:12:19.990265 17520 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.034665 17319 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:20.042428 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.074457 17524 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:20.123376 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.134694 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:20.124933 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.057291 17326 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:20.013058 17370 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.135838 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:20.136860 11136 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:20.125753 17519 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:20.056191 17396 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:19.973004 17476 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.051891 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.013444 17539 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:20.154898 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.162201 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.173615 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.174178 11136 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:20.174944 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.142812 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:19.987612 17595 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.159680 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.054340 17609 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:20.052655 17632 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:12:20.044535 17344 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:20.149917 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:20.145723 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.187307 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:20.194747 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 142979us
I20260709 12:12:20.152390 17287 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.221009 17476 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:20.221477 17287 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.224289 17287 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.146178 17264 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:20.225208 17264 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.188989 17519 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.196951 17539 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.150620 17520 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:20.163431 17590 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:12:20.137883 17571 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:12:20.204638 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.155447 17475 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:20.197417 17599 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.148886 17534 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.209846 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:20.210618 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60804.1us
I20260709 12:12:20.252038 11141 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:20.252235 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:20.151093 17541 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:20.207224 16741 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:12:20.215042 17524 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.217698 17523 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:20.192793 17386 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:20.170728 17568 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.219738 17526 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:20.229483 11136 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:20.236493 11258 leader_election.cc:400] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20.
I20260709 12:12:20.121465 17612 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.241361 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:20.207746 17344 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:20.165853 17370 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.275499 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.203505 17621 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:12:20.304808 11287 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:20.243304 17599 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:20.237526 17588 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:20.277324 11293 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:20.263500 17476 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:20.237087 17446 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.268788 17392 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.289391 17539 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:20.300844 11135 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:20.300544 11258 leader_election.cc:403] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:20.243436 17475 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:20.277845 17582 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.305095 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 117189us
I20260709 12:12:20.299569 17270 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.287660 17388 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.315374 11289 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:12:20.323648 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.330886 11140 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:20.300535 17386 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:20.306337 17344 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:20.292843 17541 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:20.372675 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:20.394932 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71412.7us
I20260709 12:12:20.312602 17599 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:20.396816 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 188158us
I20260709 12:12:20.293773 17229 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:12:20.307647 16741 consensus_queue.cc:1243] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:20.315976 17588 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:20.402064 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.419689 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.438400 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.439291 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:20.439313 11286 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:12:20.423259 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:20.413206 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.426767 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:20.420818 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.374445 17475 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.445899 11286 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:20.447909 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:20.442569 11284 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:20.449023 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.448997 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.450321 11292 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:20.444846 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:20.401629 17386 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:20.401780 17314 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20.
I20260709 12:12:20.401420 17539 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:20.490770 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.330312 17446 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.373616 17161 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:20.492738 17541 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:20.495888 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48049us
W20260709 12:12:20.497452 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74340.4us
I20260709 12:12:20.513375 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:20.445792 17588 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:20.312141 17520 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.372684 17476 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.518474 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.520483 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.451442 17523 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:20.448668 17516 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:20.401857 17582 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.517141 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:20.451215 17615 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.406708 17270 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.403992 17388 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.523389 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.531352 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.503137 17282 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:20.502985 17539 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.509222 17611 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:20.511737 17621 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:20.533279 17516 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:20.533998 17621 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:20.534355 17621 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:20.533303 17539 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.539587 17282 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:20.540216 17282 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:20.542667 17476 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.543689 17568 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.544399 17568 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.545363 17334 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:20.545791 17334 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.546159 17334 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:20.548527 17270 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:20.540272 17631 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:12:20.550865 17388 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.550652 17282 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.545818 17582 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.552101 11141 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:20.553407 17282 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:20.516820 17571 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.517948 17519 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:20.518290 16741 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.522078 17644 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.524451 17523 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:20.528966 17264 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:20.575022 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:20.575619 16741 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.571461 17571 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.581555 11137 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:20.561823 17526 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:20.529788 17314 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:20.596423 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:20.598687 11137 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:20.609639 17539 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.611208 11143 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:20.613096 17539 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.619495 17562 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:20.621374 17446 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:20.623255 17536 consensus_meta.cc:287] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.001s
I20260709 12:12:20.595846 17526 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.624296 17526 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.626669 17652 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:12:20.584807 17523 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:20.634814 17612 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:20.598361 17534 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.639894 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:20.640758 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:20.583446 17644 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.643699 11142 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:20.644078 17644 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.647545 17571 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.649858 11852 raft_consensus.cc:2410] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 20 because replica has last-logged OpId of term: 19 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 16.
I20260709 12:12:20.728255 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:20.728065 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:20.728880 11857 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:20.632342 17319 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.735410 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:20.743456 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 103395us
I20260709 12:12:20.745434 11211 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:20.746804 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.658818 17571 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.755240 11284 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:20.796001 16741 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.800177 17599 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.751632 17314 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:20.802809 17314 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.803339 17314 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.827909 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.829226 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.830717 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.841142 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:20.833724 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 388955us
I20260709 12:12:20.842737 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.842913 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:20.837913 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:20.845460 11285 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:20.837414 17161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60882 (request call id 17) took 3489 ms. Trace:
I20260709 12:12:20.832386 17344 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.847121 17161 rpcz_store.cc:276] 0709 12:12:17.348491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.348655 (+   164us) service_pool.cc:224] Handling call
0709 12:12:17.711259 (+362604us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4c001f1a80. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982ed7e644 00007f982eda5f2d 00007f982eda5b93 00007f9830a341af 00007f9830a33f3e 00007f9830ab9888 00007f9830ad675c 00007f9830ad776a 00007f9830ad691b
0709 12:12:17.713785 (+  2526us) log.cc:844] Serialized 506 byte log entry
0709 12:12:17.801523 (+ 87738us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b5400026cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ae1735 00007f9835aa1d29 00007f982f0201d4 00007f982f020162 00007f982f020091 00007f982f02000c 00007f982f01f2c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:18.134953 (+333430us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540037b020. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a54142 00007f9830a34eaa 00007f9830a3bd53 00007f9830a3bcd9 00007f9830a3bc69 00007f9830a3bc31 00007f9830a3adfd 0000000000388634 0000000000388479 00007f982d9ee475
0709 12:12:18.149637 (+ 14684us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b540037b020. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a54142 00007f9830a34eaa 00007f9830a3bd53 00007f9830a3bcd9 00007f9830a3bc69 00007f9830a3bc31 00007f9830a3adfd 0000000000388634 0000000000388479 00007f982d9ee475
0709 12:12:18.753030 (+603393us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b540037b020. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a5bb26 00007f9830a5549a 00007f9830a54714 00007f9830a34eaa 00007f9830a3bd53 00007f9830a3bcd9 00007f9830a3bc69 00007f9830a3bc31 00007f9830a3adfd 0000000000388634
0709 12:12:20.837320 (+2084290us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":219,"raft.queue_time_us":19538,"raft.run_cpu_time_us":9977,"raft.run_wall_time_us":1640200,"spinlock_wait_cycles":306838528}
I20260709 12:12:20.851353 17319 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:20.854728 17651 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.756023 17571 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.878305 17651 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:20.884326 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 367243us
I20260709 12:12:20.892606 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:20.885056 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:20.898299 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:20.898703 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:20.923282 17658 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:20.924026 17658 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.935768 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:20.883332 17319 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:20.940991 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.941109 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:20.945837 11213 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:20.843748 17386 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.899255 17539 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.887250 17612 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.886786 17651 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:20.955183 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:20.886436 17588 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.933241 17287 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.984246 17654 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.194s	user 0.008s	sys 0.005s
I20260709 12:12:20.966212 17319 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.940215 17599 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:20.928460 17657 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.888523 17334 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:20.964268 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:20.969976 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:20.889506 17475 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:20.891229 17526 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:20.946281 17644 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:20.940241 17652 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.961329 17446 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.028735 11213 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:21.029426 11210 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:20.891497 17621 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:20.930214 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:21.037755 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 107688us
W20260709 12:12:21.030135 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65950.2us
I20260709 12:12:21.044812 11185 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.045787 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.050015 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:21.031512 17407 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.030516 17658 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.035893 17116 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:21.039712 17657 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.065656 11285 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:21.069298 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.030977 17287 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.106820 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.105988 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.039865 17644 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.113662 11291 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:21.043689 17652 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.039309 17446 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.057380 17539 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.116739 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.111918 11144 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:21.117322  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:21.122288 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.119560 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.124142 11140 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:21.124982 17666 ts_tablet_manager.cc:933] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:21.126029 17663 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:12:21.127565 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.050247 17580 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:12:21.065260 17603 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.121166 11291 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:21.128463 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.101752 17535 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.133544 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.074301 16741 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.062464 17116 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.055821 17541 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:21.115419 17344 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.062567 17407 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.136680 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.142295 11137 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:21.127658 17644 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.137548 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.136705 16741 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.143390 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.121249 17520 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:12:21.062961 17582 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 12:12:21.137975 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 94426.8us
I20260709 12:12:21.150791 11137 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:21.135911 17603 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.139706 17116 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:21.136209 17535 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.152451 16741 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.180265 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.147923 17541 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:21.189915 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 115647us
I20260709 12:12:21.193638 17541 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:21.197579 17664 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:21.169790 17287 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.142132 17571 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:21.186761 17523 consensus_meta.cc:287] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.003s
I20260709 12:12:21.176944 17526 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:21.203112 17661 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:21.203534 11137 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:21.217463 17541 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.190680 17475 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.225773 17621 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.227090 17407 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.235584 17319 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.233644 11144 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:21.235378 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 189669us
I20260709 12:12:21.192685 17334 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:21.242111 11853 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:21.225307 17603 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.198954 17588 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.244773 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:21.231482 17446 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.248495 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.251197 17257 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.251627 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.252132 17257 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:21.252738 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.239763 17526 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.253422 17644 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:21.253670 17257 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:21.253842 17526 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.254808 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:21.256143 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.256230 17526 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.237811 17523 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:21.262952 16741 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.258637 17541 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.259867 17652 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.264532 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.250093 17582 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.265821 17582 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.269757 17523 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.271255 17407 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.271957 17407 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.272457 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.263537 17621 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.273346 17621 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.273663 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.274643 17257 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.275275 17410 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:21.277117 17535 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.247605 17612 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:21.277745 17582 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.278175 17612 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.280408 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.281450 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.281787 17520 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:21.282212 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.282662 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.283500 17523 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:21.283931 17523 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.284307 17523 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.285058 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37100 (request call id 1201) took 1301 ms. Trace:
I20260709 12:12:21.285755 11211 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:21.286629 17410 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.286748 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.287068 17410 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.287580 11216 raft_consensus.cc:2393] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:21.287483 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.280476 17612 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.285471 11858 rpcz_store.cc:276] 0709 12:12:19.983719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.984025 (+   306us) service_pool.cc:224] Handling call
0709 12:12:19.984302 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.110848 (+126546us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:20.147582 (+ 36734us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.292024 (+144442us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.292112 (+    88us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:20.292179 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.284808 (+992629us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540050a854. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.284857 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.284995 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40471,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":28768,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":212,"spinlock_wait_cycles":290205440,"thread_start_us":143921,"threads_started":1,"wal-append.queue_time_us":170516}
I20260709 12:12:21.293774 16741 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.292984 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:21.293833 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.292040 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.296802 11137 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:21.297703 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.275485 17621 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.291818 17659 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.302063 17674 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.305042 17674 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.308279 17674 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.308995 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.298326 11210 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:21.312317 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3553) took 1267 ms. Trace:
I20260709 12:12:21.312752 11143 rpcz_store.cc:276] 0709 12:12:20.045238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.493507 (+448269us) service_pool.cc:224] Handling call
0709 12:12:20.493840 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.611606 (+117766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.312069 (+700463us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540028fad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.312255 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269483904}
I20260709 12:12:21.314900 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:21.316598 17579 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:21.317015 17579 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.317353 17579 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.319090 17590 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:21.320791 11144 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:21.324889 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.326689 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.327872 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.328631 11285 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:21.329779 11291 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:21.330184 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.283567 17599 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:21.333822 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.339651 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.282250 17520 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:21.343698 17672 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.348259 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.352020 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:21.353703 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.334522 17599 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:21.342239 17671 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.264693 17314 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.350761 17520 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.372660 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:21.374622 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.370369 17519 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.351357 17526 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.377527 17410 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.377921 17116 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:21.357868 17672 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.349000 17603 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:12:21.403424 17655 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:21.412556 17672 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.413691 17526 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.416792 17526 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.403280 17396 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:12:21.423130 17396 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:21.423612 17396 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:21.424695 17396 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:21.428025 17410 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.428602 17595 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.429419 17595 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.431277 11210 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
W20260709 12:12:21.380656 17667 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.255s	user 0.003s	sys 0.000s
I20260709 12:12:21.382577 17671 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.371762 17599 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.383746 17421 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:21.384804 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.438349 11291 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.436761 17582 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.387347 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1044) took 1476 ms. Trace:
I20260709 12:12:21.389353 17370 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.389252 17579 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.377449 17609 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:21.393864 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.403154 17519 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.409037 17116 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:21.440783 11214 rpcz_store.cc:276] 0709 12:12:19.910847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.911020 (+   173us) service_pool.cc:224] Handling call
0709 12:12:19.933016 (+ 21996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.226990 (+293974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.227038 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.227111 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:20.227182 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.387053 (+1159871us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54000e7ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.387105 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.387258 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675120000}
W20260709 12:12:21.443468 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49676us
I20260709 12:12:21.444665 17609 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:21.448035 17609 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.449473 17609 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.453989 11861 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:21.430117 17595 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:21.454957 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 85311.3us
I20260709 12:12:21.433458 17655 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.441128 17396 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:21.440521 17421 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:21.453464 17521 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:21.469203 17671 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.470029 17679 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.470695 17679 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.473322 17679 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.485716 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.487609 17314 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.487895 17521 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:21.489171 17521 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:21.489568 17521 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:21.492336 17660 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.689s	user 0.008s	sys 0.005s
I20260709 12:12:21.493634 11292 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.460537 17655 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.494937 17541 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:21.495771 17541 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.460621 17523 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:21.500859 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.500913 17523 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.501698 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3548) took 1457 ms. Trace:
I20260709 12:12:21.502136 17541 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.501839 17421 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.503490 17421 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.504298 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.504679 17579 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.505219 11287 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:21.511709 11287 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:21.502171 11136 rpcz_store.cc:276] 0709 12:12:20.043854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.174734 (+130880us) service_pool.cc:224] Handling call
0709 12:12:21.501498 (+1326764us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54002e2cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:21.501623 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124059008}
I20260709 12:12:21.457491 17526 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.526974 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.523376 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.530826 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.531777 11138 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.511948 11292 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:21.535568 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.536370 11136 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:21.537406 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.538080 11136 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:21.516956 17521 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.540580 17521 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:21.540880 17386 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.444103 17582 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.542654 17526 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.543066 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.543895 11287 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:21.537710 17520 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.545908 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.547849 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.548584 11291 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:21.548758 11137 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:21.550314 11185 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.552614 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.554116 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:21.519395 17635 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.195s	user 0.020s	sys 0.017s
I20260709 12:12:21.559589 11185 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:21.560014 11185 leader_election.cc:403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:21.562963 11138 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:21.564859 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.566392 11138 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:12:21.566815 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.567456 11285 raft_consensus.cc:3060] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.567983 16741 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.569881 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.571733 17666 tablet_copy_client.cc:323] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
W20260709 12:12:21.567307 11184 connection.cc:256] RPC call timeout handler was delayed by -1.1556418939999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 12:12:21.575477 11184 connection.cc:256] RPC call timeout handler was delayed by -1.1198830420000832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 12:12:21.577513 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.578850 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.580088 17644 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.581943 17644 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:21.583412 17475 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.570176 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.583953 17475 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.585736 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.586373 11136 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.587411 17475 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.588132 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:21.584151 17644 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.589844 17644 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.593421 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:21.594688 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:21.569862 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.597826 11136 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:21.556210 17541 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:21.607010 11212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1046) took 1691 ms. Trace:
I20260709 12:12:21.600920 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.598398 11138 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:21.608477 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:21.607486 11212 rpcz_store.cc:276] 0709 12:12:19.915249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.915720 (+   471us) service_pool.cc:224] Handling call
0709 12:12:19.915909 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.001577 (+ 85668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.001630 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.001696 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:20.001753 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.606761 (+1605008us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b54000e79d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.606809 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.606949 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196401024}
I20260709 12:12:21.552847 17671 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:21.629997 16741 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:21.613519 11285 raft_consensus.cc:2468] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:21.568485 17446 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:21.610706 11136 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:21.619349 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.606577 17562 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.622095 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.608917 17257 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.639257 11291 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:21.640365 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.649204 11136 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:12:21.608119 17644 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:21.653240 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.654603 16741 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.655516 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.617267 17541 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:21.645509 17475 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.663825 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.654359 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.661662 11138 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:21.641366 17257 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.653944 17446 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:21.669485 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:21.668586 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.671347 11138 raft_consensus.cc:2376] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21. Re-sending same reply.
I20260709 12:12:21.669924 16741 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:21.672977 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:21.665371 17526 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.722611 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.720343 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.736282 11291 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:21.737350 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.737527 16741 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:21.737710 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2415) took 1802 ms. Trace:
I20260709 12:12:21.737943 16741 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.738106 11291 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:21.731309 11286 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:21.668190 17257 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.738476 16741 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.738229 11289 rpcz_store.cc:276] 0709 12:12:19.931775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.939961 (+  8186us) service_pool.cc:224] Handling call
0709 12:12:21.734211 (+1794250us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540041a0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:21.734327 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746045184}
W20260709 12:12:21.739593 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66687.9us
I20260709 12:12:21.740396 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.703944 17520 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.741237 11286 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:21.741551 17609 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:21.741024 17541 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.741945 17609 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.742354 17609 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:21.697038 17370 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.744452 17370 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.746656 17370 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:21.723377 17668 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:21.751508 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.756696 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.666314 17407 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:12:21.670766 17582 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.682869 17580 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.673429 17386 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:21.768106 16741 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.767872 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:21.769590 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3549) took 1725 ms. Trace:
I20260709 12:12:21.774453 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.772967 11141 rpcz_store.cc:276] 0709 12:12:20.044135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.282581 (+238446us) service_pool.cc:224] Handling call
0709 12:12:20.282965 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.552630 (+269665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.769341 (+1216711us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400371c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.769525 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618015488}
I20260709 12:12:21.767117 17370 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:21.783917 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.786175 11184 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:21.788389 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.766666 17538 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:21.705772 17599 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.790331 16741 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.792232 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.771461 17275 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:21.798206 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.668429 17644 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:12:21.798904 16741 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:21.804138 17637 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.263s	user 0.010s	sys 0.001s
I20260709 12:12:21.809304 11288 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:21.796088 17538 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.806156 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:21.785141 17396 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.807612 16741 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.735541 17446 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.833345 16741 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.833433 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3274) took 1323 ms. Trace:
I20260709 12:12:21.833950 11284 rpcz_store.cc:276] 0709 12:12:20.509826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.509969 (+   143us) service_pool.cc:224] Handling call
0709 12:12:20.515835 (+  5866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.755774 (+239939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.833164 (+1077390us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400233cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.833366 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549965568}
I20260709 12:12:21.840077 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.789110 17580 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.840595 17396 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:21.843046 17396 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.793696 17579 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:21.791364 17571 raft_consensus.cc:2804] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:21.805029 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:21.795743 17116 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.791077 17421 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:12:21.801378 17275 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.856688 17571 raft_consensus.cc:697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:21.856765 17275 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.857791 17571 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.861828 17519 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.790736 17586 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:12:21.768553 17609 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.865446 17609 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.816162 17562 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:21.780232 17386 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.816691 17655 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.853457 17579 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.866930 17579 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.867980 17655 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.812160 17538 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.846901 17319 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.870335 17319 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.871239 17595 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.872622 17319 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.873193 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1234) took 1287 ms. Trace:
I20260709 12:12:21.814261 17599 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:21.819695 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3540) took 1821 ms. Trace:
I20260709 12:12:21.808377 17407 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:21.875005 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2384) took 1052 ms. Trace:
I20260709 12:12:21.875432 17386 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.876006 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2411) took 1945 ms. Trace:
I20260709 12:12:21.876367 11290 rpcz_store.cc:276] 0709 12:12:19.930663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.934986 (+  4323us) service_pool.cc:224] Handling call
0709 12:12:19.935462 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.156497 (+221035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.156557 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:20.170100 (+ 13543us) log.cc:844] Serialized 26 byte log entry
0709 12:12:20.318182 (+148082us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:20.318223 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.875617 (+1557394us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540020a154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.875663 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.875710 (+    47us) raft_consensus.cc:1685] finished
0709 12:12:21.875736 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.875951 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9293,"raft.queue_time_us":605,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":22850,"spinlock_wait_cycles":507187968,"thread_start_us":116897,"threads_started":1,"wal-append.queue_time_us":117443,"wal-append.run_cpu_time_us":2240,"wal-append.run_wall_time_us":1002243}
I20260709 12:12:21.843418 17396 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.824818 17257 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.840786 11136 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:12:21.886531 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.886812 11136 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:21.888360 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:21.854431 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48322us
I20260709 12:12:21.791541 17370 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.893566 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.895018 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.894295 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.899457 11287 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.900537 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.901168 11210 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:21.901274 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.895649 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.902874 11284 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:21.903287 11217 raft_consensus.cc:2410] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:21.902315 17599 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:12:21.873611 11142 rpcz_store.cc:276] 0709 12:12:20.585920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.644726 (+ 58806us) service_pool.cc:224] Handling call
0709 12:12:21.510097 (+865371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.510309 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.510330 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:21.510368 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:21.510395 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.510441 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.873011 (+362570us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54002e2cd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:21.873130 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989360384}
I20260709 12:12:21.894847 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.897606 11293 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:21.904479 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.904682 11216 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:21.887315 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.878127 17538 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.906023 11218 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:21.906945 17370 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.907559 17538 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.907768 17599 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.902679 17257 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:21.908200 17599 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:21.908718 17599 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.910276 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.910471 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.910858 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.911650 11286 raft_consensus.cc:2393] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:21.914781 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.915486 11293 raft_consensus.cc:2368] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:21.897809 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:21.916324 17407 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:21.874114 11139 rpcz_store.cc:276] 0709 12:12:19.998701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.998891 (+   190us) service_pool.cc:224] Handling call
0709 12:12:19.999196 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.013314 (+ 14118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.013355 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:20.014065 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:12:20.423481 (+409416us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:20.423517 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.423594 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.786541 (+1362947us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:21.819381 (+ 32840us) raft_consensus.cc:1685] finished
0709 12:12:21.819404 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.819631 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28697,"raft.queue_time_us":13837,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":18283,"spinlock_wait_cycles":43023104,"thread_start_us":379307,"threads_started":1,"wal-append.queue_time_us":467542}
I20260709 12:12:21.903863 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.923444 11211 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:21.896339 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.875453 11219 rpcz_store.cc:276] 0709 12:12:20.822290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.822517 (+   227us) service_pool.cc:224] Handling call
0709 12:12:20.829733 (+  7216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.926866 (+ 97133us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:20.927204 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.031569 (+104365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:21.031623 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:21.031672 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.380047 (+348375us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:21.750036 (+369989us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b1800464980. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee557 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:12:21.874800 (+124764us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54003165d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.874844 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.874950 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2030,"prepare.queue_time_us":5963,"prepare.run_wall_time_us":78425,"raft.queue_time_us":4011,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5971,"spinlock_wait_cycles":240212736,"thread_start_us":101908,"threads_started":1,"wal-append.queue_time_us":198236}
I20260709 12:12:21.932845 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.933549 11287 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:21.934120 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:21.934424 11139 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:12:21.932935 16741 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.936628 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:21.941804 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.937237 17275 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.942845 17407 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:21.943682 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.944096 17275 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:21.944808 11210 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:21.935998 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.941073 17421 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:21.945521 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.945852 17421 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:21.941319 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:21.941849 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83116.1us
I20260709 12:12:21.936710 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.946187 11216 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:21.947240 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:21.947815 11826 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.723s (SENT) [suppressed 3 similar messages]
I20260709 12:12:21.916805 17670 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:12:21.947396 17421 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:21.949326 17421 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.949605 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:21.950788 17638 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 1.420s	user 0.007s	sys 0.003s
I20260709 12:12:21.952633 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 845) took 2034 ms. Trace:
I20260709 12:12:21.952679 17319 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:21.953118 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.953902 11142 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:21.953147 11860 rpcz_store.cc:276] 0709 12:12:19.919370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.934863 (+ 15493us) service_pool.cc:224] Handling call
0709 12:12:19.977835 (+ 42972us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:20.014715 (+ 36880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.014766 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:20.045012 (+ 30246us) log.cc:844] Serialized 52 byte log entry
0709 12:12:20.329819 (+284807us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:20.372491 (+ 42672us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.526673 (+154182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.526802 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.950173 (+1423371us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:21.952322 (+  2149us) raft_consensus.cc:1685] finished
0709 12:12:21.952421 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.952573 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38399,"prepare.queue_time_us":42709,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":52,"raft.queue_time_us":96622,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":51941,"spinlock_wait_cycles":23987072,"thread_start_us":417042,"threads_started":2,"wal-append.queue_time_us":406348}
I20260709 12:12:21.956780 17319 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:21.957690 17319 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:21.960726 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.960932 11142 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:21.946096 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.963595 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:21.964392 11284 raft_consensus.cc:2368] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:12:21.952899 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3542) took 1936 ms. Trace:
I20260709 12:12:21.950704 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.972680 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.974455 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.968323 11135 rpcz_store.cc:276] 0709 12:12:20.016332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.017515 (+  1183us) service_pool.cc:224] Handling call
0709 12:12:20.017889 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.332514 (+314625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.952662 (+1620148us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400264154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:21.952840 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650183552}
I20260709 12:12:21.978678 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:21.978681 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.983125 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 255c201215d14e89bc735bb8b57682cb from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:12:21.983842 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 255c201215d14e89bc735bb8b57682cb from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-255c201215d14e89bc735bb8b57682cb
I20260709 12:12:21.983932 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:21.984602 11219 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:21.987075 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:21.991194 11142 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.991374 11219 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:21.990161 11210 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:21.997494 11216 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:21.998502 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:21.992731 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:21.991485 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:22.001874 11211 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.981899 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:22.008352 16741 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.008730 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:22.014557 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:22.015931 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:22.016749 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:21.126921  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.018074 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.023206 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:22.024132 11135 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:22.026098 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 1307) took 2109 ms. Trace:
I20260709 12:12:22.026540 11852 rpcz_store.cc:276] 0709 12:12:19.899354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.902279 (+  2925us) service_pool.cc:224] Handling call
0709 12:12:22.000792 (+2098513us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54005703d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:22.008839 (+  8047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712457984}
I20260709 12:12:22.029759 11142 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:22.029606 11210 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:22.000128 11217 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:22.065426 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:22.068133 11142 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:22.062529 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 69887.3us
I20260709 12:12:22.074215 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.082412 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:22.083629 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.073854 17648 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:22.086181 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.061095 17326 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:22.086783 11217 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:22.099714 11217 pending_rounds.cc:85] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 9
I20260709 12:12:22.098176 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.098136 11210 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:22.101017 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.102474 11214 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:12:22.103274 11216 raft_consensus.cc:2393] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:22.105906 11142 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:22.106986 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.096943 17326 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.108742 17326 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.061241 17561 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:12:22.059834 17264 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:12:22.114156 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.105075 11217 pending_rounds.cc:107] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:22.115887 11217 raft_consensus.cc:2889] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:22.085822 17648 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:22.122634 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.127228 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:22.116583 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 168780us
I20260709 12:12:22.153200 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.157430 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:22.160861 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.164296 11214 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:22.165057 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:22.167436 11211 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:22.164064 11135 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:22.172827 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.157790 17370 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.174981 17370 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:22.175678 17370 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:22.177891 17370 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:22.182013 11211 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:22.188627 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 170633us
I20260709 12:12:22.191623 17590 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:22.193312 17471 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.193789 17471 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:22.186333 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.195662 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.172515 17577 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:22.204576 17264 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:22.205123 17264 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.205575 17264 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.207141 17658 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:22.207777 17658 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.208729 17658 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.210093 17658 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.217805 17599 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.223003 17648 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:22.226536 17476 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:22.227149 11219 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:22.234652 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.186422 11229 tablet_copy_source_session.cc:215] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:22.228119 17446 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:22.228577 17407 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:22.232141 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:22.233556 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.261404 11289 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
W20260709 12:12:22.285738 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59274.3us
I20260709 12:12:22.289779 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.235489 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:22.244387 11137 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:22.227850 17264 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.291893 17521 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.236708 17370 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:22.292546 17521 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.292881 17370 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.293533 17264 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:22.291285 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55901.2us
I20260709 12:12:22.294520 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.295192 17370 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.297696 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:22.298688 17582 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:22.297983 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65942us
I20260709 12:12:22.299309 17582 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.300403 11110 leader_election.cc:400] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:22.300766 11110 leader_election.cc:403] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:22.302335 17582 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.302668 17319 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:22.302974 17582 raft_consensus.cc:2764] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:22.294582 17275 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.240950 17476 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:22.303809 17476 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:22.304795 17582 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:22.305101 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:22.284381 17471 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:22.312157 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 121727us
I20260709 12:12:22.313300 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:22.313450 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:22.293601 17521 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.318905 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.319875 17520 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.233213 17579 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:22.311321 17678 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:22.243373 17396 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.322868 17579 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.323040 17396 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.323751 11217 raft_consensus.cc:2368] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
I20260709 12:12:22.305271 17275 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:22.328399 17599 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:22.329304 17578 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:22.329938 17578 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:22.233213 17326 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.331713 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.332214 11139 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:22.333711 17396 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:22.298130 17655 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:12:22.335988 11857 raft_consensus.cc:2368] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21.
I20260709 12:12:22.297628 17697 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:22.336305 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:22.354900 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.356844 17674 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.357367 17674 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:22.357865 17674 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.361894 17319 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:22.362586 17319 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:22.363116 17319 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:22.363065 17519 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:22.364670 17520 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:22.365188 17520 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:22.366439 17520 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.337703 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:22.367174 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:22.372378 11259 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.375129 17599 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:22.375665 17599 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:22.376641 17599 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:12:22.380016 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 66786.7us
I20260709 12:12:22.380128 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.336372 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:22.382301 17524 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:22.382848 17524 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:22.383817 17524 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.382745 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:22.388636 11292 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:12:22.406316 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70009.1us
I20260709 12:12:22.406877 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.407555 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:22.414533 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79087.1us
I20260709 12:12:22.326761 17407 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.335341 17421 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:22.422322 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:22.420586 11110 leader_election.cc:400] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:12:22.423255 11110 leader_election.cc:403] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:12:22.424456 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.425899 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.427518 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:22.328430 17275 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.401495 17562 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:12:22.409201 17365 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:12:22.522938 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.437127 11292 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:22.414350 17609 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.414880 17599 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:22.581950 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 297470us
W20260709 12:12:22.590818 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 162003us
W20260709 12:12:22.588521 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 211674us
I20260709 12:12:22.422125 17421 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:22.433297 17396 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:22.433562 17446 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:22.518689 17386 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:12:22.404280 17697 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.433430 17689 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:22.597335 17561 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.416723 17612 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.186s
I20260709 12:12:22.590914 17670 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:12:22.614856 17708 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:22.686470 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:22.698566 11137 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:22.461033 17578 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:22.703205 11142 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:22.642731 17699 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:22.617534 17407 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:12:22.660950 17396 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.660699 17446 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.663100 17326 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.696316 17689 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.729153 17370 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:22.724381 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 306985us
W20260709 12:12:22.725917 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.755043 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:22.755868 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 154851us
I20260709 12:12:22.757293 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.761310 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.723625 17699 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.708781 17275 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.761461 17690 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:22.764969 17386 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:22.766304 17326 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:22.776836 17671 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:22.795863 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 102988us
I20260709 12:12:22.762598 17370 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:22.815963 17476 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.005s
I20260709 12:12:22.827948 17720 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:22.830528 17689 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.828192 17612 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.838476 17370 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:22.839450 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 413595us
I20260709 12:12:22.799345 17690 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.806046 17724 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:22.806507 17386 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.773553 17446 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.849857 11110 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.860880 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.853245 11218 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:22.825457 17671 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:22.825717 17116 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:22.854772 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:22.844583 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.857033 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:22.858204 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:22.814935 17326 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.865037 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:22.866247 11216 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:22.865679 11212 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.801055 17396 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.877408 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:22.883587 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 122345us
I20260709 12:12:22.840054 17599 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:22.843928 17476 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:22.889528 17718 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:12:22.907274 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:22.877831 17697 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:22.917886 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.914276 11212 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:22.886301 17370 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.886072 17728 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:22.933933 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:22.885618 17116 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:22.859905 17724 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:22.933190 17648 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:22.918258 17738 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.960193 17697 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:12:22.968683 17275 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:22.973136 11137 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:22.947283 17561 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.936673 17739 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:22.979640 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:22.959779 17726 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:22.980248 17721 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:12:22.948015 17728 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.006035 17410 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:23.002612 17275 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.013422 17720 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:23.021070 17735 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:23.001834 17648 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:22.995100 17699 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:23.029695 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 81091.6us
W20260709 12:12:23.036487 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54819.3us
I20260709 12:12:23.037390 11290 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:22.938673 17671 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.048029 11288 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:23.048177 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:23.048885 11291 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.048621 17690 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.049875 17690 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.049921 11292 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:23.053213 17520 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.056705 11288 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:23.057864 17471 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.058514 11288 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:23.059652 11256 leader_election.cc:400] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21.
I20260709 12:12:23.060011 11256 leader_election.cc:403] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:23.060880 17421 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.062031 17421 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.064123 17648 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.022126 17561 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.066264 17561 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:23.034291 17410 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:23.067924 17410 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.014052 17697 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:23.009282 17727 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:12:23.078188 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.034997 17735 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:23.081311 11135 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:23.082353 11142 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:23.083519 11136 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:12:23.085757 11213 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:23.090718 11291 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:23.091674 11216 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:23.092041 11216 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:23.092669 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.093225 17720 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.094053 17749 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:23.098340 11288 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:12:23.104053 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.029418 17736 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:12:23.080535 17410 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.088153 17671 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.130178 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:23.130975 11256 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 255c201215d14e89bc735bb8b57682cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:23.096890 11216 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.121228 17740 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:23.142815 17116 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:23.135326 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:23.122568 17658 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.884s	user 0.005s	sys 0.008s
W20260709 12:12:23.145042 17319 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.006s
I20260709 12:12:23.157878 17319 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.131935 17711 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:12:23.160478 17319 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:23.137414 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 157912us
I20260709 12:12:23.141970 17476 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.146564 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.164052 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.163715 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:23.167764 11212 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:23.147405 17740 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:23.143409 17116 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:23.148680 17647 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.112721 17739 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21.
I20260709 12:12:23.111404 17670 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:12:23.150910 17735 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:23.154157 17742 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:23.142356 17666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255c201215d14e89bc735bb8b57682cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:23.155160 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.172207 17582 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.168651 11110 leader_election.cc:400] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:23.200330 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:12:23.170522 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92389.3us
I20260709 12:12:23.128398 17578 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:23.128562 17386 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:23.182248 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 47353.8us
I20260709 12:12:23.111678 17729 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:12:23.157876 17716 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.431s	user 0.000s	sys 0.005s
W20260709 12:12:23.162402 17674 consensus_meta.cc:287] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.804s	user 0.015s	sys 0.000s
I20260709 12:12:23.191342 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:23.136363 11213 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:23.219125 11212 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:12:23.192852 17724 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.214871 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.193159 17740 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:23.225260 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:23.228622 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.229755 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:23.230535 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.205942 17648 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:23.216347 17735 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:23.219221 17582 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.236284 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:23.239544 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.240738 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:23.188431 17647 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.258526 17647 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.259760 17365 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:23.260290 17365 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.260746 17365 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.262058 17760 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.267304 17733 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.268863 17740 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.270514 17737 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:23.228060 17386 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:23.280777 11212 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:23.242429 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:23.243511 17754 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:12:23.244256 17759 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.247318 17765 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.248059 17761 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.222746 17674 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:23.283447 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45273.6us
I20260709 12:12:23.301708 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.292371 17755 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:23.237278 17582 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:23.300107 11215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2398) took 1402 ms (client timeout 1690 ms). Trace:
I20260709 12:12:23.302857 17582 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:23.303022 11215 rpcz_store.cc:269] 0709 12:12:21.893293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.893448 (+   155us) service_pool.cc:224] Handling call
0709 12:12:23.295897 (+1402449us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400025dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:23.296057 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643731328}
I20260709 12:12:23.309311 17720 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:23.310182 17720 consensus_queue.cc:1243] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:23.310968 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.316315 17726 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.317379 11287 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.317826 17723 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:23.318148 17761 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.319451 11853 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:23.320391 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:23.321401 17697 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.320554 17761 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.318656 17723 consensus_queue.cc:1243] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:23.323369 17526 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.323881 17526 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:23.324245 17726 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:23.324635 17726 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:23.324847 17526 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.325469 17726 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.313359 17699 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.330049 17326 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.332967 17726 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.335220 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2842) took 1344 ms. Trace:
I20260709 12:12:23.241393 17648 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.300930 17759 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.340740 11139 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:23.305004 17765 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.297395 17708 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.342973 11219 rpcz_store.cc:276] 0709 12:12:21.991080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.992120 (+  1040us) service_pool.cc:224] Handling call
0709 12:12:22.226965 (+234845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.240667 (+ 13702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.334978 (+1094311us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001d3150. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:23.335144 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459663232}
I20260709 12:12:23.326218 17526 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.352068 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:23.352921 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:23.354669 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:23.356607 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 138840us
I20260709 12:12:23.356815 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.359340 11139 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:23.359901 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:23.360543 11219 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:23.361701 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:23.362527 11214 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:23.364169 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.364768 11140 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.345155 17275 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.349390 17708 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.368860 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.372148 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.372946 11136 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:23.382476 11136 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:23.387917 17759 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.363819 17671 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.392617 17671 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.393031 17671 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.393764 17648 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:23.392640 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.302801 17755 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.398763 17755 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:23.373874 17708 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.408560 17561 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.411424 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1391) took 1027 ms. Trace:
I20260709 12:12:23.412146 17765 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:23.417600 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.419349 11287 rpcz_store.cc:276] 0709 12:12:22.383850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.384015 (+   165us) service_pool.cc:224] Handling call
0709 12:12:22.384318 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.317835 (+933517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.411045 (+ 93210us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54003192d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:23.411326 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145398528}
I20260709 12:12:23.421128 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2854) took 1258 ms. Trace:
I20260709 12:12:23.423856 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:23.408561 17612 consensus_meta.cc:287] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 12:12:23.427915 17612 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:23.429267 17689 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.430114 17689 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.434615 17561 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.435927 17689 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.421574 11217 rpcz_store.cc:276] 0709 12:12:22.162733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.164803 (+  2070us) service_pool.cc:224] Handling call
0709 12:12:23.420942 (+1256139us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000262d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:23.421070 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362485504}
I20260709 12:12:23.444697 11140 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:23.445425 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.453110 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.454130 11138 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:23.457828 11138 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:23.434242 17365 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.474195 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.482093 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.471444 17595 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:23.495920 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.498178 11138 raft_consensus.cc:2368] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:23.503377 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.504076 11138 raft_consensus.cc:2368] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
I20260709 12:12:23.510120 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.510754 11135 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:23.515758 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.523236 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:23.495464 17562 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.019s	sys 0.004s
W20260709 12:12:23.525202 11289 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2431) took 1615 ms (client timeout 1752 ms). Trace:
W20260709 12:12:23.525638 11289 rpcz_store.cc:269] 0709 12:12:21.909866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.910008 (+   142us) service_pool.cc:224] Handling call
0709 12:12:23.525042 (+1615034us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54003f0a54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:23.525142 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805869312}
I20260709 12:12:23.527289 11135 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:12:23.540261 17702 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.948s	user 0.004s	sys 0.000s
W20260709 12:12:23.543143 17712 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.836s	user 0.001s	sys 0.002s
I20260709 12:12:23.547006 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:23.548729 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:23.551314 17365 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.556188 11214 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 12:12:23.532285 17562 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.020s	sys 0.004s
I20260709 12:12:23.494793 17595 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.558290 11289 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:23.534669 17777 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:23.531648 17582 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.575155 17582 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.575525 11136 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:23.569665 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:23.584206 17761 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.584702 17761 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.585052 17761 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.586355 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:23.588955 17714 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:23.589383 17714 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.589815 17714 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:23.560894 17719 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.595022 17719 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.597607 17719 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.599254 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:23.601727 17595 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:23.563172 17671 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.603847 17719 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:23.605186 17671 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.567044 17586 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:12:23.606122 17771 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:23.611053 17728 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.605520 17761 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.613006 17714 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.615161 17714 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:23.627228 17761 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:23.627619 17717 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.966s	user 0.004s	sys 0.000s
W20260709 12:12:23.649227 17775 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.141s	user 0.003s	sys 0.000s
I20260709 12:12:23.654513 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.655917 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.656853 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.657522 11138 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:23.658361 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.658898 11138 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.663084 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:23.663820 11861 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:23.665755 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:23.670068 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:23.679468 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:23.680130 11286 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
W20260709 12:12:23.686025 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.705072 11289 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:12:23.705516 11289 pending_rounds.cc:85] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 11
I20260709 12:12:23.705734 11289 pending_rounds.cc:107] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:12:23.705955 11289 raft_consensus.cc:2889] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.682111 17577 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.708352 17577 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.709488 11860 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:23.724453 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:23.732359 11137 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:23.733047 11137 pending_rounds.cc:85] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:12:23.733332 11137 pending_rounds.cc:107] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:23.733636 11137 raft_consensus.cc:2889] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.735210 11286 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:23.671532 17582 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:23.690320 11138 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:23.683168 17658 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.741619 17674 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:23.681671 17708 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.743287 17609 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.743752 17609 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:23.743887 17708 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.744786 17407 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.744607 17609 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.745499 17407 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.747943 17407 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.751402 11140 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:23.753506 11042 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 16 to 17, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 17 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:23.755111 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:23.755820 11292 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
W20260709 12:12:23.755983 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.756316 11852 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:23.725945 17754 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:23.691337 17761 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.741266 17658 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:23.740818 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:23.757046 11290 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:23.774513 11286 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.755913 11042 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 11 to 15, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 15 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:23.774622 11290 pending_rounds.cc:85] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 9
I20260709 12:12:23.775285 11290 pending_rounds.cc:107] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:23.775635 11290 raft_consensus.cc:2889] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.767618 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:23.777292 11217 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:23.769299 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:23.771368 11138 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:12:23.758893 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:23.767050 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:23.758033 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:23.778954 11212 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:23.780685 11138 pending_rounds.cc:85] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 8
I20260709 12:12:23.781055 11138 pending_rounds.cc:107] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:23.781514 11138 raft_consensus.cc:2889] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.786736 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:23.789568 11210 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:23.789708 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:23.791604 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:23.791620 17711 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.792448 17407 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.792711 17711 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.793172 17711 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.792858 11141 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:23.792891 17407 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:23.794076 17407 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.757000 17754 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.794902 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:24.020102 11217 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:23.878993 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.739028 17777 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.824327 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:23.795985 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:24.034396 11211 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
W20260709 12:12:23.835888 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.020552 17658 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.757396 17582 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.068636 11217 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
W20260709 12:12:24.050647 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 257179us
I20260709 12:12:23.797201 11212 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:23.774581 17761 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:23.895385 17476 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.714716 17577 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:23.927942 17590 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:24.053404 17769 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.075136 17671 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:24.076745 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.080269 17711 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.087567 11142 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:23.859615 17703 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.211s
I20260709 12:12:24.070086 17562 raft_consensus.cc:2764] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:12:24.048841 17777 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.071861 17407 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:24.108942 17666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37092 (request call id 1317) took 3184 ms. Trace:
I20260709 12:12:24.114161 17666 rpcz_store.cc:276] 0709 12:12:20.924314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.924525 (+   211us) service_pool.cc:224] Handling call
0709 12:12:21.125453 (+200928us) ts_tablet_manager.cc:934] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
0709 12:12:21.383215 (+257762us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eacaa 00007f982d9eabd2 00007f9835a4f131
0709 12:12:22.928277 (+1545062us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:23.561369 (+633092us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:23.564866 (+  3497us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:24.027608 (+462742us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:24.028049 (+   441us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:24.028479 (+   430us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:24.107029 (+ 78550us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":4165,"spinlock_wait_cycles":11299712,"tablet-copy.queue_time_us":191870,"thread_start_us":535998,"threads_started":2}
I20260709 12:12:24.116197 17666 tablet_copy_client.cc:806] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:24.121369 11042 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 3 to 13. New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:24.128072 11213 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:24.091923 17708 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 12:12:24.096460 17745 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:24.157836 17738 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:24.116951 17666 tablet_copy_client.cc:670] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:24.090452 17476 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.159631 17582 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:24.160180 17761 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:24.160861 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:24.162123 17777 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:24.162897 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:24.163666 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:24.094980 17769 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:24.157232 17754 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:24.156289 17407 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:24.072829 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:24.169925 11259 leader_election.cc:400] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
I20260709 12:12:24.746578 11259 leader_election.cc:403] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.227816 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.749042 11143 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:24.422609 17536 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.265873 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:24.372574 16741 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.750694 17536 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:24.751504 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 574247us
I20260709 12:12:24.188294 17737 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.564s
I20260709 12:12:24.752574 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:24.753635 17738 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:24.754763 17738 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.755594 17476 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:24.756438 17738 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:24.514420 17791 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:12:24.759132 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3609) took 1006 ms. Trace:
I20260709 12:12:24.759518 11140 rpcz_store.cc:276] 0709 12:12:23.752565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.753016 (+   451us) service_pool.cc:224] Handling call
0709 12:12:23.753384 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.753788 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.753818 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:23.754351 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:12:24.056437 (+302086us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:24.056494 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.056569 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:24.758907 (+702338us) raft_consensus.cc:1685] finished
0709 12:12:24.758930 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.759066 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16919,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9619,"thread_start_us":300675,"threads_started":1,"wal-append.queue_time_us":358404}
I20260709 12:12:24.769184 11856 raft_consensus.cc:2368] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19.
W20260709 12:12:24.770001 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 697239us
I20260709 12:12:24.097373 17590 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.751582 16741 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.770732 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:24.784301 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.788009 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:24.785127 11141 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:24.790431 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.793797 17536 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:24.791751 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3334) took 1113 ms. Trace:
I20260709 12:12:24.796100 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:24.175619 17739 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:24.168079 17711 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:24.369375 17729 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:24.406635 17740 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:24.775728 17658 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.797719 16741 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:24.810649 16741 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:12:24.813735 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.466648 17703 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:24.805485 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:24.806612 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:24.807165 11293 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:24.807432 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:24.776055 17582 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.796124 11288 rpcz_store.cc:276] 0709 12:12:23.678084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.678260 (+   176us) service_pool.cc:224] Handling call
0709 12:12:23.682535 (+  4275us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:23.683989 (+  1454us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:23.726347 (+ 42358us) log.cc:844] Serialized 14 byte log entry
0709 12:12:24.035918 (+309571us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:24.055504 (+ 19586us) log.cc:844] Serialized 52 byte log entry
0709 12:12:24.055693 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:24.055732 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.055812 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:24.081012 (+ 25200us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b1800372940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:12:24.747861 (+666849us) raft_consensus.cc:1685] finished
0709 12:12:24.791495 (+ 43634us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.791660 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":860,"prepare.queue_time_us":42139,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":15837,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":16551,"spinlock_wait_cycles":21995264,"thread_start_us":293156,"threads_started":1,"wal-append.queue_time_us":449836}
I20260709 12:12:24.786275 17777 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.802551 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:24.794569 17536 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:24.822994 11290 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.792091 17761 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:24.790325 17571 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.811147 16741 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:24.824254 11292 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:24.821643 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.804399 17729 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.822224 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.835870 11141 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:12:24.830694 11142 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 11.
I20260709 12:12:24.801492 17476 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.810477 17754 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:24.827642 17761 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.839255 17476 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:24.847956 11219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.029s	sys 0.012s
W20260709 12:12:24.851050 11219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.029s	sys 0.012s
I20260709 12:12:24.808022 17407 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:12:24.837733 17536 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:24.817883 17740 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:24.823129 17658 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:24.854127 11290 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:24.857241 16741 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:24.838160 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 315703us
I20260709 12:12:24.855290 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3590) took 1776 ms. Trace:
I20260709 12:12:24.860316 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1085) took 1072 ms. Trace:
I20260709 12:12:24.808622 17739 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.867851 11137 rpcz_store.cc:276] 0709 12:12:23.078608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.078801 (+   193us) service_pool.cc:224] Handling call
0709 12:12:23.079216 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.734199 (+654983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.855059 (+1120860us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54003ca354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:24.855228 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500703616}
I20260709 12:12:24.869969 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.852005 17761 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:24.854265 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.828485 17582 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:24.838438 17571 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:24.846568 17754 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:24.871447 11142 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:24.850919 17476 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.870798 11141 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:24.868629 11213 rpcz_store.cc:276] 0709 12:12:23.788132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.795119 (+  6987us) service_pool.cc:224] Handling call
0709 12:12:23.795458 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.128681 (+333223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.854335 (+725654us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54000267d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:24.860244 (+  5909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764276608}
I20260709 12:12:24.829999 17703 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.816293 17769 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:24.895031 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.899832 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:24.902429 11107 leader_election.cc:400] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19.
I20260709 12:12:24.907384 11107 leader_election.cc:403] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.898105 17796 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.909471 17769 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.905418 17729 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:24.912245 17738 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.916217 17590 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:24.936230 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3332) took 1695 ms. Trace:
I20260709 12:12:24.936722 11291 rpcz_store.cc:276] 0709 12:12:23.240554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.242467 (+  1913us) service_pool.cc:224] Handling call
0709 12:12:23.242842 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.364008 (+121166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.364041 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:23.364522 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:12:23.496282 (+131760us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:23.496321 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.935729 (+1439408us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400060ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:24.935792 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:24.935842 (+    50us) raft_consensus.cc:1685] finished
0709 12:12:24.935854 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.936149 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2409,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2815,"spinlock_wait_cycles":277660032,"thread_start_us":76160,"threads_started":1,"wal-append.queue_time_us":195490,"wal-append.run_cpu_time_us":2064,"wal-append.run_wall_time_us":1041132}
W20260709 12:12:24.955214 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 202750us
I20260709 12:12:24.956804 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:24.897617 17536 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:25.012075 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 842306us
W20260709 12:12:25.017376 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56127us
I20260709 12:12:24.926213 17796 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.024873 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:25.026288 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.046144 11135 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: [17.10-19.11]
I20260709 12:12:25.053258 11143 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:25.053282 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.054430 11137 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:25.054467 11141 raft_consensus.cc:2368] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:25.055222 11142 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:25.069255 17807 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15.
I20260709 12:12:25.077572 17806 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:25.011227 17749 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:12:24.926443 17754 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:25.080746 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 138057us
I20260709 12:12:25.084340 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.011250 17799 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:25.086023 11144 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:25.116930 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2729) took 1603 ms. Trace:
I20260709 12:12:25.117417 11144 rpcz_store.cc:276] 0709 12:12:23.513358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.044033 (+1530675us) service_pool.cc:224] Handling call
0709 12:12:25.085838 (+ 41805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.116563 (+ 30725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.116848 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:24.963165 17475 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:12:25.090039 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.109542 17814 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:25.112534 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 99408.6us
W20260709 12:12:25.123481 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 164475us
I20260709 12:12:25.124716 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.016582 17729 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:12:25.088104 17711 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:25.137115 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.137953 11144 raft_consensus.cc:2376] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18. Re-sending same reply.
I20260709 12:12:25.115960 17571 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:25.151916 11258 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.523s (SENT)
I20260709 12:12:25.152599 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:25.154560 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.126438 17407 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.127266 17658 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.161653 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1081) took 1395 ms. Trace:
I20260709 12:12:25.129781 17582 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.175541 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.177466 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.125504 17814 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.115970 17806 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:25.172711 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 146724us
I20260709 12:12:25.159353 17739 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.122931 17799 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:12:25.217694 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 127927us
I20260709 12:12:25.146330 17808 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:25.186573 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.215966 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.148483 17703 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:25.172134 17794 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:12:25.171736 11219 rpcz_store.cc:276] 0709 12:12:23.766114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.766950 (+   836us) service_pool.cc:224] Handling call
0709 12:12:23.767242 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:23.775461 (+  8219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.775507 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:23.776058 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 12:12:24.128358 (+352300us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:24.857950 (+729592us) log.cc:844] Serialized 14 byte log entry
0709 12:12:25.161188 (+303238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.161296 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:25.161360 (+    64us) raft_consensus.cc:1685] finished
0709 12:12:25.161378 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.161576 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7826,"prepare.queue_time_us":791418,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2093,"raft.queue_time_us":56090,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":8242,"thread_start_us":1249820,"threads_started":3,"wal-append.queue_time_us":708211}
I20260709 12:12:25.214170 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.160658 17810 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.221668 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 95811.5us
I20260709 12:12:25.171458 17816 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.218765 11138 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:12:25.222440 11142 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:12:25.235927 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2717) took 1819 ms. Trace:
I20260709 12:12:25.212189 17814 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.238888 11136 rpcz_store.cc:276] 0709 12:12:23.416849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.416993 (+   144us) service_pool.cc:224] Handling call
0709 12:12:23.417586 (+   593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.575906 (+158320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.235635 (+1659729us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003403d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:25.235857 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362666240}
I20260709 12:12:25.242214 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:25.246181 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.249601 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:25.250031 11142 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:25.234678 17739 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:25.223690 17808 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.251971 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.252825 11141 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:25.241544 17810 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.252328 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:25.262975 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.265676 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.266575 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.266886 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.267571 11144 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:25.180866 17407 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:25.251205 17739 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.267446 11136 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:25.270109 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.272395 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.275697 11141 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:25.276847 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.262029 17658 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:25.279982 11140 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:25.260617 17729 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:25.295781 11292 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:25.268833 17475 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:25.303287 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 70611.2us
I20260709 12:12:25.322232 17711 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:25.245638 17816 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.325984 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:25.262212 17819 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:12:25.331764 11291 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:25.285996 17582 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.345149 17582 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.285239 17658 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.347534 17740 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.345165 17796 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.349004 17582 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.349560 17582 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:25.349941 17777 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 12:12:25.303369 17818 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:25.265220 17824 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:25.347675 17658 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:25.300524 17729 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:25.343585 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.350065 17582 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.363971 17582 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.356979 17738 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19.
I20260709 12:12:25.350777 17827 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.365667 17827 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.366544 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.361347 17711 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.368690 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:25.369414 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:25.355369 17729 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.370152 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:25.370795 11861 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:25.370990 17590 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:25.366111 17827 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.355393 17824 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.371791 17590 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.378258 17810 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:25.379393 17590 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.379765 17407 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.327456 17803 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:12:25.341082 17825 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.354542 17777 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:25.380751 17806 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.350703 17818 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.393146 17818 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.393334 17816 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.400468 17816 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.401145 17816 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.390998 17825 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.418339 17824 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:25.419554 17827 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:25.389006 17799 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:25.407734 17822 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:12:25.419584 17825 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:25.420929 17761 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 12:12:25.421620 17761 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.423722 17761 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.425761 17816 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.425375 17814 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.429091 17814 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:25.466718 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.326866 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.470852 11141 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:25.474578 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.473857 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.476147 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.476200 11140 raft_consensus.cc:2368] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:25.490166 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.501251 17844 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.551831 17844 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:25.554740 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 181359us
I20260709 12:12:25.340061 17475 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:25.559213 17475 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.560812 17844 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.563836 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:25.574992 11293 raft_consensus.cc:1217] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-16.9]   Dedup: 14.8->[16.9-16.9]
I20260709 12:12:25.575845 11290 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:25.575845 11293 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 12:12:25.581907 17407 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.582691 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:25.582825 17407 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.583984 11289 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:25.590610 17582 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.591315 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.591547 17582 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.408201 17739 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:25.608896 17476 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:25.614856 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 380330us
I20260709 12:12:25.617003 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:25.618813 11290 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:25.594316 17582 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.624585 11292 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:25.628049 17476 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.629125 17609 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:25.631526 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 479434us
I20260709 12:12:25.631956 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:25.632761 11216 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:25.640918 17407 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.654631 17655 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.646657 17582 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.655607 17655 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.663893 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:25.665927 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.671124 11135 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:25.668434 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:25.558408 17769 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.091s
I20260709 12:12:25.669068 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.658236 17655 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.655804 17582 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.676745 17725 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.678077 17582 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.677701 17725 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.670341 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:25.689378 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:25.690450 11219 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:25.698909 11287 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:25.694070 17725 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.694721 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:25.678794 17802 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:12:25.691303 17815 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.695828 11289 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:25.702157 17815 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.704152 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.704945 11141 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.707402 11286 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
W20260709 12:12:25.699127 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.727219 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:25.728142 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58151us
I20260709 12:12:25.726226 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:25.705116 17815 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:25.730064 11143 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
W20260709 12:12:25.740327 11258 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.691s (SENT)
I20260709 12:12:25.740923 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:25.741453 17802 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:25.741988 17802 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.742565 17802 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.736788 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:25.744745 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:25.746428 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.747040 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:25.748198 11213 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.748978 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:25.751881 11140 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:25.752947 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.754235 11138 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:25.756649 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:25.758014 11217 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:12:25.762908 17812 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.763036 11216 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:25.774272 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 2862) took 2683 ms. Trace:
I20260709 12:12:25.774895 11216 rpcz_store.cc:276] 0709 12:12:23.091086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.091322 (+   236us) service_pool.cc:224] Handling call
0709 12:12:23.091556 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.084553 (+992997us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b18000124e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830b16646 00007f9830a5058e 00007f9830ad1f9e 00007f9830ad37de 00007f9830addb49 00007f9830ade416 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4
0709 12:12:25.597097 (+1512544us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5800747ed0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830addb49 00007f9830ade416 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4
0709 12:12:25.773743 (+176646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.774139 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240535680}
I20260709 12:12:25.763676 11286 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:25.776872 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.778681 17737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.009s	sys 0.027s
I20260709 12:12:25.764595 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:25.779273 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:25.779548 11210 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:25.767248 17808 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:25.764529 11142 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:12:25.783856 17737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.009s	sys 0.027s
W20260709 12:12:25.774276 17257 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
W20260709 12:12:25.815889 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83153.4us
I20260709 12:12:25.820848 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:25.826474 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 86237us
I20260709 12:12:25.827677 11139 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:25.833139 17749 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.833722 17749 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.838392 17815 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.840888 16741 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:25.846029 16741 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.847225 17689 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.847879 17689 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.848383 17729 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.851082 11212 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:25.853327 17797 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:25.856197 11861 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:12:25.856709 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:25.857489 11852 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:25.858446 17769 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:25.859146 17769 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:25.862169 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:25.862882 11214 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:12:25.862691 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:25.845256 11140 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:12:25.831193 11139 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40324 (request call id 1279) took 1599 ms (client timeout 2008 ms). Trace:
I20260709 12:12:25.850248 17689 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:25.917258 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 75036us
I20260709 12:12:25.918502 17811 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:25.919561 17811 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.836880 17725 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:25.883307 11139 rpcz_store.cc:269] 0709 12:12:24.228422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.228614 (+   192us) service_pool.cc:224] Handling call
0709 12:12:25.590928 (+1362314us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800005198. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:12:25.828186 (+237258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016448}
I20260709 12:12:25.925787 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:25.862197 17769 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:25.854152 17797 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:25.843537 17815 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:25.935155 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.997756 11141 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:25.926352 11142 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:25.940446 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:25.965443 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141825us
I20260709 12:12:25.877104 17729 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:26.056147 11258 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.701s (SENT)
I20260709 12:12:25.938313 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:25.843392 17852 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.120371 11210 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
W20260709 12:12:26.103808 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 184209us
I20260709 12:12:26.121487 11135 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 9.
I20260709 12:12:25.925539 17725 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:26.122190 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 147166us
I20260709 12:12:26.122098 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:26.123276 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.124661 11142 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:26.126472 17689 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:26.153014 17689 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.153092 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.153748 17689 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:26.154990 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.768s (SENT)
I20260709 12:12:26.155503 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:26.147239 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.156623 17807 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:26.157048 17658 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.775s	user 0.013s	sys 0.000s
W20260709 12:12:26.056003 17857 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:26.157383 17807 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.157691 17658 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.158663 17737 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.159365 17737 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.152874 11217 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:25.962277 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.150725 16741 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.146633 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:26.138700 17671 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.160183 17807 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:26.182785 17856 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:26.184919 17737 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.186038 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:26.187076 11218 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:26.182931 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.194990 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:26.203907 17811 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.207103 17827 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.164103 17725 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.176517 17671 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.220363 17815 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.223320 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.223711 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.224133 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.224807 11853 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:26.226020 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:26.227527 17808 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.228037 17808 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:26.227322 17737 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:26.228461 17808 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.230290 17810 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:26.230772 17810 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:26.231986 17810 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.233355 17810 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:26.235332 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:26.238637 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.200594 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:26.196852 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:26.245844 11258 leader_election.cc:336] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.712s (SENT)
I20260709 12:12:26.247923 11286 raft_consensus.cc:2410] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:25.958441 17830 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:26.254365 11219 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:12:26.252736 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 77721.6us
I20260709 12:12:26.255357 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:25.971632 17475 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:26.259416 11213 consensus_meta.cc:287] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.004s
I20260709 12:12:26.259992 11213 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:26.260970 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:26.259091 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 88879.6us
I20260709 12:12:26.263945 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.266901 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:26.272327 11216 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:26.273458 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.274139 11286 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:26.256489 17830 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:26.277098 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:26.276142 11212 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
W20260709 12:12:26.284392 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.287638 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:26.267597 17737 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.294577 17812 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.289094 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:26.288959 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:26.298118 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:26.296614 17737 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.300133 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:26.303241 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.304913 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.305997 11288 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:26.307554 17811 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:26.308264 17811 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.311762 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:26.317950 11212 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:26.321509 17769 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:26.321346 17768 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:12:26.322453 17769 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:12:26.321758 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 56117us
I20260709 12:12:26.263211 17852 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.315219 17729 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.310999 17827 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.337078 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:26.348966 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.359237 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 140807us
I20260709 12:12:26.364086 17711 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:26.364689 17711 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:26.364610 17808 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.365262 17711 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:26.323961 17769 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.354679 17737 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.382437 11291 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:26.355911 17811 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:26.402210 11258 leader_election.cc:336] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.776s (SENT)
I20260709 12:12:26.410133 17761 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:26.410908 17761 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:26.411477 17761 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.414098 17811 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.414661 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:26.414812 17811 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:26.416291 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 60916.4us
I20260709 12:12:26.417392 17811 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.417752 17582 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:26.418155 17582 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:26.418574 17582 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:26.422940 11284 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:26.423621 11284 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:26.425124 11284 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.433772 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:26.403575 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:26.394587 17658 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:26.450052 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 148638us
W20260709 12:12:26.457300 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64749.4us
I20260709 12:12:26.443254 17808 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.480608 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.392330 17822 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 12:12:26.484592 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.382988 17827 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.430400 17582 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.465127 17768 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:26.462630 17797 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.404116 17830 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.509989 17830 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:26.510142 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118634us
W20260709 12:12:26.511004 11258 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.799s (SENT)
W20260709 12:12:26.512197 11258 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.977s (SENT)
I20260709 12:12:26.508199 17807 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:26.519114 17852 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.520889 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.523456 11285 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:26.526032 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:26.526772 11284 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:26.477483 17475 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.536861 17827 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.493772 17768 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.537750 17768 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.537438 17725 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.539968 11137 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:12:26.481631 17737 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.542972 17749 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.542938 17737 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.543632 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:26.544240 17671 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.545236 17737 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.545161 17536 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:12:26.544329 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52233us
W20260709 12:12:26.550568 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.506137 17802 consensus_meta.cc:287] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.763s	user 0.004s	sys 0.009s
I20260709 12:12:26.568037 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.521121 17582 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.572886 11285 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:26.587564 11218 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:26.573640 17725 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.574932 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:26.582647 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 211482us
I20260709 12:12:26.583096 17737 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.584370 11286 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:26.586858 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.545259 17671 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:26.590826 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.601063 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.602864 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:26.620219 17821 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.599748 17671 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.562201 17802 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.596634 17797 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.629364 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.630122 11288 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:26.630960 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.632262 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.633471 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.616470 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.648594 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:26.648972 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:26.650743 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.626912 17671 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:26.652098 11853 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:26.639639 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.637681 17827 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.615609 17737 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.621587 17689 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:26.653541 17801 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:12:26.666353 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3356) took 1856 ms. Trace:
I20260709 12:12:26.669888 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.671429 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.653340 17749 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:26.677059 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:26.680353 11287 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 12:12:26.683213 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.686642 17737 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.648046 17821 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.673185 11284 rpcz_store.cc:276] 0709 12:12:24.805861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.807057 (+  1196us) service_pool.cc:224] Handling call
0709 12:12:24.825915 (+ 18858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.406136 (+1580221us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540019a120. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a52dc0 00007f9830add1c0 00007f9830ade231 00007f9830adad8f 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c
0709 12:12:26.646583 (+240447us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:26.646628 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:26.646679 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:26.646731 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.649663 (+  2932us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.661916 (+ 12253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20595,"raft.queue_time_us":17907,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10033,"spinlock_wait_cycles":2204589440}
I20260709 12:12:26.694273 11214 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:26.710625 16741 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:26.712149 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.696269 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:26.678673 17749 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:26.674978 17797 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.724661 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:26.723580 11859 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:26.728289 17863 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:26.730412 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51241.7us
I20260709 12:12:26.734048 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:26.739228 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 160836us
I20260709 12:12:26.677909 17711 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.719656 17749 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.744105 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.725332 17802 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.747901 16741 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.751291 16741 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:26.694883 17827 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.735057 17257 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:26.748135 17582 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.708418 17852 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:26.783890 17811 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.785594 17811 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.788383 17811 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.789996 11292 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:12:26.790555 11292 pending_rounds.cc:85] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 10
I20260709 12:12:26.790833 11292 pending_rounds.cc:107] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:12:26.791178 11292 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:26.791688 17811 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:26.792321 17811 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.792723 17797 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:26.794519 17811 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.802690 17582 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.805097 17582 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:26.805588 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.805804 17827 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:26.808185 17711 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:26.809796 11289 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:26.813623 17821 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:26.818889 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57727.4us
I20260709 12:12:26.820048 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:26.821898 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:26.822911 17644 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:26.823450 17644 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.738184 17768 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.779943 16741 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:26.823850 17644 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.828899 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:26.854558 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:26.858989 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:26.860091 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:26.860648 11288 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.862541 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:26.784250 17257 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:26.862897 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:26.859444 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:26.866650 11291 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.866537 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:26.868739 11141 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:26.869426 11142 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.866701 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:26.882004 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:26.882747 11138 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
W20260709 12:12:26.888046 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.889664 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:26.891265 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:26.892633 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:26.894106 11144 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:26.900079 17761 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:26.901489 11852 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:26.885936 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:26.883800 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:26.903623 11137 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:26.894384 11144 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:26.905344 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:26.909454 11141 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:26.910876 11138 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.910005 11042 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 10 to 12, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:26.927143 11042 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 14 to 17, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 17 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.930070 11042 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 10 to 11, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 11 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.936179 11142 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:26.885842 17711 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:26.940382 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77640.3us
W20260709 12:12:26.956749 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 134965us
I20260709 12:12:26.958845 11139 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:12:26.965490 11258 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.902s (SENT)
I20260709 12:12:26.967058 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:26.971886 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:26.939770 17801 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.975980 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:26.978703 11139 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:26.959751 17711 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:26.995558 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:26.999864 11136 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:26.997424 17711 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:27.017975 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.018970 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.024132 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.026153 16741 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:27.001045 17852 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.026746 16741 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:27.015486 11144 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.027583 16741 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.024500 11288 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
W20260709 12:12:27.029642 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 72863.1us
I20260709 12:12:27.028334 11289 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:27.031579 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:26.991185 17801 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.053329 11287 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:27.033056 17874 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.062508 11259 leader_election.cc:336] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.555s (SENT)
W20260709 12:12:27.063285 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 150531us
W20260709 12:12:27.065989 11258 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.946s (SENT)
I20260709 12:12:27.066574 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:27.067430 17863 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:27.067947 11258 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.967s (SENT)
I20260709 12:12:27.068387 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:27.069228 17863 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:27.069909 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.207s (SENT) [suppressed 22 similar messages]
I20260709 12:12:27.070886 17666 tablet_copy_client.cc:538] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:27.075107 17875 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:27.037931 17869 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:27.076375 17801 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:27.076083 17869 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.081899 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.104609 11144 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.998338 17257 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:27.127163 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 161177us
W20260709 12:12:27.141541 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.128062 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:12:27.144007 11258 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.439s (SENT)
W20260709 12:12:27.151597 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.124253 17875 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:27.157820 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:27.134464 17863 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.174569 17644 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.132704 17874 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.179239 17874 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:27.176651 17671 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:27.191481 11138 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
W20260709 12:12:27.192395 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.203269 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 83415.1us
W20260709 12:12:27.207471 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76889.5us
I20260709 12:12:27.210274 17737 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:27.210820 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:27.211565 11860 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.214390 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:27.214915 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.216100 11290 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 12:12:27.216171 17880 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:27.164386 17802 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:27.215497 11291 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:27.179224 17644 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:27.240859 11259 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.644s (SENT)
I20260709 12:12:27.193084 17671 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.204437 17801 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:27.193580 17869 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.247888 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:27.225162 17802 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:12:27.251091 17872 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:12:27.203878 17863 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.268743 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.270016 17827 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:27.265517 17749 consensus_meta.cc:287] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.005s
I20260709 12:12:27.265758 17802 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.285878 16741 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.363989 11136 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 10.
W20260709 12:12:27.342648 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84029us
I20260709 12:12:27.342900 11213 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 16. Ops: []
I20260709 12:12:27.355031 11042 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 12 to 13, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 13 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:12:27.374392 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.289397 11215 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:27.352087 17689 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:27.356294 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 78185us
I20260709 12:12:27.293169 11860 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:27.360855 17868 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.599s	user 0.006s	sys 0.000s
I20260709 12:12:27.368337 17761 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.371460 16741 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:27.287628 17875 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.372313 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.382884 11218 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:12:27.384611 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.385324 11138 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.391093 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:27.391976 11217 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:27.392324 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.386286 17852 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:12:27.393014 11140 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:27.394685 17827 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:27.396739 17827 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:27.400076 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.400923 17769 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:27.401873 17769 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:27.402554 17769 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:27.403028 17769 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:27.403887 17769 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.405169 17901 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.405616 17769 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:27.405843 17901 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.408263 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:27.408420 17901 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.386660 17884 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:27.409395 17869 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:27.409973 17884 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:27.410061 17869 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:27.411016 17884 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:27.405872 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 176461us
I20260709 12:12:27.411545 17869 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:27.413851 11259 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.656s (SENT)
I20260709 12:12:27.415606 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:27.427119 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:27.422778 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.294413 17749 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.433413 11140 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:27.434988 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:27.437008 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.376683 17863 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:27.438514 11143 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:27.434140 11215 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:27.444384 11860 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:27.447876 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.441730 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.403808 17761 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:12:27.458511 11138 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:27.467425 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:27.472776 11290 raft_consensus.cc:2393] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:27.472846 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96782.7us
I20260709 12:12:27.398370 17827 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:27.481941 11144 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:27.486060 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44748.6us
I20260709 12:12:27.487116 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:27.482884 11182 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.493033 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:27.493539 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.506814 11258 leader_election.cc:400] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:27.502061 16741 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:27.511497 11258 leader_election.cc:403] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:27.507680 17749 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:27.502179 17890 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:27.441272 17802 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:27.544747 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64443.2us
I20260709 12:12:27.492941 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:27.511482 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:27.521665 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.515432 17890 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:27.504797 11110 connection.cc:256] RPC call timeout handler was delayed by -2.8432126590000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
I20260709 12:12:27.550614 11859 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:27.550921 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.504693 17711 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.554857 17889 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:27.556727 17711 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:27.556900 17257 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:27.557283 17257 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.557655 17257 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:27.557739 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51148.7us
W20260709 12:12:27.558866 11110 connection.cc:256] RPC call timeout handler was delayed by -2.7874126589999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 12:12:27.560760 11853 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:27.561268 17910 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:27.560250 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.566802 17840 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:27.568462 17907 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:27.569079 17907 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:27.570257 17840 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:27.571843 17840 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:27.572222 17840 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:27.573103 17840 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.574425 17840 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:27.574613 17906 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:12:27.576449 17900 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:12:27.580204 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.581820 11037 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 258) took 15380 ms (client timeout 15000 ms). Trace:
I20260709 12:12:27.488233 17896 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:27.591071 11143 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:12:27.500777 17768 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.593617 17768 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:27.594311 17904 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:12:27.543948 17901 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.594369 17768 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:27.596403 11860 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:27.596936 17768 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.492293 17895 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.598863 17895 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.599442 17895 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.586522 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:27.601846 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55904.4us
I20260709 12:12:27.602939 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.593515 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:27.615124 11852 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:27.622963 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.588665 17802 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.626721 17840 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:27.640276 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:27.640591 16741 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:27.640276 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:27.570072 17907 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.639242 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.619550 17901 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.654140 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:27.655253 16741 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:27.628175 17874 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:27.664628 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:27.665242 11218 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.666699 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:27.663034 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 91569.4us
I20260709 12:12:27.669157 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.672533 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.677122 17885 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.677783 17885 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.678139 17885 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.678871 17822 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:27.582310 11037 rpcz_store.cc:269] 0709 12:12:12.217231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.323795 (+106564us) service_pool.cc:224] Handling call
0709 12:12:27.581461 (+15257666us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:17.698415 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:17.699155 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:17.699213 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:12:17.699233 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:17.704126 (+  4893us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:17.704252 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:17.704292 (+    40us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:12:17.792662 (+ 88370us) tablet.cc:701] Row locks acquired
0709 12:12:17.792718 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:12:17.792930 (+   212us) write_op.cc:270] Start()
0709 12:12:17.793096 (+   166us) write_op.cc:276] Timestamp: P: 1783599137792840 usec, L: 0
0709 12:12:17.793134 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:12:17.794038 (+   904us) log.cc:844] Serialized 10963 byte log entry
0709 12:12:18.255852 (+461814us) op_driver.cc:464] REPLICATION: finished
0709 12:12:18.465385 (+209533us) write_op.cc:301] APPLY: starting
0709 12:12:18.472505 (+  7120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:18.945447 (+472942us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:18.945596 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:19.622400 (+676804us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:19.623134 (+   734us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 12:12:19.623235 (+   101us) write_op.cc:312] APPLY: finished
0709 12:12:19.624126 (+   891us) log.cc:844] Serialized 244 byte log entry
0709 12:12:19.790098 (+165972us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:19.790364 (+   266us) write_op.cc:454] Released schema lock
0709 12:12:19.790464 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:19.798814 (+  8350us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:19.798843 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1038343,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":128523,"apply.run_cpu_time_us":57742,"apply.run_wall_time_us":1333375,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121503,"num_ops":28,"prepare.queue_time_us":290960,"prepare.run_cpu_time_us":19059,"prepare.run_wall_time_us":194193,"raft.queue_time_us":197652,"raft.run_cpu_time_us":30829,"raft.run_wall_time_us":104889,"replication_time_us":462481,"thread_start_us":671979,"threads_started":5,"wal-append.queue_time_us":336843,"wal-append.run_cpu_time_us":47090,"wal-append.run_wall_time_us":2285142}]]}
I20260709 12:12:27.681236 17609 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.681830 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.657470 17729 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:27.687441 16741 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.671396 17875 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:27.691998 17877 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:12:27.704495 17666 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
W20260709 12:12:27.712695 11258 leader_election.cc:336] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.534s (SENT)
I20260709 12:12:27.713233 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:27.714944 17827 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.746097 17729 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.693035 11218 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:27.695806 17257 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.754007 17257 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.696313 17890 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.673281 17874 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:27.673100 17869 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:12:27.759361 17874 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.763475 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:27.763789 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 91333.3us
I20260709 12:12:27.768914 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:27.772311 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 90565.8us
I20260709 12:12:27.699777 17907 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:27.776930 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64301.4us
I20260709 12:12:27.769049 17914 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:27.789644 11213 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:27.798429 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.759722 17895 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.801007 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.800386 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.783097 17840 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:27.791067 17914 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:27.808121 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.809697 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:27.816625 17797 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.817546 17768 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:27.851346 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54013us
I20260709 12:12:27.852913 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:27.854328 17863 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:27.855264 17863 consensus_queue.cc:1243] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:27.856932 17863 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:27.857301 17863 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:27.857616 17908 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.180s	user 0.000s	sys 0.002s
I20260709 12:12:27.818028 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.859565 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:27.824940 17917 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:27.832944 17827 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:27.822407 17609 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.791138 17875 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:27.879983 11214 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:27.876796 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.859572 17257 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.870193 17797 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:27.890859 17874 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.904287 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.905088 11219 raft_consensus.cc:2368] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:12:27.904670 17874 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.905917 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.898802 17768 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.899776 17895 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:27.902362 17737 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:27.902835 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.903190 17875 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.903645 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:27.841923 17914 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.849006 17840 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.858144 17863 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:27.909933 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 79496.5us
I20260709 12:12:27.916702 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.917702 11211 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:27.914189 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.919356 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.921074 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:27.922327 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.923563 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.924620 11210 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:27.926113 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.909157 17797 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.909299 17827 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.909705 17737 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:27.936378 17913 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:27.936998 17737 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.938524 17737 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.939008 17866 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:12:27.931770 17884 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:27.940971 17927 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:27.941651 17927 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:27.941987 17927 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.925400 17711 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:27.946301 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:27.948454 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.933955 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:27.950382 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.952518 11142 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:27.956022 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.956506 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:27.957865 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.959944 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:27.961265 11140 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:27.931313 17797 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.971452 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:27.972378 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.973708 11213 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:27.976603 11212 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:27.977159 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:27.948076 17914 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:27.982612 17928 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.983331 17925 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:27.983494 17909 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:27.996500 11212 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:28.001919 11140 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:12:27.985631 11135 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:27.984457 11217 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:28.004294 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:27.980897 17863 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:28.008708 11213 raft_consensus.cc:2368] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19.
I20260709 12:12:28.006760 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:28.010533 11137 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.933270 17827 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.017220 17827 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:28.020279 17899 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:28.021050 17899 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.024943 17899 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:28.025811 17899 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.035274 17909 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:28.035995 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.036492 17909 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:27.987167 17729 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.039637 11211 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:28.038007 17927 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:27.991457 17928 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:28.047747 11210 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:28.049875 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.050771 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:27.991782 17925 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:27.964596 17917 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:28.054075 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:28.044438 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79390.7us
I20260709 12:12:28.055451 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.053340 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.058423 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:28.056357 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.060281 11287 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 13: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:28.061981 11291 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:28.064019 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.064868 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.065574 11284 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:28.065948 17929 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:28.066522 17800 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:28.067991 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.070312 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.072026 11289 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.054877 17928 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:28.076548 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.078060 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.080470 11293 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:28.081893 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.026410 17899 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.087200 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.090852 11288 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:28.094695 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:28.096791 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.097684 11291 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:28.104369 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.058800 17885 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.109304 11284 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.067157 17830 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:12:28.110375 11290 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:12:28.111038 11290 pending_rounds.cc:85] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 13
I20260709 12:12:28.111455 11290 pending_rounds.cc:107] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:12:28.108889 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.111742 11290 raft_consensus.cc:2889] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:28.061589 17907 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:12:28.121906 11140 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:12:28.130775 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50748.4us
I20260709 12:12:28.131840 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:28.138006 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.139086 11291 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:28.154692 17840 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.103994 17917 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:28.083451 17827 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:28.160784 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.156792 11137 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:28.161468 11288 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
W20260709 12:12:28.161198 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77542.8us
I20260709 12:12:28.154767 11110 leader_election.cc:400] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:12:28.162317 11110 leader_election.cc:403] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:28.170663 17925 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.171607 17885 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.172405 17925 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:28.183014 11293 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:12:28.187968 11289 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:28.189978 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.192808 11293 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.197315 11291 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:28.205005 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.205659 11288 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.174320 17899 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.161084 17917 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:28.233412 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78790.5us
I20260709 12:12:28.187812 17934 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.234754 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:28.236552 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.238867 17939 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:12:28.245402 17830 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:28.247265 11288 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:28.251863 11285 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:28.250800 11293 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:28.253152 11284 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:28.253314 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:28.266104 11293 pending_rounds.cc:85] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 10
I20260709 12:12:28.266412 11293 pending_rounds.cc:107] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:12:28.266695 11293 raft_consensus.cc:2889] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:28.203812 17940 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:28.268846 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.258404 17761 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:28.281386 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46835.4us
I20260709 12:12:28.265165 17914 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:28.290089 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 219823us
I20260709 12:12:28.302569 11285 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:28.269050 17934 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:28.312525 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:28.328271 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:28.328423 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:28.329449 11859 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:12:28.330858 11110 leader_election.cc:400] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:28.331243 11110 leader_election.cc:403] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:28.332588 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:28.333343 17840 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.333987 17940 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:28.334122 17840 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.335879 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:28.304375 17761 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:28.335891 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:28.337109 17761 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.338526 17945 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:28.339044 17945 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:28.339171 17840 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.339519 17945 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.373960 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:28.342028 17927 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.346129 17827 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.405154 11853 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:28.319855 17802 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:12:28.396238 17914 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.415937 17934 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.427075 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:12:28.423537 17943 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:12:28.441658 17940 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.445308 17940 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:28.445775 17940 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.448851 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:28.449708 11258 leader_election.cc:336] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.555s (SENT)
I20260709 12:12:28.450289 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:28.402519 17827 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.454957 11286 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:28.462977 17863 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.474676 11110 leader_election.cc:400] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19.
I20260709 12:12:28.483692 17944 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:28.481052 17926 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:28.485466 17926 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.487018 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:28.489281 17840 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:28.489923 17840 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:28.490381 17797 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.001s
I20260709 12:12:28.494146 17925 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.496222 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.520239 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.484454 17944 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:28.496945 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 563022us
I20260709 12:12:28.527889 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:28.497155 17257 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:28.534140 11852 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:28.540726 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.541275 17874 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.541553 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.542294 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.542852 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.544042 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.545325 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.546517 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.547639 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.548591 17257 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:28.544042 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.549686 17257 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.550346 11292 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.550470 11216 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:12:28.551628 17907 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.552250 17907 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:28.552702 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.542963 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.551661 17929 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:28.522029 11110 connection.cc:256] RPC call timeout handler was delayed by -1.4475446500000544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 12:12:28.553509 11258 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.656s (SENT)
I20260709 12:12:28.560942 11213 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:28.560845 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:28.484431 17917 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.546303 17899 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.530978 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.548959 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.562353 11219 raft_consensus.cc:2368] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
W20260709 12:12:28.561841 11110 connection.cc:256] RPC call timeout handler was delayed by -1.2810446500000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 12:12:28.562961 11110 connection.cc:256] RPC call timeout handler was delayed by -1.2306446500001584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 12:12:28.532058 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.558895 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.563491 11210 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:12:28.565002 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.565959 11210 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:28.568272 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.519855 17797 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.570930 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.572582 11215 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 21. Ops: []
I20260709 12:12:28.573009 17797 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.572764 17907 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:28.573436 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45635.3us
I20260709 12:12:28.573657 17797 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:28.573899 17907 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.562433 17899 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:28.574820 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.575495 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.575349 17899 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.575838 17840 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.576421 17840 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:28.576669 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.570987 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.577131 17840 consensus_queue.cc:1243] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:12:28.577816 17937 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:28.578037 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.577744 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.582361 11289 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:28.578158 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.583112 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.580056 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.583864 11139 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:28.583900 11141 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:28.584685 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:28.585076 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.585807 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.579931 17929 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.581430 11184 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:28.586606 11138 raft_consensus.cc:2368] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:12:28.587446 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.587507 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:28.588138 17929 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.588449 16741 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:28.588577 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.589028 16741 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:28.589140 17671 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.547539 17689 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:28.583259 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.576426 17899 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.589910 17689 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.589963 16741 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:28.592252 17689 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.582813 17889 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:28.585243 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.589334 11138 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:28.579332 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.578938 17797 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:28.586161 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.596536 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.580370 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.584978 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.605159 11139 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:28.632766 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.633566 11138 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:28.663442 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.634469 11141 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:28.679329 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.679392 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.683298 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.684902 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:28.686128 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.688261 11290 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.604765 17942 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.687602 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:28.681669 11144 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:28.689832 11139 raft_consensus.cc:2368] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:12:28.698396 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:28.706609 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:28.693042 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:28.693665 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.708750 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:28.689268 17928 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.007s
I20260709 12:12:28.711037 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.711957 11143 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:28.712729 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.713558 11859 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:28.700906 11210 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:28.703821 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.705623 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.715261 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.720798 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.720822 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:28.724442 11217 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:28.736335 11214 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:28.739243 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:28.714392 17815 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:28.715282 17671 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.752835 11259 leader_election.cc:400] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:12:28.753208 11259 leader_election.cc:403] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:28.754058 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.709333 17689 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:12:28.737334 17934 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.759011 11139 raft_consensus.cc:2368] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:28.764047 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.765046 11139 raft_consensus.cc:2410] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:12:28.766673 17959 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:12:28.748409 17737 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.748162 17950 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:12:28.758144 17815 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:28.776597 11293 raft_consensus.cc:2410] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:28.777415 17815 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.725462 17928 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.786422 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:28.761340 17671 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:28.788591 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:28.789707 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:28.790349 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 236103us
I20260709 12:12:28.817427 11138 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:28.824363 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:28.825110 11859 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:28.826649 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:28.827867 17939 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.828217 17939 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.828510 17939 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.836828 17939 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.839836 17939 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.842144 17769 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:28.842669 17769 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:28.843233 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:28.844091 11859 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.843990 17769 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.845921 17769 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:28.814936 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.784072 17737 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
I20260709 12:12:28.789341 17950 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:28.849927 17950 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:28.851101 17950 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:28.852234 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.852591 17950 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:28.853266 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.854151 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.855175 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.856261 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:28.856837 11135 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:28.857762 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:28.859586 17926 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.859946 11135 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:12:28.859728 17942 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:28.861363 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 159107us
I20260709 12:12:28.861761 17942 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:28.864251 17942 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:28.864430 11141 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: [21.12-22.13]
I20260709 12:12:28.867679 11141 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: [22.15-23.16]
I20260709 12:12:28.865481 11137 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 12:12:28.872663 11135 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.874213 11290 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:28.780838 17934 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.891278 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:28.895270 11291 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:28.892550 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:28.897143 11292 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:28.898169 11284 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:28.760703 17797 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.898893 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:28.900615 11289 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:28.820274 17907 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:28.906888 17962 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:12:28.792376 17863 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.111s
I20260709 12:12:28.784885 17945 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:28.938468 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.912276 17907 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:28.899873 17763 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:28.948977 11291 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
W20260709 12:12:28.953562 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 167286us
I20260709 12:12:28.951429 17737 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:28.958703 17737 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:28.959695 17737 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.961110 17737 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:28.951705 17949 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.963749 17949 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.980261 17934 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.954356 17907 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:28.989207 11861 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:28.990322 17928 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:28.991050 17927 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:28.992198 17927 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.992528 17927 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:28.993777 17940 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
I20260709 12:12:28.995787 17940 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:28.996852 11137 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.997555 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2408) took 1105 ms. Trace:
I20260709 12:12:28.997972 11215 rpcz_store.cc:276] 0709 12:12:27.899846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.910347 (+ 10501us) service_pool.cc:224] Handling call
0709 12:12:27.914141 (+  3794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.573032 (+658891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.997244 (+424212us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540035aa54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:28.997450 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513717632}
W20260709 12:12:29.000137 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44233.1us
I20260709 12:12:28.993335 17927 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.003893 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:29.007586 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51898.8us
I20260709 12:12:29.009919 11859 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:29.010684 11853 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:29.007540 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 288037us
I20260709 12:12:29.011206 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:29.008675 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.013931 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.015600 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.015727 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:28.997886 17940 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:29.018514 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.019014 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:29.017798 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.021215 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:29.013787 17863 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:29.027494 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.015929 17934 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:29.036590 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.024885 17926 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.023120 17967 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:29.031754 17935 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:29.026778 17942 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.026396 17939 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:29.052390 11136 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:29.043797 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.045831 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:29.025532 17927 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.051425 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:29.029863 17863 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:29.056190 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.060797 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:29.060655 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:29.061303 11143 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:29.057793 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.062462 11144 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:29.063838 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:29.049043 17935 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:29.065311 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.065392 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.015033 17671 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.041877 17934 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:29.068755 11285 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.070670 11215 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:29.072958 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:29.063958 17863 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:29.073614 11289 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:29.082778 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:29.065444 17967 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:29.095810 17967 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:29.096797 17967 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.099377 17827 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.099872 11285 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:29.108716 11219 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:29.109470 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:29.110541 11212 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:29.085815 11182 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:29.113749 17895 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:29.115242 17729 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:29.086331 17888 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:29.087663 17945 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:29.118713 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.119026 11212 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:29.088953 17949 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.089788 17934 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.090652 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:29.090723 11286 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:29.093515 17917 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.115594 17729 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:29.116315 11139 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.127928 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:29.129725 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.139178 11143 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:29.142400 17729 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.143882 17729 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:29.144284 17969 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 12:12:29.145164 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.146664 11139 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:29.146914 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:29.170894 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.147359 11211 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:29.147090 17907 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.147675 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:29.148517 11144 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:29.147169 17945 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:29.150403 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 148897us
I20260709 12:12:29.175251 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:29.151312 17914 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:29.151539 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:29.152294 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:29.154551 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:29.156131 17944 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.146204 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:29.172662 17949 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:29.157086 17965 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:12:29.131479 17840 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:29.207329 17729 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:29.207466 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61337us
I20260709 12:12:29.207845 17840 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.209472 11141 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:29.210892 17689 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:29.211268 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:29.179163 11212 raft_consensus.cc:2410] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:29.213876 17689 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:29.214457 17729 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:29.214988 17729 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.215374 17729 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.215418 17888 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:29.216174 17888 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:29.217264 17888 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:29.218423 17970 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 12:12:29.218715 17875 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:29.219374 17875 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.207494 17949 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.221578 17875 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:29.222946 17949 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:29.191150 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:29.225327 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:29.225842 11258 leader_election.cc:400] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18.
W20260709 12:12:29.192448 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.192912 11861 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.194595 17827 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:29.202719 11210 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 12: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:29.203898 11139 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:29.159612 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:29.211889 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:29.229817 11258 leader_election.cc:400] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:29.233927 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:29.237252 11218 raft_consensus.cc:2410] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:12:29.237167 11258 leader_election.cc:403] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.234730 17944 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.242895 17950 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:12:29.245071 17821 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:29.246747 11258 leader_election.cc:400] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:29.247234 11258 leader_election.cc:403] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.247900 17827 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:29.249163 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:29.249845 17875 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:29.251576 17875 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.251950 17875 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.252795 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:29.253055 17729 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.256323 17729 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:29.256875 17907 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:29.258154 11288 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:29.166719 11852 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:12:29.210261 17840 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:29.268316 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:29.275444 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.279086 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45949.9us
W20260709 12:12:29.260591 17666 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 12:12:29.267736 17907 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.305397 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:29.312862 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63774.9us
I20260709 12:12:29.299160 17925 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:29.334677 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:29.310966 17797 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:29.303074 17729 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:12:29.304495 17874 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:12:29.347048 17907 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:29.347743 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:29.311811 17866 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:12:29.347501 17974 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:12:29.352465 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:29.336094 17925 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:29.354657 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:29.353549 17907 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.345719 17945 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:29.379498 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76600.8us
I20260709 12:12:29.355885 17827 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:29.363615 17950 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:29.411311 16741 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:29.344709 17875 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.444003 17925 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.444775 17875 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:29.416193 17950 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.445940 17950 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.446403 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:29.376195 17974 consensus_queue.cc:1243] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:29.423633 17749 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:29.375923 17945 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:29.426704 17979 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:12:29.411617 17976 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.424s	user 0.004s	sys 0.000s
W20260709 12:12:29.438787 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82188.8us
I20260709 12:12:29.378988 17913 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:29.371006 17863 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.452929 17895 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:29.460508 17935 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:29.462903 17968 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.500s	user 0.005s	sys 0.000s
I20260709 12:12:29.468155 11288 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:29.470851 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 167493us
I20260709 12:12:28.765772  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:29.510841 17984 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
W20260709 12:12:29.615391 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 101989us
I20260709 12:12:29.627705 11284 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 21. Ops: []
W20260709 12:12:29.511121 17983 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 12:12:29.619979 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 107195us
I20260709 12:12:29.615255 17821 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:29.648228 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 234610us
I20260709 12:12:29.652290 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:29.651495 17917 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.000s
I20260709 12:12:29.643142 17913 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:29.672025 11140 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:29.650736 17895 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:29.682945 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.671239 17935 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:29.691542 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.656605 17827 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 12:12:29.680200 17944 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:29.701414 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.727154 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74948.9us
I20260709 12:12:29.673749 17821 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.735405 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:29.742720 17944 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:29.743474 17944 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.745980 17944 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.749316 17821 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:29.760154 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.761119 11139 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
W20260709 12:12:29.771250 17985 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:12:29.732621 17866 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:12:29.787050 17863 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.750422 17895 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.768375 17944 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:29.793356 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65283.9us
I20260709 12:12:29.774773 17827 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:29.797998 17895 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.801330 17917 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.801952 17917 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.805680 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:29.807245 17917 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:29.811199 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:29.812273 17863 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:29.813398 17863 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:29.813774 17863 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.813989 17949 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:29.814692 17949 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:29.815037 17827 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.815837 17949 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.817314 17827 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.818429 17827 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:29.818774 17827 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:29.819502 17827 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.820840 17827 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.824416 17945 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.838410 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:29.839488 17869 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:29.839752 17888 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.839998 17869 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.840539 17869 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.814123 17863 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.881039 11144 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:29.791574 17950 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.882993 17257 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:29.883419 17257 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:29.884085 17950 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:29.884299 17257 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.885635 17257 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.885499 17869 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.893905 17913 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.895155 17913 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.901206 17869 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:29.904197 17949 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.904366 11284 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:29.906222 17840 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:29.909683 17971 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:29.910823 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 99710.9us
W20260709 12:12:29.925544 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.927412 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.929813 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.929944 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:29.930574 11140 raft_consensus.cc:2368] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:29.930985 11144 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.933126 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.934103 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.936240 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.936815 11138 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:29.934692 11143 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:29.940994 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.943687 17934 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.944271 11139 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:29.944275 17934 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:29.949854 11039 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 7 to 9, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 9 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:29.954932 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 283987us
I20260709 12:12:29.958124 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.965262 11135 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:29.972157 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:29.957672 17945 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:29.977196 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:29.977888 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 273480us
I20260709 12:12:29.978332 11039 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } }
I20260709 12:12:29.981472 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:29.982838 16741 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:29.983310 16741 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:12:29.983705 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.983651 16741 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.978790 11144 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:29.983568 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:29.984184 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:29.991818 11288 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:29.984746 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:29.992043 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:29.995644 11258 leader_election.cc:400] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:29.995949 11258 leader_election.cc:403] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.985500 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:29.994182 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 328467us
I20260709 12:12:30.001361 11292 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:30.009423 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:30.010779 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:30.011785 11144 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.013453 17671 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:30.013594 17729 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:30.013964 17945 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.014688 17945 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:29.978135 17895 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:12:30.018041 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:30.018589 17945 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.018704 11853 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
W20260709 12:12:30.019421 18008 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:30.018734 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.022847 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:30.023468 11289 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.028738 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:30.029651 17840 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:30.030090 17840 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.030507 17840 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:30.031363 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.032239 17967 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:30.033703 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.034760 18007 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
W20260709 12:12:30.037266 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 257) took 39217 ms (client timeout 15000 ms). Trace:
I20260709 12:12:30.038137 17967 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.039727 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.039937 17840 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.040644 17945 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:30.037685 11042 rpcz_store.cc:269] 0709 12:11:50.819522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.852522 (+ 33000us) service_pool.cc:224] Handling call
0709 12:12:30.037152 (+39184630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:27.716127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:27.743001 (+ 26874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:27.743062 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:12:27.743081 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:27.743965 (+   884us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:27.744023 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:27.744057 (+    34us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:27.744760 (+   703us) tablet.cc:701] Row locks acquired
0709 12:12:27.744795 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:12:27.744952 (+   157us) write_op.cc:270] Start()
0709 12:12:27.745120 (+   168us) write_op.cc:276] Timestamp: P: 1783599147744890 usec, L: 0
0709 12:12:27.745144 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:27.793970 (+ 48826us) log.cc:844] Serialized 2861 byte log entry
0709 12:12:28.167358 (+373388us) op_driver.cc:464] REPLICATION: finished
0709 12:12:28.312109 (+144751us) write_op.cc:301] APPLY: starting
0709 12:12:28.312205 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:28.325281 (+ 13076us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:28.325438 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:28.465538 (+140100us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:28.465899 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:12:28.465948 (+    49us) write_op.cc:312] APPLY: finished
0709 12:12:28.466301 (+   353us) log.cc:844] Serialized 73 byte log entry
0709 12:12:28.467096 (+   795us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:28.474974 (+  7878us) write_op.cc:454] Released schema lock
0709 12:12:28.478390 (+  3416us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:28.532909 (+ 54519us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:28.532942 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5677400,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":144419,"apply.run_cpu_time_us":15246,"apply.run_wall_time_us":198951,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33471,"num_ops":7,"prepare.queue_time_us":121068,"prepare.run_cpu_time_us":33037,"prepare.run_wall_time_us":207305,"raft.queue_time_us":101121,"raft.run_cpu_time_us":57251,"raft.run_wall_time_us":109631,"replication_time_us":422009,"thread_start_us":305382,"threads_started":4,"wal-append.queue_time_us":169661,"wal-append.run_cpu_time_us":23243,"wal-append.run_wall_time_us":1538557}]]}
I20260709 12:12:30.000887 17971 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:30.041564 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.043082 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.043469 11039 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:30.045432 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.045393 11039 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 12 to 14, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 14 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:30.047930 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.049171 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:30.049785 11136 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:30.052789 11140 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:30.057896 11144 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:30.062242 11142 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:30.095790 11285 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:30.096258 11285 pending_rounds.cc:85] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 10
I20260709 12:12:30.096499 11285 pending_rounds.cc:107] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:30.096712 11285 raft_consensus.cc:2889] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.096962 11142 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:30.097779 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:30.062932 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53675.5us
I20260709 12:12:30.000667 17944 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:30.067519 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.066322 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.007746 17875 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:30.069948 11140 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:30.071799 11289 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:30.046676 17950 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.072192 11039 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:30.091764 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:30.119964 11287 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:30.099090 16741 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.099135 11141 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:30.100311 11285 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:30.099161 11286 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:30.099217 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.052950 17907 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.067269 17945 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:30.109198 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:30.064534 18007 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.131064 11293 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 12:12:30.131441 11293 pending_rounds.cc:85] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 15
I20260709 12:12:30.131659 11293 pending_rounds.cc:107] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:12:30.122207 11286 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:30.063898 17971 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:12:30.125187 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58961.6us
I20260709 12:12:30.140743 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.108500 11210 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:12:30.129140 11136 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:30.072201 17869 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.131897 11293 raft_consensus.cc:2889] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.148100 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.149549 11286 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:30.150148 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.151790 16741 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.154162 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:30.118719 17944 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:30.161240 11039 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 17 to 18, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 18 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.180167 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.181119 17840 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.138784 17917 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.191840 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 82715.1us
I20260709 12:12:30.136307 18002 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.160388 17950 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.201357 11293 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:12:30.202099 11293 pending_rounds.cc:85] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 12
I20260709 12:12:30.202404 11293 pending_rounds.cc:107] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:12:30.202710 11293 raft_consensus.cc:2889] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.205096 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.176558 17944 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:30.167950 17907 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.166728 17914 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:30.177747 17945 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.157967 17869 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.177316 17875 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:30.213677 11039 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:30.203315 17934 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.199405 18002 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.199692 17967 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.241119 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.243350 11039 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 12 to 13, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 13 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:30.245462 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 146320us
W20260709 12:12:30.233035 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118420us
I20260709 12:12:30.248883 11853 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:12:30.290827 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 183558us
I20260709 12:12:30.213133 17950 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.234149 18002 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.246321 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:30.228545 17917 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:12:30.308161 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.243589 17895 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:12:30.314219 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:30.212281 17971 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.294370 18007 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.309676 17934 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.332091 16741 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.332854 16741 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.335160 11218 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:12:30.335510 11218 pending_rounds.cc:85] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 13
I20260709 12:12:30.335737 11218 pending_rounds.cc:107] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:30.335975 11218 raft_consensus.cc:2889] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.311419 17935 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.339727 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:30.347463 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 150520us
W20260709 12:12:30.327699 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 122735us
I20260709 12:12:30.351016 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.375412 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.377564 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.377230 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.378623 11213 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:30.379168 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:30.380523 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.381533 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:30.384843 11212 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:12:30.385581 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.385957 11859 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:30.385883 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:30.377530 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 85961.5us
I20260709 12:12:30.376256 11039 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 12 to 15, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 15 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.388060 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.388679 11853 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:30.327704 18015 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:30.391311 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.391727 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:30.392555 11212 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:30.391347 11853 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:30.392868 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.331054 17840 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.335050 17994 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.336771 17729 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:30.400507 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:30.400537 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 154319us
I20260709 12:12:30.397342 11217 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:30.396373 16741 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.397117 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:30.404356 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.398252 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:30.396221 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47905us
I20260709 12:12:30.405503 11212 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:12:30.399545 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.337637 17888 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:30.399362 11039 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:30.410261 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.411504 11293 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:30.431320 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:30.417951 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.406598 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:30.432004 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:30.438118 11214 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:30.440970 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:30.442425 11212 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:30.387846 17967 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.338997 17934 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.397188 17914 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.336217 18007 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:30.443454 17863 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:12:30.405074 17729 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.338023 17875 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.445858 17917 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.475868 11287 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:30.468994 11039 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 12 to 14, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 14 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.454365 17888 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.482371 17888 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:30.483731 17949 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 12:12:30.484004 17729 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.484340 17949 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:30.462450 17914 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:30.485540 18012 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:30.429117 17994 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.487048 17914 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.487919 11213 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:30.488859 17914 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:30.489005 17994 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.489598 18022 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:30.407341 18015 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.459913 18019 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:30.479946 11287 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:30.494831 11293 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:30.500515 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:30.540266 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:30.541456 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:30.542253 11852 raft_consensus.cc:2410] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:12:30.472813 18026 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:30.462087 17863 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.499981 17869 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.493602 17949 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:30.491873 17967 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:12:30.593894 17934 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.551658 18030 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:30.597353 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 131014us
I20260709 12:12:30.599097 18025 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:30.499367 17999 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.600037 18007 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.604000 17914 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:30.606455 11292 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:30.608335 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.548321 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107282us
W20260709 12:12:30.620512 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 210359us
W20260709 12:12:30.620667 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 202773us
I20260709 12:12:30.626510 11288 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:30.598398 18019 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:30.672654 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:30.633587 11142 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.020s
I20260709 12:12:30.600725 18026 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:30.637506 11291 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:30.613674 18022 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.640498 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:30.644853 17994 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:30.649278 18028 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.653368 17914 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:30.676159 11142 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.003s	sys 0.020s
I20260709 12:12:30.693904 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.694654 11140 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:30.679963 17967 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:30.685971 18009 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.479s	user 0.000s	sys 0.004s
I20260709 12:12:30.640842 17815 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:12:30.638188 17995 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:12:30.696408 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.734560 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.735023 18039 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:30.736001 18039 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:30.736717 17949 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:12:30.734580 18011 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:12:30.693117 18022 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.736596 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.739288 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:30.739563 18022 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.701680 18031 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.698988 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.701222 11136 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:12:30.691641 17913 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.004s
I20260709 12:12:30.727609 11141 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:30.728193 18015 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.698944 17689 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:30.750867 17797 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.755667 17666 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:30.755900 17797 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.757264 17666 tablet_bootstrap.cc:492] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:12:30.697675 18030 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.758060 17797 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.758611 18030 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:30.761466 17944 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.002s
I20260709 12:12:30.761866 17944 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.762475 18030 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.758714 17689 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:30.763942 17689 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.758366 17666 ts_tablet_manager.cc:1403] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 3.054s	user 0.082s	sys 0.041s
I20260709 12:12:30.731350 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.671399 18027 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.752115 11143 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:30.696426 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:30.755060 18040 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:30.772701 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.773456 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:30.766620 18026 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.759697 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:30.775781 11852 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
W20260709 12:12:30.744527 17827 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.923s	user 0.014s	sys 0.001s
I20260709 12:12:30.698030 18019 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:30.753221 17949 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.754112 17994 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:30.643693 17950 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.776568 11288 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:30.768091 17863 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.777699 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:30.779385 11289 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:30.784969 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:30.793542 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:30.794211 11293 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:30.795782 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:30.706564 18028 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.799206 11285 raft_consensus.cc:2410] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:30.799285 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.800642 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:30.802126 11142 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:30.803617 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:30.782105 17907 consensus_meta.cc:287] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.002s
I20260709 12:12:30.779764 17967 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.779278 17994 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:30.808737 11140 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:30.811908 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.813562 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:30.768958 18031 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.798375 18033 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:30.781484 18041 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.798547 17934 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.797111 17888 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:30.770900 18027 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.800634 17917 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.835466 17917 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:30.831405 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:30.810178 17863 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:30.837848 17917 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:30.830596 17729 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:12:30.832779 17888 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:30.839138 18038 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:12:30.837852 17863 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.839998 17863 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:30.834575 17934 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.844573 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:30.847127 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.848621 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.849956 16741 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:30.826826 17907 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.853533 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:30.855460 11288 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:30.823942 17797 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.839090 17888 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.852828 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:30.801780 18002 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.828778 18033 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.865567 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:30.857398 17797 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.843199 17815 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:30.908413 11286 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:30.910374 17797 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:30.910724 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58005.4us
I20260709 12:12:30.897238 18033 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.904152 17944 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.911234 17934 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.906730 18041 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:30.929503 18044 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:12:30.933718 18010 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.599s	user 0.001s	sys 0.001s
I20260709 12:12:30.933868 17950 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.900403 18019 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.921036 18050 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:30.949716 18050 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.950109 18050 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:30.950954 18002 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.947916 17821 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:30.960909 18031 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:30.936664 18027 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:30.937536 18020 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.463s	user 0.000s	sys 0.001s
I20260709 12:12:30.938182 18051 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.967118 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1351) took 1011 ms. Trace:
I20260709 12:12:30.967231 18051 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.967559 11139 rpcz_store.cc:276] 0709 12:12:29.955554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.955772 (+   218us) service_pool.cc:224] Handling call
0709 12:12:29.956206 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.961694 (+  5488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.961741 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.965123 (+  3382us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.118197 (+153074us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:30.118233 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.118289 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:30.932932 (+814643us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:30.966815 (+ 33883us) raft_consensus.cc:1685] finished
0709 12:12:30.966840 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.967057 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2035,"raft.run_cpu_time_us":1121,"raft.run_wall_time_us":4332,"spinlock_wait_cycles":5646208,"thread_start_us":121034,"threads_started":1,"wal-append.queue_time_us":315047}
I20260709 12:12:30.969342 17257 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:30.969760 18051 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.900862 17994 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:31.053787 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 128972us
I20260709 12:12:30.976027 17914 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:30.980355 18022 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:30.969792 17257 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:31.058897 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 109715us
I20260709 12:12:31.064720 17967 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:31.065507 17967 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.068449 18002 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.069154 18002 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.072718 18002 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.059096 18031 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.075188 17967 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.075003 18031 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.077368 18031 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.088478 11135 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.085963 18003 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:12:31.130717 18031 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:31.130438 17666 raft_consensus.cc:359] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:31.131824 17666 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:12:31.131528 18031 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.132742 17666 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:30.946403 18041 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.136268 18041 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.138651 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:31.140218 11859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:31.140643 18027 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.140949 11859 raft_consensus.cc:606] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:31.141568 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:31.142346 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:31.142947 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:31.142863 18022 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.143805 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:31.145692 18022 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.150393 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:31.150398 17257 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.151197 11213 raft_consensus.cc:606] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:31.141235 18027 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:30.979048 17950 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:31.160349 11135 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:31.166663 17950 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.167999 11135 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:31.164548 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:31.169873 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.170451 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:31.171077 11213 raft_consensus.cc:606] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:31.160801 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62182.9us
W20260709 12:12:31.179350 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.155946 17257 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.134266 18031 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.189885 18050 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.190929 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.209698 11292 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:12:31.193328 18027 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:31.193552 17830 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:31.194734 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:31.195649 18028 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.196672 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2488) took 1240 ms. Trace:
I20260709 12:12:31.197625 17888 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.199193 11290 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:31.202890 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:31.212800 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.205879 11861 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEARNER]: Advancing to term 24
I20260709 12:12:31.234236 17888 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.162904 17994 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.090086 17797 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.237735 17797 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:31.203141 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:31.230463 11291 rpcz_store.cc:276] 0709 12:12:29.956219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.956356 (+   137us) service_pool.cc:224] Handling call
0709 12:12:31.196442 (+1240086us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b540020a654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:31.196585 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506709376}
I20260709 12:12:31.238111 11213 raft_consensus.cc:606] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:31.239651 11213 raft_consensus.cc:614] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:31.211841 18019 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:12:31.202929 18054 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.118s	user 0.000s	sys 0.003s
I20260709 12:12:31.245126 18019 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.245430 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:31.246379 11858 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:31.248011 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65761.1us
I20260709 12:12:31.249389 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:31.257004 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.257982 11143 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:31.258998 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:31.212419 17992 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.212307 17874 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.269572 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:31.272480 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.274258 11285 raft_consensus.cc:2410] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 25 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:12:31.275079 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.272950 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:31.279079 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.279832 11291 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:31.280282 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.276086 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.287022 11143 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.289158 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:31.290608 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:31.294941 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.297946 16741 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:31.298533 18027 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:31.299605 16741 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:31.304102 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:31.304924 11210 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
W20260709 12:12:31.312404 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 121207us
I20260709 12:12:31.254104 17671 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:31.292001 18049 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.310635 18035 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:31.270143 17797 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:31.336829 17749 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:12:31.349192 17950 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.349840 17950 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.352069 17950 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.356845 17974 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:31.276124 17863 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.358522 17974 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:31.359046 17974 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:31.360517 17863 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.275907 17992 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.278471 17874 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.363138 18000 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 12:12:31.375205 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:31.363766 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.363849 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.371559 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.293627 18033 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.338666 18049 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.384721 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:31.382220 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 149195us
I20260709 12:12:31.386350 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:31.369634 17666 ts_tablet_manager.cc:1434] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.602s	user 0.011s	sys 0.000s
I20260709 12:12:31.400333 11142 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:31.346167 11143 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:31.378077 18031 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.402828 18031 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.391237 18049 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.403812 18033 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.365597 17992 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:31.410717 11135 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:31.412026 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.413324 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.415917 18019 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:31.416885 16741 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:31.424893 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.446821 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.448467 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:31.380555 18028 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:31.702414 18033 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:31.683516 18028 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:31.690411 11858 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:31.706027 18002 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:31.717561 18002 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.718070 18028 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:31.720522 18002 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:31.721252 18002 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:31.721902 18002 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:31.401290 17666 ts_tablet_manager.cc:1467] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Tablet startup took 633ms
I20260709 12:12:31.360832 17974 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:31.780247 11861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.065s	sys 0.105s
W20260709 12:12:31.796579 11861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.065s	sys 0.105s
W20260709 12:12:31.899403 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 193211us
W20260709 12:12:31.947577 11214 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.062s	sys 0.125s
W20260709 12:12:31.948881 11214 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.063s	sys 0.125s
W20260709 12:12:31.948624 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48281.3us
I20260709 12:12:31.979768 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3423) took 1888 ms. Trace:
I20260709 12:12:31.980615 11290 rpcz_store.cc:276] 0709 12:12:30.091015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.091149 (+   134us) service_pool.cc:224] Handling call
0709 12:12:31.198873 (+1107724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.231581 (+ 32708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.979430 (+747849us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540020a650. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:31.979679 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546851584}
I20260709 12:12:31.716138 18033 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:31.776242 18048 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:32.016377 11823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.043s
W20260709 12:12:32.031713 11823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.014s	sys 0.044s
I20260709 12:12:31.683598 17995 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.264s
W20260709 12:12:31.714439 17257 consensus_meta.cc:287] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 12:12:31.902401 18050 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:31.684226 17999 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:32.005789 18018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.029s	sys 0.053s
I20260709 12:12:32.040035 17995 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:31.700114 17950 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:32.032266 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.012s	sys 0.047s
W20260709 12:12:32.061734 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.012s	sys 0.047s
I20260709 12:12:31.955842 18023 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.070261 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:32.055576 18018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.030s	sys 0.053s
W20260709 12:12:32.071591 11218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.050s	sys 0.163s
W20260709 12:12:32.075996 11218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.050s	sys 0.165s
I20260709 12:12:32.049157 17874 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.053339 17999 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:32.078101 18063 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:12:32.081606 11826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.025s	sys 0.035s
W20260709 12:12:32.098793 11826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.025s	sys 0.035s
W20260709 12:12:32.099129 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 708459us
W20260709 12:12:32.081662 11184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.009s	sys 0.052s
W20260709 12:12:32.100386 11184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.009s	sys 0.052s
W20260709 12:12:32.102419 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 682782us
I20260709 12:12:32.043133 18048 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.060768 17995 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:32.081715 17749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.007s	sys 0.053s
I20260709 12:12:32.078181 17999 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.079787 18031 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.167110 18031 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.167836 18031 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:32.116609 17749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.053s
I20260709 12:12:32.067292 17950 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.126834 18079 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.129328 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3732) took 1223 ms. Trace:
W20260709 12:12:32.172040 18014 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.064s	user 0.011s	sys 0.027s
I20260709 12:12:32.173030 17889 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:32.129541 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.118405 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:32.131230 18060 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:12:32.133414 18048 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:32.153846 18033 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.091233 17874 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:31.778281 17666 ts_tablet_manager.cc:1469] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Trace:
0709 12:12:20.924314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.924525 (+   211us) service_pool.cc:224] Handling call
0709 12:12:21.125453 (+200928us) ts_tablet_manager.cc:934] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
0709 12:12:21.383215 (+257762us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eacaa 00007f982d9eabd2 00007f9835a4f131
0709 12:12:22.928277 (+1545062us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:23.561369 (+633092us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:23.564866 (+  3497us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:24.027608 (+462742us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:24.028049 (+   441us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:24.028479 (+   430us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:24.107029 (+ 78550us) inbound_call.cc:177] Queueing success response
0709 12:12:27.703959 (+3596930us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:30.768004 (+3064045us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:30.920087 (+152083us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:30.978402 (+ 58315us) tablet_replica.cc:280] Starting consensus
0709 12:12:31.945821 (+967419us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4800100158. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
Metrics: {"dns_us":4165,"mutex_wait_us":1237,"raft.queue_time_us":18961,"raft.run_cpu_time_us":3689,"raft.run_wall_time_us":849436,"spinlock_wait_cycles":16333952,"tablet-copy.queue_time_us":191870,"tablet-download-pool.queue_time_us":137,"tablet-download-pool.run_cpu_time_us":1729,"tablet-download-pool.run_wall_time_us":2312180,"thread_start_us":535998,"threads_started":2}
I20260709 12:12:32.162189 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1368) took 1010 ms. Trace:
I20260709 12:12:32.069841 18023 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:32.175050 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57130.1us
I20260709 12:12:32.172267 11136 rpcz_store.cc:276] 0709 12:12:30.905839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.906031 (+   192us) service_pool.cc:224] Handling call
0709 12:12:30.917074 (+ 11043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.090676 (+173602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.090713 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.153924 (+ 63211us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.388176 (+234252us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.388230 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.388319 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.129076 (+740757us) raft_consensus.cc:1685] finished
0709 12:12:32.129099 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.129248 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4045,"raft.queue_time_us":21262,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"thread_start_us":337329,"threads_started":2,"wal-append.queue_time_us":945587}
I20260709 12:12:32.183115 17869 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:32.170403 18031 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.172394 17950 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.190243 11135 rpcz_store.cc:276] 0709 12:12:31.151510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.170660 (+ 19150us) service_pool.cc:224] Handling call
0709 12:12:31.171038 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.411282 (+240244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.161950 (+750668us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540033fed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:32.162126 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550720256}
W20260709 12:12:32.199286 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 249483us
I20260709 12:12:32.183641 17749 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:32.218350 18033 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.243597 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.244329 11135 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:32.201574 17869 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.193707 17874 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:32.172326 18079 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.173730 17889 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.119962 17995 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.229775 18031 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.268677 11853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 888) took 1121 ms. Trace:
I20260709 12:12:32.251994 18033 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.255023 17869 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.269184 11853 rpcz_store.cc:276] 0709 12:12:31.140822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.141629 (+   807us) service_pool.cc:224] Handling call
0709 12:12:31.142028 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.153218 (+ 11190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.153250 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.166951 (+ 13701us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.320703 (+153752us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.320745 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.321861 (+  1116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.364569 (+ 42708us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800100158. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:12:32.257290 (+892721us) raft_consensus.cc:1685] finished
0709 12:12:32.257322 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.262149 (+  4827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10774,"raft.queue_time_us":10889,"raft.run_cpu_time_us":1538,"raft.run_wall_time_us":209441,"spinlock_wait_cycles":4691840,"thread_start_us":153303,"threads_started":1,"wal-append.queue_time_us":437856}
I20260709 12:12:32.252949 18065 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:12:32.283845 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.509s (SENT) [suppressed 31 similar messages]
W20260709 12:12:32.296895 11110 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.008s	sys 0.015s
W20260709 12:12:32.298316 11110 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.015s
W20260709 12:12:32.298642 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 562755us
I20260709 12:12:32.246572 17749 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.223631 18080 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:32.301249 11183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.011s
W20260709 12:12:32.309891 11183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.012s	sys 0.011s
I20260709 12:12:32.316689 18062 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.317466 18062 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.320472 18062 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.321471 18062 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.322121 18062 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:32.325109 18062 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.267832 18035 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.300590 17995 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.328795 18083 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.331264 18033 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:32.333802 18057 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.228s	user 0.008s	sys 0.000s
I20260709 12:12:32.341005 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:32.327992 18080 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.299875 17950 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:32.278964 17874 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.272625 18031 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.306681 18048 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.392202 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:32.392102 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:32.373716 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 143637us
I20260709 12:12:32.373229 18088 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.412175 11293 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:32.416558 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:32.418319 11214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:32.419135 11214 raft_consensus.cc:606] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:32.421015 11861 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:32.307430 18065 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.423844 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:32.425319 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:32.380041 17888 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:32.426725 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:32.424407 18043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.009s	sys 0.016s
I20260709 12:12:32.430474  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:32.393347 17950 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:32.442627 18082 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:32.443392 17950 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.438060  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.425575 17917 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:32.451934 11286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45930 (request call id 3445) took 2035 ms (client timeout 2274 ms). Trace:
W20260709 12:12:32.502876 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76211.9us
W20260709 12:12:32.436653 18043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.010s	sys 0.017s
I20260709 12:12:32.372596 18035 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:32.476800 11286 rpcz_store.cc:269] 0709 12:12:30.416190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.467724 (+ 51534us) service_pool.cc:224] Handling call
0709 12:12:32.451671 (+1983947us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400426dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:32.451857 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860733312}
I20260709 12:12:32.377403 18083 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.421559 17815 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:32.422358 18048 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.522720 18102 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.523697 18102 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.473798 17950 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.454316 18023 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.518615 17945 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:32.537199 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 97625.6us
W20260709 12:12:32.549518 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 132197us
I20260709 12:12:32.426344 18088 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:32.568370 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 160692us
I20260709 12:12:32.575474 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:32.593523 18087 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.291s	user 0.000s	sys 0.009s
I20260709 12:12:32.595749 17749 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:32.543527 18079 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.556663 18018 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:32.602144 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44466.1us
I20260709 12:12:32.602901 11135 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:32.617398 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.618849 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.619546 11135 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:32.623960 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:32.601744 18089 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.598591 18110 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.556586 17950 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.531205 18102 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.614166 17889 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:32.728847 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 99863us
W20260709 12:12:32.728758 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 130359us
I20260709 12:12:32.731774 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:32.626572 17888 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:32.602178 17999 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.706656 18023 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:32.761996 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3733) took 1855 ms. Trace:
I20260709 12:12:32.798923 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3748) took 1422 ms. Trace:
I20260709 12:12:32.763964 18080 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.732440 18089 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:32.766320 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.766556 11229 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-255c201215d14e89bc735bb8b57682cb received from {username='slave'} at 127.0.0.1:44734
I20260709 12:12:32.770754 17797 raft_consensus.cc:993] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:32.771277 18088 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:32.773736 18103 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.847150 18103 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.849933 18103 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:32.773972 17863 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.850114 17888 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.850776 17863 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.775657 18065 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.776571 18031 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:32.777024 18033 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:32.777760 18085 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.386s	user 0.002s	sys 0.007s
I20260709 12:12:32.869398 18088 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.870342 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1142) took 1573 ms. Trace:
I20260709 12:12:32.779959 18071 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.171s
W20260709 12:12:32.780638 18084 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:12:32.616775 18018 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.783305 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.784489 18041 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.785256 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.787331 18102 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.789595 17950 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:32.793995 18083 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:32.796227 18100 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:12:32.709496 18079 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.807699 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.811169 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.811496 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:32.811959 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.902765 11286 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:12:32.902781 11289 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:32.903906 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.819602 11139 rpcz_store.cc:276] 0709 12:12:31.376931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.015183 (+638252us) service_pool.cc:224] Handling call
0709 12:12:32.022089 (+  6906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.224040 (+201951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.224087 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.224757 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.350999 (+126242us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.351058 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.351168 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.798629 (+447461us) raft_consensus.cc:1685] finished
0709 12:12:32.798660 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.798842 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39825,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6731,"thread_start_us":292918,"threads_started":2,"wal-append.queue_time_us":377956}
I20260709 12:12:32.831409 11292 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:32.907644 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.904760 11286 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:12:32.908414 11292 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:32.838168 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:32.839079 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:32.841434 11229 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-255c201215d14e89bc735bb8b57682cb on tablet 255c201215d14e89bc735bb8b57682cb with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:32.819262 11141 rpcz_store.cc:276] 0709 12:12:30.906268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.906429 (+   161us) service_pool.cc:224] Handling call
0709 12:12:30.913130 (+  6701us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:30.918492 (+  5362us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:30.927712 (+  9220us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.079728 (+152016us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:31.080660 (+   932us) log.cc:844] Serialized 52 byte log entry
0709 12:12:31.080920 (+   260us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:31.081179 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.085561 (+  4382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.085677 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.333171 (+1247494us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:32.754086 (+420915us) raft_consensus.cc:1685] finished
0709 12:12:32.754130 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.761905 (+  7775us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56201,"prepare.queue_time_us":7428,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":35615,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":14201,"spinlock_wait_cycles":121274240,"thread_start_us":78665,"threads_started":1,"wal-append.queue_time_us":155757}
I20260709 12:12:32.637058 17945 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.163s
I20260709 12:12:32.913345 17945 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.913849 17945 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:32.901859 11290 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:32.914923 17945 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.916234 17945 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.853163 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:32.862322 18112 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:12:32.758869 18110 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.923863 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.893371 18101 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.865144 17999 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.867136 18076 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.868278 18048 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.831475 18023 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.949939 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.874639 18033 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.870035 18088 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:32.779351 18081 raft_consensus.cc:993] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:32.870810 11218 rpcz_store.cc:276] 0709 12:12:31.297088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.297267 (+   179us) service_pool.cc:224] Handling call
0709 12:12:31.297694 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.077106 (+779412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.077143 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.077650 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.267642 (+189992us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:32.267682 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.269030 (+  1348us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.870121 (+601091us) raft_consensus.cc:1685] finished
0709 12:12:32.870144 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.870283 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4716,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":968244,"threads_started":2,"wal-append.queue_time_us":249440}
I20260709 12:12:32.957523 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.876502 11293 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:32.877121 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.887058 18119 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.888192 18002 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:32.890659 18093 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.881299 18041 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:32.897012 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:32.994637 11137 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:32.908305 11259 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.725s (SENT)
I20260709 12:12:32.909359 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:32.996214 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87951.7us
I20260709 12:12:32.996479 11286 raft_consensus.cc:2410] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:32.838639 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:32.919358 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.874361 18031 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:32.924523 11135 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:32.863750 18089 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.004515 11287 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
W20260709 12:12:32.895973 18049 consensus_meta.cc:287] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 1.492s	user 0.011s	sys 0.011s
I20260709 12:12:32.947784 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.951105 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.952092 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.952394 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:32.952720 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.011391 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.960873 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.961572 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.958863 11285 raft_consensus.cc:2410] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:12:32.961702 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.946178 17729 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:32.963038 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.018707 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:32.900399 18022 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:33.021341 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.959911 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.892333 18018 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:32.948469 17689 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.956568 18023 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:32.999832 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44503.3us
I20260709 12:12:32.999989 11292 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:32.937672 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 84622.4us
I20260709 12:12:33.004743 11288 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:32.924979 18079 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.031605 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.032296 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.033555 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.005244 18102 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.014027 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.014303 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.018952 11211 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:12:32.962335 18080 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:32.925462 17797 raft_consensus.cc:1081] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:33.023907 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.019630 11285 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:12:33.019898 11141 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:33.029774 11137 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:32.991879 18093 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:33.009536 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:32.998224 18122 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:33.047848 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.043663 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.042346 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.044417 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.046803 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.054307 11292 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:33.045791 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.047897 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.044222 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:32.956748 18076 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.051855 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:33.057397 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.057534 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.060973 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.061331 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.061663 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.062386 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.063398 11214 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:33.064744 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.065795 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.060636 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:33.067276 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.068703 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.015422 18083 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:12:33.070307 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:32.948841 18101 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.071316 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.076043 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.073768 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.105700 11211 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:33.013757 18031 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.076503 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.117625 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.106079 11218 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:33.110267 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.074306 11137 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:33.070470 18048 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:33.019476 18049 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.128386 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.129863 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.132200 11216 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:33.123330 18130 raft_consensus.cc:1081] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:32.993866 18119 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.075731 18103 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.033957 18022 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.134609 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.134955 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:33.157198 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 191511us
I20260709 12:12:33.058391 18080 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.040612 17689 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.051803 18102 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.105780 18062 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:33.156601 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.157054 11210 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:33.118209 18092 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.163561 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.165508 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.165884 11136 raft_consensus.cc:2368] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21.
I20260709 12:12:33.165832 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.170074 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.169020 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:33.172449 17995 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.001s
I20260709 12:12:33.172808 18125 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:33.173171 18092 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.173420 18125 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.175629 18092 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.176708 18033 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.178625 18101 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:33.143349 17863 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:33.180245 18049 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.181257 18088 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.181365 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.182662 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.183661 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.184603 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.185890 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.186031 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.187342 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.131991 18048 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:33.189144 11217 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:12:33.191924 11210 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:33.161499 18103 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:33.193913 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.195477 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.198745 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.060844 18122 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:33.202821 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 331205us
W20260709 12:12:33.181416 18067 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.071s	user 0.008s	sys 0.003s
I20260709 12:12:33.209102 11142 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:33.211529 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.197057 18048 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:33.217319 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.215176 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.201625 18103 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.218134 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.200899 18079 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:33.221451 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.225796 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.164196 18124 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 12:12:33.227573 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:33.228827 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:12:33.224494 18128 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 12:12:33.185660 18062 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.252933 11858 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.228444 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.217597 18041 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.221984 11137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:12:33.224963 18049 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:33.259306 11137 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:33.262874 11137 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:33.228435 18116 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 12:12:33.260181 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.264398 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.265552 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.143430 18093 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.266355 11216 raft_consensus.cc:2410] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:12:33.275586 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.276571 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:33.279450 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.255132 18110 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.259891 18083 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:33.280294 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.281963 11216 pending_rounds.cc:85] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 12
I20260709 12:12:33.286278 11858 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:33.286970 11216 pending_rounds.cc:107] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:33.287317 11216 raft_consensus.cc:2889] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.288033 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:33.301803 18119 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.303985 18119 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:33.305526 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.306107 18119 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:33.306702 18119 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:33.307178 18119 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.299906 18041 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:33.322242 11137 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:33.327194 17869 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 1.018s	user 0.013s	sys 0.000s
W20260709 12:12:33.334049 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57522.5us
I20260709 12:12:33.335249 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3736) took 2265 ms. Trace:
I20260709 12:12:33.312808 18083 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:33.271750 18130 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:33.338755 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:33.342078 11137 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.335634 11138 rpcz_store.cc:276] 0709 12:12:31.064843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.091205 (+ 26362us) service_pool.cc:224] Handling call
0709 12:12:31.091710 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:31.155667 (+ 63957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.155710 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:31.162613 (+  6903us) log.cc:844] Serialized 52 byte log entry
0709 12:12:31.384810 (+222197us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.417853 (+ 33043us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.418601 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.418685 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.180725 (+1762040us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:33.324203 (+143478us) raft_consensus.cc:1685] finished
0709 12:12:33.329693 (+  5490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.329954 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4934,"prepare.queue_time_us":30428,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":64308,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":24964,"spinlock_wait_cycles":3534592,"thread_start_us":154029,"threads_started":1,"wal-append.queue_time_us":867836}
I20260709 12:12:33.354733 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.355883 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:33.356613 11861 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:33.356810 18138 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:12:33.356964 11861 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:33.361368 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.361312 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:33.362941 11286 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.340911 17995 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:33.369239 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.372231 11214 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:12:33.373805 11214 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:33.331933 18031 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:33.377503 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.359997 11861 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:33.367395 18141 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:12:33.383738 17995 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.384438 18062 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.341868 18076 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.339540 18041 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:33.386013 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.339073 17869 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.387992 18000 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.396360 11286 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:33.377872 18022 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.399086 17875 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.400869 11215 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
W20260709 12:12:33.403259 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 238775us
I20260709 12:12:33.419004 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.420382 11286 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:33.381616 18080 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.381770 17689 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.424189 17869 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.342199 18083 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.400318 18102 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.427521 18041 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:33.408427 18050 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.006s	sys 0.009s
I20260709 12:12:33.400684 17995 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:33.390347 18125 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.437335 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.437902 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:33.444923 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 83624.6us
I20260709 12:12:33.449913 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.451633 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:33.452719 11286 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:33.445327 18050 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.007s	sys 0.009s
I20260709 12:12:33.457064 18119 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:33.459730 18148 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:12:33.529433 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91669.3us
I20260709 12:12:33.530736 11184 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:33.464284 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:33.469826 18132 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
W20260709 12:12:33.535851 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71644.6us
I20260709 12:12:33.477939 18083 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.446681 17995 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.536645 18121 raft_consensus.cc:2764] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:33.486356  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.542128 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.543007 11137 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:12:33.543120 11140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:33.543732 11140 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:33.544070 11140 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.544143 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.548803 11137 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:33.556813 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.557824 11286 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
W20260709 12:12:33.510848 18145 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:12:33.565714 11138 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:33.566264 11138 pending_rounds.cc:85] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 12
I20260709 12:12:33.566584 11138 pending_rounds.cc:107] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:33.566872 11138 raft_consensus.cc:2889] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:33.569597 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119764us
I20260709 12:12:33.571239 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.572424 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.572541 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.573758 18083 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.573804 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.575716 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.578112 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:33.580546 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.594620 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:33.561122 18076 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:33.595852 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.603613 17935 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.596542 18124 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.621394 11140 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.624135 11144 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:33.631814 11286 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:33.633886 11140 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:33.616515 18076 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:33.642145 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.653322 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69946.9us
W20260709 12:12:33.668112 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52128us
I20260709 12:12:33.670812 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:33.653017 17945 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:33.672536 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:33.718195 18157 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:33.718817 18155 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:33.720019 18160 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:33.664314 18109 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.722862 18109 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.725386 18109 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:33.727706 17671 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.728109 17671 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:33.728430 18023 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.005s
I20260709 12:12:33.728490 17671 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.728904 18023 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:33.716949 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44511.8us
I20260709 12:12:33.732547 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.735569 11212 raft_consensus.cc:2368] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19.
I20260709 12:12:33.647616 18103 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.740168 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:33.742835 11143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3755) took 1400 ms. Trace:
I20260709 12:12:33.743387 11143 rpcz_store.cc:276] 0709 12:12:32.342773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.343024 (+   251us) service_pool.cc:224] Handling call
0709 12:12:32.343375 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.557726 (+214351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.557773 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.557831 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.557876 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.742467 (+1184591us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400263754. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:33.742576 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.742758 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492481792}
I20260709 12:12:33.746902 18076 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:33.740878 11216 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:33.713923 18118 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.730029 18089 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.897773 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3474) took 1009 ms. Trace:
I20260709 12:12:33.960484 17671 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:33.965619 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:33.966675 11136 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:33.967216 17671 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.926972 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:33.761686 18118 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.968727 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:33.954926 11292 rpcz_store.cc:276] 0709 12:12:32.888106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.896941 (+1008835us) service_pool.cc:224] Handling call
0709 12:12:33.897284 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.897456 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.897481 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.897521 (+    40us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:33.897560 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.897610 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.897714 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:33.753158 18119 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.976222 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:33.763610 18089 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:33.776146 18035 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:33.980558 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:33.898432 18048 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.002s
I20260709 12:12:33.916641 18093 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.000051 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1503) took 1105 ms. Trace:
I20260709 12:12:33.892565 17889 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.974718 18118 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.008074 11292 rpcz_store.cc:276] 0709 12:12:32.894301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.998709 (+1104408us) service_pool.cc:224] Handling call
0709 12:12:33.999087 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.999640 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.999667 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.999732 (+    65us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:33.999789 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.999868 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.999969 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.009008 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:33.925959 18158 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:12:34.040395 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 96026.3us
I20260709 12:12:34.040525 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:34.010118 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1504) took 1115 ms. Trace:
I20260709 12:12:34.044464 11214 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:34.044430 11292 rpcz_store.cc:276] 0709 12:12:32.894606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.009283 (+1114677us) service_pool.cc:224] Handling call
0709 12:12:34.009563 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.009750 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.009783 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.009825 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:34.009856 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.009917 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.010044 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.045907 11214 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:34.048461 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:34.003592 18089 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.060288 11139 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:34.008085 18114 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:34.058559 11214 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:34.059917 18023 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:34.057554 18041 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:34.091311 18023 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:34.092454 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.105206 11139 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:34.101207 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.102556 11214 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.047435 18166 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:34.069027 18114 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.027299 17889 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.007015 18048 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:34.104012 18023 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.134605 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:34.141248 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:34.118333 18103 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:34.142154 11140 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.147794 11136 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:34.133335 18114 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:34.150885 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.152356 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:34.164088 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:34.159456 11139 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:34.159875 18048 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:34.164836 11142 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.170462 11825 leader_election.cc:400] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21.
I20260709 12:12:34.166165 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2507) took 1145 ms. Trace:
W20260709 12:12:34.178522 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.182931 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.181859 11285 rpcz_store.cc:276] 0709 12:12:33.020319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.165361 (+1145042us) service_pool.cc:224] Handling call
0709 12:12:34.165655 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.165848 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.165874 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.165917 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:34.165956 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.166006 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.166108 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.187943 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3476) took 1001 ms. Trace:
I20260709 12:12:34.188517 11285 rpcz_store.cc:276] 0709 12:12:33.186728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.186910 (+1000182us) service_pool.cc:224] Handling call
0709 12:12:34.187290 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.187516 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.187553 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.187619 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:34.187673 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.187740 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.187875 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.189721 11140 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:34.191345 11214 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:34.193084 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:34.194231 17935 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:34.194818 17935 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:34.196103 17935 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:34.194794 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.202639 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:34.203912 18124 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:34.205713 11217 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:34.208124 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:34.220487 18171 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:12:34.221349 18066 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.221812 18155 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:34.149775 18111 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:34.206871 18041 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.216475 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.254289 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.255622 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.221865 18066 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.258445 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.245330 18041 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:34.281872 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.266271 18167 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:12:34.291738 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:34.293537 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80897.6us
I20260709 12:12:34.295181 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:34.265494 18066 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.296736 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.299899 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:34.301606 11142 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:34.301373 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:34.313746 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3459) took 1500 ms. Trace:
I20260709 12:12:34.314214 11291 rpcz_store.cc:276] 0709 12:12:32.813645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.845060 (+ 31415us) service_pool.cc:224] Handling call
0709 12:12:32.845434 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.870826 (+ 25392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.870858 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.880608 (+  9750us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.980785 (+1100177us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18003d0480. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:12:34.185638 (+204853us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:34.185692 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.185761 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.299309 (+113548us) raft_consensus.cc:1685] finished
0709 12:12:34.299333 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.313661 (+ 14328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19174,"raft.queue_time_us":98599,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":14864,"spinlock_wait_cycles":4590976,"thread_start_us":204604,"threads_started":1,"wal-append.queue_time_us":1355797}
I20260709 12:12:34.328243 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.284008 18041 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.244256 18111 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.336199 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3457) took 1524 ms. Trace:
I20260709 12:12:34.338727 18002 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.339481 18002 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.340723 18120 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:34.341400 18120 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:34.344516 11141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 2825) took 1392 ms (client timeout 1693 ms). Trace:
W20260709 12:12:34.344990 11141 rpcz_store.cc:269] 0709 12:12:32.951653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.957936 (+  6283us) service_pool.cc:224] Handling call
0709 12:12:34.344346 (+1386410us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b54003cb254. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:34.344457 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16609024}
W20260709 12:12:34.346361 11215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2938) took 1394 ms (client timeout 1710 ms). Trace:
W20260709 12:12:34.346866 11215 rpcz_store.cc:269] 0709 12:12:32.952305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.952456 (+   151us) service_pool.cc:224] Handling call
0709 12:12:34.346160 (+1393704us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001d3154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:34.346277 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396658432}
I20260709 12:12:34.352497 17889 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:34.328783 18177 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:12:34.336757 11284 rpcz_store.cc:276] 0709 12:12:32.811469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.812671 (+  1202us) service_pool.cc:224] Handling call
0709 12:12:32.856473 (+ 43802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.872011 (+ 15538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.872057 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.882305 (+ 10248us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.006943 (+124638us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:33.022307 (+ 15364us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.469192 (+446885us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:34.335583 (+866391us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18004a1e80. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f982d9f0a40 00007f982d9eb4e4 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:12:34.335805 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.335894 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.335950 (+    56us) raft_consensus.cc:1685] finished
0709 12:12:34.335966 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.336118 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54393,"prepare.queue_time_us":13495,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":97160,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":37851,"spinlock_wait_cycles":12632576,"thread_start_us":88190,"threads_started":1,"wal-append.queue_time_us":165686}
I20260709 12:12:34.412489 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2483) took 1235 ms. Trace:
I20260709 12:12:34.426689 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:34.413144 11210 rpcz_store.cc:276] 0709 12:12:33.182562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.187077 (+  4515us) service_pool.cc:224] Handling call
0709 12:12:34.412227 (+1225150us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b5400385c54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:34.412395 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8850816}
W20260709 12:12:34.424657 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 123375us
I20260709 12:12:34.468698 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:34.439599 17995 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.001s
W20260709 12:12:34.470186 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 1.28632e+06us
W20260709 12:12:34.463196 18180 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:12:34.454190 17935 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:34.503245 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 1.28452e+06us
I20260709 12:12:34.515239 17935 raft_consensus.cc:2764] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:34.533106 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1139) took 3237 ms. Trace:
I20260709 12:12:34.473884 18134 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.535034 18134 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.538308 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3464) took 1669 ms. Trace:
I20260709 12:12:34.538849 11293 rpcz_store.cc:276] 0709 12:12:32.868674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.959012 (+ 90338us) service_pool.cc:224] Handling call
0709 12:12:32.959433 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.002115 (+ 42682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.002159 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.012376 (+ 10217us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.459095 (+446719us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b1800462ac0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:12:33.610221 (+151126us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:33.712859 (+102638us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.537773 (+824914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.537887 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.537946 (+    59us) raft_consensus.cc:1685] finished
0709 12:12:34.538075 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.538235 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2148152,"prepare.queue_time_us":139371,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":66560,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12534,"spinlock_wait_cycles":19833600,"thread_start_us":239134,"threads_started":2,"wal-append.queue_time_us":597789}
I20260709 12:12:34.541998 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3470) took 1655 ms. Trace:
I20260709 12:12:34.542383 11287 rpcz_store.cc:276] 0709 12:12:32.887080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.770753 (+883673us) service_pool.cc:224] Handling call
0709 12:12:33.771214 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.771542 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:33.771913 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.541602 (+769689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.541666 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:34.541741 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.541816 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.541941 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487053,"prepare.queue_time_us":120738,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3521,"raft.queue_time_us":487236,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"thread_start_us":282165,"threads_started":1,"wal-append.queue_time_us":383398}
W20260709 12:12:34.547684 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.549386 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2500) took 1650 ms. Trace:
I20260709 12:12:34.550019 11292 rpcz_store.cc:276] 0709 12:12:32.898891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.046420 (+1147529us) service_pool.cc:224] Handling call
0709 12:12:34.046680 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.046881 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:34.056851 (+  9970us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.548863 (+492012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.548948 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:34.549033 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.549131 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.549306 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324101,"prepare.queue_time_us":14937,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":157623,"threads_started":1,"wal-append.queue_time_us":258080}
I20260709 12:12:34.552175 18133 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:34.554919 11258 connection.cc:256] RPC call timeout handler was delayed by -1.6257071959998939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 12:12:34.556068 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:34.533742 11219 rpcz_store.cc:276] 0709 12:12:31.296120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.305759 (+  9639us) service_pool.cc:224] Handling call
0709 12:12:31.306129 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.306549 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.306576 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.676304 (+2369728us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:12:33.716635 (+ 40331us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.149613 (+432978us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:34.149653 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.149886 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.532696 (+382810us) raft_consensus.cc:1685] finished
0709 12:12:34.532721 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.533009 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":31660416,"thread_start_us":335053,"threads_started":1,"wal-append.queue_time_us":447730}
W20260709 12:12:34.569746 11258 connection.cc:256] RPC call timeout handler was delayed by -1.1996689869997681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 12:12:34.570282 11258 connection.cc:256] RPC call timeout handler was delayed by -1.034847457999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2711s for a response
W20260709 12:12:34.574227 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63489us
W20260709 12:12:34.578647 11212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 2937) took 1626 ms (client timeout 2125 ms). Trace:
I20260709 12:12:34.574261 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3469) took 1687 ms. Trace:
I20260709 12:12:34.579604 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:34.580085 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:34.580642 11285 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
W20260709 12:12:34.579136 11212 rpcz_store.cc:269] 0709 12:12:32.951992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.952152 (+   160us) service_pool.cc:224] Handling call
0709 12:12:34.578443 (+1626291us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54002954d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:34.578594 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664166272}
I20260709 12:12:34.580960 11286 rpcz_store.cc:276] 0709 12:12:32.886763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.633017 (+746254us) service_pool.cc:224] Handling call
0709 12:12:33.651047 (+ 18030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.651245 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:33.739304 (+ 88059us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.573787 (+834483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.573858 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:34.573933 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.574025 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.574179 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":584286,"prepare.queue_time_us":102537,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":513084,"spinlock_wait_cycles":48384,"thread_start_us":398721,"threads_started":2,"wal-append.queue_time_us":415998}
I20260709 12:12:34.490326 17995 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:34.594841 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:34.595463 11293 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.563481 18093 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:34.558302 18079 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:34.563730 18002 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:34.566475 18126 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:34.543978 18118 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:34.610754 11217 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:34.582571 18137 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:34.585594 17950 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:34.620931 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 152336us
I20260709 12:12:34.581780 18019 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:34.600597 11291 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:34.691289 11284 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:34.692922 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.711143 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 106741us
I20260709 12:12:34.712862 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.601155 18103 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:34.728675 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 110614us
I20260709 12:12:34.732033 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.733065 11212 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:34.567611 18133 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.609704 18093 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.600780 17671 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 12:12:34.733913 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:34.726281 18019 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.763525 11141 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:34.756953 11293 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:34.785039 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:34.786254 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:34.795358 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:34.796358 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:34.787261 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:34.762080 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:34.754279 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:34.789408 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:34.798162 11212 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:34.799283 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:34.800711 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:34.801988 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:34.805914 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51750.3us
I20260709 12:12:34.620994 18120 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:34.614827 18079 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.808226 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:34.815950 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:34.816748 11212 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:34.816177 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:34.832207 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:34.814158 18050 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:34.835310 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:34.837795 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:34.626945 18126 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:34.692296 18137 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:34.891826 18114 consensus_meta.cc:287] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.003s
I20260709 12:12:34.892728 18114 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:34.901224 18188 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:12:34.814571 17947 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:34.834328 18050 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:34.818005 18109 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.930428 18194 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:34.850803 18120 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:34.941867 18093 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:34.839139 18086 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.947642 17995 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:34.718001 17950 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.007355 18137 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:35.013703 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1149) took 2118 ms. Trace:
I20260709 12:12:35.020550 18134 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.024318 17945 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:35.024658 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.026021 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:35.037340 18066 consensus_meta.cc:287] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.002s
I20260709 12:12:35.037586 17874 raft_consensus.cc:1064] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
W20260709 12:12:34.914151 18041 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.002s
W20260709 12:12:35.039999 18089 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.978s	user 0.015s	sys 0.000s
I20260709 12:12:34.810720 18002 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
W20260709 12:12:35.057675 11290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.016s	sys 0.016s
W20260709 12:12:35.058295 11259 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.022s
W20260709 12:12:35.174533 11259 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.011s	sys 0.022s
W20260709 12:12:35.175086 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 622838us
I20260709 12:12:34.878857 18118 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.062026 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:35.072281 11214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.017s	sys 0.007s
W20260709 12:12:35.178726 11214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.017s	sys 0.007s
I20260709 12:12:35.044341 18133 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.106014 11213 rpcz_store.cc:276] 0709 12:12:32.895135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.895307 (+   172us) service_pool.cc:224] Handling call
0709 12:12:32.895535 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.109703 (+214168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.109752 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:33.109807 (+    55us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:12:33.109866 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.013413 (+1903547us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540035be54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:35.013473 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.013635 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492073856}
I20260709 12:12:35.057005 17935 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:35.059887 18050 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.140687 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3458) took 2327 ms. Trace:
I20260709 12:12:35.140282 11215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2487) took 1242 ms. Trace:
I20260709 12:12:35.143896 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:35.073016 18120 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.183010 11141 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:35.247541 11215 rpcz_store.cc:276] 0709 12:12:33.898225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.348980 (+450755us) service_pool.cc:224] Handling call
0709 12:12:34.349273 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.474532 (+125259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.474577 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.475214 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.798965 (+323751us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:35.110518 (+311553us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.111437 (+   919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.111514 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.140078 (+ 28564us) raft_consensus.cc:1685] finished
0709 12:12:35.140097 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.140224 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124753,"prepare.queue_time_us":310173,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":154315,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":52890,"thread_start_us":561673,"threads_started":2,"wal-append.queue_time_us":626639}
I20260709 12:12:35.251397 11137 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.073256 18109 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.249850 11288 rpcz_store.cc:276] 0709 12:12:32.813108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.813273 (+   165us) service_pool.cc:224] Handling call
0709 12:12:32.823534 (+ 10261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.953839 (+130305us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:33.129330 (+175491us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.494374 (+1365044us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.495119 (+   745us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.813564 (+318445us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:34.813627 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.813728 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.140497 (+326769us) raft_consensus.cc:1685] finished
0709 12:12:35.140522 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.140634 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1361024,"raft.queue_time_us":1356444,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":14385,"thread_start_us":501499,"threads_started":3,"wal-append.queue_time_us":740604,"wal-append.run_cpu_time_us":2139,"wal-append.run_wall_time_us":1154992}
W20260709 12:12:35.178984 17874 raft_consensus.cc:1068] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Unable to promote non-voter 2b4f4725b82b481ab53f0717a429e94a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:35.288753 11137 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:35.255820 18120 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.250571 17935 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:35.099673 18086 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.255112 17950 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.298615 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.304718 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1157) took 1405 ms. Trace:
I20260709 12:12:35.305044 11288 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.174324 18066 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.280275 18079 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:35.312958 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 484917us
I20260709 12:12:35.277913 18000 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:35.319278 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.323653 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:35.182390 18041 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.326872 11137 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:35.335510 11219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2497) took 1396 ms. Trace:
I20260709 12:12:35.340592 11288 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:35.342911 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:35.183490 18089 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.297165 17935 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.353538 17974 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:35.355816 18109 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:35.334090 18000 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.361389 18000 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.363097 18041 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.364797 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3460) took 2533 ms. Trace:
I20260709 12:12:35.365785 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2489) took 1467 ms. Trace:
I20260709 12:12:35.366164 11214 rpcz_store.cc:276] 0709 12:12:33.898855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.464606 (+565751us) service_pool.cc:224] Handling call
0709 12:12:34.465039 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:34.465417 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.465445 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:34.494708 (+ 29263us) log.cc:844] Serialized 52 byte log entry
0709 12:12:35.179331 (+684623us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:35.196157 (+ 16826us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.196662 (+   505us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.247243 (+ 50581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.247340 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.365591 (+118251us) raft_consensus.cc:1685] finished
0709 12:12:35.365611 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.365728 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22108,"prepare.queue_time_us":58043,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":59185,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":11495,"spinlock_wait_cycles":26496,"thread_start_us":634541,"threads_started":1,"wal-append.queue_time_us":838457}
I20260709 12:12:35.369036 18114 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.327427 18093 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:35.369807 18093 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.370885 11135 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:35.348651 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:35.372876 11215 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:35.389114 11216 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.393895 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:35.401736 18093 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.406786 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.344913 17885 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:35.365202 11290 rpcz_store.cc:276] 0709 12:12:32.831001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.915195 (+ 84194us) service_pool.cc:224] Handling call
0709 12:12:32.915574 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.458583 (+1543009us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800401740. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ad3bfb 00007f9830ade64b
0709 12:12:34.458756 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:34.473150 (+ 14394us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.174302 (+701152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.179774 (+  5472us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.246731 (+ 66957us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:35.246782 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.246873 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.351180 (+104307us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b4800042fd8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:12:35.364594 (+ 13414us) raft_consensus.cc:1685] finished
0709 12:12:35.364615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.364740 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39520,"prepare.queue_time_us":14259,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":86989,"raft.run_cpu_time_us":11228,"raft.run_wall_time_us":2364598,"spinlock_wait_cycles":24910976,"thread_start_us":699328,"threads_started":2,"wal-append.queue_time_us":788405}
I20260709 12:12:35.408525 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:35.413429 17994 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:35.414673 17885 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:35.415745 17885 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.418414 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.419135 11290 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:35.419323 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.419888 11287 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:35.431406 11293 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:35.434288 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:35.435627 11215 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:12:35.418298 18066 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:35.443328 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 480491us
W20260709 12:12:35.444924 11859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 1401) took 1628 ms (client timeout 1858 ms). Trace:
W20260709 12:12:35.445350 11859 rpcz_store.cc:269] 0709 12:12:33.807041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.807997 (+   956us) service_pool.cc:224] Handling call
0709 12:12:35.434081 (+1626084us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835aa10a0 00007f9835aa0984 00007f982f01b6d4 00007f982f01b662
0709 12:12:35.435221 (+  1140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36619648}
I20260709 12:12:35.423076 17994 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:35.455616 11858 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.484314 11135 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.484449 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1399) took 1678 ms. Trace:
I20260709 12:12:35.485308 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.456336 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:35.486621 11287 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:35.487591 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.484917 11858 rpcz_store.cc:276] 0709 12:12:33.806419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.807720 (+  1301us) service_pool.cc:224] Handling call
0709 12:12:35.455201 (+1647481us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b58001b0698. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:12:35.455429 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.484174 (+ 28745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.484390 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3783552}
I20260709 12:12:35.488401 11141 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:35.458236 18024 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.461275 18023 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.464886 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:35.466276 18096 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:35.491421 18096 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.492087 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:35.493566 18096 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.466457 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.495213 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:35.466907 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.471095 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.496949 11291 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.471141 18114 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.766687  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.476313 18122 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.480326 18050 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.481070 18089 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.481588 18086 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:35.427528 18000 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:35.490567 18024 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.505611 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:35.508430 11218 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:35.490010 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.498347 18066 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:35.535670 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.531387 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.546985 11286 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.531406 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.305266 11210 rpcz_store.cc:276] 0709 12:12:33.899270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.464607 (+565337us) service_pool.cc:224] Handling call
0709 12:12:34.465039 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.465276 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:34.833541 (+368265us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.304308 (+470767us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.304368 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:35.304425 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.304490 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.304631 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20681,"prepare.queue_time_us":640160,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":20801,"spinlock_wait_cycles":48384,"thread_start_us":772489,"threads_started":2}
I20260709 12:12:35.532989 11825 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.550447 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:35.530320 11110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.010s	sys 0.018s
W20260709 12:12:35.552767 11110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.010s	sys 0.018s
W20260709 12:12:35.553457 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 751524us
W20260709 12:12:35.535040 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 208920us
I20260709 12:12:35.509768 18000 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:35.558439 18000 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.551955 17994 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.563482 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.562983 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:35.570649 11288 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:35.572574 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:35.549064 18048 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:35.546231 18066 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:35.577232 18086 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:35.577481 18066 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:35.577787 18086 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.578325 18086 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:35.579440 11210 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:35.582226 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:35.507731 18003 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:12:35.556602 18096 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.585265 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.588299 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.503837 18114 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.570178 18089 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.583365 18207 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.571889 18065 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:12:35.587587 17945 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.577265 18048 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.595384 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.629145 11293 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:35.590879 11291 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:35.624682 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.606957 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.607784 11859 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:12:35.634227 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.608909 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.635236 11288 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.631598 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.609123 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.613809 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3790) took 1490 ms. Trace:
I20260709 12:12:35.637207 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.636909 11139 rpcz_store.cc:276] 0709 12:12:34.122948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.124434 (+  1486us) service_pool.cc:224] Handling call
0709 12:12:34.143405 (+ 18971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.181551 (+ 38146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.613586 (+1432035us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b540032f0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:35.613753 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36334720}
I20260709 12:12:35.628250 11286 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:35.639336 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:35.640092 11291 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:35.640350 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:35.642181 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.644876 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.645114 11290 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:12:35.659315 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.661231 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.666478 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:35.662869 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 209835us
I20260709 12:12:35.613157 18065 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:35.669154 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.687672 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.605346 18114 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.616786 18111 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.688957 11135 raft_consensus.cc:2410] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:12:35.688105 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.669263 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.623200 18207 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.690970 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:35.669661 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.621601 18019 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.698843 11293 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:35.700732 11291 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:35.701097 11288 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:35.657059 18127 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.702708 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.615772 18048 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.666428 18002 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.691802 18133 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:35.591311 17935 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:35.707378 18214 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:12:35.668744 17950 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:35.720901 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.721699 11141 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:35.721822 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.723491 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:35.703387 18152 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:35.613940 17945 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.727802 17945 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:35.601672 18089 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:35.730095 11185 leader_election.cc:336] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Timed out: RequestConsensusVote RPC to 127.9.180.131:41465 timed out after 1.745s (SENT)
I20260709 12:12:35.730635 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:35.731199 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61620.4us
W20260709 12:12:35.731671 11218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2474) took 2556 ms (client timeout 1847 ms). Trace:
I20260709 12:12:35.607774 18066 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:35.732448 11218 rpcz_store.cc:269] 0709 12:12:33.175066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.193643 (+ 18577us) service_pool.cc:224] Handling call
0709 12:12:35.731394 (+2537751us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54003c46d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:35.731536 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5313700224}
I20260709 12:12:35.733830 18086 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.734396 18066 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.735668 18127 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.736076 18086 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:35.709210 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:35.732079 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.737368 11210 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:35.737676 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:35.738106 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.738875 17950 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:35.739532 17950 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:35.740181 17950 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:35.741174 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:35.743484 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:35.743706 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:35.744206 17950 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.665882 18210 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:35.689237 18065 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:35.745059 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:35.745402 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:35.711076 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:35.708580 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:35.746775 11140 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:35.703801 18207 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.710672 11139 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:35.687307 18134 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.731771 18089 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.745709 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:35.653846 17863 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:35.745388 11852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 908) took 1135 ms. Trace:
I20260709 12:12:35.924160 11852 rpcz_store.cc:276] 0709 12:12:34.609994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.610970 (+   976us) service_pool.cc:224] Handling call
0709 12:12:34.726111 (+115141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.783445 (+ 57334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.783475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.783514 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:34.783554 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.745188 (+961634us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b5400448ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:35.745230 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.745338 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131374848}
I20260709 12:12:35.897209 18167 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.886593 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:35.886893 18065 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.932488 18065 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.776983 18166 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.167s
I20260709 12:12:35.771127 18111 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:35.861790 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 286938us
I20260709 12:12:35.778048 18127 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.940444 18111 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:35.745002 18210 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:35.952553 18127 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:12:35.966295 18187 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.017s	user 0.000s	sys 0.003s
W20260709 12:12:35.970140 18191 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.039s	user 0.005s	sys 0.001s
I20260709 12:12:35.975517 18210 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:35.976790 18207 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:35.978893 18207 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:36.019865 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.714972 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.024423 11135 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 21: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:36.024677 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.026787 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3734) took 5081 ms. Trace:
W20260709 12:12:36.036628 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 306394us
I20260709 12:12:36.048106 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:36.049403 11213 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:36.050372 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1154) took 2287 ms. Trace:
I20260709 12:12:36.051077 11216 rpcz_store.cc:276] 0709 12:12:33.763214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.763367 (+   153us) service_pool.cc:224] Handling call
0709 12:12:34.151679 (+388312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.389716 (+1238037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.785627 (+395911us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400012cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:36.049812 (+264185us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400012cd0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:36.050150 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3737276544}
W20260709 12:12:36.054116 11217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2485) took 2156 ms (client timeout 2787 ms). Trace:
W20260709 12:12:36.054689 11217 rpcz_store.cc:269] 0709 12:12:33.897663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.313833 (+416170us) service_pool.cc:224] Handling call
0709 12:12:36.053723 (+1739890us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540035c354. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:36.053936 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647250688}
I20260709 12:12:35.782124 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:36.057044 11218 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:35.336079 11219 rpcz_store.cc:276] 0709 12:12:33.938701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.579547 (+640846us) service_pool.cc:224] Handling call
0709 12:12:34.579973 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.580261 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:35.067795 (+487534us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.335068 (+267273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.335136 (+    68us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.335206 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.335290 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.335432 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15629,"prepare.queue_time_us":528626,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":15788,"thread_start_us":715628,"threads_started":2}
I20260709 12:12:36.064062 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:36.094805 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.103544 17863 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.104285 17874 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.104758 17863 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.105165 17874 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.108351 17863 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:36.068394 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.069281 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 3463) took 3210 ms. Trace:
W20260709 12:12:36.075577 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 330123us
I20260709 12:12:36.078215 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1510) took 1511 ms. Trace:
I20260709 12:12:35.942377 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:36.081148 11855 raft_consensus.cc:2368] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:36.086807 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.087170 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:35.780157 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:36.088271 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.088506 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.091784 17815 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:36.091677 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.093196 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.027493 11144 rpcz_store.cc:276] 0709 12:12:30.945430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.946750 (+  1320us) service_pool.cc:224] Handling call
0709 12:12:30.947087 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:31.059464 (+112377us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:31.061214 (+  1750us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.428738 (+1367524us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b1800356b60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:12:33.489969 (+1061231us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b1800356b60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b23a 00007f9830ae5a2a
0709 12:12:33.614107 (+124138us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:33.623860 (+  9753us) log.cc:844] Serialized 532 byte log entry
0709 12:12:33.624028 (+   168us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:33.652320 (+ 28292us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.652543 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.015646 (+1363103us) spinlock_profiling.cc:243] Waited 878 us on lock 0x7b1800356b60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9bc2a6 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419
0709 12:12:36.025838 (+1010192us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54002e31d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:36.025948 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.026103 (+   155us) raft_consensus.cc:1685] finished
0709 12:12:36.026120 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.026532 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94529,"prepare.queue_time_us":1706,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":22779,"raft.queue_time_us":90623,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":5343,"spinlock_wait_cycles":73634304,"thread_start_us":119298,"threads_started":1,"wal-append.queue_time_us":2650118,"wal-append.run_cpu_time_us":2568,"wal-append.run_wall_time_us":1004282}
I20260709 12:12:36.109395 17875 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:36.110232 11138 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:36.111320 17888 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:36.108852 17874 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.066998 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:36.120188 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74210.4us
I20260709 12:12:35.951311 18028 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:36.130401 18028 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:36.120172 11292 rpcz_store.cc:276] 0709 12:12:34.566150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.571831 (+  5681us) service_pool.cc:224] Handling call
0709 12:12:34.572258 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.782635 (+210377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.782664 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.782715 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:34.782753 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.077468 (+1294715us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540041a0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:36.077554 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.077910 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483178368}
I20260709 12:12:36.135164 18028 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.136929 18028 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.961696 18127 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.151856 11139 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:36.152251 18194 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:36.153771 18198 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.154910 18198 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:36.155129 18205 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:36.155798 18198 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.143738 17875 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.159824 11144 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.161721 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:36.162650 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 94888.8us
I20260709 12:12:36.162894 11140 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.164016 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.167273 18133 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:36.168437 18134 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.135198 17945 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.171716 17945 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:36.166328 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.119464 11289 rpcz_store.cc:276] 0709 12:12:32.858905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.920250 (+ 61345us) service_pool.cc:224] Handling call
0709 12:12:32.920594 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.342810 (+1422216us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b1800406360. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ad3bfb 00007f9830ade64b
0709 12:12:34.342958 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:34.343301 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.599741 (+256440us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.600236 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.600393 (+   157us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:34.761729 (+161336us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.764153 (+  2424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.764225 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.957504 (+1193279us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:12:36.068644 (+111140us) raft_consensus.cc:1685] finished
0709 12:12:36.068692 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.069034 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48357,"prepare.queue_time_us":162870,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":86044,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12454,"spinlock_wait_cycles":18611840,"thread_start_us":307637,"threads_started":2,"wal-append.queue_time_us":587615}
W20260709 12:12:36.180318 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 237885us
I20260709 12:12:36.180528 18066 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:36.181463 18066 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:12:36.182717 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.184337 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:36.184343 18023 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:36.186420 18023 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.184343 18000 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:36.190608 17895 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:36.191996 18000 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:36.192489 18000 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:36.194059 18000 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.196600 18000 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.196159 18066 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:36.207429 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 140765us
I20260709 12:12:36.208683 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.213258 17863 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:36.216189 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.216339 17935 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:36.216620 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:36.218011 11289 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:36.221166 11291 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:36.222827 18023 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.222927 17999 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.149159 17815 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.236593 18050 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.246755 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:36.255092 17875 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.255502 11287 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:36.260267 17945 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:36.261658 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45671.5us
I20260709 12:12:36.263532 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.265460 11182 leader_election.cc:400] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:36.265779 11182 leader_election.cc:403] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:36.267220 17895 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:36.267560 18027 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.268565 18023 raft_consensus.cc:1064] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
W20260709 12:12:36.269074 18023 raft_consensus.cc:1068] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Unable to promote non-voter 2b4f4725b82b481ab53f0717a429e94a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:36.270510 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.271306 11135 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:36.275157 18108 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:36.275647 18108 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:36.276877 18108 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:36.291460 11138 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:36.304852 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 75040.7us
I20260709 12:12:36.299624 11861 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.286304 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:36.371284 11823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.298349 18096 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:36.285983 17863 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:36.374610 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 208509us
I20260709 12:12:36.287868 17874 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:12:36.300860 17945 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.378808 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:36.378947 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 113742us
I20260709 12:12:36.278462 18108 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:36.380805 11140 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:36.289144 17999 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:12:36.300707 18126 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:36.384485 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 256778us
I20260709 12:12:36.388098 11040 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:36.391296 11040 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 18 to 20, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 20 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:36.392030 17815 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:36.396345 18127 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.396536 11040 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 18 to 19, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 19 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:36.398635 11040 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 12 to 14, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 14 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:36.401530 17815 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:36.403548 18071 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:36.404749 17863 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:36.306250 18111 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.405928 18075 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:36.406541 18075 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:36.407653 18075 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.408900 18024 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.409278 18075 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:36.411342 18120 consensus_meta.cc:287] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.097s	user 0.008s	sys 0.016s
I20260709 12:12:36.411928 18120 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.375777 18096 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:36.402566 17815 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.412472 18027 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18.
I20260709 12:12:36.406040 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:36.415025 18071 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:12:36.428472 17974 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.428668 17945 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.438244 11855 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:36.438763 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.439592 11852 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:36.440654 17974 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:36.441937 17974 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:36.442286 17974 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:36.443480 17974 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.444844 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.445919 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:36.446851 17895 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:36.446722 18126 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:36.447402 17895 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:36.447862 17895 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.447961 18126 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:36.448936 18126 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:36.449355 18126 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:36.444855 17974 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.451531 18074 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.452244 18074 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:36.455106 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83068.6us
I20260709 12:12:36.456353 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:36.457772 18065 consensus_meta.cc:287] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.008s
I20260709 12:12:36.458420 18027 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:36.458912 18027 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.459270 18027 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.459873 17945 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.460667 17895 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:36.461247 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 175102us
I20260709 12:12:36.462252 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:36.426955 18198 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:36.464046 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.454191 11860 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:36.467576 17895 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:36.471231 17815 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:36.471441 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:36.480723 18120 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:36.472908 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:36.481962 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:36.478597 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:36.479657 11284 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:36.483955 17913 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:36.484439 17913 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:36.484823 17913 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.485083 18127 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:36.486953 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 81208.6us
I20260709 12:12:36.487205 18071 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.487771 18071 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:36.489051 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:36.488862 18071 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.490602 18094 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:36.491044 18094 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:36.491429 18094 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.503798 18139 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:36.513120 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54786us
I20260709 12:12:36.517426 18002 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:36.517941 17863 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:36.535892 11861 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:36.543704 11138 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.543670 18206 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.544930 17935 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.545214 18206 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.545621 17935 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.546018 17671 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:12:36.547308 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:36.548569 17935 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:36.548830 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 85469.1us
I20260709 12:12:36.550148 18065 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:36.553785 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 87414.8us
I20260709 12:12:36.553972 17874 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:36.555105 17874 consensus_queue.cc:1243] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:12:36.556320 17889 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:36.556784 17889 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:36.557426 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:36.558755 11861 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41370 (request call id 903) took 3216 ms (client timeout 1619 ms). Trace:
I20260709 12:12:36.558583 18027 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:36.559185 11861 rpcz_store.cc:269] 0709 12:12:33.342230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.342379 (+   149us) service_pool.cc:224] Handling call
0709 12:12:35.736786 (+2394407us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b18001c3080. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830b16646 00007f9830a5058e 00007f9830ad1f9e 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c
0709 12:12:36.104381 (+367595us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b580043c4d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c
0709 12:12:36.299262 (+194881us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b58005f21d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c
0709 12:12:36.558649 (+259387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951513600}
I20260709 12:12:36.561020 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:36.561460 18027 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.530721 18002 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:36.562721 18002 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:36.590548 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58901.6us
W20260709 12:12:36.593533 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 129692us
W20260709 12:12:36.599351 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47131.8us
W20260709 12:12:36.599180 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64816.7us
I20260709 12:12:36.530556 17945 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.605453 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:36.480223 18126 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.592664 18074 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.558038 17889 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:36.640885 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.642828 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2512) took 1177 ms. Trace:
I20260709 12:12:36.643265 11284 rpcz_store.cc:276] 0709 12:12:35.465918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.466200 (+   282us) service_pool.cc:224] Handling call
0709 12:12:36.642551 (+1176351us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b540031abd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:36.642728 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264479616}
I20260709 12:12:36.646265 18206 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.647647 11040 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:36.650985 11256 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.652377 11256 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.652848 18028 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:36.653527 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.627259 18000 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:36.640265 17945 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.657763 17945 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.640920 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.659713 18224 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.660858 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:36.661017 11287 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:36.662990 18167 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.665633 17935 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.666478 11140 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:36.668336 17995 raft_consensus.cc:1064] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:12:36.665532 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:36.675697 18127 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:36.680702 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.666565 17935 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:36.682053 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 68905.4us
I20260709 12:12:36.682320 17995 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.684440 17935 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.685211 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:36.686056 11287 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:36.694404 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.705106 18127 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:36.710012 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:36.707116 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 99125.3us
I20260709 12:12:36.711526 11140 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:36.702086 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:36.675922 18120 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:36.672477 18133 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.690719 18206 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.732334 18094 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.755612 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.739596 17913 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.757345 18094 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.763221 11138 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:12:36.764190 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 110747us
I20260709 12:12:36.767109 11860 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:12:36.767275 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.769670 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.757300 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.762384 11852 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:36.750283 18224 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:36.772477 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:36.778223 11287 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.773168 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.746026 17935 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.753944 18206 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.790141 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:36.787396 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.772370 18127 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:36.778034 18224 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.779040 18133 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:36.787784 18206 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.784112 17935 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.791437 17913 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.802881 18120 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:36.810106 18224 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.837085 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.837543 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:36.837872 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:36.850785 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:36.851617 11138 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.863339 18126 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.865180 17895 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:36.865648 17895 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:36.856771 18096 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.870054 17889 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.894812 17895 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.909337 17895 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.905898 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:36.900125 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 142920us
I20260709 12:12:36.844271 17935 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.934072 11138 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
W20260709 12:12:36.944024 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 179148us
I20260709 12:12:36.906016 18096 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.957849 18071 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.958570 18071 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.966773 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.967829 18086 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.967308 11040 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:36.969398 11259 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:36.969266 11040 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:36.970257 18086 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:36.939056 17945 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.970904 18086 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:36.971371 17945 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.971903 18086 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.973570 17945 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:36.975517 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:36.978513 18050 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:36.983629 11256 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:36.987300 18120 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.987943 11289 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:36.990952 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b238aa9f5b8450ca03fed7b6a294cf3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:39166
I20260709 12:12:36.993083 18071 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:36.979152 18050 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:36.993906 18224 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:36.995836 18050 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:36.987334 11040 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 12 to 17, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 17 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:36.998061 11040 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.000407 11040 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.001957 11040 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 12, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:36.997087 18224 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:37.007078 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62293.5us
I20260709 12:12:37.002413 11287 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:37.020040 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:37.033685 11284 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:37.007175 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 254) took 31814 ms (client timeout 15000 ms). Trace:
I20260709 12:12:37.007242 18120 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.039382 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:37.044340 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:37.045390 11136 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.046830 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:37.044480 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:37.047547 11143 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:37.011957 11040 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.048832 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:37.044453 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:37.053685 11135 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.008065 18066 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:37.055044 18066 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.057649 18066 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:37.058063 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:37.058956 18198 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:37.060664 11141 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:37.065982 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 90562.1us
I20260709 12:12:37.067860 18139 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:37.040355 17945 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:37.035243 11039 rpcz_store.cc:269] 0709 12:12:05.192543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.238365 (+ 45822us) service_pool.cc:224] Handling call
0709 12:12:37.006820 (+31768455us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:30.745280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:30.842992 (+ 97712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:30.844690 (+  1698us) write_op.cc:435] Acquired schema lock
0709 12:12:30.846851 (+  2161us) tablet.cc:662] Decoding operations
0709 12:12:31.085400 (+238549us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:31.085457 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:31.085485 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:12:31.117194 (+ 31709us) tablet.cc:701] Row locks acquired
0709 12:12:31.117216 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:31.117359 (+   143us) write_op.cc:270] Start()
0709 12:12:31.117479 (+   120us) write_op.cc:276] Timestamp: P: 1783599151117310 usec, L: 0
0709 12:12:31.117501 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:31.118292 (+   791us) log.cc:844] Serialized 4389 byte log entry
0709 12:12:32.329755 (+1211463us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b
0709 12:12:33.264087 (+934332us) op_driver.cc:464] REPLICATION: finished
0709 12:12:33.380594 (+116507us) write_op.cc:301] APPLY: starting
0709 12:12:33.388535 (+  7941us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:33.540579 (+152044us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:33.540613 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:33.933219 (+392606us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:33.933549 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:12:33.933600 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:33.933985 (+   385us) log.cc:844] Serialized 105 byte log entry
0709 12:12:33.936370 (+  2385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:33.956107 (+ 19737us) write_op.cc:454] Released schema lock
0709 12:12:33.956156 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:33.956610 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:33.956638 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62998,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":77681,"apply.run_cpu_time_us":21643,"apply.run_wall_time_us":585292,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50239,"num_ops":11,"prepare.queue_time_us":87383,"prepare.run_cpu_time_us":34294,"prepare.run_wall_time_us":1825726,"raft.queue_time_us":345264,"raft.run_cpu_time_us":3997,"raft.run_wall_time_us":10327,"replication_time_us":2146406,"spinlock_wait_cycles":50064896,"thread_start_us":1767676,"threads_started":4,"wal-append.queue_time_us":1337593,"wal-append.run_cpu_time_us":46822,"wal-append.run_wall_time_us":2463475}]]}
I20260709 12:12:37.041996 11256 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:37.073953 18120 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.074159 18206 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.076437 18206 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:37.071938 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.077746 18120 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:37.082378 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50516.3us
I20260709 12:12:37.085373 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.086194 18120 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:37.087697 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.088428 18120 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:37.089886 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.091900 11284 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:37.006438 18002 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:37.097747 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 55430.7us
I20260709 12:12:37.072461 17945 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:37.100649 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47048.5us
I20260709 12:12:37.103332 18120 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.103348 11136 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:37.108935 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.109572 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:37.112654 11141 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
W20260709 12:12:37.116233 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.122008 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.122000 11135 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:37.123194 11861 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:37.122335 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:37.132014 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.132910 11292 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:37.141573 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:37.147034 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.125478 17913 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:37.151599 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:37.162570 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.162616 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.163750 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.173425 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:37.178102 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.177795 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88002.5us
I20260709 12:12:37.175810 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.187549 11293 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:37.190650 18245 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:12:37.149937 18002 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:37.168033 17913 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:37.197544 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.198127 11211 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.198441 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.198576 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.199654 11217 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:12:37.199894 11861 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:37.201850 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:37.203953 17945 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:37.205482 11219 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:37.195912 18112 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:37.216838 18112 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:37.217195 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:37.218094 18112 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.221604 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.225580 11852 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.227903 18050 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:37.228268 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44840.1us
I20260709 12:12:37.228533 18050 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.229265 11286 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:37.230607 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:37.231611 18002 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:37.231887 18050 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:37.232229 18002 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:37.232474 18050 raft_consensus.cc:2764] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:12:37.233309 18002 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.234911 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:37.235124 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:37.235674 11860 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:37.235783 11291 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.238384 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:37.238998 11293 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.239050 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.239979 11211 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:37.240701 11219 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:37.208874 11217 pending_rounds.cc:85] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 13
I20260709 12:12:37.247776 11217 pending_rounds.cc:107] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:12:37.248270 11217 raft_consensus.cc:2889] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.215831 11212 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:37.235448 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:37.209870 11210 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:12:37.247328 11219 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:37.253521 11258 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:37.260435 11293 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:37.261777 11218 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:37.269158 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:37.271180 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:37.275661 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.277206 18120 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.277840 18120 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:37.279083 11169 heartbeater.cc:646] Failed to heartbeat to 127.9.180.190:38919 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.9.180.190:38919 timed out after 15.000s (SENT)
I20260709 12:12:37.279788 18133 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:37.278874 18120 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.291814 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.250638 17995 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:37.295166 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.297887 11139 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:37.286288 18074 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.301949 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.307303 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:37.297654 11110 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.131:41465 timed out after 2.245s (SENT) [suppressed 38 similar messages]
I20260709 12:12:37.306336 18074 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.312114 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.247225 17913 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.305323 18127 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:37.281186 17671 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:12:37.283875 17875 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:12:37.311586 18074 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.328766 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:37.337702 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.346238 11210 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:37.320013 18224 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:37.333266 17945 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.349992 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.340688 18050 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:37.323020 17995 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.332671 18127 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.360100 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.373696 11140 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:37.377521 18050 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.378933 11136 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:37.384477 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.388381 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:37.389142 11860 raft_consensus.cc:606] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:37.389750 11860 raft_consensus.cc:614] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:37.392473 18050 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:37.396329 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.399060 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.400350 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.400977 11219 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:37.401999 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.402689 11218 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:37.404834 18127 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:37.408542 18093 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:37.398269 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:37.362654 17945 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.434475 11293 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:37.434741 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.434831 18224 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:12:37.443816 18071 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:37.434914 11856 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:12:37.458567 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.371636 18086 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:37.468400 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:37.479310 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:37.479672 18050 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.480219 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:37.480347 18050 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:37.481488 18050 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.483161 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.483386 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.484826 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.485834 18095 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.484989 18096 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:12:37.486284 18244 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:12:37.484597 18198 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.486698 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:37.487471 11210 raft_consensus.cc:606] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:37.487977 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:37.488868 18251 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:37.489231 17995 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:37.489262 18251 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:37.489897 18251 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.460206 18206 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:37.495012 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:37.496984 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:37.440129 11291 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:12:37.506433 11287 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.511756 18096 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:37.552198 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:37.553061 11210 raft_consensus.cc:606] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:37.553206 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.553545 11210 raft_consensus.cc:614] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:37.513165 18198 raft_consensus.cc:2764] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:37.559492 11856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1413) took 1136 ms. Trace:
I20260709 12:12:37.562999 11856 rpcz_store.cc:276] 0709 12:12:36.417412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.422887 (+  5475us) service_pool.cc:224] Handling call
0709 12:12:36.428713 (+  5826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.450191 (+1021478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.549344 (+ 99153us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400361d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:37.554085 (+  4741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313224960}
I20260709 12:12:37.512792 18096 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:37.597741 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44655.7us
I20260709 12:12:37.513233 18066 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:12:37.614255 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:37.601800 18095 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:37.601598 17945 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:37.631289 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.609812 17889 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.601425 18251 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.604918 17875 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:12:37.643282 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:37.639537 18127 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.637877 18095 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:37.650022 17935 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:37.665793 17999 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:12:37.671710 18251 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:37.677444 18250 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:12:37.678201 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 409833us
I20260709 12:12:37.680800 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 1b238aa9f5b8450ca03fed7b6a294cf3 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
W20260709 12:12:37.707863 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 64730.8us
I20260709 12:12:37.639482 17889 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.711911 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:37.720953 11293 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:37.666863 17888 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:37.667171 18127 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.738838 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:37.744426 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:37.740000 18246 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.374s	user 0.005s	sys 0.001s
I20260709 12:12:37.739358 18035 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:37.751703 18095 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.719288 17815 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.759238 17994 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.759743 18035 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:37.759831 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.760785 18035 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.761296 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.735410 17889 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:37.753430 18167 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:37.733904 18248 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:12:37.706841 17935 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:37.743458 17888 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.768908 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.773283 18027 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.768953 18133 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.784492 11856 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:37.778223 17888 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.787107 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:37.787961 11852 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:12:37.791923 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.762413 18086 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.753887 18127 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:37.767521 18167 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:37.769800 17815 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.797330 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:37.801535 11210 raft_consensus.cc:606] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:37.801851 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 90088us
I20260709 12:12:37.804889 17994 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.804751 18074 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.806646 17994 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:37.807147 18074 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:37.810451 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:37.811093 11210 raft_consensus.cc:606] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:37.811596 11210 raft_consensus.cc:614] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:37.819711 11289 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:37.819657 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:37.820215 11284 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:12:37.820580 11140 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.809607 18167 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.825558 18167 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:37.827194 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 58367.8us
I20260709 12:12:37.828003 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.828651 18027 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.828951 17815 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.829790 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:37.835147  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:12:37.828068 18265 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:12:37.798270 17935 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.848371  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:37.847831 18251 consensus_queue.cc:1175] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2b4f4725b82b481ab53f0717a429e94a" responder_term: 22 status { last_received { term: 22 index: 19 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:37.847043 17935 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.847532 18027 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:37.878793 11140 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:37.877820 18027 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:37.880724 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:37.891950 18027 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.892890 18127 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:37.893532 18127 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.893934 18126 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:37.894418 18126 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:37.895426 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:37.895277 18126 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.895944 18127 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:37.897253 18127 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:37.897276 18198 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:37.897833 18127 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:37.899115 17888 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:37.898288 18127 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.900964 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:37.901257 11139 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:37.859342 17994 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:37.904881 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:37.910370 11291 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:37.911296 11140 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:37.914773 11860 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:37.915131 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:37.905925 18120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.016s
I20260709 12:12:37.914965 18086 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:12:37.916432 18133 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:12:37.925896 17888 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:37.922596 18262 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
W20260709 12:12:37.927918 18255 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 12:12:37.928085 11135 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
W20260709 12:12:37.928148 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47535.3us
I20260709 12:12:37.928977 17994 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:37.930810 17895 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:37.923309 18268 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:37.932991 18065 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:37.917881 18126 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:37.933422 18065 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:37.934402 18065 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.935386 18065 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:37.917012 18074 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.939006 18074 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:37.939944 18074 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:37.940277 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:37.941053 11136 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:37.941232 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:37.944394 11135 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:37.954033 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.954895 11291 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:37.955885 17895 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:37.958786 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.962896 11291 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.963244 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:37.972590 11142 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:12:37.973683 11212 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:37.974411 11289 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:37.974678 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:37.975234 11219 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.964093 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:37.982824 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.001550 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.002159 11284 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.006141 11852 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:38.009189 11284 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:38.013229 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.013844 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:37.966361 18120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.016s
I20260709 12:12:38.012600 18257 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:38.017325 11219 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:38.015492 11289 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:38.022406 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.029747 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.000039 17671 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:38.034288 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 58062.7us
I20260709 12:12:38.039011 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.040016 11293 raft_consensus.cc:2376] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20. Re-sending same reply.
I20260709 12:12:38.041350 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.042225 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.019105 18257 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.044229 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.041833 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.049814 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.050962 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.052131 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.052632 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.053176 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.053905 11286 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:38.054020 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.055047 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.055725 11292 raft_consensus.cc:2368] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:38.055550 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.056545 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.056986 11218 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:38.057652 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.041673 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.058423 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.062863 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.063512 11218 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:38.052704 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.056972 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.074414 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.043061 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:38.106777 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54230.1us
I20260709 12:12:38.106014 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.113174 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.114367 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.062076 18257 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.137423  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.151218 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.152047 11213 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.152215 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.152752 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.153612 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.160389 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:38.161237 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 53656.2us
I20260709 12:12:38.151348 18094 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.165378 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.165464 18094 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.169701 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.171068 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.171861 11287 raft_consensus.cc:2376] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19. Re-sending same reply.
I20260709 12:12:38.167207 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:38.195873 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.196589 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:38.197734 11292 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:38.199819 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.202291 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.159978 17999 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.210422 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:38.216984 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.217975 11287 raft_consensus.cc:2368] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:38.102316 17671 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.162151 18127 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.392661 11218 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:38.394652 11291 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:38.396839 11217 raft_consensus.cc:2376] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14. Re-sending same reply.
I20260709 12:12:38.408046 17895 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:38.408581 17895 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.408973 17895 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.411446 11213 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:38.385950 18028 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:38.413487 18028 consensus_queue.cc:1243] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:12:38.416743 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.396418 17815 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.008s
W20260709 12:12:38.402747 18272 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:12:38.229852 17999 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:38.394416 18094 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:38.445744 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:38.436306 17815 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:38.459712 18291 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:12:38.460384 17999 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:38.462078 18266 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:38.462695 18266 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:38.463748 18266 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.466769 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:38.475525 18027 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 12:12:38.476063 18027 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.478305 18027 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:38.480333 18127 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:38.481822 18280 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:12:38.483803 18281 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:12:38.484688 11286 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:12:38.487032 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1563) took 1370 ms. Trace:
I20260709 12:12:38.491943 11288 rpcz_store.cc:276] 0709 12:12:37.116493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.162556 (+ 46063us) service_pool.cc:224] Handling call
0709 12:12:37.207635 (+ 45079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.230971 (+ 23336us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:37.560359 (+329388us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.903817 (+343458us) spinlock_profiling.cc:243] Waited 939 us on lock 0x7b1800397540. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b23a 00007f9830ae5a2a
0709 12:12:38.003977 (+100160us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.004925 (+   948us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.005194 (+   269us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:38.005263 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.005443 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.060782 (+ 55339us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4800042fd8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:12:38.486606 (+425824us) raft_consensus.cc:1685] finished
0709 12:12:38.486638 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.486811 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79665,"prepare.queue_time_us":391762,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2827,"raft.queue_time_us":16726,"raft.run_cpu_time_us":1255,"raft.run_wall_time_us":57235,"spinlock_wait_cycles":29931904,"thread_start_us":428379,"threads_started":2,"wal-append.queue_time_us":494617}
I20260709 12:12:38.499686 17671 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:38.451797 17935 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:12:38.507601 17935 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:38.507933 17935 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:38.508911 17935 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.520350 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.521812 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.522312 18127 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.523279 18127 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.528201 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:38.530762 11144 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:12:38.545032 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 78333.8us
I20260709 12:12:38.546258 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:38.506315 18286 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:12:38.533205 17935 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.554170 18251 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:38.581140 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.586382 18050 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.592725 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.593128 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.577069 18298 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:38.565610 18065 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:12:38.600423 18120 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.600301 18109 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260709 12:12:38.600797 17895 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.604661 17895 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:38.606950 18251 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.621685 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.624027 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.627892 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.627106 18298 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:38.629982 18198 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.632295 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.641944 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:38.632002 18120 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:38.643987 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:38.644583 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:38.645423 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:38.646351 11142 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.646822 11141 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:38.648834 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.654266 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:38.655146 11140 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:12:38.658651 18127 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.659152 18276 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:38.650738 17895 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:38.646364 18198 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.667049 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:38.673978 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45155.8us
I20260709 12:12:38.674974 17995 raft_consensus.cc:993] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:38.675549 17895 raft_consensus.cc:1081] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:38.675366 11110 leader_election.cc:400] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:38.677570 11110 leader_election.cc:403] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:38.680855 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.681430 11284 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:12:38.694087 11143 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:38.697362 11212 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:38.700079 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 489715us
I20260709 12:12:38.707587 11142 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:38.721149 11291 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.660802 18257 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.741315 18127 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:38.742035 18127 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.744558 18127 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:38.745065 18127 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:38.745517 18127 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:38.747885 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73269us
I20260709 12:12:38.748767 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.749929 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.750988 18198 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.719233 18120 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:38.753374 11291 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:38.753785 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.731348 18300 raft_consensus.cc:993] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:38.756882 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.739538 18256 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:38.769477 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 106153us
I20260709 12:12:38.771406 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.772543 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.755085 18198 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.781102 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:38.759068 18306 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:38.760864 18276 raft_consensus.cc:1081] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:38.746840 18094 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:12:38.767208 18266 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.746784 18299 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:12:38.779340 18120 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.798240 11184 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:38.795362 18311 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:12:38.812692 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59815.2us
I20260709 12:12:38.813844 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.819245 11217 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:38.798123 18127 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:38.822762 11215 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:12:38.822640 11143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
W20260709 12:12:38.855274 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 77449.1us
I20260709 12:12:38.855728 11143 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:38.856216 11143 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.799768 18298 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:38.820290 18306 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:38.803310 17999 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:38.797248 18000 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:12:38.830772 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48311.4us
I20260709 12:12:38.866518 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.867544 11291 raft_consensus.cc:2393] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:38.868597 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.839569 18257 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:38.783283 18256 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.732884 18035 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:38.880373 11290 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.892454 18320 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:38.864991 18127 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.890834 11289 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:12:38.898833 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 85132.3us
I20260709 12:12:38.899652 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.902060 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.871502 18198 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.904754 18198 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:38.905984 18316 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.906728 18316 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.874904 18306 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:38.907160 18316 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.912165 11289 raft_consensus.cc:1217] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[18.10-21.12]   Dedup: 18.10->[19.11-21.12]
W20260709 12:12:38.912987 18313 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:12:38.912998 11289 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: [18.10-21.12]
I20260709 12:12:38.914115 18256 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:38.909873 18306 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.863983 17999 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.805941 18120 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.881798 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.915742 11291 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:12:38.918632 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.923343 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.872977 18071 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.924211 11143 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:38.933527 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.937992 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:38.939533 18316 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:38.926477 18266 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.925432 17945 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:38.945132 11143 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:38.940121 18071 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.973536 18071 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:38.976756 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.978475 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.978719 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:38.979316 11213 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:38.979602 11139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:38.980238 11139 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:38.980643 11139 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.982374 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:38.982470 11212 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:38.983101 11291 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:38.984508 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61248.5us
I20260709 12:12:38.985635 11110 leader_election.cc:400] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:38.985734 11210 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:38.985994 11110 leader_election.cc:403] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:38.987082 11137 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:38.987227 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:38.987532 17935 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22.
I20260709 12:12:38.988286 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:38.988659 17935 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:38.989305 11143 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:38.988373 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:38.980671 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.996733 11291 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:38.997327 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.999850 11140 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:39.003671 18120 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:39.009083 11861 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:38.937369 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45395.7us
I20260709 12:12:39.013561 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:39.010915 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:38.921092 17999 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:39.016880 17874 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.016741 18266 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:39.017511 17874 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:38.921561 18257 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:39.017964 17895 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:39.022888 18074 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:39.020423 11860 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:39.039310 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:39.040930 18276 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:39.042294 18000 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:39.042696 18000 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:38.937093 18198 raft_consensus.cc:2764] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 12:12:39.043550 18000 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:39.045264 18000 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.047943 18257 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:39.052189 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:39.068768 18198 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:39.033126 17895 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:39.051616 18074 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.080488 18074 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:39.081183 18206 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:39.079668 11288 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:39.057554 18256 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:39.086217 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 97902us
I20260709 12:12:39.078011 11291 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:39.097535 11290 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:39.098364 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:39.099310 11210 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:39.054601 18120 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:12:39.059391 18316 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:39.093508 18323 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:39.107501 18257 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:39.083406 18198 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:39.109292 18198 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:39.115330 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:39.116622 17895 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:39.117954 17895 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:39.119573 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.177100 18329 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:12:39.180114 11288 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:39.099769 18139 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 12:12:39.181151 11139 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:39.199882 11144 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:39.213560 11139 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:39.242890 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 146100us
I20260709 12:12:39.247962 11214 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
W20260709 12:12:39.261499 18325 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 12:12:39.264199 18316 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.264777 18316 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.267748 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:39.268607 11211 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
W20260709 12:12:39.268989 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 178386us
W20260709 12:12:39.269624 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 180452us
I20260709 12:12:39.270344 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:39.271512 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:39.271749 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:39.272528 18120 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:39.272907 18120 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.273286 18120 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:39.274643 18050 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:39.275403 18050 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:12:39.275671 18286 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:39.276101 18050 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:39.283365 11284 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:39.287107 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:39.287837 11291 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:39.292073 11293 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:39.293772 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48867.5us
I20260709 12:12:39.295640 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:39.295966 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:39.298544 11291 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:12:39.298964 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:39.299289 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:39.298152 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:39.304320 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:39.305090 11288 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.307986 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:39.310362 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:39.315047 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:39.337155 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:39.340768 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:39.302356 18266 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.341811 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:39.342545 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:39.348757 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:39.308593 17945 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:39.340045 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:39.294746 18320 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:12:39.362404 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:39.352420 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:39.375597 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:39.313592 18317 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:39.356719 18050 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 12:12:39.397485 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48807.3us
I20260709 12:12:39.313812 18298 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:12:39.410564 11216 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:12:39.369720 18316 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:39.416854 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54519.7us
I20260709 12:12:39.351264 18108 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
W20260709 12:12:39.451385 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 91487.7us
I20260709 12:12:39.452863 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:39.480835 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 82003us
I20260709 12:12:39.489012 17945 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:39.408622 18139 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:39.497107 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 99797.1us
I20260709 12:12:39.390086 17888 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:12:39.396348 18035 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:12:39.381034 18074 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.478837 18206 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:39.545847 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 126986us
I20260709 12:12:39.546864 18071 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:39.554613 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.569789 11861 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:39.550853 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:39.492308 18000 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:39.508828 18281 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:39.559904 17888 consensus_queue.cc:1243] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:39.560277 18257 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.491323 17999 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:39.561630 18206 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.606523 17945 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.607617 18206 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:39.592638 18316 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.624424 18167 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:39.635828 18336 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:12:39.647601 18337 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:12:39.648778 18335 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 12:12:39.711017 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 160223us
I20260709 12:12:39.715790 11288 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
W20260709 12:12:39.723644 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 380304us
I20260709 12:12:39.727240 17874 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:39.732211 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:39.734936 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:39.736445 18120 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.740267 18120 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:39.720011 18071 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.746901 18071 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.750023 18071 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:39.750968 11858 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:39.712435 18316 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.769954 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:39.778633 18347 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.779270 18347 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:39.782040 18347 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:39.758504 18316 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:39.756029 18074 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:39.789932 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:39.899922 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 112578us
I20260709 12:12:39.924208 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:39.896417 18316 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.937580 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:39.939584 11210 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:39.939942 11210 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:39.940634 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:39.942744 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:39.942958 11212 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:39.945065 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:39.945536 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:39.945942 11289 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:39.946389 18316 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:39.965876 18120 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:39.977278 18120 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:39.977706 18120 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:39.979138 18316 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:39.979866 11288 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:39.947294 11210 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:39.982949 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:39.983662 11852 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:39.986753 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:39.987839 18316 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:39.988281 18316 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.988698 18316 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.939302 17895 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:39.997709 11211 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:40.001111 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.002310 11293 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:40.017861 11217 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:12:40.019450 11287 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:40.016664 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:40.021322 11284 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:40.034639 11289 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:12:40.019021 18111 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.036494 18111 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.040005 17889 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.040295 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:40.040943 11214 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:40.040637 17889 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:40.041425 18341 log.cc:927] Time spent T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.434s	user 0.007s	sys 0.003s
I20260709 12:12:40.042660 18035 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:40.043438 18111 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.043282 18035 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.050112 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.050776 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.051713 11217 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:40.058962 18035 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.060271 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.079574 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.086947 11216 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:40.090127 11861 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 932) took 1071 ms. Trace:
I20260709 12:12:40.090610 11861 rpcz_store.cc:276] 0709 12:12:39.019213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.019467 (+   254us) service_pool.cc:224] Handling call
0709 12:12:39.024627 (+  5160us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.576229 (+551602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.089866 (+513637us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b5400152cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:40.090066 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1243592576}
I20260709 12:12:40.086566 11284 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:12:40.096177 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.096712 11214 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:40.077450 18035 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.100450 18350 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:12:40.116693 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.128964 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.124419 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:40.129923 11211 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:40.135191 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.136029 11213 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:40.109282 18035 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:40.159785 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 707038us
I20260709 12:12:40.139171 17815 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.160686 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.162247 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:40.152935 18319 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:40.167143 18348 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:40.167856 18348 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:40.168833 18348 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.169461 18198 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:40.170463 18198 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:40.170833 18198 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:40.171633 18198 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.172755 18198 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.173391 18251 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:40.174100 18251 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.178647 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:40.180351 11858 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:40.181339 18065 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:40.181473 17945 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.183060 18065 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.185506 18065 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.184005 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:40.162079 18266 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:40.189507 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:40.192320 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:40.192708 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.193571 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:40.196916 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:40.197899 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:40.198591 18127 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.165215 17815 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.193905 18344 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:40.183738 18319 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:40.200781 18257 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.191021 18050 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:40.214958 11139 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:40.216512 18317 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.205168 18298 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.216763 18319 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.219808 18298 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.220602 17815 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.209276 18127 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.200244 18316 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.221356 18127 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.193712 18347 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.229791 18127 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.222275 18298 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.230962 18298 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.208261 18074 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:40.231539 18298 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.233999 18298 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.229806 18050 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:40.252103 18050 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.258263 18074 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:40.273597 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:40.281736 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:40.292225 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:40.293401 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:40.294330 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 97484.3us
I20260709 12:12:40.295847 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.293221 11137 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
W20260709 12:12:40.303273 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.273510 18251 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:40.289043 18371 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:12:40.310748 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:40.310616 18373 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:40.268922 18298 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:40.269145 18342 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:12:40.316772 18065 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.322316 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.324734 11289 raft_consensus.cc:1217] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[18.10-21.12]   Dedup: 18.10->[19.11-21.12]
I20260709 12:12:40.332823 11218 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:40.335484 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.297390 18316 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.338184 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.338403 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.339599 11214 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:40.338960 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.341969 11289 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: [18.10-21.12]
I20260709 12:12:40.341131 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:40.341974 11293 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:40.346689 11216 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
W20260709 12:12:40.358621 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.368372 18299 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:40.368918 18299 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:40.369858 18299 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.376564 18299 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.363696 17875 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:40.380081 17875 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:40.381173 17875 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:40.392715 11138 raft_consensus.cc:2410] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:12:40.348747 18035 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.349990 18120 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.408004 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 2864) took 1093 ms. Trace:
I20260709 12:12:40.409891 18120 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.411311 11852 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 17: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:40.417456 17889 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.436136 11210 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.438783 18108 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.439568 18108 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.458070 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.459321 11289 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:40.441576 18065 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.444056 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:40.408645 11140 rpcz_store.cc:276] 0709 12:12:39.315014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.315132 (+   118us) service_pool.cc:224] Handling call
0709 12:12:39.315490 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.387864 (+ 72374us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:39.724002 (+336138us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.177703 (+453701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.177735 (+    32us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:40.177769 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.407643 (+229874us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54002e22d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:40.407706 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.407887 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245535,"prepare.queue_time_us":691117,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1173,"raft.queue_time_us":245636,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3099,"spinlock_wait_cycles":165722880,"thread_start_us":522167,"threads_started":2,"wal-append.queue_time_us":288300}
I20260709 12:12:40.454190 18108 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.473609 11210 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:12:40.476819 17935 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:40.487283 17935 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:40.478173 18251 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:40.489573 18251 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:40.489683 11289 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:40.490887 18251 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.492976 18251 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.495150 17935 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.496744 18359 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:40.498941 18359 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:40.499311 18359 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:40.500641 17935 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:40.506789 17999 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:40.500659 18359 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.508105 18359 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:40.509348 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.511636 17945 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.512382 17945 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.515920 18266 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.516578 18266 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.519342 18266 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.521785 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.522460 11858 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:40.517391 18368 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:40.529340 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:12:40.545840 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71353.8us
I20260709 12:12:40.527004 17945 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.567206 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:40.553802 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:40.582407 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:40.583566 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:40.588896 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:40.591919 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.599061 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45371us
I20260709 12:12:40.607160 18167 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.607751 18167 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.609797 18167 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.611148 18350 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.611555 18350 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.611877 18350 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.614748 18120 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.615337 18120 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.617453 18120 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.618757 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:40.619364 11143 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:40.622089 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:40.623677 18108 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.624030 18108 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.624346 18108 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.625463 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.627225 11215 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.627410 17874 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.628006 17874 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.628526 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:40.552353 18028 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 12:12:40.630306 17874 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.556705 18298 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.633365 17874 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.633585 18298 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.545771 18266 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.634121 17874 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.634987 18266 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.637173 18266 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.637181 17874 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.592725 18342 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:12:40.638005 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:40.638790 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.639318 11213 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.640030 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.640631 11289 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:40.641686 11284 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:40.649219 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.652765 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:40.653715 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.654856 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.658291 11293 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:40.640684 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:40.662969 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:40.662355 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 352691us
W20260709 12:12:40.665582 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.665239 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:40.666805 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.667078 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:40.671506 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.688532 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.689904 11288 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:40.670939 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.690008 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 16, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.697630 11039 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.591374 17888 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.698457 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:40.663388 18373 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.699808 11039 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 20, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.672626 18027 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.556466 18343 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.137s
W20260709 12:12:40.707412 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.707681 18027 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.702715 18373 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.708611 18373 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.709805 18027 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.711079 18353 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:40.711583 18298 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:40.707273 18346 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:40.713377 18346 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:40.714365 18346 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.716233 11213 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
W20260709 12:12:40.717658 11040 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 137) took 28668 ms (client timeout 15000 ms). Trace:
I20260709 12:12:40.719183 11185 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.722671 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.723465 18027 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:40.724355 18027 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:40.700611 17888 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.725914 17888 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.728039 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:40.718112 11040 rpcz_store.cc:269] 0709 12:12:12.049573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.062967 (+ 13394us) service_pool.cc:224] Handling call
0709 12:12:40.717576 (+28654609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:37.602121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:37.679359 (+ 77238us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:37.679414 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:12:37.679433 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:37.680639 (+  1206us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:37.680724 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:37.680762 (+    38us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:12:37.681980 (+  1218us) tablet.cc:701] Row locks acquired
0709 12:12:37.682117 (+   137us) write_op.cc:260] PREPARE: finished
0709 12:12:37.682292 (+   175us) write_op.cc:270] Start()
0709 12:12:37.682451 (+   159us) write_op.cc:276] Timestamp: P: 1783599157682224 usec, L: 0
0709 12:12:37.682470 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:12:37.736387 (+ 53917us) log.cc:844] Serialized 4750 byte log entry
0709 12:12:37.907276 (+170889us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b
0709 12:12:38.618583 (+711307us) op_driver.cc:464] REPLICATION: finished
0709 12:12:38.746529 (+127946us) write_op.cc:301] APPLY: starting
0709 12:12:38.746689 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:38.999615 (+252926us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:38.999668 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:39.256676 (+257008us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:39.257048 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:12:39.257092 (+    44us) write_op.cc:312] APPLY: finished
0709 12:12:39.257477 (+   385us) log.cc:844] Serialized 113 byte log entry
0709 12:12:39.258337 (+   860us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:39.258501 (+   164us) write_op.cc:454] Released schema lock
0709 12:12:39.258571 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:39.259039 (+   468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:39.259065 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":510564,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":66585,"apply.run_cpu_time_us":22653,"apply.run_wall_time_us":540108,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54431,"num_ops":12,"prepare.queue_time_us":433252,"prepare.run_cpu_time_us":31856,"prepare.run_wall_time_us":521312,"raft.queue_time_us":110841,"raft.run_cpu_time_us":10508,"raft.run_wall_time_us":36560,"replication_time_us":926052,"spinlock_wait_cycles":25442048,"thread_start_us":634396,"threads_started":4,"wal-append.queue_time_us":395064,"wal-append.run_cpu_time_us":6467,"wal-append.run_wall_time_us":2108316}]]}
I20260709 12:12:40.704967 11039 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 15, term changed from 17 to 24, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130), NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added, now has a pending config: VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129), VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130), VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131), VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:40.738090 11039 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.739122 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.696295 18257 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.699039 18347 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.741410 11039 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.742673 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.700526 18127 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:40.747243 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85280.8us
I20260709 12:12:40.760324 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:40.761303 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.764875 11142 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 12:12:40.765579 11142 pending_rounds.cc:85] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 14
I20260709 12:12:40.765846 11142 pending_rounds.cc:107] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:12:40.764559 11039 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 19, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:40.766085 11142 raft_consensus.cc:2889] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:40.768054 18379 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:40.768306 18347 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.773504 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:40.774384 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.775578 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:40.776427 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:40.783810 11284 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:40.784756 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.767588 11039 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 21, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 21 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.743249 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:40.786787 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 43674.8us
I20260709 12:12:40.787842 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:40.787705 11039 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.790138 11039 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 19, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.689628 18316 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:40.796988 11144 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:40.745754 18344 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.800230 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.800805 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:40.799929 11039 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:40.795280 17945 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:40.816265 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:40.993409 18120 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:40.993988 18120 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:40.994694 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 178591us
I20260709 12:12:40.796278 18251 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
W20260709 12:12:40.998584 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 199086us
I20260709 12:12:40.999056 18251 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:40.814440 18344 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.004784 18317 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:41.005337 18317 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.007460 18317 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:41.011718 18344 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:40.970229 18108 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.015908 11216 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
W20260709 12:12:41.015802 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 261580us
I20260709 12:12:40.823431 18050 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.799427 18127 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:40.970773 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 152926us
I20260709 12:12:40.971892 18350 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.805176 18374 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.976099 17888 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:40.980948 18266 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:40.985353 18109 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:40.986549 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 176758us
I20260709 12:12:40.816367 18000 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:40.987082 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.987339 18375 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:40.990312 18347 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:40.795517 18198 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.996215 18120 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:40.996570 18298 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:40.965808 18373 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:40.819427 11039 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.017957 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:41.021973 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:41.025807 11215 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:41.022578 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:41.034946 11285 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:41.019577 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:41.019964 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:41.058662 11138 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:41.023900 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:41.019125 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:41.071374 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 52330.9us
I20260709 12:12:41.046793 11039 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 17, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:41.073813 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51339.8us
W20260709 12:12:41.075150 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 55251us
I20260709 12:12:41.077997 11285 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:12:41.080214 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:41.080453 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:41.080931 11289 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.081171 11293 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.073278 11039 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 19, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:41.029237 18359 consensus_meta.cc:287] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.009s
W20260709 12:12:41.129599 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60921.9us
W20260709 12:12:41.131611 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54658.5us
I20260709 12:12:41.129964 11110 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:41.135406 11110 leader_election.cc:403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:41.134627 11039 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.129339 17875 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.142283 11039 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 22, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.029325 17815 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.025228 18350 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:41.071544 18342 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:41.018762 18344 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:41.017081 18108 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:41.041929 18298 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:41.020762 18127 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:41.146716 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54881.4us
I20260709 12:12:41.138566 18276 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:41.144894 11039 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.154695 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:41.092283 18120 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.131867 18374 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:41.163167 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 363959us
I20260709 12:12:41.042102 18198 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.026773 18000 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:41.025084 18266 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.178804 11288 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:41.177862 11293 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:41.152781 17935 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.030263 18375 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.184716 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:41.194872 11289 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:41.195642 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:41.196889 11039 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 20 to 22, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.221073 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:41.211076 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:41.212033 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:41.223001 11143 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:41.216617 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:41.198696 18108 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.157117 18362 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:41.226608 11211 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 17: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:41.226042 11039 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.228052 11136 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:41.231822 11039 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 22, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.233652 11039 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.235780 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:41.238181 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:41.237839 11039 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 18, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.239651 11039 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.241196 11039 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.243084 11039 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 19, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.245116 11039 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.247154 11039 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.251721 11039 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.255975 11039 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:41.246445 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95069.1us
I20260709 12:12:41.260052 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 19, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.263597 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:41.174314 18342 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:41.261749 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56788.6us
I20260709 12:12:41.224385 18108 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.275024 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:41.266268 11039 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 20, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.231923 18120 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.187371 18344 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.274636 17994 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.201619 18276 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:41.232554 17888 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:41.278635 11039 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 20 to 23, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 23 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.282881 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:41.287104 11852 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:12:41.288699 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 93182.5us
W20260709 12:12:41.285265 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.295559 18398 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:41.298053 18276 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:41.277076 18393 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:12:41.280217 18108 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.280750 18120 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.285784 18300 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.320901 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:41.326980 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44185.2us
I20260709 12:12:41.304821 11039 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:41.329667 11039 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:41.325912 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 126444us
I20260709 12:12:41.265344 18298 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:41.306545 18351 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.320987 18120 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.331547 17888 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:41.333817 18065 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:41.338415 18351 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.805637 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:41.806823 18342 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:41.812377 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 460222us
I20260709 12:12:41.811169 17888 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.816847 18000 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:41.818663 18266 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:41.819041 18343 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:41.306193 18127 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:41.834888 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 485650us
I20260709 12:12:41.848636 11861 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:12:41.829265 18401 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.479s	user 0.000s	sys 0.012s
W20260709 12:12:41.855670 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 50159.1us
I20260709 12:12:41.890368 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:41.864521 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.865155 17895 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:41.836745 18346 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:41.894196 18108 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.003s
I20260709 12:12:41.941783 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:41.940691 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:41.867961 17671 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:41.901376 11214 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:41.945436 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:41.873286 18027 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:41.985816 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:41.987703 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:41.895328 18120 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.007s
I20260709 12:12:41.873127 18342 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:41.990406 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:41.986866 11211 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:12:41.888988 18403 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:12:41.896590 17935 consensus_meta.cc:287] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.672s	user 0.019s	sys 0.001s
I20260709 12:12:41.895675 18266 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.016013 11214 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:41.854841 18405 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.157s
I20260709 12:12:41.990152 17671 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.018330 18342 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.888211 18343 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.998276 18346 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.035037 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2539) took 1409 ms. Trace:
I20260709 12:12:42.021042 18353 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:42.020604 17935 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:42.035553 11210 rpcz_store.cc:276] 0709 12:12:40.624005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.626586 (+  2581us) service_pool.cc:224] Handling call
0709 12:12:40.627086 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.630837 (+  3751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.630876 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.631458 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:12:40.802141 (+170683us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:40.802205 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.802310 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.020000 (+1217690us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b24000fda78. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2cfb0 00007f98306a3488 00007f98306a3be8 00007f983067b398 00007f983067676a 00007f9830675bb6
0709 12:12:42.028617 (+  8617us) raft_consensus.cc:1685] finished
0709 12:12:42.028643 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.033750 (+  5107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3370,"raft.queue_time_us":4136,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":138738176,"thread_start_us":170197,"threads_started":1,"wal-append.queue_time_us":353085}
I20260709 12:12:42.040804 18342 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.040786 18346 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:41.998018 18108 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:41.985146 17895 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.035400 18344 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.030117 18266 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:42.049626 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 176206us
I20260709 12:12:42.055609 18346 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.076112 18346 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.078480 18346 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.080590 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.018055 18120 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.021983 18403 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.083418 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.087815 11141 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:42.086922 11212 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:42.094663 11140 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:42.105687 18351 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.105924 18411 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.106807 18411 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.108376 18373 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.055832 18353 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:42.110862 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 239301us
I20260709 12:12:42.072007 18027 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:42.112142 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:42.133788  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.137609 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.079515 18344 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:12:42.139612 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.143033 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.143860 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:12:42.141366 17895 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.172029 18403 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.172655 18000 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:42.173255 18000 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.173329 18343 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.173882 18000 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.145370 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:42.174938 17895 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.175565 17895 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.175653 18027 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.176384 18416 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:42.176810 18416 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:42.177153 18416 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:42.179106 18353 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.113009 17888 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.183239 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.183951 11136 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:42.185210 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:42.118453 18346 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.203634 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.206279 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.207041 11291 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:42.201862 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.212585 18120 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.213274 18120 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.213778 18120 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.178383 17895 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:42.223881 18397 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:12:42.223680 18350 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:42.244903 17671 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.224045 18412 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.225208 18346 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.246982 18266 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.249368 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.254640 18425 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.211251 18411 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.290839 11284 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:42.261725 18108 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.329686 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.256811 18350 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.261471 18120 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.318720 18415 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.319618 18416 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.345441 17888 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:42.340126 18344 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.289927 18412 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.302796 18425 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.315058 18403 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.339257 18350 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:42.351461 18432 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.313762 18127 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.361937 18435 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.342311 18120 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.369017 18198 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.387328 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.386670 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.371476 18433 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.378664 17888 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.371093 18027 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.400190 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:12:42.406700 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 115759us
I20260709 12:12:42.369359 18344 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.409310 11290 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:42.414412 11140 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 3945) took 1204 ms (client timeout 1539 ms). Trace:
W20260709 12:12:42.421213 11140 rpcz_store.cc:269] 0709 12:12:41.210327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.216317 (+  5990us) service_pool.cc:224] Handling call
0709 12:12:42.414127 (+1197810us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54002530d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:42.414294 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904719744}
I20260709 12:12:42.409617 17888 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.427775 18027 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.435207 18198 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.436007 18198 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.375293 18403 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.438359 18403 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.409150 18441 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:42.439244 18198 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.440543 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.443508 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.440624 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.383149 18435 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.444792 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.445964 11210 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:12:42.354804 18415 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.382740 18127 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.384662 18120 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.451229 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.378676 18432 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.453835 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:42.457266 18437 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:12:42.466058 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.408679 18433 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.451013 17874 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.481520 18412 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.483875 18432 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.488139 18346 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.490958 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1229) took 1288 ms. Trace:
I20260709 12:12:42.491595 11217 rpcz_store.cc:276] 0709 12:12:41.202625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.207233 (+  4608us) service_pool.cc:224] Handling call
0709 12:12:42.489931 (+1282698us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800004b98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:12:42.490231 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.490502 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.490526 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.490587 (+    61us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:12:42.490634 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.490710 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.490876 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37542144}
I20260709 12:12:42.493505 18375 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.494263 18120 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.500908 18344 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:42.524642 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 70937.1us
I20260709 12:12:42.531140 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.531662 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.531940 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:42.532573 11137 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.533972 18445 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.529855 18425 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.528930 18375 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:42.537567 18375 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.539462 18425 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.539716 18375 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.540019 18425 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.542140 18425 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.545862 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3941) took 1337 ms. Trace:
I20260709 12:12:42.546092 11137 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:42.546416 11144 rpcz_store.cc:276] 0709 12:12:41.208583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.212752 (+  4169us) service_pool.cc:224] Handling call
0709 12:12:41.213162 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.232220 (+ 19058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.232255 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.232297 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:41.232326 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.545660 (+1313334us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54002544d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:42.545704 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.545810 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43360512}
I20260709 12:12:42.546720 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:42.548071 11135 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:42.549572 11140 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:42.458004 18435 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.531491 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:42.560127 18443 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.550443 18425 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.566171 18393 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.568087 18403 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.568130 11135 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:12:42.568670 18266 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.568740 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.568141 18251 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.571180 17945 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.572067 18198 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.573240 18348 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:42.562271 18375 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.606499 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.607774 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.491046 18127 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:12:42.588186 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57242.5us
W20260709 12:12:42.609597 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78190.8us
I20260709 12:12:42.593829 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.597549 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.598208 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.598918 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.598973 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.611575 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.528640 18433 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.560907 18443 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.611653 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.567484 18027 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.583218 18120 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.592293 18346 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:42.592936 18317 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:42.589177 18344 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.593559 18251 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.617564 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.610554 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:42.588245 18415 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.615911 18348 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:42.622180 18443 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.624770 18374 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.644816 18348 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:42.613215 18375 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.600324 17945 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:42.632081 11852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 1299) took 1858 ms (client timeout 2173 ms). Trace:
I20260709 12:12:42.636153 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.656492 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:42.656841 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46421us
W20260709 12:12:42.640375 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 184794us
I20260709 12:12:42.589008 18425 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.646229 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.595184 18393 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.595685 18266 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.595777 18403 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.659686 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:42.647918 11852 rpcz_store.cc:269] 0709 12:12:40.773160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.773258 (+    98us) service_pool.cc:224] Handling call
0709 12:12:42.631868 (+1858610us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54006fe5d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:12:42.631988 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858566912}
I20260709 12:12:42.605892 18198 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.671301 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1221) took 1514 ms. Trace:
I20260709 12:12:42.671453 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.672142 17945 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.673382 18435 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.676189 11213 rpcz_store.cc:276] 0709 12:12:41.156924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.159884 (+  2960us) service_pool.cc:224] Handling call
0709 12:12:41.192364 (+ 32480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.302785 (+110421us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:41.303148 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.825785 (+522637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.825981 (+   196us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:41.826147 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.671102 (+844955us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000267d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:42.671143 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.671248 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420125,"prepare.queue_time_us":1464,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3366,"raft.queue_time_us":420484,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":253345536,"thread_start_us":101634,"threads_started":1,"wal-append.queue_time_us":682580}
I20260709 12:12:42.680274 11184 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.644763 18344 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.674018 18375 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.674400 18299 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.682291 18299 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.684576 18299 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.686902 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.678736 18127 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.689112 18127 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.689570 18127 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.690030 18344 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.664443 18432 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:12:42.645246 18374 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.697225 18298 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:42.698446 18374 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.620671 18120 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.701092 18120 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.661536 18443 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:42.703995 11256 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.132:46563 timed out after 2.173s (SENT) [suppressed 4 similar messages]
W20260709 12:12:42.705716 18447 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:12:42.642158 18317 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.707759 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.709024 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.710114 18393 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.710183 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.710318 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.711715 11858 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:42.712100 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.708189 18317 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:42.715564 18348 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.716691 18266 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.717042 18348 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.721645 18425 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.722680 17895 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:42.723218 17895 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:42.724095 17895 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.727936 18403 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.727993 17888 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.730317 18198 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.733460 17671 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.733985 17671 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.735076 18416 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.737494 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.738831 18368 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:42.741183 17874 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.741673 17874 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.742151 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.743574 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.744607 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:42.743672 17874 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.747324 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:42.748087 18000 consensus_meta.cc:287] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.006s
I20260709 12:12:42.748559 18000 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.750746 11216 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:42.753525 18251 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.755741 18435 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.757786 18435 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.759907 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.760377 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:42.760892 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.761425 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.762916 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.763325 11215 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:42.764061 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.764189 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:42.764523 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 84299.3us
I20260709 12:12:42.764752 11217 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:42.765326 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:42.762845 18443 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:42.765827 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.766630 11855 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:42.766322 18443 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.767828 11287 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:42.769160 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.770772 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.772024 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.774786 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.774904 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.775467 11140 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:42.775725 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.775672 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.767217 18416 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:42.765094 17671 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.765228 18000 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:42.789989 11144 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:42.790072 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.791426 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.791671 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.792136 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.792654 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.793002 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.793524 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.793602 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.793704 11289 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:42.790342 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:42.795210 11135 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.794672 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.798134 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.799806 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:42.798188 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 224025us
I20260709 12:12:42.774097 18368 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.810324 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:12:42.809672 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 96537.1us
I20260709 12:12:42.809819 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:42.814612 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.814929 11139 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 12:12:42.815357 11139 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 13
I20260709 12:12:42.815563 11139 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 12:12:42.815791 11139 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:42.816746 11259 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:42.817116 11259 leader_election.cc:403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:42.797600 18251 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.827692 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:12:42.825815 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 121861us
I20260709 12:12:42.828792 11139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 3947) took 1602 ms. Trace:
I20260709 12:12:42.830123 18317 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.830719 18317 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.838243 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.839428 11289 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:42.808456 18416 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:42.840862 11287 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:42.840778 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:42.843948 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.829169 11139 rpcz_store.cc:276] 0709 12:12:41.226180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.227412 (+  1232us) service_pool.cc:224] Handling call
0709 12:12:41.227787 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.816191 (+1588404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.828559 (+ 12368us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540032f0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:42.828734 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3648997120}
I20260709 12:12:42.825245 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:42.841558 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.806187 17888 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.819623 18343 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:42.812361 18368 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:42.824090 18425 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.857641 11135 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:42.862242 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.870348 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:42.863267 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.863613 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.863833 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.864662 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.864984 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.877278 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:42.878423 11289 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:42.815986 18403 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:42.880090 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:42.882251 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:42.885164 11218 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:12:42.883234 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:42.887801 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60197.1us
I20260709 12:12:42.849826 18120 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.881843 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.868359 18368 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.892247 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:42.896961 11218 raft_consensus.cc:606] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:42.897338 11218 raft_consensus.cc:614] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:42.859494 18343 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:42.874059 18096 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.890460 18348 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:42.875053 18344 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:42.884241 18350 consensus_meta.cc:287] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 12:12:42.903546 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.843542 18251 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.858814 18432 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:12:42.867117 17888 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:42.915669 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.894279 18410 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:42.892760 18120 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:42.901254 18436 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:42.919063 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:42.923678 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.903719 18343 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:42.925917 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.920327 17875 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:12:42.938601 18375 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:42.939400 18405 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.940186 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.920764 18373 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:42.938920 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.954780 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.908799 18374 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:42.953933 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.954262 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.957722 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.958324 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.958673 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.916937 18350 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.959408 11217 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:12:42.965512 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46542.7us
W20260709 12:12:42.966710 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 43911.2us
I20260709 12:12:42.968031 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:42.926403 18120 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.966856 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.974380 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:42.932639 18300 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:42.982921 18251 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:42.983065 18348 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:42.975955 18375 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.972817 18403 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.910918 18096 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.006470 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:42.981204 11144 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:42.981457 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.010962 11139 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
I20260709 12:12:42.982208 18449 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.982262 18266 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.958421 18443 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:43.013321 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.007700 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:42.915817 18344 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:42.963078 18198 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:43.023052 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51823.3us
I20260709 12:12:43.018293 17888 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:43.032589 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.024921 11860 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:43.025461 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:43.027199 11214 raft_consensus.cc:2368] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23.
I20260709 12:12:43.028052 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:43.035490 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.036638 11139 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:12:43.031075 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59215.3us
I20260709 12:12:43.037453 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.040495 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.040729 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:43.043408 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.049803 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:43.052559 11214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:43.053256 11214 raft_consensus.cc:606] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:43.053177 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.053805 11214 raft_consensus.cc:614] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:43.062853 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.063833 18108 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:43.064205 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.065438 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.059684 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.066546 18351 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:43.066766 18350 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:43.031402 18266 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.068110 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:43.068312 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.068718 11860 raft_consensus.cc:2376] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24. Re-sending same reply.
I20260709 12:12:43.067644 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.066076 17888 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.948844 18416 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.040617 18317 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:43.074270 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.072767 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.052726 17874 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.087150 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.091223 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:43.092648 11107 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.093845 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.094925 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.093395 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:43.104059 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.087915 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:43.104996 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:43.111300 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.119897 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.120101 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.111456 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:43.052505 18127 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:43.081404 18450 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.113s	user 0.001s	sys 0.002s
I20260709 12:12:43.116298 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.121248 11136 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.121483 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:43.134382 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.117960 18443 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:43.116993 18108 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:43.176681 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:43.184077 11216 raft_consensus.cc:606] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.118294 18403 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:43.184486 11216 raft_consensus.cc:614] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:43.182843 11286 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:43.123067 18266 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.123193 17888 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:43.185895 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48267.2us
W20260709 12:12:43.192149 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 57846.8us
I20260709 12:12:43.113301 18027 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:12:43.112478 18167 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:43.179912 18433 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:43.196941 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.176605 17895 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.202150 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.117843 18432 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 12:12:43.205799 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 94571.2us
I20260709 12:12:43.200166 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:12:43.201920 18451 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:43.179059 18443 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:12:43.197113 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92195.7us
I20260709 12:12:43.185817 17874 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:43.206475 18455 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:12:43.226522 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:43.199294 18298 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.228266 11136 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:12:43.245150 11291 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.245613 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.176828 18198 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:43.247547 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:43.248277 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.260092 11110 leader_election.cc:400] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23.
I20260709 12:12:43.261752 11110 leader_election.cc:403] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:43.227756 18403 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.210748 18433 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:43.264554 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.289868 11291 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:12:43.241492 18443 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.203560 18120 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.266831 11258 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
W20260709 12:12:43.547046 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 280398us
I20260709 12:12:43.547813 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.548908 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:12:43.391552 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 170118us
I20260709 12:12:43.423192 18343 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.282991 18344 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:43.274441 18433 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.284955 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:43.256665 17874 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.592963 11214 raft_consensus.cc:1217] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Deduplicated request from leader. Original: 24.13->[25.14-25.14]   Dedup: 25.14->[]
I20260709 12:12:43.227053 17895 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.314376 18127 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:43.401059 17888 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:43.287535 18457 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:12:43.407130 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:43.307796 18096 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:43.278123 18464 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.522806 18403 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.258893 18463 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:43.532989 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 268485us
I20260709 12:12:43.397008 18368 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.283910 18462 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:43.341336 18425 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
W20260709 12:12:43.283319 18456 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:12:43.343271 18422 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:43.270445 18373 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23.
I20260709 12:12:43.544201 11215 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:43.553643 18120 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:43.546590 18108 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:43.555258 18432 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.557663 11293 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.561208 18417 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:43.568192 18443 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.588796 11218 raft_consensus.cc:606] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:43.592701 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:43.595643 11214 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:12:43.597954 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.599195 11140 raft_consensus.cc:1240] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:43.600000 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:43.607673 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:43.610677 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.615047 17895 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:43.610262 18344 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.617491 18462 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:43.594379 18300 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:43.618448 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:43.620044 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.622798 18463 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:12:43.658918 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48379.7us
I20260709 12:12:43.665047 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.667500 18368 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:43.668249 18443 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:43.654475 11287 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:12:43.663373 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:43.682601 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:43.680454 18198 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:12:43.670396 18448 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:43.685036 18448 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.685190 18463 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.687357 18448 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:43.662147 18462 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:43.619218 18422 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.688112 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:43.665829 18373 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.692155 11138 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:43.693212 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:43.654743 18417 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.675974 18403 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.703423 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:43.678869 18449 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.717139 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:43.720639 11216 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:12:43.672950 18300 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.689355 18368 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:43.702914 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:12:43.734690 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 185840us
I20260709 12:12:43.737028 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:43.704346 18441 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:43.713837 18469 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:43.707834 18343 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:43.751678 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.760565 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.753494 11138 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:43.755028 18346 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.763439 11258 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.768417 11258 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.772935 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.677841 17888 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.753466 18438 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:43.781762 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.786952 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:43.715202 18403 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:43.791816 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.765807 18344 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:43.805169 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.767035 18317 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.781509 18443 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.819530 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.938607 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:43.763005 18462 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.811789 18417 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:43.930470 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:43.880199 17874 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:43.817400 18441 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:43.939311 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:43.790877 18120 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.812296 18346 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.762692 18469 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:43.782909 18438 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:43.948962 18422 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:43.931917 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:43.827847 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 145136us
I20260709 12:12:44.001879 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.004213 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:43.794426 18432 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:43.777766 18474 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:12:43.952253 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 186756us
W20260709 12:12:43.971009 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 151593us
W20260709 12:12:43.971593 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 148802us
I20260709 12:12:43.972793 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:43.973330 18317 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.975666 18463 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.978417 18462 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:43.930317 18425 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.979030 18441 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:43.990093 11216 raft_consensus.cc:1240] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.988097 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:44.012534 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:44.014169 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.017804 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.025565 18463 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.026875 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:44.027652 18463 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.028784 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.029879 18474 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.008260 18198 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.031818 18463 consensus_queue.cc:1059] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:44.033051 18432 raft_consensus.cc:3055] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:44.033412 18432 raft_consensus.cc:740] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:44.034328 18432 consensus_queue.cc:260] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.037853 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:12:44.038170 18478 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:12:44.003377 18438 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:44.048326 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51356.1us
I20260709 12:12:44.052513 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:44.054579 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44990.5us
I20260709 12:12:44.065703 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.070819 11285 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:44.071185 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.088418 18317 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:44.104852 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48711.8us
I20260709 12:12:44.109623 18373 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:44.109550 18167 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:44.110251 18373 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:44.112102 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55058.2us
I20260709 12:12:44.088342 18425 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.113711 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:44.111250 18373 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.116212 18373 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.120291 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.121508 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.121654 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.122294 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.122574 18418 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.123334 18418 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.123492 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.127185 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.127741 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.132472 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.132723 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.135632 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.136180 11140 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:44.141930 11293 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:44.142583 11219 raft_consensus.cc:606] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:44.149931 18198 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:44.145876 18346 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.154120 18474 consensus_queue.cc:1059] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:44.155943 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.123497 18300 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:44.095494 18403 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:44.160132 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.164324 18432 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:44.174069 18317 raft_consensus.cc:3055] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.195250 18317 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:44.203575 11211 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:44.216579 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.198787 18403 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:44.209726 18485 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.202944 18224 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:12:44.206777 18094 consensus_queue.cc:1059] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
W20260709 12:12:44.289819 18492 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:44.274250 18352 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:12:44.285704 18459 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:12:44.324122 18352 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.341243 18352 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:44.328953 18428 raft_consensus.cc:3055] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:44.332624 18433 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.002s
I20260709 12:12:44.346966 18428 raft_consensus.cc:740] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:44.286517 18485 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.355656 18485 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.355755 18428 consensus_queue.cc:260] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.357208 18428 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.357859 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:44.336131 11288 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:12:44.359993 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.347177 18433 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.360033 11142 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:12:44.361181 11291 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:44.338428 18469 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:44.368705 18433 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:44.371249 18438 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.374150 11861 raft_consensus.cc:2410] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:44.380522 18438 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:44.389165 18482 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:44.389954 18482 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:44.390782 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 120275us
W20260709 12:12:44.402794 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 190381us
I20260709 12:12:44.419234 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:44.437426 18373 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.438130 18373 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.440809 18373 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.445382 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.447592 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:44.448391 11292 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:12:44.538522 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.538862 11215 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:12:44.545269 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.549454 18433 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:44.551155 18352 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.553661 18352 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.554170 18373 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:44.554658 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:44.557924 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.559599 11141 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:12:44.560415 18373 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:44.560913 18373 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.561113 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:44.562433 18356 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.563143 18356 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:44.561303 18373 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.564374 18356 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:44.592099 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.592352 18317 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.593676 18317 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.595975 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:44.612025 18433 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:44.612792 18433 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.613618 18094 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.613987 18094 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:44.614826 18094 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.615829 18433 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:44.616022 18094 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.621261 18482 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.623782 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:44.624579 11289 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:44.627141  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:44.630249 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:44.630756 18299 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:44.631115 18482 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.631565 18482 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:44.631505 18299 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.636600 18299 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:44.632118 18482 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.632714 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.640444 18299 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.640347 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.650166 18299 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.653020 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:44.656901 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:44.666283 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.667618 18346 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:44.668231 18346 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.650249 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:44.670239 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:44.670445 18350 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:44.671281 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.672184 17895 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.672556 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.673010 11287 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:44.670380 18346 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:44.676489 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 1680) took 1034 ms. Trace:
I20260709 12:12:44.676964 11291 rpcz_store.cc:276] 0709 12:12:43.641775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.641951 (+   176us) service_pool.cc:224] Handling call
0709 12:12:43.642308 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:44.361565 (+719257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.676252 (+314687us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540017f2d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:44.676417 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652848384}
I20260709 12:12:44.677923  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:44.679564 18109 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:44.680675 18109 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:44.681087 18109 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:44.684366 18109 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.685957 18109 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:44.662375 18486 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.613s	user 0.004s	sys 0.026s
I20260709 12:12:44.691479 18469 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:44.696487 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:44.699285 11259 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.700572 18120 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.703393 18469 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:44.704231 18482 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.708966 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.691677 17895 raft_consensus.cc:993] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:44.714742 18469 raft_consensus.cc:1081] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
W20260709 12:12:44.681701 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83560.6us
I20260709 12:12:44.716549 18299 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:44.717136 18299 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.719720 18299 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:44.721239 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:44.721889 11855 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:44.725091 11182 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:44.724900 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:44.729074 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.730970 11144 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:44.732939 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:44.733577 11291 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.736577 18299 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.737108 18299 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:44.737964 18299 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.732489 18120 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:44.730237 18482 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.742981 11291 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:44.743567 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:44.746867 11861 raft_consensus.cc:1240] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:44.747481 17671 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:44.744385 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:44.748697 18485 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:44.749218 18485 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:44.750087 18485 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.724419  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:44.773675 18299 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.783062 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:44.783298 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.784070 11219 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:44.785050 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.810863 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:44.811702 11291 raft_consensus.cc:2393] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:44.812973 11215 raft_consensus.cc:1240] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:44.814363 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:44.815026 11141 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.815419 11141 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.816040 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:44.825518 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.823825 11141 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.832378 11287 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:44.835361 11141 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.842087 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:44.842768 11287 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.843575 11289 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:44.802780 18433 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.849172 17895 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:44.849902 17895 consensus_queue.cc:1243] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:44.803020 18432 consensus_queue.cc:1059] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 12:12:44.851625 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.852285 11215 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:44.854549 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 259) took 6918 ms. Trace:
I20260709 12:12:44.852960 11215 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:44.857800 11287 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:12:44.857937 17874 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:44.858594 11291 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:44.857352 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:44.859172 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:44.855317 11039 rpcz_store.cc:276] 0709 12:12:37.930479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.930744 (+   265us) service_pool.cc:224] Handling call
0709 12:12:38.104235 (+173491us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:12:44.848784 (+6744549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:42.186540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:42.187094 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:42.187134 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:12:42.187152 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:42.316489 (+129337us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:42.316553 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:42.316584 (+    31us) tablet.cc:685] Acquiring locks for 34 operations
0709 12:12:42.363547 (+ 46963us) tablet.cc:701] Row locks acquired
0709 12:12:42.363572 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:12:42.363780 (+   208us) write_op.cc:270] Start()
0709 12:12:42.363960 (+   180us) write_op.cc:276] Timestamp: P: 1783599162363712 usec, L: 0
0709 12:12:42.363986 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:12:42.364915 (+   929us) log.cc:844] Serialized 13595 byte log entry
0709 12:12:42.912316 (+547401us) op_driver.cc:464] REPLICATION: finished
0709 12:12:43.270400 (+358084us) write_op.cc:301] APPLY: starting
0709 12:12:43.273166 (+  2766us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:43.471388 (+198222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:43.519732 (+ 48344us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:44.194391 (+674659us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:44.288165 (+ 93774us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 12:12:44.288216 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:44.288772 (+   556us) log.cc:844] Serialized 292 byte log entry
0709 12:12:44.392363 (+103591us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:44.392628 (+   265us) write_op.cc:454] Released schema lock
0709 12:12:44.392697 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:44.400343 (+  7646us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:44.400386 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9414,"reported_tablets":51,"spinlock_wait_cycles":265715968,"child_traces":[["op",{"apply.queue_time_us":329159,"apply.run_cpu_time_us":70057,"apply.run_wall_time_us":1136857,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146655,"num_ops":34,"prepare.queue_time_us":158093,"prepare.run_cpu_time_us":111300,"prepare.run_wall_time_us":405377,"raft.queue_time_us":186392,"raft.run_cpu_time_us":34303,"raft.run_wall_time_us":275214,"replication_time_us":535257,"thread_start_us":732731,"threads_started":5,"wal-append.queue_time_us":376939,"wal-append.run_cpu_time_us":19395,"wal-append.run_wall_time_us":1302749}]]}
I20260709 12:12:44.844875 18414 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:44.859063 11215 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.866580 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:44.866827 11215 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.855361 18346 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:44.868114 18346 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:44.869024 18346 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:44.870206 18346 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:44.824199 18373 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.872829 11138 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:44.874341 11287 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:44.888639 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:44.889287 11291 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.896337 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:44.897187 18373 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:44.897789 18350 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:44.864184 18485 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:44.899518 18485 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:44.900058 11037 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:44.863885 18469 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.901440 11291 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:44.903524 18418 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.905058 18276 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:44.906447 11037 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } }
I20260709 12:12:44.907317 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:44.862432 17874 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.933235 11215 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:12:44.936762 18276 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:44.948653 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:44.951005 11287 raft_consensus.cc:2393] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:44.952872 11289 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:12:44.949728 11291 raft_consensus.cc:1217] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 16.9->[18.10-23.13]   Dedup: 18.10->[19.11-23.13]
I20260709 12:12:44.954013 11291 pending_rounds.cc:85] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 10
I20260709 12:12:44.954260 11291 pending_rounds.cc:107] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:12:44.954526 11291 raft_consensus.cc:2889] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:44.915650 17874 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:44.962072 18485 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:44.944226 18373 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:44.980489 11037 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:44.994234 17874 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.000530 11037 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 14 to 18, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:45.002106 11037 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 20 to 21, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 21 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:44.983620 18373 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:45.005615 18373 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.009193 11037 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 17 to 20, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 20 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:44.995914 17874 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.013042 18299 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:45.017491 18167 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:45.017900 18167 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:45.020202 11037 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 13 to 16, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:45.023517 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:45.039992 11860 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:12:45.041249 11182 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:45.050572 18299 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:45.051184 18299 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:45.052052 18299 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:45.064345 11037 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 14 to 16, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 16 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:44.986707 18368 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 12:12:45.080255 11140 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:45.088639 18422 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:45.110924 11215 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:45.114732 11141 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:45.122864 18428 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:45.153484 11140 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:12:45.137010 18428 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:12:45.173645 18167 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.187580 18167 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:45.189087 18299 consensus_queue.cc:1175] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "018d40ceb45d4447aa293f4c1d929bb8" responder_term: 23 status { last_received { term: 23 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: [22.13-22.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:45.220413 11215 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:45.230975 18512 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.003s
I20260709 12:12:45.234916 18403 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:45.223776 18299 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:45.247073 18299 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.249142 18299 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:45.252595 11292 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:45.254304 18485 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:45.280283 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:45.284729 11293 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:12:45.330634 18514 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
W20260709 12:12:45.311594 18515 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:12:45.372691 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:45.373364 11135 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:45.430326 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:45.431970 18418 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.432399 18418 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:45.432758 18418 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:45.450282 18520 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.083s	user 0.004s	sys 0.000s
W20260709 12:12:45.455595 18521 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:12:45.480600 11287 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 12:12:45.480942 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65098.9us
I20260709 12:12:45.486429 18403 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:45.504838 11215 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:45.507606 18418 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.508466 18373 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:45.513990 18418 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:45.514803 11292 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:45.516894 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:45.517282 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:45.547062 11293 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:45.528982 11216 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:12:45.551308 11216 pending_rounds.cc:85] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 12
I20260709 12:12:45.551597 11216 pending_rounds.cc:107] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:12:45.551842 11216 raft_consensus.cc:2889] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:45.533007 11288 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:45.553668 18373 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:45.564119 18373 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:45.570451 11135 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:45.574605 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:12:45.574075 18167 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:12:45.578626 18300 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:45.579193 18300 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:45.580088 18300 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.612317 18433 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.612922 18433 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.617173 18433 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:45.617537 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:45.618242 11138 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:12:45.619794 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:45.620021 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:45.621021 18433 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:45.621569 18433 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.622679 18433 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.637181 17875 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:45.644474 17875 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.650025 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:45.650821 11138 raft_consensus.cc:2393] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 15: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:12:45.651940 11860 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:45.652186 17875 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:45.657258 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:45.663810 17895 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:45.695806 18433 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.737701 11292 raft_consensus.cc:2368] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16.
I20260709 12:12:45.741477 11185 leader_election.cc:400] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16.
I20260709 12:12:45.741861 11185 leader_election.cc:403] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:45.742823 18299 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.754257 18433 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:45.755440 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:45.756079 11138 raft_consensus.cc:3060] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.758208 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:45.805383 18299 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16.
I20260709 12:12:45.812513 11138 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:12:45.813961 11258 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:45.814935 18433 raft_consensus.cc:2804] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:45.815461 18433 raft_consensus.cc:697] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:45.816327 18433 consensus_queue.cc:237] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.819068 11216 raft_consensus.cc:2468] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:12:45.861249 11037 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 259) took 15895 ms (client timeout 15000 ms). Trace:
I20260709 12:12:45.851491 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 17, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:45.861795 11037 rpcz_store.cc:269] 0709 12:12:30.000576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.014594 (+ 14018us) service_pool.cc:224] Handling call
0709 12:12:45.861105 (+15846511us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:45.339910 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:45.340537 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:45.340576 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:12:45.340596 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:45.341477 (+   881us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:45.341560 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:45.341595 (+    35us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:12:45.342257 (+   662us) tablet.cc:701] Row locks acquired
0709 12:12:45.342276 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:12:45.342430 (+   154us) write_op.cc:270] Start()
0709 12:12:45.356549 (+ 14119us) write_op.cc:276] Timestamp: P: 1783599165342383 usec, L: 0
0709 12:12:45.363056 (+  6507us) op_driver.cc:348] REPLICATION: starting
0709 12:12:45.391973 (+ 28917us) log.cc:844] Serialized 3230 byte log entry
0709 12:12:45.544356 (+152383us) op_driver.cc:464] REPLICATION: finished
0709 12:12:45.668365 (+124009us) write_op.cc:301] APPLY: starting
0709 12:12:45.668461 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:45.697759 (+ 29298us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:45.697858 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:45.779316 (+ 81458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:45.779576 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:12:45.779630 (+    54us) write_op.cc:312] APPLY: finished
0709 12:12:45.779925 (+   295us) log.cc:844] Serialized 81 byte log entry
0709 12:12:45.780102 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:45.780235 (+   133us) write_op.cc:454] Released schema lock
0709 12:12:45.780290 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:45.785891 (+  5601us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:45.785933 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34337,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":123771,"apply.run_cpu_time_us":12680,"apply.run_wall_time_us":112365,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37663,"num_ops":8,"prepare.queue_time_us":136826,"prepare.run_cpu_time_us":23583,"prepare.run_wall_time_us":87109,"raft.queue_time_us":74555,"raft.run_cpu_time_us":28338,"raft.run_wall_time_us":99415,"replication_time_us":181128,"thread_start_us":287682,"threads_started":4,"wal-append.queue_time_us":56585}]]}
I20260709 12:12:45.864867 11039 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129), VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130), VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131), VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.868393 11039 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 21 to 22, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 22 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:45.870452 11039 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.871922 11039 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.873544 11039 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.875186 11039 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 16, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 16 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.876462 11039 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 12, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 12 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.878000 11039 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.879288 11039 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 20, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 20 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:45.882895 11039 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.884289 11039 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.885696 11039 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:45.887493 11039 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.888921 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 20, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.890406 11039 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 17, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 17 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.893357 11039 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.902093  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.914575 18433 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.915519 18433 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.894796 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 18, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 18 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.923564 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:45.922605 11039 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.925976 11039 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 22, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.928583 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:45.929224 11216 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:45.929139 11039 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.930755 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:45.930717 11039 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.931694 18432 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:45.932083 18432 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.932335 18433 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:45.932598 18432 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.932077 11039 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 19, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 19 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:45.934348 11039 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 22 to 24, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:45.936182 11039 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 18, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 18 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.958630 18432 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.967149 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:45.970407 18346 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.971055 18346 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.979300 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:45.981907 18373 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:45.982664 18373 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:45.985039 18373 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:45.987246 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:45.988157 11138 raft_consensus.cc:2410] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:12:45.989583 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:45.990417 11293 raft_consensus.cc:2368] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:45.992421 18346 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:45.994199 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:45.998438 11216 raft_consensus.cc:2393] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:12:45.999922 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:46.003019 18433 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.008750 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:46.009442 11216 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.016604 11110 leader_election.cc:400] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:46.017215 11110 leader_election.cc:403] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:46.028779 18403 raft_consensus.cc:3060] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.032963 18346 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.033532 18346 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.015599 18432 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:46.054582 18300 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:46.055598 18346 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:46.055243 18300 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.058705 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:46.059401 11860 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:12:46.063352 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:46.064042 11293 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:12:46.064038 11216 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:46.071022 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:46.062795 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:46.080598 11259 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:46.083815 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:46.086086 11860 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:46.089165 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:46.079237 18524 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.093163 18524 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.096264 18418 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:46.096830 18418 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:46.097195 18418 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:46.085023 18433 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:46.101270 18433 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.101662 18433 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.085224 18432 raft_consensus.cc:2804] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:46.108172 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:46.109565 11216 raft_consensus.cc:606] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:46.082201 18300 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:46.110107 11216 raft_consensus.cc:614] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:46.120649 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:46.123703 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:46.124332 11215 raft_consensus.cc:606] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:46.124688 11215 raft_consensus.cc:614] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:46.125700 18501 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.223718 18501 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.225914 18501 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:46.226547 18432 raft_consensus.cc:697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:46.217551 18524 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:46.220825 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 88241.3us
W20260709 12:12:46.227353 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 93637us
W20260709 12:12:46.216847 18523 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.091s	user 0.004s	sys 0.003s
I20260709 12:12:46.243539 18432 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:46.227412 18403 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:12:46.250447 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:46.255546 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:46.281111 11293 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
W20260709 12:12:46.248157 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 156217us
I20260709 12:12:46.288075 11141 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:46.264890 11292 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:46.269017 11860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:46.293140 11860 raft_consensus.cc:606] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:46.293498 11860 raft_consensus.cc:614] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:46.296562 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:46.297547 11216 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:12:46.308180 11135 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:12:46.335282 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60628.6us
I20260709 12:12:46.320032 18167 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:46.264865 18433 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.244454 18418 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.318933 18432 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:12:46.343621 18418 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:46.340761 18167 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.345605 18433 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:46.346581 18167 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:46.347486 11288 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:12:46.347693 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:46.348449 11860 raft_consensus.cc:2393] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:12:46.350871 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:46.352114 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:46.352692 11860 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.352977 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:46.358644 18428 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.359063 18428 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.359853 18428 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.365104 11860 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:46.366577 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:46.367442 18432 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:46.367969 18432 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:46.368839 18432 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.375061 18428 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.377287 18428 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:46.386359 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:46.387220 18414 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:46.431427 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 75407.2us
I20260709 12:12:46.445647 11216 raft_consensus.cc:1275] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:46.450778 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:46.452049 11215 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:12:46.495956 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 109558us
I20260709 12:12:46.539450 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:46.556172 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:46.557575 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:46.557629 11292 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.554134 11215 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:46.588150 11855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:46.589391 11855 raft_consensus.cc:606] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:46.589987 11855 raft_consensus.cc:614] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:46.649344 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 95021.9us
I20260709 12:12:46.670167 11141 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:46.672220 18346 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:46.666306 11292 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:46.689982 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:46.691219 11219 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.726933 17875 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:46.747596 11293 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:12:46.758810 17895 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:46.760856 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:46.769953 18551 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.781221 11219 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:12:46.778793 18559 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.785207 18559 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.786441 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:46.787673 18559 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:46.790899 11855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:46.789549 18094 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.791908 11855 raft_consensus.cc:606] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:46.792850 11855 raft_consensus.cc:614] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:46.797546 18094 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:46.800551 18094 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:46.825316 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:46.825978  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:46.826145 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:46.826308 11293 raft_consensus.cc:2410] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for term 26 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:12:46.835167  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:46.839102  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.857880 18558 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:46.858558 18558 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:46.859820 18558 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:46.871134 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45165.8us
I20260709 12:12:46.875455 18537 consensus_queue.cc:1048] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:46.888585 11855 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:46.917145 18433 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:46.959822 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:46.995652 11216 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:46.999138 11215 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:47.049201 18537 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:47.052256 18432 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.115358 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:47.121810 11038 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 4 to 18, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 18 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.139318 18543 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:47.138834 11216 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:47.149680 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 260) took 1455 ms. Trace:
I20260709 12:12:47.150353 11039 rpcz_store.cc:276] 0709 12:12:45.694228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.694416 (+   188us) service_pool.cc:224] Handling call
0709 12:12:47.149387 (+1454971us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:46.103975 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:46.104525 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:46.104559 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:12:46.104577 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:46.106313 (+  1736us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:46.106395 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:46.122532 (+ 16137us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:12:46.124471 (+  1939us) tablet.cc:701] Row locks acquired
0709 12:12:46.124492 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:46.124657 (+   165us) write_op.cc:270] Start()
0709 12:12:46.124777 (+   120us) write_op.cc:276] Timestamp: P: 1783599166124590 usec, L: 0
0709 12:12:46.124799 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:46.125499 (+   700us) log.cc:844] Serialized 9844 byte log entry
0709 12:12:46.361655 (+236156us) op_driver.cc:464] REPLICATION: finished
0709 12:12:46.389034 (+ 27379us) write_op.cc:301] APPLY: starting
0709 12:12:46.389160 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:46.718749 (+329589us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:46.718916 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:46.853510 (+134594us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:46.854044 (+   534us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 12:12:46.854102 (+    58us) write_op.cc:312] APPLY: finished
0709 12:12:46.918742 (+ 64640us) log.cc:844] Serialized 220 byte log entry
0709 12:12:46.920529 (+  1787us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:46.921103 (+   574us) write_op.cc:454] Released schema lock
0709 12:12:46.921194 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:46.948456 (+ 27262us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:46.948508 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4759,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":26809,"apply.run_cpu_time_us":44347,"apply.run_wall_time_us":554591,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108927,"num_ops":25,"prepare.queue_time_us":136881,"prepare.run_cpu_time_us":5878,"prepare.run_wall_time_us":21840,"replication_time_us":236679,"thread_start_us":125201,"threads_started":2}]]}
I20260709 12:12:47.209161 11861 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:12:47.234318 18550 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:47.242266 11136 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:12:47.258798 18555 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.264195 11861 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.280813 18545 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:12:47.312173 11039 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 24 to 25, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 25 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.314524 11039 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 22, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 22 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:47.317361 11039 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 23, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 23 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:47.329376 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 255c201215d14e89bc735bb8b57682cb with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:47.331058 11855 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:12:47.318686 11039 catalog_manager.cc:5697] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:47.337767 17895 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:12:47.364650 11142 raft_consensus.cc:2955] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.379616 11039 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:47.477231 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92757.4us
W20260709 12:12:47.500659 11038 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 255) took 25299 ms (client timeout 15000 ms). Trace:
I20260709 12:12:47.503484 11287 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:47.519606 11287 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:12:47.520998 11213 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:12:47.511827 11038 rpcz_store.cc:269] 0709 12:12:22.200837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.201043 (+   206us) service_pool.cc:224] Handling call
0709 12:12:23.399710 (+1198667us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:12:47.500517 (+24100807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:47.232436 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:47.239003 (+  6567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:47.239702 (+   699us) write_op.cc:435] Acquired schema lock
0709 12:12:47.239725 (+    23us) tablet.cc:662] Decoding operations
0709 12:12:47.247161 (+  7436us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:47.247270 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:47.248442 (+  1172us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:47.248773 (+   331us) tablet.cc:701] Row locks acquired
0709 12:12:47.248840 (+    67us) write_op.cc:260] PREPARE: finished
0709 12:12:47.249035 (+   195us) write_op.cc:270] Start()
0709 12:12:47.249185 (+   150us) write_op.cc:276] Timestamp: P: 1783599167248963 usec, L: 0
0709 12:12:47.249205 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:12:47.263144 (+ 13939us) log.cc:844] Serialized 536 byte log entry
0709 12:12:47.271174 (+  8030us) op_driver.cc:464] REPLICATION: finished
0709 12:12:47.278995 (+  7821us) write_op.cc:301] APPLY: starting
0709 12:12:47.279112 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:47.279963 (+   851us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:47.280057 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:47.280827 (+   770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:47.280994 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:47.281046 (+    52us) write_op.cc:312] APPLY: finished
0709 12:12:47.281224 (+   178us) log.cc:844] Serialized 25 byte log entry
0709 12:12:47.281388 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.281495 (+   107us) write_op.cc:454] Released schema lock
0709 12:12:47.281533 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":306245,"reported_tablets":50,"spinlock_wait_cycles":67569536,"child_traces":[["op",{"apply.queue_time_us":7565,"apply.run_cpu_time_us":2859,"apply.run_wall_time_us":2859,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4192,"num_ops":1,"prepare.queue_time_us":89228,"prepare.run_cpu_time_us":3632,"prepare.run_wall_time_us":31138,"replication_time_us":21747,"thread_start_us":88681,"threads_started":1}]]}
I20260709 12:12:47.563318 18543 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.571916 18428 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.574677 18558 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:47.551929 11042 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 18 to 20, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 20 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.591823 11042 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 9 to 10, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 10 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:47.724972 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 92171.7us
W20260709 12:12:47.859128 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 138) took 14605 ms (client timeout 15000 ms). Trace:
W20260709 12:12:47.860575 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 103112us
W20260709 12:12:47.885596 11042 rpcz_store.cc:269] 0709 12:12:33.256326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.260752 (+  4426us) service_pool.cc:224] Handling call
0709 12:12:47.859046 (+14598294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:47.750555 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:47.751183 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:47.751228 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:12:47.751247 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:47.751736 (+   489us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:47.751798 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:47.751829 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:47.752192 (+   363us) tablet.cc:701] Row locks acquired
0709 12:12:47.752212 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:12:47.752386 (+   174us) write_op.cc:270] Start()
0709 12:12:47.752503 (+   117us) write_op.cc:276] Timestamp: P: 1783599167752337 usec, L: 0
0709 12:12:47.752529 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:12:47.753208 (+   679us) log.cc:844] Serialized 919 byte log entry
0709 12:12:47.754992 (+  1784us) op_driver.cc:464] REPLICATION: finished
0709 12:12:47.756332 (+  1340us) write_op.cc:301] APPLY: starting
0709 12:12:47.756404 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:47.757727 (+  1323us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:47.757817 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:47.759052 (+  1235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:47.759225 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:47.759277 (+    52us) write_op.cc:312] APPLY: finished
0709 12:12:47.759470 (+   193us) log.cc:844] Serialized 33 byte log entry
0709 12:12:47.759631 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.759718 (+    87us) write_op.cc:454] Released schema lock
0709 12:12:47.759756 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:47.760086 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.760118 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33428,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":1094,"apply.run_cpu_time_us":3726,"apply.run_wall_time_us":3726,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8384,"num_ops":2,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":2985,"prepare.run_wall_time_us":2984,"replication_time_us":2328}]]}
I20260709 12:12:47.915987 11036 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.918877 11036 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.924561 11036 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 19 to 22, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 22 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.964600 11039 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:47.966085 11039 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 21, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:47.988757 11039 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 17 to 18, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.066670 11036 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 260) took 2260 ms. Trace:
I20260709 12:12:48.067180 11036 rpcz_store.cc:276] 0709 12:12:45.806417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.806713 (+   296us) service_pool.cc:224] Handling call
0709 12:12:48.066585 (+2259872us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:47.936566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:47.937075 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:47.937102 (+    27us) write_op.cc:435] Acquired schema lock
0709 12:12:47.937119 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:47.937574 (+   455us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:47.937628 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:47.937651 (+    23us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:47.937967 (+   316us) tablet.cc:701] Row locks acquired
0709 12:12:47.937983 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:12:47.938124 (+   141us) write_op.cc:270] Start()
0709 12:12:47.938250 (+   126us) write_op.cc:276] Timestamp: P: 1783599167938078 usec, L: 0
0709 12:12:47.938275 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:12:47.938990 (+   715us) log.cc:844] Serialized 1302 byte log entry
0709 12:12:47.940892 (+  1902us) op_driver.cc:464] REPLICATION: finished
0709 12:12:47.946332 (+  5440us) write_op.cc:301] APPLY: starting
0709 12:12:47.946414 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:47.948968 (+  2554us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:47.949096 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:47.951051 (+  1955us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:47.951225 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:47.951270 (+    45us) write_op.cc:312] APPLY: finished
0709 12:12:47.951477 (+   207us) log.cc:844] Serialized 41 byte log entry
0709 12:12:47.952198 (+   721us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.952288 (+    90us) write_op.cc:454] Released schema lock
0709 12:12:47.952336 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:47.952735 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.975652 (+ 22917us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":5794,"apply.run_wall_time_us":6346,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12576,"num_ops":3,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":2654,"prepare.run_wall_time_us":2686,"replication_time_us":2499}]]}
I20260709 12:12:48.105257 11039 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:48.139240 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet 255c201215d14e89bc735bb8b57682cb with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:51326
I20260709 12:12:48.179014  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.183970 18591 tablet_replica.cc:333] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
W20260709 12:12:48.249426 11041 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 258) took 37040 ms (client timeout 15000 ms). Trace:
I20260709 12:12:48.257768 18591 raft_consensus.cc:2243] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:48.256904 11041 rpcz_store.cc:269] 0709 12:12:11.208653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.208985 (+   332us) service_pool.cc:224] Handling call
0709 12:12:48.249175 (+37040190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173220,"reported_tablets":50}
I20260709 12:12:48.260171 18591 raft_consensus.cc:2272] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.305861 18591 ts_tablet_manager.cc:1916] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:48.351257 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 256) took 5364 ms. Trace:
I20260709 12:12:48.351752 11040 rpcz_store.cc:276] 0709 12:12:42.986256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.986433 (+   177us) service_pool.cc:224] Handling call
0709 12:12:43.193489 (+207056us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:12:48.351053 (+5157564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18032,"reported_tablets":50,"spinlock_wait_cycles":243307264}
I20260709 12:12:48.360634 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:48.361222 11215 raft_consensus.cc:606] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:48.385111 11861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:48.385854 11861 raft_consensus.cc:606] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:48.399936 11861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:48.409621 11861 raft_consensus.cc:606] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:48.414108 11855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:48.414856 11855 raft_consensus.cc:606] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:48.418246 11855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:12:48.419112 11855 raft_consensus.cc:606] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:48.420504  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:48.423506  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:48.424495  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.440852 18591 ts_tablet_manager.cc:1929] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.17
I20260709 12:12:48.441643 18591 log.cc:1199] T 255c201215d14e89bc735bb8b57682cb P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/255c201215d14e89bc735bb8b57682cb
I20260709 12:12:48.445271 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet 255c201215d14e89bc735bb8b57682cb (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:12:48.482865 18588 raft_consensus.cc:993] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:48.483455 18588 raft_consensus.cc:1081] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:48.486336 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:12:48.486964 11136 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.487323 11136 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.505524 11136 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.516252 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:48.516943 11215 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.518601 18543 raft_consensus.cc:993] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:48.519131 18543 raft_consensus.cc:1081] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:48.521039 11293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:49838
I20260709 12:12:48.521598 11293 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.521968 11293 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.518932 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:48.522804 11861 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:48.523145 11861 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:48.524021 11861 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.525233 11861 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.536933 11215 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:48.539590 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:48.540678 18587 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:48.541203 18587 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:48.516686 11136 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:48.542200 18587 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.545579 11861 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:48.597816 18594 raft_consensus.cc:993] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:48.598604 18592 raft_consensus.cc:1081] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:48.600315 11292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:48.600880 11292 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.601212 11292 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.616842 11292 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:48.610644 11293 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.622174 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:48.622833 11136 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.625181 11292 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:48.626305 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:48.626567 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:48.626997 11213 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:48.627068 11135 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.627390 11213 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:48.629833 11213 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:48.634114 11213 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.634444 11040 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 22 to 23, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 23 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.640275 11293 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:48.643638 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:48.644326 11861 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:48.644584 11861 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:48.648116 11861 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.658609 11136 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:48.695182 11861 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.696055 18559 raft_consensus.cc:993] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:48.696641 18588 raft_consensus.cc:1081] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:48.698501 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:48.699420 18346 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:48.699913 18346 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:48.700783 18346 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.705852 11135 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:48.721303 11861 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:48.722126 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:48.727536 11213 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:48.728195 11292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:49838
I20260709 12:12:48.728900 11292 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.729270 11292 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.738538 18346 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:48.742012 18346 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:48.743422 18346 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:48.750186 11041 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 22 to 23, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 23 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.780586 18588 raft_consensus.cc:993] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:48.781212 18588 raft_consensus.cc:1081] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:48.806247 11292 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.807822 11142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:12:48.808557 11142 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.808940 11142 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.810091 11292 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:48.810333 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:48.811034 11861 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:48.811362 11861 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:48.812288 11861 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.813547 11861 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.819936 11142 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.871877 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:48.872836 11215 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.875726 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:48.876654 11855 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:48.877038 11855 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:12:48.877837 11855 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.879323 11855 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.876555 11142 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:48.893944 11855 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:48.896202 11041 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 23 to 24, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.897998 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:48.899318 18587 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.899806 18587 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:48.900707 18587 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.926187 11215 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:12:48.823249 11861 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:48.839272 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:48.941617 11213 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.942422 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:48.943691 18346 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:48.944217 18346 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:48.950656 11213 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:48.951153 18346 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:48.942094 11041 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 18 to 19, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 19 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.011102 11041 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 21 to 22, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.034772 11215 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:49.036298 18585 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:12:49.096989 11861 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:12:49.098989 18587 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:12:49.126403 11855 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 12:12:49.130761 18608 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:12:49.270680 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55637us
W20260709 12:12:49.271027 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88858.6us
I20260709 12:12:49.300278 11142 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 12:12:49.318063 18432 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:12:49.371062 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63338us
W20260709 12:12:49.404755 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 138530us
I20260709 12:12:49.411845 11213 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:49.415082 18621 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:49.429551 11213 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:49.440953 11861 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
W20260709 12:12:49.446146 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 539267f9f49c4c16b3ec8b1c92be6d29: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:12:49.479498 18608 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:12:49.486992 11213 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:49.506520 11855 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:49.517047 11219 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 12:12:49.520833 18615 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:12:49.553319 18585 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:49.530987 18621 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 12:12:49.611475 11291 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:49.639070  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:49.640214 17895 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:49.680346 11142 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:49.681324 11140 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:49.704612 18558 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:49.710841 18624 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:49.763482 11182 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75d2c70008a4d06a2db7185a2b623e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.791849 11211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:49.792619 11211 raft_consensus.cc:606] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:49.807717 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:49.808367 11213 raft_consensus.cc:606] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:49.815124 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:49.815879 11213 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:49.833793 18558 raft_consensus.cc:993] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:49.834688 18622 raft_consensus.cc:1081] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:49.820226 18592 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:49.843832 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:49.843432 11136 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:49.844448 11213 raft_consensus.cc:606] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:49.854233 11213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:49.856143 11213 raft_consensus.cc:606] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:49.858984  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:49.861735  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:49.863214  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:49.878872 11291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:49.879633 11291 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:49.880060 11291 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.886379 11288 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:49.923635 11213 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:49.959846 11291 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:49.963546 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:49.964184 11135 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.966437 11291 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:49.987905 18558 raft_consensus.cc:993] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:49.988926 11135 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:49.998117 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:49.999361 18632 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:50.000142 18632 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:50.001133 18632 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:49.988494 11041 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:49.989742 18558 raft_consensus.cc:1081] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:49.990206 18593 raft_consensus.cc:993] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:50.005031 18593 raft_consensus.cc:1081] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:49.994016 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:50.006136 11215 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:50.006431 11215 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:50.007215 11215 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.008466 11215 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.004338 17895 raft_consensus.cc:993] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:50.012872 11291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:50.017100 11291 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.017714 11291 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.027151 17895 raft_consensus.cc:1081] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:50.032889 11135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:50.033495 11135 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.033887 11135 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.036156 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:50.036712 11136 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.037056 11136 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.048476 11215 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:50.053521 18593 raft_consensus.cc:993] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:50.054049 18550 raft_consensus.cc:1081] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:50.058472 11287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:50.059134 11287 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.059464 11287 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:50.067606 11291 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.078648 11136 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.108983 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:50.109639 11213 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:50.109665 11288 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:50.084830 11135 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.111720 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:50.112305 11219 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:50.109694 11291 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:50.112669 11219 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:50.112798 11136 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:50.110148 11213 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:50.110666 11287 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.119282 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:50.120620 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:50.121683 11291 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.122360 11142 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.122761 11287 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:50.122396 11135 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:50.125597 18639 ts_tablet_manager.cc:933] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:50.118711 18592 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:50.133226 11142 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:50.118606 11219 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.135484 11219 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.119355 11213 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.152366 11141 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:50.153489 11219 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:50.134543 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:50.155764 11286 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.154878 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:50.157080 11182 consensus_peers.cc:597] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25bbe9f3cd6e42aca82fdba9812b235c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.158694 18632 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:50.159235 18632 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:50.160063 18632 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.157469 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:50.167572 11213 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.169173 11142 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:50.165349 11135 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:50.204100 11135 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:12:50.205906 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:12:50.211584 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 99738.9us
I20260709 12:12:50.214254 18624 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:50.214929 18624 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:50.215975 18624 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.249475 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:50.177699 18594 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:12:50.256947 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:50.257318 18606 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:50.257787 11219 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:50.258255 11219 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:50.259087 11219 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.311067 11213 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:12:50.341928 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:12:50.374051 18638 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:12:50.392910 11213 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:50.393325 11213 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:50.394065 11219 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:50.384649 11286 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:50.395380 11288 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:50.396703 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:50.408108 11219 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:12:50.417856 11213 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.420913 11291 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:50.437322 11213 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.412464 18614 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:50.404651 18639 tablet_copy_client.cc:323] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:12:50.507174 18614 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:50.508312 18614 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:50.525074 11213 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
W20260709 12:12:50.550873 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 134893us
W20260709 12:12:50.551566 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 133370us
I20260709 12:12:50.552939 18606 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:50.684693 18606 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:50.689781 18640 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.403s	user 0.004s	sys 0.000s
W20260709 12:12:50.730728 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 110714us
I20260709 12:12:50.767452 11136 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:12:50.768004 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133102us
I20260709 12:12:50.786603 18616 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:50.797065 18661 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:50.801919 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:50.803756 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58714.4us
I20260709 12:12:50.823076 11219 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:50.823335 11213 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:50.831000 11141 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:12:50.866875 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet c75d2c70008a4d06a2db7185a2b623e2 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:12:50.867599 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet c75d2c70008a4d06a2db7185a2b623e2 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-c75d2c70008a4d06a2db7185a2b623e2
W20260709 12:12:50.884972 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46704us
I20260709 12:12:50.851110 18660 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:12:50.887298 18670 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:12:50.887584 18648 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:12:50.926542 11141 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:50.937177 18678 ts_tablet_manager.cc:933] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:50.939122 11229 tablet_copy_source_session.cc:215] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:50.947443 18639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75d2c70008a4d06a2db7185a2b623e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.976856 18678 tablet_copy_client.cc:323] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:12:51.007256 11141 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:51.007786 11287 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:51.008786 18346 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:51.012513 18664 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:51.015749 11287 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:51.022604 11229 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet 25bbe9f3cd6e42aca82fdba9812b235c from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:12:51.023348 11229 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet 25bbe9f3cd6e42aca82fdba9812b235c from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-25bbe9f3cd6e42aca82fdba9812b235c
I20260709 12:12:51.033691 11215 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:51.080494 18671 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:51.098026  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.103801 11216 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:12:51.116753 11286 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:51.141191 11229 tablet_copy_source_session.cc:215] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:51.182695 18678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bbe9f3cd6e42aca82fdba9812b235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:51.201589 18673 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 12:12:51.237582 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 269) took 1263 ms. Trace:
I20260709 12:12:51.241755 11036 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 270) took 1263 ms. Trace:
I20260709 12:12:51.264083 11036 rpcz_store.cc:276] 0709 12:12:49.978721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.978906 (+   185us) service_pool.cc:224] Handling call
0709 12:12:51.241682 (+1262776us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6995,"reported_tablets":2}
I20260709 12:12:51.242295 11041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 264) took 1281 ms. Trace:
I20260709 12:12:51.272692 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37092 (request call id 1529) took 1300 ms. Trace:
I20260709 12:12:51.273218 18639 rpcz_store.cc:276] 0709 12:12:49.972504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.972670 (+   166us) service_pool.cc:224] Handling call
0709 12:12:50.125945 (+153275us) ts_tablet_manager.cc:934] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
0709 12:12:50.945809 (+819864us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:51.141901 (+196092us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:51.142025 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:51.271773 (+129748us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:51.272148 (+   375us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:51.272542 (+   394us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:51.272612 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":190218,"tablet-copy.queue_time_us":152187,"thread_start_us":216104,"threads_started":2}
I20260709 12:12:51.238030 11042 rpcz_store.cc:276] 0709 12:12:49.974066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.978454 (+  4388us) service_pool.cc:224] Handling call
0709 12:12:51.237511 (+1259057us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7249,"reported_tablets":1}
W20260709 12:12:51.279810 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85104.7us
I20260709 12:12:51.298419 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:51.299235 11216 raft_consensus.cc:606] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:51.271544 11041 rpcz_store.cc:276] 0709 12:12:49.960694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.960840 (+   146us) service_pool.cc:224] Handling call
0709 12:12:51.234470 (+1273630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:50.148368 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:50.156062 (+  7694us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:50.156109 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:12:50.156129 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:50.158079 (+  1950us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:50.158144 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:50.158190 (+    46us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:50.158423 (+   233us) tablet.cc:701] Row locks acquired
0709 12:12:50.158444 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:50.158646 (+   202us) write_op.cc:270] Start()
0709 12:12:50.158772 (+   126us) write_op.cc:276] Timestamp: P: 1783599170158585 usec, L: 0
0709 12:12:50.158796 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:12:50.159583 (+   787us) log.cc:844] Serialized 599 byte log entry
0709 12:12:50.902039 (+742456us) op_driver.cc:464] REPLICATION: finished
0709 12:12:50.961790 (+ 59751us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f9834511ef0
0709 12:12:51.107924 (+146134us) write_op.cc:301] APPLY: starting
0709 12:12:51.108019 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:51.218786 (+110767us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:51.219434 (+   648us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:51.220329 (+   895us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:51.220536 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:51.220584 (+    48us) write_op.cc:312] APPLY: finished
0709 12:12:51.220790 (+   206us) log.cc:844] Serialized 25 byte log entry
0709 12:12:51.225961 (+  5171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:51.226050 (+    89us) write_op.cc:454] Released schema lock
0709 12:12:51.226091 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:51.226557 (+   466us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:51.226590 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":197853,"apply.run_cpu_time_us":4089,"apply.run_wall_time_us":118591,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8319,"num_ops":1,"prepare.queue_time_us":139691,"prepare.run_cpu_time_us":37183,"prepare.run_wall_time_us":246388,"raft.queue_time_us":464503,"raft.run_cpu_time_us":31898,"raft.run_wall_time_us":206706,"replication_time_us":729077,"spinlock_wait_cycles":2923776,"thread_start_us":703544,"threads_started":4,"wal-append.queue_time_us":231174}]]}
I20260709 12:12:51.343443 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "809626de5a674cba911a83815f1e05ca"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:51.344134 11219 raft_consensus.cc:606] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:51.353674 18639 tablet_copy_client.cc:806] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:51.354641 18639 tablet_copy_client.cc:670] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:51.359237 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:51.359875 11216 raft_consensus.cc:606] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:51.369789 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:51.370442 11216 raft_consensus.cc:606] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:51.375312 11143 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:12:51.384991 11256 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc7de5348ade43f196ccf4a393cc5bb8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.386363 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:51.387094 11216 raft_consensus.cc:606] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:51.388463  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:51.389678 11292 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:51.390630  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:51.391166 18678 tablet_copy_client.cc:806] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:51.391793  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.391880 18678 tablet_copy_client.cc:670] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:51.407388 11041 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 11, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.415730 11041 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 21 to 22, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:51.432224 11041 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 20, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 20 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:51.438665 18624 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:51.434638 11041 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 22 to 23, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 23 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:51.430438 18615 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:51.529217 11210 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:51.534126 18594 raft_consensus.cc:993] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:51.534786 18594 raft_consensus.cc:1081] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:51.543129 11212 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:51.545433 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:51.546056 11141 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.546408 11141 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.561726 11141 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:51.568040 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65599.3us
I20260709 12:12:51.572475 18616 raft_consensus.cc:993] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:51.572973 18616 raft_consensus.cc:1081] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:51.592494 11284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:51.593129 11284 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.593451 11284 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:51.574455 18346 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:51.595639 18671 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:51.612443 11141 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:51.613684 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:51.614598 11861 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.690609 18678 tablet_copy_client.cc:538] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:51.702960 18639 tablet_copy_client.cc:538] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:51.715806 18620 raft_consensus.cc:993] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:51.819681 11861 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
W20260709 12:12:51.859232 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 247540us
I20260709 12:12:51.859479 11284 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:51.861375 18620 raft_consensus.cc:1081] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:51.872484 18662 raft_consensus.cc:993] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:51.900293 11284 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:51.903568 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:51.904560 11291 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:51.908699 11141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:51.909583 11141 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.910017 11141 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.924136 11136 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:51.928227 18672 raft_consensus.cc:1081] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:51.928603 18662 raft_consensus.cc:993] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:51.929152 18662 raft_consensus.cc:1081] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:51.932159 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:12:51.945612 11141 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:52.004246 11141 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:52.008386 11136 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:51.957404 18606 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:52.028303 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97496us
W20260709 12:12:52.042918 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 90683us
I20260709 12:12:52.037989 18606 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:12:52.089427 18703 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 12:12:52.110425 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 165652us
W20260709 12:12:52.110885 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 160978us
I20260709 12:12:52.081540 18606 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:52.230979 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:52.231914 11215 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:52.232293 11215 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:52.233201 11215 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:52.234344 11215 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:52.240141 11284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:52.240823 11284 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:52.241219 11284 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:52.235316 18705 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 12:12:52.230562 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:52.251717 11289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "809626de5a674cba911a83815f1e05ca"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:52.271071 11210 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:52.271373 11289 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:52.272006 11289 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:52.255685 18660 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:52.261742 18678 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:12:52.266981 11136 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:52.267804 18722 ts_tablet_manager.cc:933] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:52.269798 11861 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:52.271420 11210 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:12:52.316007 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 95568.6us
I20260709 12:12:52.307494 11210 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:52.318261 11210 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.299563 11284 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:52.320669 11215 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:12:52.354219 11144 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:52.362221 18639 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:12:52.364059 11284 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:52.377987 11210 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:52.368279 11289 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:12:52.318708 18713 consensus_queue.cc:1175] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2b4f4725b82b481ab53f0717a429e94a" responder_term: 21 status { last_received { term: 20 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:52.371945 18716 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:52.383984 18716 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:52.384328 11289 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:12:52.384600 18716 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:52.365724 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:52.387346 11144 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.392501 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:52.393260 11135 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:52.418774 11135 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:12:52.426532 11289 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: []
W20260709 12:12:52.440281 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 120641us
I20260709 12:12:52.434656 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:52.501423 11042 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 25 to 26, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 26 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:12:52.516394 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.443197 11210 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:52.532898 11042 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 22 to 23, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 23 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:52.488390 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 46755.8us
W20260709 12:12:52.541060 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 106553us
I20260709 12:12:52.544064 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:52.545017 11212 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:12:52.545420 11212 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:52.517449  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:52.556608 11138 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:52.559805 11144 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:52.563344 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:52.564114 11215 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:52.564489 11215 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:52.565457 11215 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:52.590703 18726 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
W20260709 12:12:52.590277 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48396.9us
I20260709 12:12:52.604198 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:52.605027 11289 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.502876 18722 tablet_copy_client.cc:323] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:12:52.602883 18670 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:52.635682 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74948.5us
I20260709 12:12:52.420930 18716 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:52.644731 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.647110 11288 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:52.652933 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91249.2us
I20260709 12:12:52.663331 11289 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:52.695739 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:52.660633 18670 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:52.650602 18660 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46840 (request call id 7) took 1538 ms. Trace:
I20260709 12:12:52.720180 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet bc7de5348ade43f196ccf4a393cc5bb8 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:12:52.732893 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet bc7de5348ade43f196ccf4a393cc5bb8 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-bc7de5348ade43f196ccf4a393cc5bb8
I20260709 12:12:52.714092 11212 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:52.736267 11212 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:52.734539 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:52.742578 11258 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:52.743649 18646 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:12:52.744220 18646 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:52.744472 18721 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:52.745016 18721 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:52.745149 18646 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:52.745905 18721 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:52.774775 11212 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
W20260709 12:12:52.783118 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 51962.6us
W20260709 12:12:52.786675 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52825us
W20260709 12:12:52.799166 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50676.6us
I20260709 12:12:52.800362 18672 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:52.796082 18717 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
I20260709 12:12:52.772810 18716 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.814133 11135 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: []
I20260709 12:12:52.826297 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:52.827175 11210 raft_consensus.cc:606] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:52.834753 11135 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:52.836350 11215 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.734377 18660 rpcz_store.cc:276] 0709 12:12:51.112581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.114336 (+  1755us) service_pool.cc:224] Handling call
0709 12:12:51.155006 (+ 40670us) log.cc:844] Serialized 506 byte log entry
0709 12:12:52.650444 (+1495438us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":230,"mutex_wait_us":7632,"raft.queue_time_us":9331,"raft.run_cpu_time_us":2013,"raft.run_wall_time_us":10561,"thread_start_us":159328,"threads_started":1,"wal-append.queue_time_us":191172,"wal-append.run_cpu_time_us":1849,"wal-append.run_wall_time_us":1001859}
I20260709 12:12:52.844841 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:52.848398 11303 tablet_copy_source_session.cc:215] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:52.852237 18722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7de5348ade43f196ccf4a393cc5bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:52.861600 11135 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:52.871291 11215 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:52.879818 11216 raft_consensus.cc:606] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:52.880311 11216 raft_consensus.cc:614] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:52.878168 18670 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:52.887759 11859 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:52.956022 18717 raft_consensus.cc:993] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:52.962211 11216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:52.962893 11216 raft_consensus.cc:606] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:12:52.963495 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49643.2us
I20260709 12:12:53.002739 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:53.003448 11215 raft_consensus.cc:606] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:53.009449 11219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:53.010076 11219 raft_consensus.cc:606] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:53.002465 18717 raft_consensus.cc:1081] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:53.012662  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:12:53.019325 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 46857.3us
W20260709 12:12:53.021903 18678 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:53.027037  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:53.027803 18751 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:53.030227 11144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:53.030805 11144 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:53.031172 11144 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.034909 11214 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:53.035737 18726 raft_consensus.cc:993] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:53.039471 18717 raft_consensus.cc:1081] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
W20260709 12:12:53.038136 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 146567us
I20260709 12:12:53.045737 11135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:53.046362 11135 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:53.046962 11135 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:53.053252 11144 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.066896 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:53.069603 11135 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.075732 11144 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:53.077219 18751 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:53.080123 18751 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:53.081121 18751 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.100868 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 265) took 1663 ms. Trace:
I20260709 12:12:53.095137  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.103535 11135 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:53.116001 18717 raft_consensus.cc:993] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:53.101317 11042 rpcz_store.cc:276] 0709 12:12:51.437585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.437771 (+   186us) service_pool.cc:224] Handling call
0709 12:12:53.100802 (+1663031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:52.723085 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:52.723643 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:52.723676 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:12:52.723698 (+    22us) tablet.cc:662] Decoding operations
0709 12:12:52.724149 (+   451us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:52.724205 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:52.724232 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:52.724543 (+   311us) tablet.cc:701] Row locks acquired
0709 12:12:52.724556 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:12:52.724714 (+   158us) write_op.cc:270] Start()
0709 12:12:52.724834 (+   120us) write_op.cc:276] Timestamp: P: 1783599172724661 usec, L: 0
0709 12:12:52.724857 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:52.725497 (+   640us) log.cc:844] Serialized 929 byte log entry
0709 12:12:53.014914 (+289417us) op_driver.cc:464] REPLICATION: finished
0709 12:12:53.076459 (+ 61545us) write_op.cc:301] APPLY: starting
0709 12:12:53.076544 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:53.078446 (+  1902us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:53.078557 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:53.079721 (+  1164us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:53.079993 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:53.080050 (+    57us) write_op.cc:312] APPLY: finished
0709 12:12:53.080235 (+   185us) log.cc:844] Serialized 33 byte log entry
0709 12:12:53.086732 (+  6497us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:53.086842 (+   110us) write_op.cc:454] Released schema lock
0709 12:12:53.086890 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":12,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":61295,"apply.run_cpu_time_us":4254,"apply.run_wall_time_us":10799,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12511,"num_ops":2,"prepare.queue_time_us":181141,"prepare.run_cpu_time_us":2728,"prepare.run_wall_time_us":8210,"replication_time_us":289887,"thread_start_us":181676,"threads_started":2}]]}
I20260709 12:12:53.116475 18717 raft_consensus.cc:1081] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:53.124858 18722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37100 (request call id 1379) took 1077 ms. Trace:
I20260709 12:12:53.125319 18722 rpcz_store.cc:276] 0709 12:12:52.047543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.047731 (+   188us) service_pool.cc:224] Handling call
0709 12:12:52.279195 (+231464us) ts_tablet_manager.cc:934] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
0709 12:12:52.850905 (+571710us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:53.016265 (+165360us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:53.016517 (+   252us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:53.124102 (+107585us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:53.124391 (+   289us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:53.124738 (+   347us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:53.124796 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":80262,"tablet-copy.queue_time_us":163264,"thread_start_us":205032,"threads_started":2}
I20260709 12:12:53.126657 18722 tablet_copy_client.cc:806] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:53.127193 18722 tablet_copy_client.cc:670] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:53.135848 11036 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 270) took 1643 ms. Trace:
I20260709 12:12:53.136747 18722 tablet_copy_client.cc:538] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:53.148415 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:53.141479 11135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:53.149062 11289 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.149255 11135 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:53.149789 11135 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.146912 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:53.150784 11216 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:53.151077 11216 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:53.151786 11216 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.153297 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:53.153847 11215 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:53.154165 11215 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:53.155611 11215 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.156833 11215 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:53.157810 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:53.158463 11287 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:53.165167 11215 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:53.177983 11289 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:53.146869 11036 rpcz_store.cc:276] 0709 12:12:51.492541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.494987 (+  2446us) service_pool.cc:224] Handling call
0709 12:12:53.135786 (+1640799us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2434,"reported_tablets":8}
I20260709 12:12:53.184852 11216 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.186857 11287 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:12:53.180461 11135 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.197748 11135 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:53.192580 11216 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:12:53.178340 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:53.200614 18751 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:53.201116 18751 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:53.202020 18751 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.205543 11040 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:12:53.209344 11042 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 20 to 21, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:53.220470 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:53.221089 11291 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.231525 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:53.249109 11216 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:53.252708 11291 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:53.253441 11039 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 20 to 21, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.258708 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:53.259378 11216 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:53.259704 11216 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:53.261205 11216 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.254882 18711 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:53.256213 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:53.278194 11216 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.287839 11216 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:12:53.276587 18711 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:53.299181 18664 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:53.319674 18664 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:53.320595 18664 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.303717 18606 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:12:53.328014 11216 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:12:53.374344 11256 consensus_peers.cc:597] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.378628 18711 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.332993 18744 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:12:53.399996 11214 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260709 12:12:53.400095 18755 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:12:53.405869 18639 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:53.417922 11216 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:53.419481 18639 tablet_bootstrap.cc:492] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:12:53.420341 18639 ts_tablet_manager.cc:1403] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 1.058s	user 0.041s	sys 0.020s
I20260709 12:12:53.422235 11135 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:12:53.450166 18673 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:53.452052 11144 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:53.460626 11138 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:53.464972 18722 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:12:53.465045 11040 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 20 to 21, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:53.467257 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 43624.8us
I20260709 12:12:53.467715 18660 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:53.467795 11040 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 23 to 24, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:53.469897 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45544.8us
I20260709 12:12:53.472661 11040 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 26 to 27, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 27 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:53.481257 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 56521.2us
I20260709 12:12:53.481379 18678 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:53.477512 18719 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:53.495220 18721 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:12:53.617103 18678 tablet_bootstrap.cc:492] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:12:53.590870 18714 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
W20260709 12:12:53.646281 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 156897us
I20260709 12:12:53.687520 18639 raft_consensus.cc:359] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:53.688681 18639 raft_consensus.cc:740] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:12:53.689427 18639 consensus_queue.cc:260] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:53.698423 18720 raft_consensus.cc:993] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:53.699225 18678 ts_tablet_manager.cc:1403] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 1.438s	user 0.051s	sys 0.028s
I20260709 12:12:53.699900 18751 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.759557 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 167328us
W20260709 12:12:53.799854 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58193.6us
I20260709 12:12:53.763365 18751 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:53.822460 18726 raft_consensus.cc:1081] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:53.880602 18639 ts_tablet_manager.cc:1434] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.460s	user 0.006s	sys 0.005s
I20260709 12:12:53.923626 11860 raft_consensus.cc:1217] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 12:12:53.927367 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 126679us
W20260709 12:12:54.083206 18761 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.451s	user 0.003s	sys 0.004s
I20260709 12:12:54.083789 18722 tablet_bootstrap.cc:700] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent opening tablet: real 0.113s	user 0.002s	sys 0.000s
W20260709 12:12:54.178072 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 251300us
I20260709 12:12:54.120887 11293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:54.302453 11293 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.302901 11293 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.295214 18550 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:54.340220 11293 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.191463 18788 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:54.006368 18751 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:54.325956 18726 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:54.365164 11293 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:54.382633 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:54.383253 11219 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:54.383536 11219 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:54.384224 11219 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.385033 11219 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:53.997232 18678 raft_consensus.cc:359] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:54.404687 11289 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:12:54.406034 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.399760 18726 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:54.412784 18726 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:54.406688 18678 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:12:54.350930 18550 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.414911 18678 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:54.416818 18550 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:54.418953 18678 ts_tablet_manager.cc:1434] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.663s	user 0.030s	sys 0.011s
W20260709 12:12:54.419348 18678 ts_tablet_manager.cc:1467] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Tablet startup took 670ms
I20260709 12:12:54.420122 11860 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEARNER]: Advancing to term 21
I20260709 12:12:54.410311 11289 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:54.428947 11219 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:54.431201 11293 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:54.371201 18788 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.440986 18742 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:54.474205 18788 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:54.478052 11228 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-c75d2c70008a4d06a2db7185a2b623e2 received from {username='slave'} at 127.0.0.1:44734
I20260709 12:12:54.478765 11228 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-c75d2c70008a4d06a2db7185a2b623e2 on tablet c75d2c70008a4d06a2db7185a2b623e2 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:54.449105 18742 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.483166 18742 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:54.501683 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:54.503067 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:54.504323 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:54.507534 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63885.9us
I20260709 12:12:54.514994 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:54.518952 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:54.519732 11288 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:54.524493 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:54.521095 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:54.531283 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77658us
I20260709 12:12:54.530759 18646 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.536332 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:54.536762 18646 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.539141 18646 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:54.539942 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:54.542290 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:12:54.419679 18678 ts_tablet_manager.cc:1469] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Trace:
0709 12:12:50.743379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.743583 (+   204us) service_pool.cc:224] Handling call
0709 12:12:50.937586 (+194003us) ts_tablet_manager.cc:934] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
0709 12:12:51.181392 (+243806us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:51.311216 (+129824us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:51.311391 (+   175us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:51.374545 (+ 63154us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:51.374881 (+   336us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:51.375241 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:51.375317 (+    76us) inbound_call.cc:177] Queueing success response
0709 12:12:52.261117 (+885800us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:12:53.755990 (+1494873us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:12:53.778461 (+ 22471us) tablet_replica.cc:261] Starting instrumentation
0709 12:12:53.779350 (+   889us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":424,"mutex_wait_us":31346,"raft.queue_time_us":1517,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"tablet-copy.queue_time_us":140740,"tablet-download-pool.queue_time_us":810,"tablet-download-pool.run_cpu_time_us":2737,"tablet-download-pool.run_wall_time_us":297172,"thread_start_us":135751,"threads_started":2}
I20260709 12:12:54.544034 18744 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:54.544751 18744 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:54.545650 18744 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.547945 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 271) took 1313 ms. Trace:
I20260709 12:12:54.296082  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:54.556154 11219 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:54.561398 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:54.565155 11210 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:54.566998 11210 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:54.578991 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:54.591111 18726 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:54.599442 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64491.9us
I20260709 12:12:54.601512 18766 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:54.604049 18751 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:54.605959 18751 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:12:54.608454 18803 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:12:54.608659 18751 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:54.548341 11040 rpcz_store.cc:276] 0709 12:12:53.234622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.234810 (+   188us) service_pool.cc:224] Handling call
0709 12:12:54.547885 (+1313075us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:53.500453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:53.662106 (+161653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:53.669618 (+  7512us) write_op.cc:435] Acquired schema lock
0709 12:12:53.683296 (+ 13678us) tablet.cc:662] Decoding operations
0709 12:12:53.684003 (+   707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:53.684068 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:53.684096 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:53.684445 (+   349us) tablet.cc:701] Row locks acquired
0709 12:12:53.684463 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:53.684623 (+   160us) write_op.cc:270] Start()
0709 12:12:53.684754 (+   131us) write_op.cc:276] Timestamp: P: 1783599173684580 usec, L: 0
0709 12:12:53.684779 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:12:53.685618 (+   839us) log.cc:844] Serialized 1371 byte log entry
0709 12:12:53.690385 (+  4767us) op_driver.cc:464] REPLICATION: finished
0709 12:12:53.690886 (+   501us) write_op.cc:301] APPLY: starting
0709 12:12:53.690982 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:53.818775 (+127793us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:53.870625 (+ 51850us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:53.873123 (+  2498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:53.873338 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:53.873389 (+    51us) write_op.cc:312] APPLY: finished
0709 12:12:53.873657 (+   268us) log.cc:844] Serialized 41 byte log entry
0709 12:12:53.879461 (+  5804us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:53.879588 (+   127us) write_op.cc:454] Released schema lock
0709 12:12:53.879644 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:53.920676 (+ 41032us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:53.924838 (+  4162us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12625,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":7508,"apply.run_wall_time_us":191401,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12576,"num_ops":3,"prepare.queue_time_us":2105,"prepare.run_cpu_time_us":4029,"prepare.run_wall_time_us":189028,"replication_time_us":5446}]]}
I20260709 12:12:54.616176 18550 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.616745 18550 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:12:54.662400 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83456.2us
I20260709 12:12:54.667243 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:54.667896 11137 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.671417 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:54.672456 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 48876.3us
I20260709 12:12:54.674434 11185 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:54.665591 11041 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 22 to 23, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 23 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.677516 11041 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 19 to 20, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 20 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.680015 11041 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 12 to 13, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 13 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.681792 18805 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:54.712527 18735 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:54.777591 18651 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:12:54.792167 18744 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:54.792814 18744 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:12:54.798473 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 124109us
I20260709 12:12:54.799351 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:54.799531 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:54.803150 18788 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:54.803167 18789 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:54.802627 18550 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:54.808516 18789 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:54.810711 18789 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:54.817718 18798 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.818288 18798 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.818810 11228 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-25bbe9f3cd6e42aca82fdba9812b235c received from {username='slave'} at 127.0.0.1:44734
I20260709 12:12:54.819527 11228 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-25bbe9f3cd6e42aca82fdba9812b235c on tablet 25bbe9f3cd6e42aca82fdba9812b235c with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:54.820345 18798 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:54.821898 11137 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:12:54.822878 18550 raft_consensus.cc:1064] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:12:54.824188 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:54.829326 18742 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:54.829969 18742 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:54.832918 18742 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:54.835158 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:54.838855 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:54.795850 18735 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:54.848632 18735 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:54.776664 18805 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:54.855165 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:54.856503 18805 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:54.859604 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60339.6us
W20260709 12:12:54.862963 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63501.4us
I20260709 12:12:54.865038 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:54.866892 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:54.874927 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:54.875556 11214 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:12:54.879562 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:54.886611 18765 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:54.915377 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:54.915864 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:54.864779 18742 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:54.922742 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:54.923868 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:54.872171 18789 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:54.872408 18726 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:54.926021 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:54.894863 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:54.939306 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:54.940325 18714 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:54.940788 18714 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:54.941170 18714 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.929250 18744 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:54.965144 18714 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:54.893106 18766 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:54.893437 18751 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:12:54.923012 18798 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.971349 18550 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:54.984202 11214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:54.984984 11214 raft_consensus.cc:606] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Received request to transfer leadership to TS ba2779405e8d452e95f42421b2b60928
I20260709 12:12:55.013592 11210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:12:55.014236 11210 raft_consensus.cc:606] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:55.016917  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:55.020275  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:55.020977 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:55.021632 11210 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:55.022414 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 147988us
I20260709 12:12:55.019146 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:54.998090 18798 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:55.025141 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:55.032802 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:55.034094 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:55.058143 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:55.063002 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:55.066082 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:55.013134 18714 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:55.089212 18773 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:55.100939 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 93141.3us
I20260709 12:12:55.070441 18594 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:55.106895 18772 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:55.114892 11214 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:55.105432 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:55.132354  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:55.138585 11210 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:12:55.150942 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:55.158752 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:55.173118 18781 raft_consensus.cc:993] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:12:55.173722 18781 raft_consensus.cc:1081] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
W20260709 12:12:55.175415 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 54985.8us
I20260709 12:12:55.176920 18798 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:55.157372 18744 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:55.179617 18816 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:12:55.184319 11143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:12:55.184983 11143 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:55.185324 11143 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.188015 11141 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:55.191998 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:12:55.203660 11214 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:55.208531 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:55.213438 18714 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:55.214670 18735 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:55.216461 18815 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:12:55.203167 18651 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:12:55.148491 18717 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:55.252991 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:55.226037 11143 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:55.278052 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:55.291385 11143 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:55.299057 11219 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:12:55.283629 18714 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:55.276566 18660 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:55.326165 18738 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:55.335747 11141 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:55.343828 18594 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:55.388144 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103524us
I20260709 12:12:55.393664 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:55.394312 11215 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.394629 11215 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:55.395344 11215 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:55.396648 11215 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.393884 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:12:55.397353 11287 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.389122 18798 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:55.412837 11215 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:55.387339 18714 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:55.425093 11289 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:55.428377 18831 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:12:55.436256 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 142854us
I20260709 12:12:55.452747 11287 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:12:55.436990 18765 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:55.460000 18711 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:55.460460 18711 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:55.461297 18711 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:55.462662 18711 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:55.471278 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56898.8us
W20260709 12:12:55.473243 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 173045us
I20260709 12:12:55.487172 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:55.507519 18721 raft_consensus.cc:1064] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:12:55.517699 18812 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:55.518283 18812 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:12:55.526340 11860 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:55.535600 18798 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:55.536554 11289 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:55.548768 18787 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:55.559317 18788 raft_consensus.cc:993] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:55.559878 18788 raft_consensus.cc:1081] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Signalling peer ba2779405e8d452e95f42421b2b60928 to start an election
I20260709 12:12:55.567741 18721 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:55.571317 18722 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:55.576695 11287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
 from {username='slave'} at 127.0.0.1:45930
I20260709 12:12:55.577339 11287 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:55.577728 11287 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:55.580112 18812 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:55.592316 11287 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:55.593542 11856 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:55.596992 11212 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:55.606781 18773 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:55.607751 18722 tablet_bootstrap.cc:492] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:12:55.608649 18722 ts_tablet_manager.cc:1403] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 2.144s	user 0.049s	sys 0.035s
I20260709 12:12:55.643321 11287 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:55.746340 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103632us
I20260709 12:12:55.765342 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:12:55.766146 11215 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:55.766479 11215 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:12:55.767174 11215 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:55.636739 18735 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.120s
W20260709 12:12:55.760048 18810 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:12:55.786863 11215 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:55.798292 11041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 267) took 1328 ms. Trace:
I20260709 12:12:55.799675 11039 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 18 to 19, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 19 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.764241 18722 raft_consensus.cc:359] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:55.805123 18722 raft_consensus.cc:740] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:12:55.805984 18722 consensus_queue.cc:260] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:12:55.808079 18722 ts_tablet_manager.cc:1434] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.199s	user 0.008s	sys 0.000s
I20260709 12:12:55.801012 11041 rpcz_store.cc:276] 0709 12:12:54.470125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.470289 (+   164us) service_pool.cc:224] Handling call
0709 12:12:54.564586 (+ 94297us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:12:55.798210 (+1233624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:54.793404 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:54.794057 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:54.794097 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:12:54.794118 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:54.912757 (+118639us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:54.919894 (+  7137us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:54.924705 (+  4811us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:12:54.998573 (+ 73868us) tablet.cc:701] Row locks acquired
0709 12:12:55.001063 (+  2490us) write_op.cc:260] PREPARE: finished
0709 12:12:55.003148 (+  2085us) write_op.cc:270] Start()
0709 12:12:55.003647 (+   499us) write_op.cc:276] Timestamp: P: 1783599175002992 usec, L: 0
0709 12:12:55.003677 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:12:55.062765 (+ 59088us) log.cc:844] Serialized 1317 byte log entry
0709 12:12:55.418602 (+355837us) op_driver.cc:464] REPLICATION: finished
0709 12:12:55.534931 (+116329us) write_op.cc:301] APPLY: starting
0709 12:12:55.535021 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:55.616474 (+ 81453us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:55.616593 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:55.771570 (+154977us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:55.771812 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:12:55.771856 (+    44us) write_op.cc:312] APPLY: finished
0709 12:12:55.772077 (+   221us) log.cc:844] Serialized 41 byte log entry
0709 12:12:55.772261 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.772364 (+   103us) write_op.cc:454] Released schema lock
0709 12:12:55.772410 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:55.772858 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:55.772885 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38522,"reported_tablets":7,"spinlock_wait_cycles":28204416,"child_traces":[["op",{"apply.queue_time_us":114237,"apply.run_cpu_time_us":7140,"apply.run_wall_time_us":237916,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16703,"num_ops":3,"prepare.queue_time_us":41071,"prepare.run_cpu_time_us":12708,"prepare.run_wall_time_us":326310,"raft.queue_time_us":172112,"raft.run_cpu_time_us":1895,"raft.run_wall_time_us":89377,"replication_time_us":395521,"thread_start_us":187784,"threads_started":4,"wal-append.queue_time_us":56631}]]}
I20260709 12:12:55.812718 11141 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:55.825204 11215 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:12:55.844497 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:12:55.873098 18805 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:55.879173 18805 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:12:55.884234 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:12:55.884796 11861 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:55.906770 11860 raft_consensus.cc:1217] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 12:12:55.928881 11856 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:55.935881 11861 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:12:55.880247 18805 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:55.956614 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-bc7de5348ade43f196ccf4a393cc5bb8 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:12:55.957159 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-bc7de5348ade43f196ccf4a393cc5bb8 on tablet bc7de5348ade43f196ccf4a393cc5bb8 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:55.957567 18738 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 12:12:55.969853 18848 log.cc:927] Time spent T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:12:55.883426 18796 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:55.981943 11141 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.002588 11219 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:56.003614 18738 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.032541 18769 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:56.040493 11286 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.065788 11219 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.086107 11144 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:56.087484 11139 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.117830 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 272) took 1322 ms. Trace:
I20260709 12:12:56.120174 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 276) took 1278 ms. Trace:
I20260709 12:12:56.126684 11040 rpcz_store.cc:276] 0709 12:12:54.841450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.841640 (+   190us) service_pool.cc:224] Handling call
0709 12:12:56.120117 (+1278477us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4229,"reported_tablets":4}
I20260709 12:12:56.153215 11041 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 20 to 21, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.118287 11039 rpcz_store.cc:276] 0709 12:12:54.795028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.795285 (+   257us) service_pool.cc:224] Handling call
0709 12:12:56.117767 (+1322482us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:55.928272 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:55.982183 (+ 53911us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:55.987696 (+  5513us) write_op.cc:435] Acquired schema lock
0709 12:12:55.991212 (+  3516us) tablet.cc:662] Decoding operations
0709 12:12:56.008859 (+ 17647us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:56.008912 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:56.008947 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:56.009138 (+   191us) tablet.cc:701] Row locks acquired
0709 12:12:56.009154 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:12:56.009303 (+   149us) write_op.cc:270] Start()
0709 12:12:56.009415 (+   112us) write_op.cc:276] Timestamp: P: 1783599176009259 usec, L: 0
0709 12:12:56.009449 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:12:56.009993 (+   544us) log.cc:844] Serialized 541 byte log entry
0709 12:12:56.084972 (+ 74979us) op_driver.cc:464] REPLICATION: finished
0709 12:12:56.085304 (+   332us) write_op.cc:301] APPLY: starting
0709 12:12:56.085400 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:56.086337 (+   937us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:56.086426 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:56.091997 (+  5571us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:56.092158 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:56.092201 (+    43us) write_op.cc:312] APPLY: finished
0709 12:12:56.092391 (+   190us) log.cc:844] Serialized 25 byte log entry
0709 12:12:56.092550 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:56.092649 (+    99us) write_op.cc:454] Released schema lock
0709 12:12:56.092690 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":29727,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":2984,"apply.run_wall_time_us":7694,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4192,"num_ops":1,"prepare.queue_time_us":81329,"prepare.run_cpu_time_us":3089,"prepare.run_wall_time_us":95240,"replication_time_us":75343,"thread_start_us":65714,"threads_started":1}]]}
I20260709 12:12:56.173553 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 149) took 1277 ms. Trace:
I20260709 12:12:56.179025 11042 rpcz_store.cc:276] 0709 12:12:54.895983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.916154 (+ 20171us) service_pool.cc:224] Handling call
0709 12:12:56.173468 (+1257314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3498,"reported_tablets":2,"spinlock_wait_cycles":13568}
I20260709 12:12:56.192186 18744 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:56.217878 11856 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 11 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.244392 11039 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 11 to 12, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.246917 11039 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 11 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:56.249374 11039 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 21 to 22, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:12:56.282063 11215 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:56.309909 11286 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:56.354636 18836 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:56.360776 11040 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 25 to 26, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 26 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.407204 11216 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:12:56.483071 11289 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:56.423790 18744 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.050s
I20260709 12:12:56.436008 18766 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 12:12:56.507977 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 66607.3us
W20260709 12:12:56.594204 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 67409.6us
W20260709 12:12:56.601322 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 92331.3us
W20260709 12:12:56.659715 18859 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:56.676266 18773 raft_consensus.cc:1064] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:12:56.652168 11216 consensus_queue.cc:237] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:56.802534 18773 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:56.909005 11144 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:56.935977 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 117943us
I20260709 12:12:56.940371 11218 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:56.953933 18550 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:12:57.024282  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:57.074379 11861 raft_consensus.cc:1275] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:57.071612 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 130820us
W20260709 12:12:57.115085 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59281.8us
I20260709 12:12:57.128209 18594 consensus_queue.cc:1048] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.140136 11144 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:57.202131 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 165554us
W20260709 12:12:57.179538 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141917us
W20260709 12:12:57.268239 18859 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.003s
I20260709 12:12:57.277195 11861 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:12:57.283555 18891 log.cc:927] Time spent T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 12:12:57.144338 18867 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:57.302736 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54652.7us
I20260709 12:12:57.364498 11856 raft_consensus.cc:2955] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:57.392338 11860 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:12:57.411237 11139 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:12:57.412029 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 158051us
I20260709 12:12:57.432951 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c75d2c70008a4d06a2db7185a2b623e2 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:57.436893 18883 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:57.450554 18874 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:57.442610 11039 catalog_manager.cc:5697] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index 12 to 13, VOTER ba2779405e8d452e95f42421b2b60928 (127.9.180.131) evicted. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:57.485906 18884 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.515262 11213 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:57.521363 18773 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:12:57.537626 11856 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:57.542011 18883 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:57.542821 18883 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:57.570801 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:57.590620 18673 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:12:57.593042 18873 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.571965 18867 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:57.569078 18883 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:57.612706 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:57.618286 18867 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:57.621850 18867 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:57.623049 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:57.626199 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:57.627010 11139 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:12:57.667863 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:57.685216 11258 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:57.714890 18883 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:57.755755 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:57.778898 18883 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:57.790822 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:57.796903 11855 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:57.961017 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 107582us
W20260709 12:12:57.998431 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45922.1us
I20260709 12:12:57.995620 18883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51326 (request call id 1) took 1507 ms. Trace:
I20260709 12:12:58.023176 18893 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:58.103536 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 139959us
I20260709 12:12:58.032289 18883 rpcz_store.cc:276] 0709 12:12:56.473111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.475354 (+  2243us) service_pool.cc:224] Handling call
0709 12:12:56.708055 (+232701us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e3a0a 00007f982f3e3693 00007f982f3e3631 00007f9830b163f1 00007f9830a4f9fe 00007f9830ad6749 00007f9830ad776a 00007f9830ad691b 00007f9830ae203c 00007f9830ae16b3
0709 12:12:56.710121 (+  2066us) log.cc:844] Serialized 501 byte log entry
0709 12:12:57.961492 (+1251371us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1252,"raft.run_cpu_time_us":1098,"raft.run_wall_time_us":1098,"spinlock_wait_cycles":9872256}
I20260709 12:12:58.215509 11211 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:58.222316 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 114770us
I20260709 12:12:58.033984 18873 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:58.247505 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 138576us
I20260709 12:12:58.273752 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25bbe9f3cd6e42aca82fdba9812b235c with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:12:58.282357 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 78957.9us
W20260709 12:12:58.613579 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65625.1us
W20260709 12:12:58.796710 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 91568.3us
I20260709 12:12:58.824008 18864 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:58.824872 18864 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:58.851856 18852 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:58.888056 18852 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:58.944821 18920 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.020649 18920 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.043434 18864 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.064508 18893 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:59.071430 18923 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:59.073380 11277 tablet_service.cc:1558] Processing DeleteTablet for tablet c75d2c70008a4d06a2db7185a2b623e2 with delete_type TABLET_DATA_TOMBSTONED (TS ba2779405e8d452e95f42421b2b60928 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51326
I20260709 12:12:59.090655 18920 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.080132 18893 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.084692 18894 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:59.088647 18864 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:12:59.095595 18923 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.114449 18894 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.159770 18923 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.124130 18864 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.163122 18864 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.175113 18935 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.176025 18935 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.179375 18893 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:12:59.222126 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 75340.2us
I20260709 12:12:59.178372 18935 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:12:59.278940 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54468.6us
I20260709 12:12:59.284686 18934 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.285382 18934 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.287675 18934 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.288580 18943 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.289250 18943 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:12:59.291549 18943 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.292037 18943 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.292546 18943 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.296132 18943 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.299284 18942 tablet_replica.cc:333] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:12:59.305549 18894 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.318127 18920 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.318900 18920 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.321728 18920 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.327363 18942 raft_consensus.cc:2243] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:59.344965 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.356104 18938 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.357268 18938 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.356478 18942 raft_consensus.cc:2272] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:59.359773 18941 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:59.360486 18941 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.361204 18938 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.371474 18941 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.384708 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:12:59.382800 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 93749.1us
I20260709 12:12:59.386719 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.388396 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.388914 11144 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:12:59.394896 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.402148 18939 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.403057 18939 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.404583 18935 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.405148 18935 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.405794 18939 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.407392 18935 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.406728 11143 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:12:59.412374 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56910.9us
I20260709 12:12:59.419277 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:59.421998 18945 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:59.422650 18945 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.423015 18945 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:59.421365 11040 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:59.433709 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.434363 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.435096 11135 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:12:59.447012 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:59.448052 18893 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:59.448477 18893 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.448884 18893 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.453366 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.456208 18894 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.456831 18894 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.458664 18939 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.462560 18939 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.465382 18939 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.465827 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.459856 18940 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.468017 18940 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.468901 18894 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.470194 18940 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.472175 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.472433 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.473641 11135 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:12:59.465430 18852 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.476553 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:59.477958 18940 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:59.478380 18940 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.478801 18940 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.473583 18893 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.499110 18894 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.500981 18894 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.503767 18894 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.508052 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.512636 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.514530 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:12:59.515606 18945 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.535977 18936 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.536600 18936 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.538848 18936 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.540227 18945 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.517052 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.517735 18893 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.521798 18950 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.522686 18933 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:59.560464 18950 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.526872 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:59.530848 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:59.615000 11143 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.540791 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.516876 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.549145 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:59.519397 18940 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.555500 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:59.556366 18923 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.562942 18950 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.564536 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:12:59.565429 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:59.566120 18943 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.566699 18920 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.568246 18874 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:59.568681 18942 ts_tablet_manager.cc:1916] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:59.569005 18941 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.571863 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:59.628126 18941 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.576855 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 1868) took 1265 ms. Trace:
I20260709 12:12:59.589649 18864 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.590257 18946 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.635964 18946 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.595530 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.640038 18864 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.603200 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 274) took 1363 ms. Trace:
I20260709 12:12:59.642673 11039 rpcz_store.cc:276] 0709 12:12:58.240004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.250583 (+ 10579us) service_pool.cc:224] Handling call
0709 12:12:59.603081 (+1352498us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":16384}
I20260709 12:12:59.609959 18872 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.611188 18670 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.643941 18670 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.605842 18937 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.608095 11286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:12:59.646042 18937 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.612731 11858 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:59.646826 11286 raft_consensus.cc:606] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:59.643905 18872 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.648445 18937 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.649736 18872 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.650650 18943 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.652992 18940 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.653690 18920 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.646301 18670 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.655604 18670 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.655884 18920 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.656170 18670 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.623001 18923 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.650089 18874 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.658792 18938 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:59.659665 18938 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.662817 18938 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.664326 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.630664 11136 rpcz_store.cc:276] 0709 12:12:59.046575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.074461 (+ 27886us) service_pool.cc:224] Handling call
0709 12:12:59.074843 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:59.144774 (+ 69931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.144818 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:59.144877 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:59.144921 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.576407 (+431486us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b5400264b54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:12:59.576466 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:59.576646 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160278784}
I20260709 12:12:59.665512 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:12:59.669750 11139 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.619493 18933 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.658309 18670 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.685429 18933 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.692940 18940 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.638348 18946 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.694552 11139 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:12:59.642405 18864 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.650390 18872 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:12:59.673024 11826 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:12:59.669418 18874 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.720912 18894 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.730916 18894 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.707635 18941 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.722600 18872 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.722900 18947 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.712906 18893 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:12:59.734954 18947 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.723887 18940 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.693881 18923 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.777091 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.780457 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 281) took 1026 ms. Trace:
W20260709 12:12:59.724246 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51343.8us
I20260709 12:12:59.786032 11143 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:12:59.744140 18872 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.738045 18935 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.791517 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:12:59.771283 18933 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:12:59.793022 11041 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:12:59.764633 18939 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.742332 18934 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.735865 18945 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.748546 18942 ts_tablet_manager.cc:1929] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:12:59.740998 18943 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.734990 18893 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.818805 18917 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.819583 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.826438 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:12:59.958889 18872 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.088198 18872 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.936056 18935 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:12:59.791420 18947 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.090663 18872 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:12:59.960273 18940 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.085873 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:12:59.966392 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:00.107134 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:12:59.965844 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:12:59.837715 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 114624us
I20260709 12:13:00.091269 18934 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.113137 18935 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.131711 18973 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:00.135972 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:12:59.959198 18957 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.958662 18920 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:12:59.960801 18894 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:12:59.962718 18961 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.090896 18969 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.059466 18953 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.136956 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:00.153159 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.137409 18942 log.cc:1199] T c75d2c70008a4d06a2db7185a2b623e2 P ba2779405e8d452e95f42421b2b60928: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/wals/c75d2c70008a4d06a2db7185a2b623e2
I20260709 12:13:00.167464 11143 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:00.173611 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.164173 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.177894 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:00.182519 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45616.7us
I20260709 12:13:00.182540 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.185541 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.158465 18969 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.188205 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.188838 18968 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:00.189617 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.189848 18970 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.190456 18970 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:12:59.781028 11040 rpcz_store.cc:276] 0709 12:12:58.754512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.068044 (+313532us) service_pool.cc:224] Handling call
0709 12:12:59.780382 (+712338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:59.511435 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:59.512032 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:59.512069 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:12:59.512088 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:59.512439 (+   351us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:59.512516 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:59.512542 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:59.512739 (+   197us) tablet.cc:701] Row locks acquired
0709 12:12:59.512768 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:12:59.512921 (+   153us) write_op.cc:270] Start()
0709 12:12:59.534529 (+ 21608us) write_op.cc:276] Timestamp: P: 1783599179512869 usec, L: 0
0709 12:12:59.534570 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:12:59.535506 (+   936us) log.cc:844] Serialized 599 byte log entry
0709 12:12:59.569334 (+ 33828us) op_driver.cc:464] REPLICATION: finished
0709 12:12:59.732152 (+162818us) write_op.cc:301] APPLY: starting
0709 12:12:59.732243 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:59.733487 (+  1244us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:59.733584 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:59.734310 (+   726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:59.749517 (+ 15207us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad832a 00007f9830a5df14 00007f9830a5dec3 00007f9830a5de38 00007f9830a5ddf3 00007f9830a5d0dc 00007f9830a86e16 00007f9830a6ecbb 00007f9830a5939d 00007f9830a5cd75
0709 12:12:59.749590 (+    73us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:12:59.749687 (+    97us) write_op.cc:312] APPLY: finished
0709 12:12:59.749966 (+   279us) log.cc:844] Serialized 25 byte log entry
0709 12:12:59.750175 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:59.750253 (+    78us) write_op.cc:454] Released schema lock
0709 12:12:59.750298 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:59.750765 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:59.750790 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":144449,"apply.run_cpu_time_us":3574,"apply.run_wall_time_us":18609,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8319,"num_ops":1,"prepare.queue_time_us":65863,"prepare.run_cpu_time_us":3642,"prepare.run_wall_time_us":47488,"raft.queue_time_us":2284,"raft.run_cpu_time_us":12433,"raft.run_wall_time_us":191602,"replication_time_us":34571,"spinlock_wait_cycles":25218432,"thread_start_us":169129,"threads_started":4,"wal-append.queue_time_us":18113}]]}
I20260709 12:13:00.111832 18939 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:00.122931 18945 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.190201 18969 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.198084 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:00.195848 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88808us
I20260709 12:13:00.173941 18894 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.201578 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.202692 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:00.179768 18946 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.213313 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.213346 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.216805 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.168519 18920 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.218796 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.219879 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.220383 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.221844 18942 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51326 (request call id 2) took 1720 ms. Trace:
I20260709 12:13:00.223105 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.225063 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.219882 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.189667 18968 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.155285 18957 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.229936 18893 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.238303 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.161492 18953 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:00.241258 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.243314 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.207890 18940 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:00.211238 18969 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:13:00.263397 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62002.1us
I20260709 12:13:00.166617 18961 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:00.263943 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 92806.6us
I20260709 12:13:00.292264 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.293363 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.290894 18972 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:00.299171 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.214879 18894 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.237883 18947 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.304942 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.308465 18947 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:00.309119 18957 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:00.236757 18942 rpcz_store.cc:276] 0709 12:12:58.501151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.073063 (+571912us) service_pool.cc:224] Handling call
0709 12:12:59.266842 (+193779us) ts_tablet_manager.cc:1151] Deleting tablet c75d2c70008a4d06a2db7185a2b623e2
0709 12:12:59.298836 (+ 31994us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:12:59.641967 (+343131us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:59.748373 (+106406us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:00.221748 (+473375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209817,"tablet-delete.queue_time_us":62276,"thread_start_us":62330,"threads_started":1}
I20260709 12:13:00.317281 18968 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.300479 18940 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:00.320214 18940 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.306860 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.322654 18970 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.323513 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.323817 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.324658 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.363271 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:00.306955 18969 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:00.384863 18969 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.393429 18939 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.393479 18953 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.395665 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:00.246851 18946 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.404531 11029 catalog_manager.cc:5028] TS ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): tablet c75d2c70008a4d06a2db7185a2b623e2 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
W20260709 12:13:00.405884 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 211108us
W20260709 12:13:00.406463 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 109173us
I20260709 12:13:00.413539 11182 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:00.416589 18920 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:00.554800 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:00.530388 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 122657us
I20260709 12:13:00.652160 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:00.550944 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:00.529947 11135 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
W20260709 12:13:00.479013 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65586.6us
W20260709 12:13:00.660949 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 114565us
W20260709 12:13:00.552676 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5860 after lost signal to thread 9941
W20260709 12:13:00.694080 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2d80 after lost signal to thread 11076
I20260709 12:13:00.420863 18970 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:00.697539 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08000afe60 after lost signal to thread 11243
W20260709 12:13:00.742274 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08000afe80 after lost signal to thread 11244
W20260709 12:13:00.745072 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08003fbaa0 after lost signal to thread 11317
W20260709 12:13:00.753350 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08002aedc0 after lost signal to thread 11318
W20260709 12:13:00.754051 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 81877.2us
W20260709 12:13:00.754657 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7320 after lost signal to thread 11885
W20260709 12:13:00.755223 11314 debug-util.cc:398] Leaking SignalData structure 0x7b0800347580 after lost signal to thread 11886
I20260709 12:13:00.673981 18961 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:00.758536 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.759114 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.761046 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.620620 18939 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:00.754828 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 85922.7us
I20260709 12:13:00.777917 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:00.550563 18934 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.552163 18946 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:00.770326 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 94122.5us
I20260709 12:13:00.836669 18970 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:00.839941 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 62460.3us
I20260709 12:13:00.847528 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.847882 18979 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.848809 18979 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:00.858667 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 163586us
W20260709 12:13:00.867969 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 112125us
I20260709 12:13:00.842814 18946 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:00.874375 18987 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:00.893862 18946 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.928187 18935 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.947399 18935 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.949080 18946 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.949955 18985 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:00.950224 18950 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.929051 18979 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.929772 18995 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:00.931568 18944 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.932420 18962 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:00.935042 18978 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.923189 18966 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:00.941265 18976 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:00.941926 18670 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:00.915364 18981 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:00.978664 18966 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:00.979246 18981 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:00.981067 18966 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:00.981513 18981 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:00.956773 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55989us
I20260709 12:13:00.981928 18978 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.983611 11140 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:00.983968 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:00.984275 18978 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.984567 11861 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:00.985638 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:00.958252 18970 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.986563 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:00.988489 18962 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:00.988970 18962 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:00.957271 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:00.957911 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 182669us
I20260709 12:13:00.960331 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.950213 18935 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.941956 18894 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:00.892758 18987 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:00.971262 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:00.971230 18670 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.972280 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:00.963826 18995 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.977002 18976 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.961396 18950 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:00.999375 18944 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.994840 18941 raft_consensus.cc:993] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: : Instructing follower 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:13:00.990697 18947 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:00.990412 18962 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:00.951130 18985 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.094646 18950 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:01.095453 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103986us
I20260709 12:13:01.075309 18941 raft_consensus.cc:1081] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Signalling peer 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:13:01.076325 18970 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:01.076921 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119746us
I20260709 12:13:01.098654 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.100544 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:01.100879 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.077875 18962 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:01.104600 11259 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.521s (SENT)
I20260709 12:13:01.104269 11042 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 23 to 24, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.108282 11042 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 19 to 20, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:01.084555 18976 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:01.118124 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:01.098016 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.077997 18995 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:01.079949 18944 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:01.081812 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.082670 11216 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:13:01.082891 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.083889 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.084503 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.128368 11142 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:01.086611 18992 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:01.091041 18987 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:01.092247 11860 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:01.092871 18670 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:00.990552 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:01.122644 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:01.133725 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 143275us
I20260709 12:13:01.134681 18966 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:01.134522 18992 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.135138 18966 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:01.135922 18966 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.136920 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:01.137305 18992 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:01.138373 18978 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:01.134284 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.138870 18978 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.139321 18978 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.140019 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.141176 11110 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.142524 18964 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:13:01.126118 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.133073 18970 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.145502 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.146361 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.146207 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.147675 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.148113 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.147563 18981 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.149544 18980 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.150836 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.151161 18944 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.151180 11138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:54014
I20260709 12:13:01.151537 11216 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:13:01.151887 11138 raft_consensus.cc:606] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:01.152437 19004 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:01.148265 11214 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:13:01.155428 11285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:01.156020 11285 raft_consensus.cc:606] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:01.153648 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.157929 18970 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:01.157470  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:01.143644 18969 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:01.159770 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.160676 18966 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.161335 18969 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:01.162830 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.164542 18941 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:01.165968 18670 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:01.166373 18670 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:01.167421 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.168596 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.168722 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.169405 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.169588 18969 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:01.169957 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.167438 18670 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.172082 18670 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.172974 11217 raft_consensus.cc:2955] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:01.174072 11215 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:01.175019 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.175748 11210 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:01.178128 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.178761 11216 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:01.178846 11218 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:01.181423 18945 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:01.182365 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.182587 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.183022 11218 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:01.184784 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.185380 11218 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:01.185549 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.186633 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.187356 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.186633 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.188431 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:01.189707 11131 tablet_service.cc:1558] Processing DeleteTablet for tablet 25bbe9f3cd6e42aca82fdba9812b235c with delete_type TABLET_DATA_TOMBSTONED (TS 018d40ceb45d4447aa293f4c1d929bb8 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:39166
I20260709 12:13:01.119686 18985 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:01.269058 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.234472 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.221580 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.222927 11211 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.205170 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.197358 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.192333 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 276) took 1233 ms. Trace:
W20260709 12:13:01.191354 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 45953.3us
I20260709 12:13:01.277205 11218 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:01.276525 11214 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:13:01.276525 11210 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:01.221999 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.283689 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.214054 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.277522 11039 rpcz_store.cc:276] 0709 12:12:59.958611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.958820 (+   209us) service_pool.cc:224] Handling call
0709 12:13:01.192252 (+1233432us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:13:01.238940 11216 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:01.220315 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.203223 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:01.196246  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:01.193075 11041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 153) took 1880 ms. Trace:
W20260709 12:13:01.273574 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 169014us
I20260709 12:13:01.283087 11215 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:01.280285 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:01.290699 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.288362 11213 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:01.286350 11219 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
W20260709 12:13:01.293061 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 89939.4us
I20260709 12:13:01.206984 18975 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.299981 18975 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:01.300063 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.300314 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.301401 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.303433 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.304540 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.195382 18966 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:01.309130  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:01.309015 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.310366 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.311105 11219 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:13:01.318337 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.318918 19008 tablet_replica.cc:333] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:01.318434 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:01.323767 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.300468 18975 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.302830 18950 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.306061 18934 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.330000 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.331244 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.288671 11041 rpcz_store.cc:276] 0709 12:12:59.312220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.314318 (+  2098us) service_pool.cc:224] Handling call
0709 12:13:01.193005 (+1878687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:00.383530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:00.384216 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:00.384255 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:13:00.384272 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:00.384668 (+   396us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:00.384726 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:00.384758 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:00.384994 (+   236us) tablet.cc:701] Row locks acquired
0709 12:13:00.385012 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:00.385171 (+   159us) write_op.cc:270] Start()
0709 12:13:00.385292 (+   121us) write_op.cc:276] Timestamp: P: 1783599180385115 usec, L: 0
0709 12:13:00.385314 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:13:00.386100 (+   786us) log.cc:844] Serialized 536 byte log entry
0709 12:13:00.887642 (+501542us) op_driver.cc:464] REPLICATION: finished
0709 12:13:01.080445 (+192803us) write_op.cc:301] APPLY: starting
0709 12:13:01.080543 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:01.081872 (+  1329us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:01.081961 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:01.138924 (+ 56963us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:01.139169 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:13:01.139216 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:01.139470 (+   254us) log.cc:844] Serialized 25 byte log entry
0709 12:13:01.139671 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:01.139774 (+   103us) write_op.cc:454] Released schema lock
0709 12:13:01.139826 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:01.140332 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:01.140372 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10695,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":184719,"apply.run_cpu_time_us":3944,"apply.run_wall_time_us":59854,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8319,"num_ops":1,"prepare.queue_time_us":204159,"prepare.run_cpu_time_us":3049,"prepare.run_wall_time_us":30670,"replication_time_us":477094,"thread_start_us":262953,"threads_started":2}]]}
I20260709 12:13:01.344012 11287 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:13:01.334645 18984 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.355942 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.356240 18984 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.356722 18984 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.357313 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.358074 11213 raft_consensus.cc:2393] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:01.339926 18950 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:01.359043 18950 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.368508 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.369791 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.370661 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.370821 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.371172 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.371753 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.372159 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.374608 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.376310 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:01.370905 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.380471 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.387229 18962 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:01.387988 18962 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.334046 18978 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.345566 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.346344 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.340207 18934 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.349826 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.351449 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.352108 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.328825 11214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:39588
I20260709 12:13:01.402019 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.403307 11214 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:01.403903 11214 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:01.352872 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:01.353758 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.355697 19008 raft_consensus.cc:2243] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.425001 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.437718 11213 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:01.496812 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.485066 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:01.408764 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 102583us
I20260709 12:13:01.438715 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:01.517966 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79377.3us
I20260709 12:13:01.419312 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:01.486085 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.520251 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.407171 11287 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:01.468851 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:01.484877 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:01.475492 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.524019 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.522653 11284 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 12:13:01.529438 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54067.1us
I20260709 12:13:01.525583 18943 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.525955 18981 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:01.531365 18987 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:01.538090 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.531718 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.531244 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.530190 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.535722 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.538385 11288 consensus_queue.cc:237] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.408651 18934 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.425433 18962 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:01.538214 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:01.545095 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:01.551548 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:01.555745 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.556165 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.479116 18961 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.080s
I20260709 12:13:01.549189 18980 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:01.559036 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.561499 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.538574 18943 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:01.570178 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:01.536042 18981 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:01.438129 18975 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.588029 18975 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:01.557662 18976 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:01.596457 18976 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.597378 18970 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:01.542410 18987 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.580747 18950 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.567971 18978 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:01.565452 18969 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:01.583246 18961 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:01.570457 19004 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:01.585310 19008 raft_consensus.cc:2272] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.602137 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.606787 11855 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:01.562569 18995 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:01.565220 18944 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:01.564498 18939 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.605161 18976 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:01.568738 18962 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.574992 19000 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:01.600384 18981 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:01.620290 11858 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:01.608908 18987 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:01.613854 18961 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:01.625962 18980 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.614089 19004 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:01.625845 18995 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.629256 19000 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.611166 18872 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:13:01.644779 19000 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.643113 18995 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.646811 18872 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:01.647143 18872 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:01.655632 18872 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.656905 18872 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.642778 19004 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:01.465186 18984 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:01.666555 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 105162us
I20260709 12:13:01.668428 11185 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.671180 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:01.671885 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 174307us
W20260709 12:13:01.669239 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107274us
I20260709 12:13:01.619002 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.685842 11855 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:01.683104 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:01.683547 18939 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.665812 18986 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:13:01.689152 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:01.692770 11858 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:13:01.693363 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74828us
I20260709 12:13:01.667788 18962 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:13:01.697723 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.655632 18961 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.703204 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.708163 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:01.710240 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.712152 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:01.713723 18969 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.713851 18964 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:01.715471 19008 ts_tablet_manager.cc:1916] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.715879 19013 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.718652 18945 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.708556 18950 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:01.719493 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.722455 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.701414 18999 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:01.726665 18968 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:01.727031 18968 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:01.727923 18968 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.729172 18968 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.741946 18961 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:01.745412 18969 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:01.747216 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.748654 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.749435 19014 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.750094 19014 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.751564 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.752733 19014 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.754345 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.755617 18969 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:01.758555 19000 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.760793 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:01.764959 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:01.764871 18987 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.767011 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:01.769390 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.772957 19013 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:01.774178 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.761088 19000 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:01.774894 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:01.781073 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:01.781585 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:01.785072 19013 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.796849 18969 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.799333 18984 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:01.785750 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.809652 18969 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.811122 18969 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:01.817490 18995 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:01.820983 11138 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:01.822229 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:01.807866 11214 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.783896 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.784804 19015 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:01.846477 18985 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:01.846760 19015 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:01.847296 19015 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:01.847569 11214 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:01.836404 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 144278us
W20260709 12:13:01.848474 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64655.8us
I20260709 12:13:01.837860 18962 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:01.785465 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.835692 18976 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.862351 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:01.870193 11858 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:01.807926 18981 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:01.875747 18945 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:01.877326 18981 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:01.878896 11142 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:13:01.849522 18982 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.885417 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:01.886147 11290 raft_consensus.cc:3055] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:01.886436 11290 raft_consensus.cc:740] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:01.887231 11290 consensus_queue.cc:260] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.888602 11290 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:01.891794 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.881739 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96359.9us
I20260709 12:13:01.892722 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:01.863905 18962 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:01.869798 18976 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:01.788511 18934 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:01.930835 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:01.926826 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 308085us
I20260709 12:13:01.933331 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.890893 18938 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:01.935372 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:01.941567 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.949741 11858 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:01.951267 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.954083 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:01.957505 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.938654 18976 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.965543 11210 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:01.937692 19011 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:01.918105 18941 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:13:01.935969 18985 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:13:01.999007 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49516.1us
W20260709 12:13:02.001767 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44348.1us
I20260709 12:13:02.002650 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:02.006191 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:01.987267 18987 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.009717 11290 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
W20260709 12:13:02.010252 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67479.6us
I20260709 12:13:02.009155 11182 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:02.001955 18980 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.996686 19016 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.007570 18872 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:02.023058 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:02.024125 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:02.027015 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.028064 11135 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:02.023629 18987 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:02.031282 18987 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:02.031611 18987 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:02.038163 18987 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:02.040729 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.042900 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:01.980835 18962 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:02.008680 19004 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:02.065881 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.019686 19020 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:02.073316 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:02.019868 19016 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:02.023979 19023 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:02.022923 18872 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:02.087549 18670 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:02.088065 18670 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:02.088958 18670 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:02.075155 19020 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:02.095909 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:02.096886 19029 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:02.097153 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:02.097977 19029 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:02.098388 19029 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.098515 19021 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:02.099272 19029 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:02.100117 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:02.100813 19029 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:02.101202 19013 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:02.102573 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:02.102710 11140 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:02.096050 19020 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.106727 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:02.064332 18961 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:02.051769 18995 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:02.116007 19018 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:13:02.120563 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 107150us
I20260709 12:13:02.097167 18938 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:02.127362 11139 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
W20260709 12:13:02.131752 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 88932.5us
W20260709 12:13:02.147941 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 66551.4us
I20260709 12:13:02.149874 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:02.083802 18872 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.080899 19016 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.156628 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.135255 18961 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:02.135571 19023 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:02.165165 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 141088us
I20260709 12:13:02.162741 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.170976 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:02.150060 18934 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:02.182883 11855 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:02.171105 18961 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.190613 18971 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:02.198915 18971 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:02.193225 19017 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.209757 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.148614 19026 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.181994 19014 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.164510 18987 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.218192 11139 raft_consensus.cc:1275] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:02.219352 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:02.200153 18971 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:02.211267 18946 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.234697 19032 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:02.258327 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 101781us
I20260709 12:13:02.265977 19023 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:02.270205 18976 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.272357 18670 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.272850 18976 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.275218 19015 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.277442 11136 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:02.266022 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.292266 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.297472 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.277388 19015 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:02.290302 19026 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:02.270156 19020 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.296682 19031 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.329173 11858 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:02.313215 19034 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:02.313391 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.326436 18976 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:02.328045 19008 ts_tablet_manager.cc:1929] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
W20260709 12:13:02.361016 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 47707.4us
I20260709 12:13:02.362227 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.366233 19026 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:02.386829 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 214595us
I20260709 12:13:02.389340 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.389680 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.357653 19008 log.cc:1199] T 25bbe9f3cd6e42aca82fdba9812b235c P 018d40ceb45d4447aa293f4c1d929bb8: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/wals/25bbe9f3cd6e42aca82fdba9812b235c
I20260709 12:13:02.394423 18961 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.415184 18962 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.419021 19034 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.424837 19004 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:02.427649 19020 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.433329 19016 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.444233 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:02.445890 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.462199 11286 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:02.463032 11287 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:13:02.463236 11288 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.467121 11284 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:02.467033 18872 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.468209 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:02.469544 11284 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.469609 18872 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.470652 11284 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:02.471541 11293 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.473305 11287 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:02.387609 19026 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:02.489517 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.495637 11289 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:02.496199 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:02.499277 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.499812 11217 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:02.497713 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:02.513098 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.501488 19029 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.519407 19008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39166 (request call id 4) took 1322 ms. Trace:
I20260709 12:13:02.542734 18961 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.561157 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.521606 18968 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:13:02.562633 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.563089 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.564136 18976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51326 (request call id 3) took 1044 ms. Trace:
I20260709 12:13:02.494809 18943 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:13:02.565490 18943 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:13:02.564540 18976 rpcz_store.cc:276] 0709 12:13:01.519747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.519862 (+   115us) service_pool.cc:224] Handling call
0709 12:13:01.555850 (+ 35988us) log.cc:844] Serialized 501 byte log entry
0709 12:13:01.822393 (+266543us) spinlock_profiling.cc:243] Waited 913 us on lock 0x7b180036f400. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f982d9f0a40 00007f982d9eb4e4 00007f982d9eb455 00007f9830a34b0b 00007f9830ab9b63 00007f9830ae1752 00007f9830ad99fa
0709 12:13:02.564040 (+741647us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146927,"raft.queue_time_us":167301,"raft.run_cpu_time_us":1489,"raft.run_wall_time_us":20067,"spinlock_wait_cycles":2099072,"thread_start_us":111311,"threads_started":1,"wal-append.queue_time_us":144728}
I20260709 12:13:02.565855 18943 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.566794 18943 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.568533 18943 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:02.553503 19016 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:02.504125 18964 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:13:02.506103 18986 consensus_queue.cc:1048] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:13:02.518651 18944 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:13:02.497377 19000 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:13:02.562739 19004 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:02.585285 19004 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.587954 18945 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:02.559234 19027 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:13:02.596452 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc7de5348ade43f196ccf4a393cc5bb8 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:02.604234 18938 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:02.604689 18938 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.605744 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.605602 18938 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.619875 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.622344 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:02.628156 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.627796 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:02.624804 19000 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:02.625109 18670 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:02.637102 18980 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:02.637600 18980 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.642285 18938 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.648826 19020 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:02.537324 19008 rpcz_store.cc:276] 0709 12:13:01.189143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.189329 (+   186us) service_pool.cc:224] Handling call
0709 12:13:01.318346 (+129017us) ts_tablet_manager.cc:1151] Deleting tablet 25bbe9f3cd6e42aca82fdba9812b235c
0709 12:13:01.318420 (+    74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:02.149468 (+831048us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:02.327883 (+178415us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:02.511458 (+183575us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":128087,"thread_start_us":114050,"threads_started":1}
I20260709 12:13:02.653931 11028 catalog_manager.cc:5028] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): tablet 25bbe9f3cd6e42aca82fdba9812b235c (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:13:02.656462 19041 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:02.656903 19041 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:02.670832 11289 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
W20260709 12:13:02.672892 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 161347us
I20260709 12:13:02.682125  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:02.631421 19036 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.319s	user 0.011s	sys 0.000s
I20260709 12:13:02.726111 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:02.586364 19004 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:02.745657 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 241835us
I20260709 12:13:02.775703 11858 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:13:02.724083 18944 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:13:02.756603 18999 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.727332 18964 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 12:13:02.779683 19004 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.782552 11137 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:02.759369 19014 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.024s
W20260709 12:13:02.782655 19012 log.cc:927] Time spent T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.072s	user 0.001s	sys 0.006s
I20260709 12:13:02.747044 19034 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:02.801996 19028 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 12:13:02.804669 18944 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:02.805341 18944 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.638438 18980 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.807374 18964 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:02.807968 18964 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.809178 18964 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.812060 19028 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:02.812640 19028 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.813609 19028 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.815357 19028 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.756397 19027 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:13:02.797304 19034 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:02.819492 19027 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:02.820022 19034 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.694067 19020 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 12:13:02.838431 19034 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:02.820092 19027 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:02.844697 18964 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.848738 19027 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.850404 19027 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.798825 19014 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.053s
I20260709 12:13:02.827905 18944 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:02.974076 11136 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:02.943136 18986 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.017539 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.019843 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.021157 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.022100 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:03.028921 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.029042 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.032658 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.037173 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:03.042760 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69443us
W20260709 12:13:03.040859 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77712.7us
I20260709 12:13:03.022769 19046 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:03.034432 19022 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.024044 19003 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:13:03.055783 11139 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:03.058802 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.060367 11292 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:03.022634 18986 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.067838 19016 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:13:03.071954 18943 consensus_meta.cc:287] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.000s
I20260709 12:13:03.076691 18986 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:03.078892 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.107189 19021 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:03.107659 19021 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:03.109004 18670 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:03.109633 18670 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.062214 19022 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.110618 18670 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:03.112041 18670 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:03.112740 19022 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.054253 19046 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.108623 19021 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.118520 19021 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.119904 11140 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:13:03.122903 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76791.9us
W20260709 12:13:03.159078 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61190.7us
W20260709 12:13:03.174386 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51828us
W20260709 12:13:03.124902 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 57644.2us
I20260709 12:13:03.193428 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.194219 11289 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:03.181331 19022 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:03.207435 19022 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.231740 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:03.232460 19046 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.230242 19022 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.249562 11217 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:03.250102 18944 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.250910 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.251688 11216 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:03.253414 19028 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:03.259769 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:03.261584 11039 catalog_manager.cc:5697] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 13 to 14, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.261755 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:03.254024 19028 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.105719 19041 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.270793 11041 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 21 to 22, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 22 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:03.295856 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 230894us
W20260709 12:13:03.281356 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 89382.3us
I20260709 12:13:03.300931 11138 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:03.318921 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.314149 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:03.330392 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.331321 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.332057 11218 raft_consensus.cc:2468] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:03.335981 18978 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:03.336493 18978 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.337158 18978 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:03.348361 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 348612us
I20260709 12:13:03.303599 18976 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:03.370550 11137 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 14.
I20260709 12:13:03.363456 11141 raft_consensus.cc:2955] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:03.367250 18976 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.382256 11140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:54014
I20260709 12:13:03.382473 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.382933 11140 raft_consensus.cc:606] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.383363 11140 raft_consensus.cc:614] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:03.382386 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52403.3us
I20260709 12:13:03.388195 11218 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:03.387041 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:03.390936 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:03.399081 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60795.7us
I20260709 12:13:03.406459  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:03.408481  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:03.409291  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:03.398262 11185 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:03.395655 19063 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:03.415278 18962 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:03.419018 19063 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.420027 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.421358 11140 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:03.420881 19063 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.415300 19028 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.422734 18962 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.424307 18962 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.388998 18976 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:03.431173 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.439777 18981 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.444764 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.445475 11140 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:03.445796 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:03.447144 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.435856 19028 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:03.427837 19034 consensus_meta.cc:287] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
W20260709 12:13:03.457028 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.458803 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.465540 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.396602 19055 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:13:03.497195 18938 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.497936 18938 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.500566 19041 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:03.501663 18938 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.455256 19028 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.478760 18980 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:03.508709 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58486.9us
I20260709 12:13:03.510221 18984 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:03.430451 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.429042 19029 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.537266 19016 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.553619 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.561594 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.562502 11216 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:03.549664 19020 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.566185 19020 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.568502 19020 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:03.569147 19028 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.572240 18978 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.573632 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.580739 11218 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:03.579566 19055 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:03.583158 19055 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.586843 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.589124 19055 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.593886 18976 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.596385 18976 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:03.576931 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:03.560937 19016 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.600704 19016 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.603248 11285 raft_consensus.cc:2368] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
W20260709 12:13:03.619084 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65535.2us
I20260709 12:13:03.622905 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:03.628501 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.628729 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:03.629207 11215 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:03.627053 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.623705 11858 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:13:03.632264 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.633163 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:03.633846 11218 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 28: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:03.634120 11860 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:03.632803 11211 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:03.616240 19015 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:03.635700 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:03.639729 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.640638 11288 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:03.644522 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.645123 11137 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:13:03.643388 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:03.648229 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:03.647287 11860 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:03.648806 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:03.653699 11110 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:03.653988 11110 leader_election.cc:403] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:03.655005 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
I20260709 12:13:03.638477 19016 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:03.660056 18978 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.652601 18939 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:03.647149 18976 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:13:03.686851 18976 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.687806 18976 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.690793 18939 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:03.691298 18939 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:03.692147 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:03.692974 11288 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 28: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:03.644250 19015 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.695363 19015 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.676492 11144 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:03.656250 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:03.681226 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 46218.2us
I20260709 12:13:03.684587 19034 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:03.702894 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:03.710757 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 54626.5us
I20260709 12:13:03.711138 11136 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:03.712677 11110 leader_election.cc:400] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:03.714102 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:03.724954 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76851.4us
I20260709 12:13:03.707919 19034 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.712384 18962 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:03.708109 19016 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.702606 18980 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:03.714859 19029 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:03.718690 19041 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:03.728790 19064 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:03.762707 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:03.749311 19034 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.740782 19032 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:03.755357 19055 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:03.771193 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.751129 18962 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.772890 11139 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 28: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:03.775194 11138 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:03.785436 18962 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.784384 19016 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.773264 19041 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:03.791463 19041 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.761410 18985 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:03.798868 18985 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.801329 18939 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.802096 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.802906 11138 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:03.803431 19055 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.809109 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.765878 19064 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.755422 19059 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:03.838543 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.829115 19032 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.873365 19032 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.866305 18985 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.851545 19059 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.878036 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.878906 11139 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 14: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:03.854609 19073 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:03.879812 19073 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:03.881047 18972 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.880746 19073 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.881594 18972 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.853207 19015 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.883033 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.883553 19064 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.869801 19029 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.885007 19029 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.885334 19015 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.885690 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.887109 19029 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.846704 18986 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:03.871891 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.888489 18972 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.891790 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:03.892590 11860 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.892467 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.892938 19064 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:03.893501 19064 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.894104 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.897804 11288 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:13:03.896714 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.899214 11138 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:03.897248 18872 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.899946 19064 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.900506 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:03.900053 18872 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.902281 19064 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:03.903048 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:03.903502 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:03.880040 19059 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.904397 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.905457 19059 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.905660 11136 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:03.909246 18939 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.909442 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:03.910357 11861 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:03.896714 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.912114 11291 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:13:03.913056 19029 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:03.919770 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:03.920281 18939 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:03.920385 11861 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:03.872153 19055 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.921036 18939 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:03.909384 18872 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:03.913630 19029 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.927687 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:03.928443 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:03.928781 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.929121 11217 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.929466 11215 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:03.930094 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:03.928536 11136 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:03.933952 11860 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:03.927487 11256 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:03.934780 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:03.926069 19029 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.952713 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:03.958599 19059 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.962688 19072 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:03.976935 19072 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.977234 19028 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:03.977394 19072 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.978046 19028 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:03.979125 19028 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:03.973830 19064 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:13:03.988391 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 61066.1us
I20260709 12:13:03.990092 18986 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:03.990535 18986 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.990916 18986 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.994041 18939 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:03.998006 19072 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:04.002348 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50320.4us
I20260709 12:13:03.981905 19034 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:04.012948 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.015025 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:03.998629 19064 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:04.015393 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:04.009480 11217 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:04.016377 11288 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:04.023840 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:04.030370 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.035548 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.036039 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:04.041339 11291 raft_consensus.cc:2393] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:04.042601 11285 raft_consensus.cc:2368] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23.
I20260709 12:13:04.043779 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:03.998776 19029 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.052930 11185 leader_election.cc:400] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23.
I20260709 12:13:04.053226 11185 leader_election.cc:403] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.039023 19056 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.049878 19014 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.011420 18962 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.080330 11139 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.068605 19034 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:04.072520 19072 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.074438 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:04.026157 19064 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:04.075613 18985 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.078686 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:04.084687 11138 raft_consensus.cc:2368] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25.
I20260709 12:13:04.087069 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:04.092923 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:04.096622 11860 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.083098 19058 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:04.106850 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 279) took 1345 ms. Trace:
I20260709 12:13:04.117386 11860 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:04.120385 11217 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.124910 11256 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.084362 18976 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:13:04.119725 19058 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:04.137706 11217 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:13:04.144033 19029 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.145213 11138 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:04.147568 18962 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:04.147969 11184 leader_election.cc:400] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25.
I20260709 12:13:04.148267 11184 leader_election.cc:403] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.149142 18986 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:04.149606 19013 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.151372 18986 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:04.109681 11039 rpcz_store.cc:276] 0709 12:13:02.761326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.761453 (+   127us) service_pool.cc:224] Handling call
0709 12:13:04.106706 (+1345253us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:03.415393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:03.416089 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:03.416138 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:13:03.416160 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:03.451817 (+ 35657us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:03.451907 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:03.451945 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:03.452149 (+   204us) tablet.cc:701] Row locks acquired
0709 12:13:03.452167 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:03.452362 (+   195us) write_op.cc:270] Start()
0709 12:13:03.452500 (+   138us) write_op.cc:276] Timestamp: P: 1783599183452286 usec, L: 0
0709 12:13:03.452526 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:03.453271 (+   745us) log.cc:844] Serialized 536 byte log entry
0709 12:13:03.874789 (+421518us) op_driver.cc:464] REPLICATION: finished
0709 12:13:04.051787 (+176998us) write_op.cc:301] APPLY: starting
0709 12:13:04.051901 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:04.071990 (+ 20089us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:04.072110 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:04.072920 (+   810us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:04.073123 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:13:04.073183 (+    60us) write_op.cc:312] APPLY: finished
0709 12:13:04.073410 (+   227us) log.cc:844] Serialized 25 byte log entry
0709 12:13:04.073598 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:04.073672 (+    74us) write_op.cc:454] Released schema lock
0709 12:13:04.073715 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:04.074140 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:04.074168 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":172231,"apply.run_cpu_time_us":3743,"apply.run_wall_time_us":22366,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8319,"num_ops":1,"prepare.queue_time_us":135662,"prepare.run_cpu_time_us":23450,"prepare.run_wall_time_us":235703,"raft.queue_time_us":219541,"raft.run_cpu_time_us":9698,"raft.run_wall_time_us":138298,"replication_time_us":422122,"thread_start_us":553068,"threads_started":4,"wal-append.queue_time_us":239419}]]}
I20260709 12:13:04.152845 11291 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:04.157214 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:04.157955 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:04.158620 11285 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.158102 11136 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.161173 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:04.162464 11860 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:04.164674 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:04.129871 19073 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:04.163316 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:04.173171 11210 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.154263 19058 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:04.178941 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 71932.3us
I20260709 12:13:04.181602 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:04.180059 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:04.202719 11285 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:04.205250 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:13:04.209666 19082 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:13:04.204317 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.212855 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.182358 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet bc7de5348ade43f196ccf4a393cc5bb8 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:38310
I20260709 12:13:04.181421 19073 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:04.167845 18986 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:04.216747 19034 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:04.223799 19034 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:04.224413 19085 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 12:13:04.224944 19034 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:04.226985 19086 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:13:04.206743 19020 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:04.231393 11041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 155) took 1438 ms. Trace:
I20260709 12:13:04.231906 11041 rpcz_store.cc:276] 0709 12:13:02.793247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.793400 (+   153us) service_pool.cc:224] Handling call
0709 12:13:04.231319 (+1437919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:03.723312 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:03.723905 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:03.723952 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:13:03.727760 (+  3808us) tablet.cc:662] Decoding operations
0709 12:13:03.733381 (+  5621us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:03.733438 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:03.733492 (+    54us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:03.733725 (+   233us) tablet.cc:701] Row locks acquired
0709 12:13:03.733749 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:13:03.749315 (+ 15566us) write_op.cc:270] Start()
0709 12:13:03.755655 (+  6340us) write_op.cc:276] Timestamp: P: 1783599183748426 usec, L: 0
0709 12:13:03.758711 (+  3056us) op_driver.cc:348] REPLICATION: starting
0709 12:13:03.815008 (+ 56297us) log.cc:844] Serialized 536 byte log entry
0709 12:13:04.048084 (+233076us) op_driver.cc:464] REPLICATION: finished
0709 12:13:04.083526 (+ 35442us) write_op.cc:301] APPLY: starting
0709 12:13:04.084192 (+   666us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:04.150833 (+ 66641us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:04.150957 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:04.151826 (+   869us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:04.152012 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:13:04.152060 (+    48us) write_op.cc:312] APPLY: finished
0709 12:13:04.152276 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 12:13:04.152477 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:04.152572 (+    95us) write_op.cc:454] Released schema lock
0709 12:13:04.159192 (+  6620us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:04.212185 (+ 52993us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:04.213938 (+  1753us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":25082,"apply.run_cpu_time_us":3959,"apply.run_wall_time_us":110096,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4192,"mutex_wait_us":260,"num_ops":1,"prepare.queue_time_us":368255,"prepare.run_cpu_time_us":4019,"prepare.run_wall_time_us":132314,"replication_time_us":280186,"thread_start_us":101770,"threads_started":1}]]}
I20260709 12:13:04.215179 18944 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:04.241703 18985 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23.
I20260709 12:13:04.251225 18970 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:04.251842 18970 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.253927 18970 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.261884 11210 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:04.267169 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.267953 11144 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:04.271277 11139 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:13:04.270432 11218 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:04.269421 18944 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:04.283111 18986 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:13:04.222220 19064 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:04.300271 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:04.301839 18919 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:04.314509 19064 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:04.317478 19064 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.316361 18978 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.320343 18978 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:04.324008 19064 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.324759 18978 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:04.290836 19073 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:04.333191 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.333983 11285 raft_consensus.cc:2368] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23.
I20260709 12:13:04.315189 18944 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.315838 18919 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:04.352432 18919 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:04.353299 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:04.356254 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.312829 19014 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:04.360666 19092 tablet_replica.cc:333] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:04.362186 19056 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:04.358649 19016 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.370675 19013 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25.
I20260709 12:13:04.370934 19016 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.371467 19092 raft_consensus.cc:2243] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.371734 11211 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:04.372571 19092 raft_consensus.cc:2272] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.361560 19058 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.374843 19058 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.376711 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.378006 11288 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:04.378300 11136 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:04.376716 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.381476 11139 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:04.383867 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:04.384845 11137 raft_consensus.cc:2393] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:04.386042 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.387137 11141 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:04.388998 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.394039 11219 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.409874 11217 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:13:04.413868 11042 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 26 to 27, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 27 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:04.432807 18980 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.433686 18980 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.398130 11210 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.426816 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.415020 19013 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:13:04.436685 18980 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.398845 19020 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:04.442516 19020 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.443018 19020 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.411468 19063 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:13:04.447068 18980 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.448028 18980 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.451339 18980 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.429509 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:04.458577 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51120.2us
I20260709 12:13:04.459474 11185 leader_election.cc:400] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23.
I20260709 12:13:04.459784 11185 leader_election.cc:403] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.460431 19013 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23.
I20260709 12:13:04.461491 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:04.462177 11288 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
I20260709 12:13:04.462620 19013 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:04.466243 18976 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:13:04.467794 18976 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:04.473610 11217 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:04.474005 19013 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:04.479000 11216 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:04.487578 18872 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:04.490233 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:04.506175 11219 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:13:04.507855 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 85246.5us
I20260709 12:13:04.526899 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.530964 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:04.531183 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:04.531705 11218 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:04.453997 19020 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.541903 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:04.542403 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:04.543059 11219 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:13:04.548501 11292 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:04.526089 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.551932 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:04.410046 19058 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:04.578740 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:04.508440 18970 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:13:04.556890 18981 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.564627 19016 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:04.596021 11141 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:04.563423 19041 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:04.563056 19109 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:04.563381 18961 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:13:04.583163 19014 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.602155 11141 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:04.611937 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:04.586741 19024 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:04.617121 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:04.568866 19058 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.602826 19041 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:04.659925 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83488.3us
I20260709 12:13:04.664462 11219 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:04.621565 19020 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:04.647163 19107 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:04.671129 19107 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:04.674964 19099 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:13:04.659601 19015 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:04.664708 19041 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:04.663915 19024 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:04.687722 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 70661.3us
I20260709 12:13:04.617372 19109 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:04.671579 19107 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:04.624722 19014 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.686272 19015 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.704656 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:04.705245 11144 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:13:04.710758 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 129502us
I20260709 12:13:04.699631 19092 ts_tablet_manager.cc:1916] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:04.715080 19109 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:04.708482 11139 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.718945 11218 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.721623 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:04.706568 19015 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:04.706820 19110 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:04.728150 18986 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:04.740130 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.740962 11291 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 28.
I20260709 12:13:04.729285 18872 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:13:04.743177 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:04.742143 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.743767 19109 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.799695 11139 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:04.791646 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.801739 11137 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22.
I20260709 12:13:04.801882 19108 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:04.819480 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 70639.3us
W20260709 12:13:04.809481 19079 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:13:04.816810 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44951.2us
I20260709 12:13:04.741508 19110 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.831523 18962 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
W20260709 12:13:04.839002 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 96936.8us
I20260709 12:13:04.814925 19058 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.851693 19014 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:04.852067 19118 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:13:04.852919 19110 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:04.776216 19024 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.806275 19109 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.820530 19119 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:13:04.821062 19108 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:04.864440 11216 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.864831 19109 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.868719 11218 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:04.870575 11291 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:04.875061 18986 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:04.880182 18961 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:13:04.883687 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 90401.9us
I20260709 12:13:04.884606 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.885397 11291 raft_consensus.cc:2368] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22.
I20260709 12:13:04.886189 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.886767 11288 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
W20260709 12:13:04.891952 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76853.1us
I20260709 12:13:04.904326 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:04.904466 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:04.905661 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:04.906636 11288 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:04.906936 11211 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:13:04.909737 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:04.913148 11137 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.912590 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.886827 19108 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:04.919402 18980 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:04.921977 19107 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.923492 19041 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:04.927735 19032 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:04.947764 19032 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:04.948922 19032 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.913013 19015 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:04.953187 11141 raft_consensus.cc:2368] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:13:04.910300 19109 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:13:04.961557 11860 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:04.954149 19015 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:04.971153 11288 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:04.931650 18980 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:04.977895 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 132753us
W20260709 12:13:04.986400 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73892.2us
I20260709 12:13:04.986650 11215 raft_consensus.cc:2368] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 29.
I20260709 12:13:04.988123 19063 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:04.989181 11860 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:04.990517 19072 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:04.992089 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 103949us
I20260709 12:13:04.992736 11185 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:04.995477 11258 leader_election.cc:400] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:13:04.995757 11258 leader_election.cc:403] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.995919 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:04.996212 19000 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:13:04.984011 19067 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:04.998867 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 208744us
I20260709 12:13:04.999221 19067 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:05.012002 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:05.012966 11137 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:04.987166 18980 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.002059 19067 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:05.016078 11185 leader_election.cc:400] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22.
I20260709 12:13:05.020274 11185 leader_election.cc:403] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:05.021456 11215 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:05.014072 19029 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:13:05.026038 19107 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:05.026662 18970 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.030750 19041 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:05.042469 11184 leader_election.cc:400] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22.
I20260709 12:13:05.057477 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:05.058264 11292 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:05.058910 11215 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:05.058140 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:05.061066 11212 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:05.063093 11110 leader_election.cc:400] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 29.
I20260709 12:13:05.036965 19059 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:05.060433 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:05.067740 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:05.068298 11290 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:05.053334 19129 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:13:05.073948 19059 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.074473 19059 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:05.078713 19028 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:05.081449 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:05.082101 11289 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:05.198020 11289 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 29.
W20260709 12:13:05.198887 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119266us
W20260709 12:13:05.199324 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 109540us
I20260709 12:13:05.219462 11290 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:05.221323 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:05.269237 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:05.270066 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47803.9us
I20260709 12:13:05.271708 11216 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:13:05.268628 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 49002.1us
I20260709 12:13:05.274459 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:05.274649 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:05.289629 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68389.3us
I20260709 12:13:05.324155 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:05.276031 18978 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader election won for term 29
W20260709 12:13:05.387712 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 112562us
W20260709 12:13:05.380504 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 96496.1us
W20260709 12:13:05.400816 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 103486us
W20260709 12:13:05.473274 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 253054us
I20260709 12:13:05.378962 19028 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:05.531354 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 160183us
W20260709 12:13:05.543056 18970 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 12:13:05.543867 18970 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22.
W20260709 12:13:05.544338 19133 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
W20260709 12:13:05.545650 19139 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 12:13:05.516392 19103 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:13:05.546887 19136 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 12:13:05.548571 19137 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:13:05.508925 19028 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:05.493508 19047 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.091s
I20260709 12:13:05.564571 19028 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:05.499019 19107 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
W20260709 12:13:05.596377 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 217399us
W20260709 12:13:05.604444 19000 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.585s	user 0.013s	sys 0.000s
W20260709 12:13:05.620639 18980 consensus_meta.cc:287] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.005s
W20260709 12:13:05.623075 11292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.000s
W20260709 12:13:05.646099 11292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.012s	sys 0.000s
W20260709 12:13:05.634617 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 234837us
W20260709 12:13:05.672389 19059 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
W20260709 12:13:05.645504 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 244874us
I20260709 12:13:05.630211 19000 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17.
I20260709 12:13:05.659317 18980 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:05.697651 19092 ts_tablet_manager.cc:1929] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260709 12:13:05.701038 19059 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:05.712929 19108 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.780s	user 0.004s	sys 0.010s
I20260709 12:13:05.774834 19092 log.cc:1199] T bc7de5348ade43f196ccf4a393cc5bb8 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/bc7de5348ade43f196ccf4a393cc5bb8
I20260709 12:13:05.784552 19108 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:13:06.058079 19131 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.006s	sys 0.008s
I20260709 12:13:06.319427 19092 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38310 (request call id 3) took 2161 ms. Trace:
I20260709 12:13:07.085402 18980 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:07.102965 19059 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:07.009829 19092 rpcz_store.cc:276] 0709 12:13:04.127111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.159342 (+ 32231us) service_pool.cc:224] Handling call
0709 12:13:04.359349 (+200007us) ts_tablet_manager.cc:1151] Deleting tablet bc7de5348ade43f196ccf4a393cc5bb8
0709 12:13:04.359419 (+    70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:13:04.987451 (+628032us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:05.697501 (+710050us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:06.200824 (+503323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":127299,"thread_start_us":78973,"threads_started":1}
I20260709 12:13:07.605894 19108 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:08.039264 19028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.001s	sys 0.005s
W20260709 12:13:08.039808 19028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.001s	sys 0.005s
I20260709 12:13:08.082440 11213 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 17: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:08.892903 11136 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:09.742305 11136 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.005s
I20260709 12:13:09.743022 11136 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 29.
W20260709 12:13:09.777582 19140 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 4.213s	user 0.039s	sys 0.016s
W20260709 12:13:09.803651 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.324s	user 0.038s	sys 0.053s
W20260709 12:13:09.804387 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.324s	user 0.039s	sys 0.053s
W20260709 12:13:09.804805 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 4.40182e+06us
W20260709 12:13:09.826313 11182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.352s	user 0.041s	sys 0.090s
W20260709 12:13:09.826881 11182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.357s	user 0.042s	sys 0.090s
W20260709 12:13:09.827207 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 4.4277e+06us
W20260709 12:13:09.831192 11137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.624s	user 0.011s	sys 0.064s
W20260709 12:13:09.832125 11137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.625s	user 0.012s	sys 0.065s
I20260709 12:13:09.834013 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3164) took 4780 ms. Trace:
I20260709 12:13:09.834606 11137 rpcz_store.cc:276] 0709 12:13:05.053115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.054218 (+  1103us) service_pool.cc:224] Handling call
0709 12:13:05.054533 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.054930 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.054973 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.055598 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.627813 (+572215us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:13:09.832946 (+4205133us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:09.833081 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.833205 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:09.833248 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:09.833254 (+     6us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:09.833808 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33684,"raft.queue_time_us":6562,"raft.run_cpu_time_us":1790,"raft.run_wall_time_us":563629,"spinlock_wait_cycles":4134144,"thread_start_us":4625875,"threads_started":1,"wal-append.queue_time_us":1912712,"wal-append.run_cpu_time_us":2744,"wal-append.run_wall_time_us":1137765}
W20260709 12:13:09.854687 18978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.345s	user 0.021s	sys 0.026s
W20260709 12:13:09.855268 18978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.359s	user 0.022s	sys 0.026s
I20260709 12:13:09.855679 18978 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:09.857889 18978 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:13:09.877556 11258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.271s	user 0.028s	sys 0.021s
W20260709 12:13:09.878477 11258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.272s	user 0.028s	sys 0.021s
I20260709 12:13:09.885031 18986 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.886183 18986 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:09.890476 18986 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:09.891986 19166 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:09.892356 11256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.289s	user 0.019s	sys 0.036s
W20260709 12:13:09.893297 11256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.290s	user 0.020s	sys 0.037s
I20260709 12:13:09.894557 19167 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:09.893316 19166 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:09.895450 19167 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:09.897485 19166 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:09.898079 19167 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:09.898182 19166 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.899067 19166 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:09.900796 19166 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:09.892180 18986 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:09.908488 18986 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:09.914698 18986 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:09.932399 11135 raft_consensus.cc:2368] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22.
I20260709 12:13:09.935812 19169 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:09.938416 19167 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.939152 19168 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.943001 19063 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:09.945439 19169 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:09.946550 19111 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.947544 19111 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:09.949318 19169 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:09.950112 19111 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:09.951116 18986 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.952275 18986 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:09.953817 19142 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 4.390s	user 0.020s	sys 0.035s
I20260709 12:13:09.954856 19063 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:09.959117 19168 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:09.964425 18986 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:09.966565 19168 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:09.958106 19063 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:09.966241 19167 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:09.950192 19169 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:09.972170 19169 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:09.975668 19169 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:09.967983 11136 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 4618) took 4693 ms (client timeout 2037 ms). Trace:
W20260709 12:13:09.977421 11136 rpcz_store.cc:269] 0709 12:13:05.274275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.274391 (+   116us) service_pool.cc:224] Handling call
0709 12:13:09.967512 (+4693121us) spinlock_profiling.cc:243] Waited 3.62 s on lock 0x7b540032f0d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:09.967733 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8318216448}
I20260709 12:13:09.979790 19171 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:09.981052 19171 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:09.985086 19171 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:09.992033 19167 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.031337 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 4292) took 4975 ms. Trace:
I20260709 12:13:10.031934 11285 rpcz_store.cc:276] 0709 12:13:05.055420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.055551 (+   131us) service_pool.cc:224] Handling call
0709 12:13:05.055850 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.066203 (+ 10353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.066234 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.066762 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:13:10.015249 (+4948487us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18003320e0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:13:10.030613 (+ 15364us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:10.030671 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.030769 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:10.030828 (+    59us) raft_consensus.cc:1685] finished
0709 12:13:10.030840 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.031134 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9949,"raft.queue_time_us":10788,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3325,"spinlock_wait_cycles":25441024,"thread_start_us":15085,"threads_started":1,"wal-append.queue_time_us":4958218}
I20260709 12:13:10.129128 11855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41370 (request call id 1100) took 5091 ms. Trace:
I20260709 12:13:10.129696 11855 rpcz_store.cc:276] 0709 12:13:05.037200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.037359 (+   159us) service_pool.cc:224] Handling call
0709 12:13:05.037795 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.046420 (+  8625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.046451 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.047003 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:13:10.052179 (+5005176us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800124a80. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:13:10.123117 (+ 70938us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:10.123242 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.123392 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:10.128477 (+  5085us) raft_consensus.cc:1685] finished
0709 12:13:10.128501 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.128838 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1636,"raft.queue_time_us":15654,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4509,"spinlock_wait_cycles":23239552,"thread_start_us":70362,"threads_started":1,"wal-append.queue_time_us":5058780}
I20260709 12:13:10.131866 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3161) took 5090 ms. Trace:
I20260709 12:13:10.132386 11144 rpcz_store.cc:276] 0709 12:13:05.041400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.042072 (+   672us) service_pool.cc:224] Handling call
0709 12:13:05.042507 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.045464 (+  2957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.045514 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.047955 (+  2441us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.269451 (+221496us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:05.269502 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.269582 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:09.732115 (+4462533us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:13:09.775924 (+ 43809us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:10.131294 (+355370us) raft_consensus.cc:1685] finished
0709 12:13:10.131323 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.131648 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2502,"raft.queue_time_us":2666,"raft.run_cpu_time_us":67480,"raft.run_wall_time_us":4685764,"spinlock_wait_cycles":40069760,"thread_start_us":195709,"threads_started":1,"wal-append.queue_time_us":426782}
W20260709 12:13:10.149523 11259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.545s	user 0.037s	sys 0.050s
W20260709 12:13:10.150476 11259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.547s	user 0.038s	sys 0.050s
I20260709 12:13:10.154970 19167 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.156019 19167 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.159526 19167 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.165357 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 156) took 5858 ms. Trace:
I20260709 12:13:10.039675 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet bc7de5348ade43f196ccf4a393cc5bb8 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
W20260709 12:13:10.195515 11029 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 156062us
I20260709 12:13:10.174477 19167 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.197013 19167 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.175854 19165 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.200910 19165 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.192962 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.203809 19165 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.204172 18961 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.205204 18961 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.211524 18961 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.212114 18961 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.212775 18961 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.215497 18961 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.176903 19171 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:10.180367 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 374180us
I20260709 12:13:10.180684 19063 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.180997 19169 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.222548 19063 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.224880 19169 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.226397 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 2089) took 5192 ms. Trace:
I20260709 12:13:10.231487 19171 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.230721 11291 rpcz_store.cc:276] 0709 12:13:05.033960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.034108 (+   148us) service_pool.cc:224] Handling call
0709 12:13:05.034410 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.034831 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.034858 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.035310 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.361777 (+326467us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:05.361838 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.361939 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:09.952799 (+4590860us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:10.225804 (+273005us) raft_consensus.cc:1685] finished
0709 12:13:10.225829 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.226200 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":248,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":17883520,"thread_start_us":325980,"threads_started":1,"wal-append.queue_time_us":437370}
I20260709 12:13:10.235113 19063 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.203815 11039 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.239802  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:10.241097 11039 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 22 to 23, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 23 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:10.254032 19169 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.252815 19063 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.254952 19171 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.258683 19072 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.260782 19169 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.255494 19063 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.263234 19057 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.293953 19178 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.301208 19057 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.301306 19178 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.195156 11042 rpcz_store.cc:276] 0709 12:13:04.306356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.307031 (+   675us) service_pool.cc:224] Handling call
0709 12:13:10.164974 (+5857943us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:04.686575 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:04.745252 (+ 58677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:04.749957 (+  4705us) write_op.cc:435] Acquired schema lock
0709 12:13:04.770270 (+ 20313us) tablet.cc:662] Decoding operations
0709 12:13:04.817063 (+ 46793us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:04.822236 (+  5173us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:04.834300 (+ 12064us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:04.844230 (+  9930us) tablet.cc:701] Row locks acquired
0709 12:13:04.845817 (+  1587us) write_op.cc:260] PREPARE: finished
0709 12:13:04.853971 (+  8154us) write_op.cc:270] Start()
0709 12:13:04.854108 (+   137us) write_op.cc:276] Timestamp: P: 1783599184853915 usec, L: 0
0709 12:13:04.854133 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:13:04.854930 (+   797us) log.cc:844] Serialized 536 byte log entry
0709 12:13:05.045089 (+190159us) op_driver.cc:464] REPLICATION: finished
0709 12:13:05.672852 (+627763us) write_op.cc:301] APPLY: starting
0709 12:13:05.672949 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:05.674173 (+  1224us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:05.674279 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:05.675010 (+   731us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:05.675231 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:13:05.675273 (+    42us) write_op.cc:312] APPLY: finished
0709 12:13:05.675448 (+   175us) log.cc:844] Serialized 25 byte log entry
0709 12:13:05.675608 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:05.675694 (+    86us) write_op.cc:454] Released schema lock
0709 12:13:05.675734 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":603274,"apply.run_cpu_time_us":3299,"apply.run_wall_time_us":3299,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8319,"num_ops":1,"prepare.queue_time_us":231864,"prepare.run_cpu_time_us":4202,"prepare.run_wall_time_us":182302,"replication_time_us":158456,"thread_start_us":1337958,"threads_started":2}]]}
I20260709 12:13:10.275193 19072 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.308871 19072 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.312402 19178 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.313678 19169 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:10.316464 19073 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.252429 19167 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.261644 19047 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.326140 19047 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.328876 19047 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.321583 19073 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.324169 11286 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:10.329133 19055 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.330437 18978 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.331840 19063 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.346922 19057 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.348574 18978 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.349658 19153 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.350584 19153 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.351846 18972 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.352635 18972 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.353327 18984 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.322326 19169 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:10.336792 19060 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.338007 19073 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.338420 19168 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.363727 18972 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.364061 19168 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:10.364889 11135 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 4613) took 5093 ms (client timeout 1593 ms). Trace:
I20260709 12:13:10.365109 19153 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.365449 19055 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.365983 19150 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.366739 19150 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.368306 19055 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.351204 18978 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.354125 18984 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.372288 19150 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.373003 19120 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.373234 18984 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.373679 19120 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.363996 18974 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.375474 18974 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.376240 19120 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.361258 19072 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.377254 19072 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.378023 18974 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.379547 19072 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:10.379972 19138 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 4.869s	user 0.034s	sys 0.041s
I20260709 12:13:10.380205 19151 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.381001 19151 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:10.365383 11135 rpcz_store.cc:269] 0709 12:13:05.271737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.272492 (+   755us) service_pool.cc:224] Handling call
0709 12:13:10.364632 (+5092140us) spinlock_profiling.cc:243] Waited 4.56 s on lock 0x7b54001266d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:10.364816 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10491908480}
I20260709 12:13:10.385450 11136 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:10.361223 19060 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.392506 19149 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.393592 19149 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.394829 19060 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.396692 19151 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:10.397024 19149 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:10.397483 11213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39602 (request call id 2907) took 5338 ms (client timeout 3364 ms). Trace:
W20260709 12:13:10.397986 11213 rpcz_store.cc:269] 0709 12:13:05.059034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.060165 (+  1131us) service_pool.cc:224] Handling call
0709 12:13:10.396981 (+5336816us) spinlock_profiling.cc:243] Waited 3.01 s on lock 0x7b54000262d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:10.397249 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6933400832}
W20260709 12:13:10.401021 19155 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 4.733s	user 0.033s	sys 0.027s
I20260709 12:13:10.403460 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2842) took 5336 ms. Trace:
I20260709 12:13:10.403869 11292 rpcz_store.cc:276] 0709 12:13:05.066765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.066893 (+   128us) service_pool.cc:224] Handling call
0709 12:13:05.067173 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.092756 (+ 25583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.092787 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.093282 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.646583 (+553301us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:05.646643 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.646750 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:10.400293 (+4753543us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:10.403001 (+  2708us) raft_consensus.cc:1685] finished
0709 12:13:10.403024 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.403281 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25221,"raft.queue_time_us":25962,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":29655040,"thread_start_us":552788,"threads_started":1,"wal-append.queue_time_us":574484}
I20260709 12:13:10.412334 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.413307 11144 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:10.415952 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.416958 11135 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:10.421243 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.439087 11137 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:10.422713 19024 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.440778 19024 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.424510 19041 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.442953 19041 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.445365 19041 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.426172 19056 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.429486 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.446975 11139 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:10.431192 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.433311 19061 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.448808 19061 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.450893 19064 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.452244 19061 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.451982 19064 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.452942 19061 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.453661 19061 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.446326 19056 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.454942 19116 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.456723 19163 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.435074 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.458961 19163 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:10.460335 11184 connection.cc:256] RPC call timeout handler was delayed by -3.6400158619999274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 12:13:10.461055 11184 connection.cc:256] RPC call timeout handler was delayed by -3.2404158619999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 12:13:10.461692 19163 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.429900 19059 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.510677 19055 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.511711 19055 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.513011 18981 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.513794 18981 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.513870 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.515002 19058 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.515100 11143 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:13:10.515864 19058 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.474136 19175 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.517457 19175 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.518834 18985 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.519693 19067 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.519512 18985 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.520340 19067 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.521827 18985 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.522275 19061 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.510728 19014 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.523237 19112 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.455876 19116 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.523893 19014 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.524047 19112 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.516131 19013 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.522683 18945 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.526213 19013 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.526665 19059 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.527267 18945 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.528757 19013 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.530557 19041 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.530798 19022 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.531093 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.531279 19041 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.531523 19022 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.522864 19061 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.532620 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.532745 19061 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.474048 19174 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:10.533406 11137 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:10.533910 19174 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.534384 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.534850 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:10.535207 11137 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 22: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:10.532092 11144 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 15.
I20260709 12:13:10.594442 11288 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:13:10.543897 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.607515 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.522359 18985 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.610966 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:10.600122 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45315.9us
I20260709 12:13:10.558287 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.610723 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.656977 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.609140 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.608615 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.682128 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:10.682437 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.682817 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.683175 11137 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 29.
I20260709 12:13:10.557794 19061 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.600929 19175 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.598181 19116 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.533917 19022 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:10.602376 11184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.593s (SENT) [suppressed 5 similar messages]
I20260709 12:13:10.609966 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.609601 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.687739 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:10.549988 19141 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 4.984s	user 0.025s	sys 0.020s
I20260709 12:13:10.687528 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.690330 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.692049 18980 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.692131 19144 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.699542 19067 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.700351 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.701211 19056 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.701841 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.702309 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.702906 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.703008 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.703375 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.703696 19059 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.704412 18945 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.705016 19174 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.705403 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.705506 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:10.705957 11288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2841) took 5710 ms (client timeout 3364 ms). Trace:
I20260709 12:13:10.706770 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.706947 18981 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.688155 19055 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.707374 11138 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:10.548838 19058 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.601289 19064 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.655364 19168 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.687645 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.709111 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.709942 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.710829 18985 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.553514 19060 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.714980 19041 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.604592 19024 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.595644 19148 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.552955 19029 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.596973 19014 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.817937 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.793443 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.836824 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.817723 11135 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:13:10.817219 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.785552 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:10.798758 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.899322 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.817219 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:10.902438 11216 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:10.901248 11211 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:10.908057 11286 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.817376 19145 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:10.887004 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 70540.4us
I20260709 12:13:10.907579 11854 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:13:10.896116 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:10.911602 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.595875 19013 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:10.898885 11288 rpcz_store.cc:269] 0709 12:13:04.995357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.995602 (+   245us) service_pool.cc:224] Handling call
0709 12:13:10.695628 (+5700026us) spinlock_profiling.cc:243] Waited 5.39 s on lock 0x7b5400425ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:10.705826 (+ 10198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12396351360}
I20260709 12:13:10.915311 11291 raft_consensus.cc:2368] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 29.
I20260709 12:13:10.915169 11140 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:10.596118 18970 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.928257 18985 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.599661 19112 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.716518 19090 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.909622 19145 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.935704 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:10.937080 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 334751us
I20260709 12:13:10.942298 11136 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 10.
I20260709 12:13:10.942317 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.939926 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 28.
I20260709 12:13:10.945960 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.946394 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.947471 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.946835 11142 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:13:10.951789 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.954192 19090 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.955585 11258 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:10.955756 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:10.957046 19090 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:10.957643 19169 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:10.930335 19060 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.957264 19170 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:13:10.968809 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3160) took 5927 ms. Trace:
I20260709 12:13:10.968941 19028 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.941958 19029 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.969863 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.959067 19169 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.965771 11218 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:10.957261 19144 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.976709 11212 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:10.938102 19148 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.982344 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:10.975500 19124 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.984089 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:10.950249 18970 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.969060 19060 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:10.958233 19013 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:10.951530 18980 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.970160 11141 rpcz_store.cc:276] 0709 12:13:05.041122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.041443 (+   321us) service_pool.cc:224] Handling call
0709 12:13:05.041820 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.042129 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.042155 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.046918 (+  4763us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.295412 (+248494us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:05.509035 (+213623us) log.cc:844] Serialized 14 byte log entry
0709 12:13:05.509497 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.509637 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:10.548993 (+5039356us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:10.968313 (+419320us) raft_consensus.cc:1685] finished
0709 12:13:10.968420 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:10.968619 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177207,"prepare.queue_time_us":214719,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":57695,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":17261,"spinlock_wait_cycles":16841088,"thread_start_us":181995,"threads_started":1,"wal-append.queue_time_us":453154}
I20260709 12:13:11.001883 11139 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
I20260709 12:13:10.990873 11137 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 17: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:11.080435 19144 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.081009 19144 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:11.033440 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45812.1us
I20260709 12:13:11.042887 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:10.977847 19169 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.074265 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.088810 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:11.100456 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.081554 19144 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.101003 11289 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
W20260709 12:13:11.099433 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 142728us
I20260709 12:13:11.105343 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.105597 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.107993 18970 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.059252 19090 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:10.991786 19109 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:10.991480 19124 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.996181 19029 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.108668 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:10.992908 19028 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:10.992502 19015 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:10.993860 19154 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:11.110616 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08003d49a0 after lost signal to thread 9941
W20260709 12:13:11.136332 11882 debug-util.cc:398] Leaking SignalData structure 0x7b0800348140 after lost signal to thread 11076
I20260709 12:13:11.110810 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.111570 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.112737 11144 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:11.114883 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:10.994608 19108 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.126068 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:10.994225 19107 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:11.128731 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.130204 11286 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:11.133904 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.136304 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:11.167037 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd240 after lost signal to thread 11168
W20260709 12:13:11.167446 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd2a0 after lost signal to thread 11169
I20260709 12:13:11.169013 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.180992 19124 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.188517 19013 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.130321 19109 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.194469 19109 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.194656 19090 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.195724 18986 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:11.196169 18986 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.197012 18986 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:11.197119 19090 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.181051 19144 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.199091 19028 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.200181 19145 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.135623 19170 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:11.195993 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.207034 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.207459 11210 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:11.207792 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.208781 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.171950 19015 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:11.209543 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74486.5us
W20260709 12:13:11.213059 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080030d700 after lost signal to thread 11243
I20260709 12:13:11.131544 18970 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:13:11.220104 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080030d760 after lost signal to thread 11244
I20260709 12:13:11.209595 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:11.217585 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44866.4us
I20260709 12:13:11.222913 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.136176 19029 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:11.230886 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.231181 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.231392 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:11.230784 11110 connection.cc:256] RPC call timeout handler was delayed by -2.6793803490002119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33640000000000003s for a response
W20260709 12:13:11.237040 11110 connection.cc:256] RPC call timeout handler was delayed by -2.6793803490002119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33640000000000003s for a response
W20260709 12:13:11.244766 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08003627e0 after lost signal to thread 11317
W20260709 12:13:11.245282 11882 debug-util.cc:398] Leaking SignalData structure 0x7b080031eb60 after lost signal to thread 11318
W20260709 12:13:11.247020 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08003dae60 after lost signal to thread 11885
I20260709 12:13:11.224735 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:11.257894 18980 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.258069 19108 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:11.259136 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.225870 18970 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:11.260365 11110 leader_election.cc:400] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 29.
I20260709 12:13:11.260870 11110 leader_election.cc:403] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:11.261790 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.262606 19124 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 29.
I20260709 12:13:11.262984 19144 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:11.263590 19144 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:11.264811 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.266290 19124 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:11.267055 19124 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:11.268292 19148 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.268308 19124 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.269881 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.264686 19144 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.276759 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.276635 19029 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.260655 18970 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:13:11.280755 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 56125.3us
I20260709 12:13:11.281751 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.279039 19029 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.286327 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.288519 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.210193 19154 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.285619 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:11.295593 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.297037 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:11.286687 19190 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:13:11.206997 19170 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:11.298230 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.300081 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.301013 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.260638 19108 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.286526 19168 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:11.309670 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.286330 19194 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:11.315421 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.195331 19107 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:11.309894 18986 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.291410 19013 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.310410 19178 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:11.323630 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.325615 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.338281 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.311941 19171 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:11.341270 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.342152 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.343044 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.348294 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.318928 19168 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:11.319329 19194 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.362629 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.337867 19178 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.374558 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.345382 19171 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:11.387164 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.388835 11216 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:13:11.367378 19168 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.396946 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.400322 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.371477 19194 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.414781 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.388402 19178 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:11.392279 19171 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:11.415396 11215 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:13:11.421584 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.422549 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.424207 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:11.406849 19111 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:11.434459 11215 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:13:11.380530 19013 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:11.442600 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 127346us
I20260709 12:13:11.442996 19111 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.455926 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.470635 19111 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:11.467964 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.481276 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.507609 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.512981 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.526696 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.494107 19015 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.527374 11285 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:11.543756 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.544721 11143 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:11.530519 18986 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:11.580766 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:11.580816 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 97291.5us
I20260709 12:13:11.588812 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.593288 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.594123 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.583143 19154 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.587142 19170 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.585808 19107 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:11.618062 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.619971 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.621348 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.622862 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.623616 11138 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:11.624763 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.626016 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.626921 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.628369 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 280) took 6957 ms. Trace:
I20260709 12:13:11.628883 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.629895 11140 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:11.631119 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.632284 11140 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:11.608687 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:11.611053 19013 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:11.628888 11039 rpcz_store.cc:276] 0709 12:13:04.670978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.678805 (+  7827us) service_pool.cc:224] Handling call
0709 12:13:11.628297 (+6949492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:10.326248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:10.327079 (+   831us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:10.327143 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:13:10.327173 (+    30us) tablet.cc:662] Decoding operations
0709 12:13:10.328016 (+   843us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:10.328140 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:10.328167 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:13:10.328726 (+   559us) tablet.cc:701] Row locks acquired
0709 12:13:10.328775 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:13:10.328963 (+   188us) write_op.cc:270] Start()
0709 12:13:10.329119 (+   156us) write_op.cc:276] Timestamp: P: 1783599190328869 usec, L: 0
0709 12:13:10.329194 (+    75us) op_driver.cc:348] REPLICATION: starting
0709 12:13:10.330071 (+   877us) log.cc:844] Serialized 1312 byte log entry
0709 12:13:10.684040 (+353969us) op_driver.cc:464] REPLICATION: finished
0709 12:13:11.125627 (+441587us) write_op.cc:301] APPLY: starting
0709 12:13:11.132471 (+  6844us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:11.202003 (+ 69532us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:11.202136 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:11.204450 (+  2314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:11.260932 (+ 56482us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:13:11.260998 (+    66us) write_op.cc:312] APPLY: finished
0709 12:13:11.261418 (+   420us) log.cc:844] Serialized 41 byte log entry
0709 12:13:11.261660 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:11.261786 (+   126us) write_op.cc:454] Released schema lock
0709 12:13:11.261862 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:11.262461 (+   599us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:11.262517 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32324,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":384387,"apply.run_cpu_time_us":9043,"apply.run_wall_time_us":161115,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16703,"num_ops":3,"prepare.queue_time_us":70297,"prepare.run_cpu_time_us":11695,"prepare.run_wall_time_us":44961,"raft.queue_time_us":278926,"raft.run_cpu_time_us":30378,"raft.run_wall_time_us":132800,"replication_time_us":354670,"thread_start_us":276504,"threads_started":4,"wal-append.queue_time_us":70703}]]}
I20260709 12:13:11.641240 11138 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:11.628237 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.649330 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.650286 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.651293 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.677603 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:11.681324 11110 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:11.684551 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.690917 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.688495 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:11.694404 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 119715us
I20260709 12:13:11.700780 19111 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:11.702726 11140 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:11.702905 19170 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.703564 19170 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.706034 19170 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:11.690297 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 180916us
I20260709 12:13:11.708918 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:11.687964 19109 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.723690 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.727245 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.686793 19196 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:11.734195 19111 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:11.747920 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.792781 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:11.787815 11140 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
W20260709 12:13:11.802160 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 70285.9us
I20260709 12:13:11.724325 19013 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 12:13:11.805186 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107778us
W20260709 12:13:11.804503 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61377.9us
I20260709 12:13:11.735642 19144 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:11.811719 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:11.743566 19178 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:11.809248 18970 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:13:11.830148 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.800927 11041 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 23 to 24, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.833657 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:11.834239 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.857172 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.858006 11137 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 12.
I20260709 12:13:11.859263 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.861773 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.863020 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.864470 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.866050 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.867978 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.840224 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.876094 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.876370 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:11.816293 19144 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.881227 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.885180 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:11.889737 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:11.838542 19170 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:11.832347 19219 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:11.881315 19056 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:11.886840 19144 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:11.892361 11041 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 23 to 24, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.881340 19214 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:11.880134 19213 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:13:11.899972 19219 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:11.933876 19209 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:13:11.935034 18986 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:11.838376 18970 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:11.938575 19231 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:13:11.939762 11041 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 13 to 14, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 14 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.942474 19107 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:11.956615 19224 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:11.925923 19214 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:11.966910 19111 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:11.879861 19194 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:11.902153 19170 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:12.023562 19170 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:11.985615 19219 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:12.026598 11210 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:12.018025 19214 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:11.919078 19056 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:12.031025 18970 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.031312 19056 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.012840 19231 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.032518 19231 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:12.033737 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:11.968988 19213 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.034775 19213 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:13:12.035135 19212 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:13:12.014003 11041 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 21 to 22, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.928601 11185 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:12.015647 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 130533us
W20260709 12:13:12.039077 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 220051us
W20260709 12:13:12.041749 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 113281us
I20260709 12:13:12.019157 19107 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.042894 11185 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.043624 11041 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 20 to 21, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:12.018632 19111 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:12.052215 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.068131 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.051717 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.073398 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.032776 19056 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:12.081235 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.090880 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.091666 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.093113 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.067878 19111 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:12.076100 18985 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:12.051065 19112 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:12.067276 19218 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:12.046931 18945 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:12.117615 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 65971.2us
I20260709 12:13:12.105840 11288 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:13:12.118748 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:12.046227 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 208797us
W20260709 12:13:12.105378 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 276013us
W20260709 12:13:12.127067 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 249296us
I20260709 12:13:12.051342 18986 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:12.142208 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:12.143481 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.105288 19216 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.149724 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.149957 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:12.133821 19168 consensus_meta.cc:287] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.006s
I20260709 12:13:12.153968 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.148720 11826 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:12.154253 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.157984 11290 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:12.159526 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.162139 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.133497 18986 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:12.141837 19171 consensus_meta.cc:287] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.705s	user 0.016s	sys 0.003s
I20260709 12:13:12.119830 18985 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.135207 19233 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:12.154601 18945 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.136901 19225 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:12.172145 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.171279 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.200111 11287 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:12.198297 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.155500 19178 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.168867 18985 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.175181 19233 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.168692 19235 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.223376 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.179589 19225 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:12.222193 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95271.3us
W20260709 12:13:12.226230 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 98203.3us
I20260709 12:13:12.207779 19149 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:13:12.230661 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 91296.5us
I20260709 12:13:12.166301 19168 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.175433 19171 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:12.231328 19169 consensus_meta.cc:287] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.122s	user 0.010s	sys 0.010s
W20260709 12:13:12.279461 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 49663us
I20260709 12:13:12.282994 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.225790 19233 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.287151 11291 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:12.228291 19217 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:12.228416 19225 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.178253 11857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:13:12.234344 19149 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:12.346720 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.291837 11857 raft_consensus.cc:606] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.266208 19128 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:12.359346 19128 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:12.359902 19236 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:13:12.352319 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:12.347242 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79126.1us
I20260709 12:13:12.352497 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.353839 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.363418 19171 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.363821 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.365152 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.356984 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:12.352744 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.361325 19194 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.361536 11219 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:12.369270 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:12.375355 11212 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.365801 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:12.359874 19128 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.289201 19217 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:12.381896 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.286728 19169 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.367571 19149 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:12.392900 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.395195 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.395892 11218 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:12.386300 19217 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:12.400122 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 117219us
I20260709 12:13:12.397869 19194 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:13:12.393173 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 108557us
I20260709 12:13:12.404026 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:12.395643 19229 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 12:13:12.403079 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.410473 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.412863 19240 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.419166 11214 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:12.422647 19168 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.424242 19219 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.434753 19109 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:12.430219 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 2108) took 1028 ms. Trace:
I20260709 12:13:12.439015 11291 rpcz_store.cc:276] 0709 12:13:11.401833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.401946 (+   113us) service_pool.cc:224] Handling call
0709 12:13:11.402318 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.289342 (+887024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.429912 (+140570us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400061dd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:12.430110 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034476416}
I20260709 12:13:12.440073 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:12.442174 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:12.386474 19144 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.444100 11135 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:12.447276 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:12.483438 11211 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 12:13:12.484023 11211 pending_rounds.cc:85] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 14
I20260709 12:13:12.494870 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:12.408517 19194 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:12.408365 19206 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.495494 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.494082 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:12.495457 11137 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.498383 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:12.484277 11211 pending_rounds.cc:107] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 12:13:12.501017 11211 raft_consensus.cc:2889] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:12.406119 19154 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:12.502300 19154 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.503623 18985 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.505760 18986 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.507578 19219 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:12.509469 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 62328us
I20260709 12:13:12.512861 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.514272 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.521377 11293 raft_consensus.cc:1240] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:12.510506  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:13:12.522400 11135 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 30.
I20260709 12:13:12.523038 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.523896 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.524910 11215 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 12.
I20260709 12:13:12.526087 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:12.527091 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:12.527796 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:12.435397 19109 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.531037 11212 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:12.529920 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.521795 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:12.533862 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:12.533862 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.523322 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:12.494051 19168 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:12.524289  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:12.538450 11214 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:12.501232 19194 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.546917 11288 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:12.546631 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:12.626708 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:12.627007 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:12.634078 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 100276us
I20260709 12:13:12.634514 11141 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:13:12.634939 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 101133us
I20260709 12:13:12.635149 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.636711 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:12.627849 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 98009.6us
I20260709 12:13:12.631778 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:12.536314 19213 consensus_meta.cc:287] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.003s
I20260709 12:13:12.641626 11286 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:12.531734 19029 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.643465 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.644586 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.544461 18970 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:12.543048 19250 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:12.668839 11293 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
W20260709 12:13:12.654523 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 117462us
I20260709 12:13:12.540338 19168 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.513739 19206 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.674873 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:12.686064 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51033.7us
I20260709 12:13:12.640214 19148 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.687606 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.637599 19242 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:12.667981 19170 consensus_meta.cc:287] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.644s	user 0.021s	sys 0.000s
I20260709 12:13:12.638978 19251 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.707571 19170 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.708135 19255 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:12.709458 19255 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.710153 19255 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.710762 19170 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.700852 19242 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:12.712954 19242 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.674829 19241 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:12.717792 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 171307us
I20260709 12:13:12.656488 19013 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:12.650252 19249 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.662478 18970 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:12.689762 19256 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:12.654914 19029 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.685855 19056 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:12.684002 19168 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.662344 19213 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.731460 19244 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:12.735219 18970 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:12.730370 19013 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:12.696376 19247 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:13:12.722237 11141 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 16.
W20260709 12:13:12.699707 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 152986us
W20260709 12:13:12.752411 19111 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.001s
I20260709 12:13:12.769661 11291 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:13:12.739435 19249 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.773687 19249 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.775179 19249 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:12.775895 19249 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.776922 19242 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.749418 19056 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:12.769716 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 94852.1us
I20260709 12:13:12.753934 19169 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.786602 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:12.788239 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 149944us
I20260709 12:13:12.767350 19124 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:12.789527 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 102054us
I20260709 12:13:12.762688 19013 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:12.783545 19214 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.000s
I20260709 12:13:12.785895 19056 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:12.794710 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.799731 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:12.794405 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.800978 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:12.797610 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:12.804666 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 155698us
I20260709 12:13:12.791039 19144 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:12.804387 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:12.806342 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.790529 19174 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:12.794799 18986 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.781170 19111 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.818183 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:12.828397 19215 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:12.827119 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57967.9us
I20260709 12:13:12.835652 19259 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:12.836313 19111 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.839140 11185 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.841511 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.838081 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:12.846799 11285 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 17. Current term is 18. Ops: []
W20260709 12:13:12.849385 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49460.4us
I20260709 12:13:12.849951 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.851013 11184 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:12.851641 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 56233us
I20260709 12:13:12.852751 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.853963 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.796725 19124 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.855047 19194 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.855381 19259 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.857466 19259 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:12.857905 19124 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.858026 19194 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.848886 19148 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:12.858887 19148 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:12.859261 19148 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.862977 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:12.809422 19060 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.864802 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:12.809724 19260 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:12.869972 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:12.874200 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.812820 19267 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:12.802075 19214 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.825716 19109 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:12.885526 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 91336us
I20260709 12:13:12.849138 19241 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:12.889509 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:12.848292 19220 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:12.826256 19263 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:12.870752 19124 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:12.893826 11826 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.867129 19218 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:12.864634 19266 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:12.871126 19247 raft_consensus.cc:2764] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:12.896788 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:12.863776 19251 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.903594 19029 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.871570 19144 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:12.906869 11284 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:12.907886 19213 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:12.912484 19128 consensus_meta.cc:287] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 12:13:12.913443 19242 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.900030 19261 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:13:13.048292 19261 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:13.048766 19261 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.049480 19214 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.904438 19109 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:13.050824 19109 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:13.051364 19109 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.893898 19112 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.876021 19260 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:12.916590 19233 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.003s
W20260709 12:13:12.916790 19225 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.541s	user 0.000s	sys 0.009s
I20260709 12:13:12.904596 19124 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:12.918685 19056 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:12.922107 18970 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.899089 19267 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.898800 19263 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:13.072244 19263 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.073549 18970 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:12.966310 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72535.8us
I20260709 12:13:13.075011 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.075644 19056 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.937527 19206 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:12.904103 19218 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:13.057921 19128 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.068907 19124 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.077371 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:12.903110 18945 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.078794 19272 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:13.078265 19128 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:13.079505 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:13.080468 19217 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 12:13:13.080864 19244 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:12.877583 19194 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:13.070814 19225 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:12.942549 19107 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:12.992332 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 95601.5us
I20260709 12:13:13.083841 19225 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:12.974960 11137 raft_consensus.cc:2468] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:13.011835 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.086578 11288 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:13.088205 11291 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:13.088619 19231 consensus_meta.cc:287] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 1.056s	user 0.005s	sys 0.008s
I20260709 12:13:13.069087 19233 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.022403 19111 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:13.039053 19154 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.090754 11286 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:13.091325 19233 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.042586 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.076483 19218 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:12.941520 18985 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.080967 11826 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.099165 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.085950 19168 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:13.075954 19149 consensus_meta.cc:287] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 12:13:13.076438 19248 raft_consensus.cc:993] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:12.896519 19265 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.078891 11860 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:13.066663 19260 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.967121 19221 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:13.079531 19128 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:13.089088 19231 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.067451 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.038959 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.094722 11293 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:13.040752 19238 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:13.094900 11136 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.040127 19249 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.104846 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.049888 19261 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
W20260709 12:13:13.070847 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 196708us
I20260709 12:13:13.132025 19262 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:13:13.144863 19261 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:13.145457 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.146260 11287 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:13:13.076062 19267 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.146970 19267 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.125162 11292 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:13.148720 19256 consensus_queue.cc:1059] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:13.149622 19231 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.149914 19256 consensus_queue.cc:1059] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:13.122745 19149 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.150955 19256 raft_consensus.cc:3055] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:13.151464 19256 raft_consensus.cc:740] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.151557 11853 raft_consensus.cc:1240] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:13.130988 19168 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.152522 19256 consensus_queue.cc:260] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.154423 19149 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:13.154811 19060 consensus_queue.cc:1059] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:13.139277 19013 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.155359 19265 consensus_queue.cc:1059] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:13.080894 19217 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.122284 11285 raft_consensus.cc:1275] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:13.145530 19262 raft_consensus.cc:3055] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:13.120784 19264 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.154284 19256 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.142382 19148 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.168659 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.170630 19148 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.151659 19272 raft_consensus.cc:3055] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:13.176841 19274 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:13.173523 19249 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:13:13.123780 19244 raft_consensus.cc:1081] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:13.138093 19124 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.179517 19271 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:13:13.180652 19124 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.177124 19272 raft_consensus.cc:740] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.180784 19109 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.173069 19013 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.175637 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.182655 19231 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:13.183082 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.183223 19231 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.184343 19231 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:13.184885 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.185894 19233 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.186532 19168 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:13.187104 19168 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.187572 19263 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.188079 19168 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.188787 11143 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.190044 19263 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.190891 19263 raft_consensus.cc:3055] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:13.191263 11861 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.192533 19217 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:13.173856 19262 raft_consensus.cc:740] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.194233 19262 consensus_queue.cc:260] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.198769 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.202912 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.204183 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.204924 11285 raft_consensus.cc:2393] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 11: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.208199 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.208995 11293 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 29: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.210680 19248 consensus_queue.cc:1059] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:13.211160 19107 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:13.211998 11136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:40324
I20260709 12:13:13.212683 11136 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:13.209007 19215 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:13:13.213091 11136 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.213758 19267 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:13.214854 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.211823 19107 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.219230 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.221016 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.219400 19265 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:13.222338 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.222810 19265 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.214661 19090 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.009s
I20260709 12:13:13.206524 19149 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:13:13.224526 19267 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:13.224938 19149 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.225025 19267 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.230954 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.228291 11258 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.232815 11290 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.191280 19263 raft_consensus.cc:740] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.237566 11293 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:13:13.239871 19260 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.242573 19249 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:13.243170 19249 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.243664 19260 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.243889 19263 consensus_queue.cc:260] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.244737 19109 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.245517 19263 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:13.245296 19249 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.226110 19267 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.238875 19090 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:13.253587 19144 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:13.254575 19090 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.254930 19144 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.257153 19090 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.257366 19144 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.252133 19255 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:13.226977 19124 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.249866 11136 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.261241 19107 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.225123 19265 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:13.246731 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 378393us
I20260709 12:13:13.269256 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.229386 19244 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:13:13.272073 19244 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:13.272472 19244 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.273401 19244 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.226087 19149 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.265506 19124 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.267241 19255 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.277256 19124 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.280584 19255 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.281356 19244 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:13.281615 19124 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.283128 19218 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.283785 19225 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.284384 19225 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.285851 19218 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:13.259091 19168 raft_consensus.cc:2804] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:13.287299 19225 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:13.314765 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.314886 19168 raft_consensus.cc:697] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.316377 19168 consensus_queue.cc:237] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.317947 11293 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:13.289893 19275 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:13:13.318544 19275 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.319487 11285 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:13.319868 19275 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.286078 19272 consensus_queue.cc:260] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.321429 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.322295 11293 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.322225 19272 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:13.322976 11290 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:13.297016 19279 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:13:13.308430 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.312606 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.313385 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.314071 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.287478 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.323707 11136 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:13.327555 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.328869 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.321431 19275 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:13.338315 11285 raft_consensus.cc:1240] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:13.339121 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.342803 11142 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:13.342881 11861 raft_consensus.cc:3055] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.344259 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.343811 11861 raft_consensus.cc:740] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.344944 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.345755 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.347095 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.352488  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:13.353168 11256 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.346544 19276 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.355417 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:13.359844 11856 raft_consensus.cc:2468] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:13.345840 11861 consensus_queue.cc:260] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.366154 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.364683 19225 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:13.363274 19252 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:13.373670 11284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 4338) took 1177 ms. Trace:
I20260709 12:13:13.370604 19174 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.376080 11256 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.377851 19278 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:13.378192 19269 raft_consensus.cc:2804] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:13.378741 19269 raft_consensus.cc:697] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.379030 19278 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:13.379586 19278 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.366706 19276 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:13:13.379915 19269 consensus_queue.cc:237] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.380620 19174 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:13.381502 19013 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:13.381867 19013 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.382553 19276 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:13.383075 19276 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.382726 19013 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.383980 19276 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.384473 19013 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.380640 19278 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.374194 11284 rpcz_store.cc:276] 0709 12:13:12.192210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.192414 (+   204us) service_pool.cc:224] Handling call
0709 12:13:12.210278 (+ 17864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:13.021066 (+810788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.369722 (+348656us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540031a6d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:13.369847 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599134976}
I20260709 12:13:13.388486 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:13.388748 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 499324us
I20260709 12:13:13.393147 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.399530 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.400853 11861 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.386607 19278 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:13.403304 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 144754us
I20260709 12:13:13.407364 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.408150 11212 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:13.403399 19221 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:13.412133 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.382869 19261 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:13:13.398196 19252 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:13.443332 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.444484 11287 raft_consensus.cc:1240] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.411901 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.444059 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.444247 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.440491 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.451079 11211 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:13:13.388108 19260 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:13:13.451946 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.392339 19215 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:13:13.450496 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.411410 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.449322 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.455906 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.456218 19107 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:13.456403 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.458992 19261 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:13.459553 19261 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.459857 19263 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:13.460561 19263 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:13.460475 19261 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.461946 19261 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:13.448134 11214 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:13.459095 19255 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:13.442119 11213 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:13:13.464457 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:13.466914 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.468955 11138 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:13.467587 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 94129.3us
I20260709 12:13:13.470053 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.486204 11135 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:13.471010 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.443768 19154 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 12:13:13.487984 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet a5303488c195434ca5cfdb88d6256a0c: Illegal state: Replica 018d40ceb45d4447aa293f4c1d929bb8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:13.490849 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.478868 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.479161 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.493517 11138 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.479892 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.483965 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.486320 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:13.485483 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 94827us
I20260709 12:13:13.400619 19056 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.476025 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.495952 11139 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 21: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:13.479729 19255 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:13.496248 11140 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:13.494680 11144 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:13.452170 19264 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:13.509708 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.452025 19090 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:13:13.500115 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.501339 19168 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:13.523424 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.502455 19260 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:13.526638 11284 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:13:13.527328 11135 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:13:13.503957 19262 raft_consensus.cc:3060] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.459319 19265 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:13:13.520489 11861 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
W20260709 12:13:13.497359 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.521503 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:13.523121 11141 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:13.517447 19264 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.512967 19255 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.531603 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:13.535229 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.536762 11216 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.537477 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.542727 11212 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 18: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:13.537910 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.538645 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.539330 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.540062 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.537397 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.438901 18985 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 12:13:13.543730 11214 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
W20260709 12:13:13.547984 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 144706us
I20260709 12:13:13.550547 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.550932 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.551210 11210 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:13.554533 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.555611 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.556052 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.557711 11141 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:13.558225 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.547598 19244 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:13:13.560783 19255 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.562139 19255 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.547771 19171 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:13.570868 19264 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.571902 19267 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:13.572567 19264 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:13.577019 11858 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:13:13.585372 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.586830 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.587638 19216 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:13:13.588033 19216 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:13.588265 19260 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:13.588455 19216 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:13.590669 19107 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:13:13.596901 11107 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.597755 19265 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.598137 11107 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:13.598891 19265 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:13.599548 19265 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.600680 19265 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.603277 19276 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:13.583477 11144 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:13.608596 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.607978 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:13.608594 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.609659 11136 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:13:13.609385 11140 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 29.
I20260709 12:13:13.588043 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.613734 11138 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:13.615813 11143 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.627472 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.629741 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.631491 11214 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:13.632795 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.630957 19235 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:13:13.634930 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.622177 19239 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:13.639124 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.642163 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.642846 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.634987 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:13.647081 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.646799 18986 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:13.648383 18986 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:13.648736 18986 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.649907 11290 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.650753 11293 raft_consensus.cc:2393] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.650810 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:13.651389 11292 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.651495 11285 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.652230 11214 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:13.653116 11217 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:13.653559 18986 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.654767 18986 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.658888 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.659709 19149 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:13.661000 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:13.662106 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.664709 19060 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:13.665813 19283 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:13.666225 19283 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.667286 19283 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.668617 19283 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.669013 11212 raft_consensus.cc:2393] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:13.670363 11211 raft_consensus.cc:1240] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:13.671968 19266 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:13.672394 19266 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.673209 19266 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.674505 19217 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:13.674898 19217 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.677035 19275 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:13.677448 19275 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:13.678207 19275 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.679196 19275 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.679435 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.680701 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.681335 11041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 280) took 9368 ms. Trace:
I20260709 12:13:13.639550 19235 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.699038 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.707654 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.681800 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.710256 11139 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 10. Current term is 11. Ops: []
I20260709 12:13:13.682379 11144 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.686712 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.683117 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.696677 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.695792 11039 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 21 to 23, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 23 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.717118 11211 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:13:13.717952 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.709143 11213 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:13.713358 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.718895 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.689479 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.725601 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:13.698976 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:13.726878 11217 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:13.727196 11292 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:13.727474 11285 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:13.688444 19239 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.730228 19215 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:13:13.731025 19239 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.731837 19235 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.733354 19235 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:13:13.684309 19217 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.734046 11213 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:13.687548 19060 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:13:13.736011 19217 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:13.736281 19266 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:13.738113 19215 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:13.737293 11214 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:13.739184 19274 consensus_queue.cc:1175] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" responder_term: 24 status { last_received { term: 23 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:13.738526 19215 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:13.741468 11861 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:13.742156 19215 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.743868 19215 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:13.746016 11215 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:13.684506 19056 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:13.703011 19241 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:13:13.750574 11144 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:13.752890 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet e7c488a2c80e4e21bde9ae92cfae70b3: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:13.752193 11211 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 30 because replica has last-logged OpId of term: 29 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 15.
I20260709 12:13:13.753345 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 283) took 9712 ms. Trace:
I20260709 12:13:13.754062 11143 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:13.721019 11039 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:13.762624 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:13.758941 19056 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.766716 19056 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.768013 19056 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.760596 11040 rpcz_store.cc:276] 0709 12:13:04.040763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.040910 (+   147us) service_pool.cc:224] Handling call
0709 12:13:04.271566 (+230656us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:13:13.753110 (+9481544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79353,"reported_tablets":6,"spinlock_wait_cycles":239278976}
I20260709 12:13:13.681701 11041 rpcz_store.cc:276] 0709 12:13:04.312636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.312783 (+   147us) service_pool.cc:224] Handling call
0709 12:13:13.681246 (+9368463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:12.484497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:12.507227 (+ 22730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:12.507272 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:13:12.507294 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:12.508072 (+   778us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:12.508149 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:12.508182 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:12.642626 (+134444us) tablet.cc:701] Row locks acquired
0709 12:13:12.652724 (+ 10098us) write_op.cc:260] PREPARE: finished
0709 12:13:12.675384 (+ 22660us) write_op.cc:270] Start()
0709 12:13:12.696737 (+ 21353us) write_op.cc:276] Timestamp: P: 1783599192669277 usec, L: 0
0709 12:13:12.700113 (+  3376us) op_driver.cc:348] REPLICATION: starting
0709 12:13:12.781939 (+ 81826us) log.cc:844] Serialized 2094 byte log entry
0709 12:13:13.221630 (+439691us) op_driver.cc:464] REPLICATION: finished
0709 12:13:13.377330 (+155700us) write_op.cc:301] APPLY: starting
0709 12:13:13.377460 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:13.381246 (+  3786us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:13.381340 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:13.506241 (+124901us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:13.506584 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:13:13.506633 (+    49us) write_op.cc:312] APPLY: finished
0709 12:13:13.506925 (+   292us) log.cc:844] Serialized 57 byte log entry
0709 12:13:13.507113 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:13.507232 (+   119us) write_op.cc:454] Released schema lock
0709 12:13:13.507278 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:13.507800 (+   522us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:13.507829 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78644,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":155401,"apply.run_cpu_time_us":9618,"apply.run_wall_time_us":130424,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25087,"num_ops":5,"prepare.queue_time_us":206188,"prepare.run_cpu_time_us":50857,"prepare.run_wall_time_us":587995,"raft.queue_time_us":132819,"raft.run_cpu_time_us":15178,"raft.run_wall_time_us":122113,"replication_time_us":521360,"thread_start_us":504118,"threads_started":4,"wal-append.queue_time_us":298529}]]}
W20260709 12:13:13.773633 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 66039us
I20260709 12:13:13.772492 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.773284 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.775079 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.783109 11258 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.787621 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.762611 19261 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:13:13.790282 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 76980.9us
I20260709 12:13:13.793491 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.787168 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.773645 19090 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.804657 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.807487 11138 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:13:13.811667 11139 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 30 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:13:13.812803 11135 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:13.807780 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:13.808355 19154 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:13:13.784714 19231 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:13:13.820528 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.821271 11213 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:13.818347 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.768666 19269 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:13:13.814698 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.784085 19107 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:13:13.808450 19013 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:13.850036 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.852519 11219 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:13:13.809196 19252 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:13.808583 19148 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:13.820004 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.830444 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.792680 19168 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:13.851181 11293 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.818688 11258 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.851788 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.821316 19225 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:13.846803 19107 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:13.817551 18945 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.858940 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.853693 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.915721 11213 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:13.819798 19218 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.830400 19029 consensus_queue.cc:1048] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:13:13.899668 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.823376 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.899032 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:13.860867 19194 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:13.866187 19231 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:13.933751 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 115139us
W20260709 12:13:13.931703 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 108522us
I20260709 12:13:13.935815 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:13.930474 11211 raft_consensus.cc:2368] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 30.
I20260709 12:13:13.937254 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:13.898818 19013 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.928097 11215 raft_consensus.cc:2376] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22. Re-sending same reply.
I20260709 12:13:13.954322 19218 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:13.955963 19218 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.956426 19218 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.958168 11213 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:13.922549 19225 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.924299 19221 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:13.947501 11861 raft_consensus.cc:1275] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:13.957566 19218 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.924779 19148 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.938783 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:13.945686 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:13.916162 19107 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:13.940050 19154 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:13.971619 19225 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:13.943480 19168 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:13.951913 19090 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:13.951335 19258 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:13.980329 11214 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 16. (term mismatch)
I20260709 12:13:13.992971 11214 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 15
I20260709 12:13:13.996567 11214 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 29.16
I20260709 12:13:13.982558 18986 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:13.998558 11214 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:13.985335 11216 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:13.961937 19221 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:13.983165 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:13.981402 19249 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:14.000137 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 5fd2e22241c745b9aa339da0259546f0: Illegal state: Replica 5d1ee1ef054240338e0a9e05a67acdfc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:13.988814 19090 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:14.019222 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.981099 19148 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.014658 11219 raft_consensus.cc:2393] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:14.014281 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 206578us
I20260709 12:13:13.978360 19216 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:13.982892 19171 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:13:14.031095 19221 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.031878 19171 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:14.032256 19171 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:14.032425 19221 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.033113 19171 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.000011 19231 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.022022 19242 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:13:14.038952 19148 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:14.039340 19242 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:14.040745 19242 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.042133 11218 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:13.976974 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.045363 19216 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.045471 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:14.001389 19258 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:14.023253 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.045074 11217 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:14.050117 11852 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
W20260709 12:13:14.052372 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 75549.6us
I20260709 12:13:14.056442 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:14.059382 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.061154 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.063248 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:14.065718 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:14.015630 18986 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:14.034353 19171 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.021128 19090 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.000320 19247 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:14.056396 19109 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.071568 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.092753 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.069911 19029 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:14.020089 19218 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.069765 19154 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:14.082258 19194 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:14.098821 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.071020 19269 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:14.070112 19255 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:14.070807 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.050163 19107 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.070138 19265 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:13:14.102010 19124 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.126771 11861 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:14.096851 19109 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:14.140034 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 321738us
I20260709 12:13:14.091236 18985 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.100214 19267 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:13:14.141436 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 70723.6us
I20260709 12:13:14.177038 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.177349 11143 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:14.143095 19213 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:14.179401 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:14.181663 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.073315 19168 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.161509 19107 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.164124 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:14.118340 18986 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.118480 19154 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:14.170723 19300 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:13:14.171180 19303 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:14.122937 19194 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:14.141866 19255 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.174614 19109 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:14.143710 19293 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:13:14.183807 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:14.186107 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 87410.6us
I20260709 12:13:14.196498 19225 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.203344 19231 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.249553 19154 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:14.164156 19269 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:14.175105 19258 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.253579 19194 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.178572 19267 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:14.256013 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.199687 19264 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:14.196055 19111 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:14.195735 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:14.267377 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 83679us
I20260709 12:13:14.288959 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.268396 19303 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:13:14.289676 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 94052.3us
I20260709 12:13:14.293458 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:14.289824 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.299557 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.291873 19124 raft_consensus.cc:2764] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:13:14.287072 19267 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:14.304265 19309 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:14.307152 19269 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.311527 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.316332 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:14.318544 11143 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:14.325114 19090 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.327191 19154 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.327463 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:14.331125 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.312938 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.341179 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.289157 19111 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:14.355696 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44295.3us
I20260709 12:13:14.356840 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.344326 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.354203 19221 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.358901 19264 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:14.359143 19221 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:14.342746 19124 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:14.360658 19124 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.361541 19221 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:14.362318 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.296795 18985 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.366536 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.377812 11110 leader_election.cc:400] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 28. Current term is 30.
I20260709 12:13:14.315311 19216 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:13:14.378026 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:14.383742 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:14.368249 19107 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:14.365439 19111 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:14.386837 11143 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 30.
I20260709 12:13:14.365945 19274 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:14.384788 11826 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.379514 19247 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.394408 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:14.381287 19215 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:14.383761 19303 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:14.383977 19307 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:14.386837 19216 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:14.407189 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:14.388411 19107 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:14.412300 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.382270 19264 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:13:14.415186 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.369618 19225 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:13:14.386277 19217 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:13:14.406049 19174 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:13:14.406991 19303 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:14.435695 11135 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:14.436818 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:14.413040 19235 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.417861 19107 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.419108 19309 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:14.418771 18985 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:14.446815 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:14.420413 19275 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.449584 11141 raft_consensus.cc:3060] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.452716 19264 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:14.455106 11143 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:13:14.455229 11219 raft_consensus.cc:2393] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 13: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:14.454391 18985 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.467028 18985 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:14.470769 19317 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:14.471267 19317 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:14.472146 19317 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.473455 19317 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.477516 19154 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.479229 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:14.480855 19267 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.481570 19109 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:14.487442 11139 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:14.494773 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:14.441953 19090 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:14.438097 19303 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:14.501832 11135 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:13:14.515136 11141 raft_consensus.cc:1275] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:13:14.498476 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84507.6us
I20260709 12:13:14.523614 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:14.524423 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.455467 19309 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:14.491345 19235 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:14.491747 19154 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.539388 11861 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:14.540972 11212 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:14.496376 19329 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:14.542698 19329 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:14.543321 19109 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:14.528703 19255 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:13:14.543797 19329 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.546231 19322 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:14.546897 19329 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:14.547246 18985 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:14.532824 19216 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.555277 19255 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:14.557013 19255 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.557106 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:14.557551 19255 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.559531 19090 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.532555 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 112821us
I20260709 12:13:14.517797 19149 raft_consensus.cc:3055] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:13:14.604449 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 182047us
I20260709 12:13:14.603925 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:14.533761 19235 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:13:14.617197 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.620107 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:14.621500 19109 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.534212 19309 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.622083 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:14.607471 19149 raft_consensus.cc:740] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:14.612445 19267 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:14.560118 19090 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.640105 11861 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:13:14.636955 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 214623us
I20260709 12:13:14.647747 11141 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:14.602029 19154 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.628918 19109 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:14.665123 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:14.690106 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:14.694468 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:14.695300 11286 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:14.697862 11287 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:14.647648 19323 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:13:14.673468 19109 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:13:14.716333 19319 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:13:14.701555 19149 consensus_queue.cc:260] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:14.734555 19318 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:13:14.735901 19090 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.737738 19154 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.746027 11141 raft_consensus.cc:1240] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 12. Current term is 13. Ops: []
I20260709 12:13:14.746222 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:14.767043 11854 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:14.711724 19274 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:14.746564 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:14.768906 11852 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:13:14.690845 19111 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:14.695819 19330 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 12:13:14.770440 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:13:14.776105 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet 35f8f77c6e8c4a66b41088646a9c8c90: Illegal state: Replica ba2779405e8d452e95f42421b2b60928 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
W20260709 12:13:14.781037 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 97226.9us
I20260709 12:13:14.782990 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.784762 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:14.791858 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:14.703262 19235 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:14.944604 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 145627us
I20260709 12:13:14.786471 19154 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:14.951610 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 166976us
I20260709 12:13:14.769001 19107 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:14.936663 19312 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:13:14.773064 19327 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.164s
W20260709 12:13:15.002068 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49745.4us
W20260709 12:13:15.019217 19331 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
W20260709 12:13:15.025971 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73627.1us
I20260709 12:13:14.952937 19154 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.952945 19109 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:15.035179 19334 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:13:15.036856 19194 consensus_meta.cc:287] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.006s
I20260709 12:13:15.037343 19194 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.039804 19111 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.990877 19247 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.040952 11292 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:15.040591 19154 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.046845 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:14.991801 19255 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:14.990877 19225 consensus_queue.cc:1048] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.094s
W20260709 12:13:15.046650 19335 log.cc:927] Time spent T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:13:15.005915 19339 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:15.028436 19346 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.009763 19317 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:15.053467 19247 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.069494 19194 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.065198 19107 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.061311 19255 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:13:15.078312 19309 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:15.090257 19275 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.002s
I20260709 12:13:15.090399 19247 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:15.090898 19275 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:15.092129 11138 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:15.094795 19309 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.095707 19347 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.096472 19347 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.099630 19347 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:15.101918 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.112895 19303 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 12:13:15.113446 19303 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.115110 11290 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:15.130249 19313 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:15.130857 19313 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:15.131676 19324 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:15.132139 19324 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:15.131891 19313 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.133294 19313 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.133055 19324 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.133597 19174 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.133860 19307 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.134413 19307 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.136643 19307 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.137494 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:15.138139 11218 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:15.139640 19056 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.140167 19056 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.133627 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:15.142989 11210 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:13:15.143489 18985 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:15.145330 19221 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:15.145887 19221 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.146803 11141 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:13:15.148151 19221 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.134286 19174 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.149333 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.150046 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:15.150913 19324 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.151094 19174 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.152076 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:15.152691 11144 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:15.155822 19303 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:15.158752 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 388534us
I20260709 12:13:15.161832 19324 consensus_queue.cc:1059] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:15.162559 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 157) took 2958 ms. Trace:
I20260709 12:13:15.162953 19324 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.168378 19324 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.169493 19264 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.170015 19264 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:15.170778 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 139938us
I20260709 12:13:14.696911  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:15.178720 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.185659 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.186036 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.186358 11143 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:13:15.186569 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.186645 11139 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:15.187583 11135 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 29.
I20260709 12:13:15.162940 11039 rpcz_store.cc:276] 0709 12:13:12.286239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.366041 (+ 79802us) service_pool.cc:224] Handling call
0709 12:13:15.162430 (+2796389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:13.991921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:14.116811 (+124890us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:14.118983 (+  2172us) write_op.cc:435] Acquired schema lock
0709 12:13:14.121849 (+  2866us) tablet.cc:662] Decoding operations
0709 12:13:14.157062 (+ 35213us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:14.157135 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:14.157169 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:14.157528 (+   359us) tablet.cc:701] Row locks acquired
0709 12:13:14.157549 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:13:14.157727 (+   178us) write_op.cc:270] Start()
0709 12:13:14.157862 (+   135us) write_op.cc:276] Timestamp: P: 1783599194157675 usec, L: 0
0709 12:13:14.157887 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:13:14.158685 (+   798us) log.cc:844] Serialized 919 byte log entry
0709 12:13:14.201224 (+ 42539us) op_driver.cc:464] REPLICATION: finished
0709 12:13:14.483221 (+281997us) write_op.cc:301] APPLY: starting
0709 12:13:14.496985 (+ 13764us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:14.544286 (+ 47301us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:14.544406 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:14.545869 (+  1463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:14.546094 (+   225us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:13:14.546143 (+    49us) write_op.cc:312] APPLY: finished
0709 12:13:14.613684 (+ 67541us) log.cc:844] Serialized 33 byte log entry
0709 12:13:14.625803 (+ 12119us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:14.638265 (+ 12462us) write_op.cc:454] Released schema lock
0709 12:13:14.645140 (+  6875us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:14.681624 (+ 36484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:14.688733 (+  7109us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3208,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":240557,"apply.run_cpu_time_us":6005,"apply.run_wall_time_us":212684,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12511,"num_ops":2,"prepare.queue_time_us":207876,"prepare.run_cpu_time_us":4162,"prepare.run_wall_time_us":177328,"replication_time_us":43127,"thread_start_us":338973,"threads_started":2}]]}
I20260709 12:13:15.188946 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:15.175089 11042 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:15.142256 19056 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.208866 11144 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 31.
I20260709 12:13:15.211699 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.211542 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.218813 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:15.212558 11042 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 26 to 28, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 28 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:15.224562 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.228427 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.230139 11853 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:15.220428 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:15.225272 11857 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:13:15.233810 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:15.232246 11042 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 26, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 26 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.200037 19261 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.221668 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:15.200413 19267 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.201929 19333 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.205082 19336 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.237263 11042 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 15 to 17, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 17 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.236889 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:15.203809 19307 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.229503 19337 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:15.220410 19347 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.210850 19109 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.230561 19309 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.257555 11107 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:15.262526 11042 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.246131 19324 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:15.214643 19329 consensus_queue.cc:1059] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:13:15.242172 19221 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:15.249375 19107 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:15.246701 18945 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.289012 11218 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:15.287213 19109 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.292302 19148 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.286834 19241 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.293180 19349 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:15.230345 19174 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:13:15.262251 19337 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.301975 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:15.303334 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:15.313841 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.341988 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.249033 19261 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.252064 19267 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.340200 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:15.349938 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48057.5us
I20260709 12:13:15.300307 19216 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:15.289908 19107 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:15.351517 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 180082us
I20260709 12:13:15.352717 11293 raft_consensus.cc:2393] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:15.264348 19307 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.307343 19349 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.278901 19154 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.256577 19333 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.376819 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:15.378306 19333 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.378213 19303 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:15.380321 19303 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:15.380823 19264 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.262776 19336 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.382133 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:15.382823 11216 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.383347 19336 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.386034 19261 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.288261 19309 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.386407 19056 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.343246 19337 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.396793 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.397660 11293 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:15.305197 18945 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.342571 19241 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.417253 11144 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:13:15.417591 11135 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:13:15.353155 19216 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:15.418356 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.357658 19107 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:15.419150 11139 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:15.419315 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:15.419646 11135 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:15.405179 19340 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:15.418851 19216 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.420790 11143 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:15.381966 19303 consensus_queue.cc:1048] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:15.356421 19090 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:15.422526 19090 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:15.423760 19090 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.287353 19347 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.371212 19154 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.427376 11135 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:15.427805 19154 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.361040 19349 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.371946 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:15.375326 19255 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.288942 19221 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:15.405478 19352 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:15.405164 18985 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.407186 19307 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:15.407573 19350 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:13:15.407759 18945 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.471487 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:15.461601 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.407954 19353 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.408977 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:15.410588 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.410729 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.418525 19241 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.365746 19339 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.365017 19267 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.420661 19340 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.427394 11144 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 30. Current term is 31. Ops: [30.16-30.16]
I20260709 12:13:15.368695 19109 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.432471 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:15.433812 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.435743 11861 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:13:15.437227 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:15.449330 11210 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:15.461140 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.428346 19347 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.481805 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.501116 11856 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 16.
I20260709 12:13:15.482118 11289 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:13:15.440737 19269 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 12:13:15.486382 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:15.428457 19154 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:15.488400 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 79517.8us
I20260709 12:13:15.490397 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.514537 11216 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:15.491099 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.454113 19221 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.495631 11258 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:15.447831 19261 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.497732 11857 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.499678 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:15.482031 11292 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:15.482064 19276 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:15.511917 11855 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:13:15.567090 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 330279us
I20260709 12:13:15.503613 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:15.512490 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.491124 18945 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.570946 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:15.489338 19353 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.525156 19154 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.525251 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:15.573312 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.525668 19340 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:15.527402 11107 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:15.528046 19347 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:15.530674 19357 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:15.531746 19013 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.494886 19339 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.534978 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:15.535725 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:15.515208 19225 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:13:15.540398 11218 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:15.540876 19149 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:15.542953 19241 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.550506 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:15.694723 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 123862us
I20260709 12:13:15.555157 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:15.556468 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60828.8us
I20260709 12:13:15.695608 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:15.523051 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:15.450562 19255 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.515841 11860 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:15.498210 19239 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.482311 18985 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:15.569113 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 65759.2us
W20260709 12:13:15.701907 11826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.482355 19148 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.491619 19056 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:15.522082 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:15.583240 19309 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:15.579957 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 52646.9us
I20260709 12:13:15.580385 11290 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:15.512702 19303 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:13:15.539417 11215 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 30. Current term is 31. Ops: [30.16-30.16]
I20260709 12:13:15.564934 19242 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:15.650959 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.579053 19276 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.695631 11212 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
W20260709 12:13:15.672971 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 90953.2us
W20260709 12:13:15.706626 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 183648us
I20260709 12:13:15.722060 19358 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:15.722653 19358 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.723039 19358 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.724125 19221 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.708516 11285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:15.665184 19357 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.576779 11856 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:13:15.726303 19221 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.715277 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.716150 11289 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 21: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:15.693822 19174 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:13:15.705245 19313 consensus_meta.cc:287] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 12:13:15.574654 18945 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.576768 19261 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.722676 19365 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:15.726976 11285 raft_consensus.cc:606] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:15.703169 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:15.733341 19357 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:15.734058 19332 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:13:15.734278 19353 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:15.719074 11292 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:15.734822 19339 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.671160 19013 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.741349 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.751225 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:15.751578 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.744760 19347 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.755695 11290 raft_consensus.cc:2393] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:15.757622 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.718827 19242 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.761001 11292 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:15.703537 19233 consensus_queue.cc:1059] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:15.735858 19174 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.702773 19241 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:15.772538 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77024.1us
I20260709 12:13:15.775609 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.768769 19242 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.742949 18945 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.784911 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:15.747997 19221 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.707360 19239 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.798676 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.791945 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:15.754995 19217 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:15.742611 19365 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.797526 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:15.728518 19269 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:13:15.760473 19339 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.786713 19174 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:15.748914 19309 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:13:15.820674 19362 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:15.820990 19344 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:15.821652 19344 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:15.821527 19258 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.822826 19013 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.822647 19344 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.823071 19258 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.824147 19276 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.825294 18985 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.825992 19371 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.826431 19148 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.826517 19371 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.827885 19255 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.801997 19217 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.829066 19217 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:15.829674 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.812239 19154 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:15.831053 19154 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:15.832065 19241 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:15.825421 19363 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:13:15.770117 19336 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
W20260709 12:13:15.846930 19369 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:15.764494 19347 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.831868 19154 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.805692 19365 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:15.861610 11857 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
W20260709 12:13:15.862015 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 165762us
W20260709 12:13:15.866956 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61172.8us
I20260709 12:13:15.806030 19221 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.872046 11859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:13:15.869880 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:15.860123 19255 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:15.856914 19362 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:15.814389 19339 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.864548 19276 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.887357 19235 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.875413 19216 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.892231 19216 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.894637 19370 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:15.895287 19370 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.897375 19370 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.899168 19371 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.900583 19324 raft_consensus.cc:3055] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:15.901008 19324 raft_consensus.cc:740] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:15.901353 19221 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:15.902421 19368 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:13:15.904887 19357 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.905385 19357 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.907116 19217 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.919050 19367 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.919893 19339 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.919723 19367 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.921191 19339 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.921690 19124 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:15.908761 19327 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:15.921949 19351 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:15.922549 19327 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:15.922268 19124 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.923121 19351 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:15.910439 19261 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.923491 19327 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.924530 19124 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.925040 19327 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.901878 19324 consensus_queue.cc:260] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.866393 19358 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.869007 19313 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:13:15.875686 19255 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:15.929468 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.915154 19360 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.926622 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.927783 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.931753 11141 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 11.
I20260709 12:13:15.925429 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.934299 11211 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:15.923511 19351 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:15.930315 11285 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:15.962570 19324 raft_consensus.cc:3060] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.963295 19323 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:15.962924 19351 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:15.964080 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.964964 11284 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:15.965770 19367 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.965939 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:15.966519 19349 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:13:15.966784 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.967005 19349 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.967497 11289 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:15.967984 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:15.964257 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:15.969573 11853 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
W20260709 12:13:15.969849 19107 consensus_meta.cc:287] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 12:13:15.970769 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:15.971657 19357 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.964219 19351 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:15.973698 18945 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:15.974757 19358 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:15.975315 19374 log.cc:927] Time spent T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:13:15.976171 19111 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:15.976671 19255 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.880192 19247 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 12:13:15.977732 19255 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.978854 19258 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:15.981339 19347 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.929802 19276 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:15.983109 19217 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:15.983986 19276 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:15.954394 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 84605.2us
I20260709 12:13:15.987447 11135 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:13:15.990433 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:15.991380 11285 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.990705 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:15.992673 11289 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.001286 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.001976 11286 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:15.998116 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.002883 11292 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.866128 19337 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.005457 19337 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.006402 19362 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 16, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:16.008337 19349 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:15.970394 19107 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.009828 11859 raft_consensus.cc:606] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:16.010267 11859 raft_consensus.cc:614] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:16.012149 19360 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.013273 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.014134 11853 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 13.
I20260709 12:13:16.003001 19380 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:16.020273 19380 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.020735 19380 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.029232 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.029410 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.030241 11284 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:16.030145 11853 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 11.
I20260709 12:13:15.996809 19367 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.031740 19367 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.032167 19239 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.001204 19357 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:16.032900 19357 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.033934 19367 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.034762 11285 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:13:16.036911 11826 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.038347 19235 raft_consensus.cc:2804] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:16.039072 19235 raft_consensus.cc:697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:16.011045 19347 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.040022 19235 consensus_queue.cc:237] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.041348 19347 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.041967 19107 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.042631 19317 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:16.043056 19317 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:16.043576 19347 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:16.044622 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 47806.5us
I20260709 12:13:16.045308 19360 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.045324 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.035033 19357 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.047209 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.048672 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:15.984365 18945 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.061790 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.060964 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.065641 11285 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:16.066268 11292 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:16.050616 19337 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.065281 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64505.3us
I20260709 12:13:16.080248 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.083174 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.083767 11214 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:16.085340 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.086158 11211 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:16.092226 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.092984 11214 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:16.055498 19276 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:16.098095 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.099181 11135 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:16.089818 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.100790 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.063627 19013 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:16.095201 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.108023 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:15.921715 19339 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.082058 19370 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:13:16.121565 19365 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.127286 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.102438 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.099990 11219 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:16.106753 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:16.161837 11141 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:16.162307 11135 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.108870 11139 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:16.094826 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.068928 19218 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:16.116252 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.165134 11852 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.088768 19337 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.122690 19339 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.180279 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.113641 11825 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.181290 11139 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
W20260709 12:13:16.181748 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 68208.5us
I20260709 12:13:16.083716 18985 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:16.087489 18945 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:16.126722 11213 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:13:16.127777 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2893) took 1100 ms. Trace:
I20260709 12:13:16.096710 11259 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:16.065757 19242 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.167923 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.168653 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.169098 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:16.170814 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:16.098558 19276 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.174049 11218 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:16.171561 19217 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:16.176365 11211 raft_consensus.cc:1240] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:16.178194 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.180574 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.219899 11141 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:16.221323 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:16.125200 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.184435 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.184669 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:16.185607 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.223063 11210 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:16.223414 11139 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:16.224363 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.185909 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.225513 11144 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:16.187254 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.187803 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.172406 19154 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.196887 19149 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:13:16.199510 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:16.202245 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.231868 11858 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:16.231985 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.203831 11138 raft_consensus.cc:2468] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 16.
I20260709 12:13:16.232625 11144 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:16.233511 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:16.222828 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.200984 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.234875 11139 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:16.210093 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:16.210659 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 111857us
I20260709 12:13:16.212276 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:16.231117 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52990.7us
I20260709 12:13:16.236440 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.164954 19109 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.216763 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.213686 11219 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:13:16.203505 18985 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.226305 11137 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:16.089221 19317 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.174970 19360 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.213135 19013 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.207626 11287 rpcz_store.cc:276] 0709 12:13:15.027740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.027917 (+   177us) service_pool.cc:224] Handling call
0709 12:13:15.031467 (+  3550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:15.031677 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:15.031969 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 12:13:15.157936 (+125967us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b180034de60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d968c0a 00007f98370a8219 00007f982d9f0a40 00007f982d9eb4e4 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287 00007f9830af6208
0709 12:13:16.115914 (+957978us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b180034de60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f98306834bc 00007f982d9d148b 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9eb455 00007f9830ad3060 00007f9830ae5716 00007f9830af6287
0709 12:13:16.127420 (+ 11506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:16.127487 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:16.127536 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.127602 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.127716 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134700,"prepare.queue_time_us":15802,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":173068,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":17321,"spinlock_wait_cycles":20422400,"thread_start_us":77329,"threads_started":1,"wal-append.queue_time_us":3965,"wal-append.run_cpu_time_us":670,"wal-append.run_wall_time_us":1001812}
I20260709 12:13:16.262393 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.205698 11135 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:16.263418 11857 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:16.235046 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:16.264462 11213 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.235769 11140 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.226203 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:16.260942 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.260113 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.266120 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.266371 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.266831 11144 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:13:16.267604 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.212841 19340 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:16.268258 11857 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.268070 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.236773 11852 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:13:16.238181 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.303107 11858 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:16.255007 11289 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:13:16.258710 11217 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:16.260249 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:16.260926 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.304723 11854 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:16.217610 18945 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:16.306038 18945 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.306869 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.215050 19327 raft_consensus.cc:2804] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:16.262724 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.172711 19218 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.307977 19327 raft_consensus.cc:697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:16.308064 19218 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:16.308341 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45735.6us
I20260709 12:13:16.309167 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.309566 19358 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:16.309103 19327 consensus_queue.cc:237] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.310071 19358 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:16.271639 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.310783 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.310987 19358 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.311666 19376 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:16.312103 19376 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:16.312474 19376 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.274775 19383 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.314972 19383 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.315717 11142 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:16.316265 19375 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:16.311034 11853 raft_consensus.cc:2368] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24.
I20260709 12:13:16.316768 19375 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.317231 19375 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.317342 19383 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.259089 19357 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.318813 19371 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:16.318671 19357 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.319235 19371 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.319590 19371 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.320883 19357 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.318663 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.322118 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.267724 19247 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:13:16.323800 19247 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:16.324185 19247 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:16.325129 19247 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.276804 19339 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:16.326794 11219 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:16.277921 19264 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:16.327178 19264 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:16.326447 19247 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.328225 19264 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.237152 19149 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.330061 19149 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:16.261744 18985 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:16.330139 19264 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.278900 19013 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.279587 19221 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:16.333585 19221 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.333997 19221 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:16.335143 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.281390 19267 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.283855 19242 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.258728 19323 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:13:16.238111 19168 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:16.226979 19276 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:16.267458 19109 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.259163 19217 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.258364 19370 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.294281 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:16.294910 19255 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.295266 19340 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.259388 19154 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.297293 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:16.298974 11856 raft_consensus.cc:2393] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:13:16.419375 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 122143us
I20260709 12:13:16.420421 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.239045 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.275835 19360 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.237584 19382 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.153s
W20260709 12:13:16.275875 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 74963.8us
W20260709 12:13:16.328769 19386 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 12:13:16.426191 11107 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.337605 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.339258 11213 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
W20260709 12:13:16.341815 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.429962 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 92453.8us
I20260709 12:13:16.430994 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:16.340013 19218 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.434589 19218 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.434788 19357 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:16.435369 19357 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.435798 19357 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:16.280738 11857 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:16.342753 11293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:16.261114 19362 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:16.345813 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 51638.6us
I20260709 12:13:16.441206 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.342680 19267 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.445056 11139 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:16.230188 19174 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.399323 11039 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 15 to 16, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 16 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:13:16.402212 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 56932.5us
W20260709 12:13:16.402323 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 142306us
I20260709 12:13:16.326673 19339 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:16.421468 11141 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:16.428028 11287 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:16.439013 11293 raft_consensus.cc:606] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:16.287034 11140 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:16.449913 11107 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.399887 19373 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:16.482035 19373 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:16.445425 11182 leader_election.cc:400] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24.
I20260709 12:13:16.482450 19373 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:16.486594 19275 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:16.490890 19365 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.491694 11182 leader_election.cc:403] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:16.492470 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 47263.1us
I20260709 12:13:16.491684 19380 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.448555 11039 catalog_manager.cc:5697] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 22 to 23, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 23 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:16.455109 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:13:16.511001 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55981.9us
I20260709 12:13:16.511991 11107 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:13:16.512904 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.463799 19109 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.469947 19217 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.417515 19255 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.479735 19154 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.479779 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.428284 19346 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:16.447485 19218 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:16.442849 19383 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:16.480635 19385 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:13:16.530447 11214 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:16.481514 19392 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:13:16.496526 19339 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:16.496258 19373 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.480365 19344 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:16.426477 19242 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:16.450100 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.453934 11825 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.503158 19340 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.514359 19382 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:16.516607 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.510996 11039 catalog_manager.cc:5697] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 22 to 23, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 23 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:16.501040 19013 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.413692 19370 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.526430 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.592638 11291 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:16.536757 18945 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.502511 19360 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:16.545753 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 91916.2us
W20260709 12:13:16.597617 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.598889 11857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:50556
I20260709 12:13:16.599560 11857 raft_consensus.cc:606] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:16.523728 19275 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:16.599817 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.528107 19109 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:16.525276 19346 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:16.551362 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 101335us
I20260709 12:13:16.529168 19383 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:16.612857 19383 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:16.554158 19337 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.533002 19385 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.556082 11039 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 21 to 22, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 22 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:16.588446 19235 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:13:16.527401 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78028.9us
I20260709 12:13:16.555234 19382 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:16.623116 19385 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:16.623955 19382 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.625514 19382 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:16.599972 11857 raft_consensus.cc:614] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:16.601066 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.627067 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.627547 11140 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:13:16.524169 19149 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.594367 19356 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.543220 19344 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:16.549645 19242 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.544049 19218 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:16.553361 19154 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:16.620239 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.621116 11825 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.628906 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.544719 19276 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.548686 19221 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.621619 19109 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:16.644248 19109 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.645905 19221 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.647152 19380 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.648622 11211 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:16.648869 19370 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.618855 19346 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:16.614442 19362 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:16.617550 19255 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.655512 19267 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:16.633556 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 124309us
I20260709 12:13:16.656471 11853 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:13:16.606120 19275 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:16.660871 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.662288 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.663122 11293 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:16.642002 19174 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.642933 19276 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.619407 19371 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.603801 18985 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.672034 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.670908 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:16.683709 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62685.5us
I20260709 12:13:16.699271 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:16.699749 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.700249 11143 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:16.702695 11212 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:16.703461 19264 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:16.703938 19264 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.704319 19264 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:16.706823 19218 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.708233 19324 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.708834 19324 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.713810 11289 raft_consensus.cc:2393] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:16.713945 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.714865 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.638438 19344 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:13:16.716089 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78201.8us
I20260709 12:13:16.717245 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.638667 19242 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:16.719024 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.635286 19235 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:16.707288 19154 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:16.722297 19373 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.722415 19324 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.725754 19321 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:16.725788 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.727054 19340 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:16.727488 19340 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.727891 19340 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.640476 19356 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.752744 11284 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:16.731602 19327 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:16.732108 18985 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.735128 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2897) took 1212 ms. Trace:
I20260709 12:13:16.726279 19321 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.736474 19371 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.737428 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:16.761914 11218 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.762111 11289 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:16.762398 11291 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:16.763355 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.740058 18945 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24.
I20260709 12:13:16.740998 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:16.765782 11140 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:16.744470 19235 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.664554 19275 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:16.684831 19013 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.685276 19267 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.745370 11139 raft_consensus.cc:3060] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:16.656407 19360 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 12:13:16.786684 11287 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:16.781661 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:16.754240 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.754457 11214 raft_consensus.cc:1240] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 29. Current term is 30. Ops: [29.17-29.17]
I20260709 12:13:16.754585 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:16.788954 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.753780 11212 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:16.752985 11143 raft_consensus.cc:2468] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:13:16.756229 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.756282 11288 rpcz_store.cc:276] 0709 12:13:15.522302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.522462 (+   160us) service_pool.cc:224] Handling call
0709 12:13:15.565883 (+ 43421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:15.580467 (+ 14584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:15.580505 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:16.041042 (+460537us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:13:16.045722 (+  4680us) log.cc:844] Serialized 26 byte log entry
0709 12:13:16.211898 (+166176us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:16.212321 (+   423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.212404 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:16.734250 (+521846us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b240020b178. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2cfb0 00007f98306a3488 00007f98306a3be8 00007f983067b398 00007f983067676a 00007f9830675bb6
0709 12:13:16.734926 (+   676us) raft_consensus.cc:1685] finished
0709 12:13:16.734947 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.735073 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16856,"raft.queue_time_us":14589,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":88296,"spinlock_wait_cycles":66369792,"thread_start_us":165815,"threads_started":1,"wal-append.queue_time_us":437874}
I20260709 12:13:16.759197 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.793908 11290 raft_consensus.cc:2410] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:13:16.759227 11292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:16.712189 19346 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.770316 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.765039 19321 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.768705 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.800208 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:16.684671 19357 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:16.797495 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.804576 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.805598 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:16.796334 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 352923us
I20260709 12:13:16.806856 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.795503 19340 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:16.789237 19400 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:13:16.801182 11825 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:16.816830 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:16.775429 19362 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:16.799831 19255 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.816962 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:16.831712 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:16.719385 19383 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.797246 19149 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:16.836028 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63313.8us
I20260709 12:13:16.722314 19154 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.767110 19385 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.761747 19264 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.786005 19382 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:13:16.815137 19337 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:16.830420 19370 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:16.833110 18945 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:16.817261 19221 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:16.787328 19267 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.842382 11856 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:16.859257 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.869309 11289 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:16.830862 19333 raft_consensus.cc:2804] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:13:16.873767 19385 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.873939 19333 raft_consensus.cc:697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:16.774765 19013 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.817590 19324 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:13:16.888154 19267 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.888831 19267 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.867280 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:16.841415 19380 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:16.863770 19337 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.872099 19154 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:16.876214 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:16.876114 11293 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:16.894579 11139 raft_consensus.cc:1275] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:16.880252 19346 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.881271 19356 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.877611 18985 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:16.887076 19383 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:16.878877 19375 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.005s
W20260709 12:13:16.889304 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.914624 19376 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.005s
I20260709 12:13:16.934514 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:16.861469 19373 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:16.841079 19255 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:16.909835 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 275618us
I20260709 12:13:16.911512 11289 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:16.891607 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.948621 11857 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:16.915727 18985 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:16.917482 19264 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.867530 18945 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.891022 19380 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:16.876116 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:16.841429 19362 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.913126 19337 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.935201 11139 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:16.943450 19149 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:16.947157 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:16.945871 19373 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:16.997100 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50076.9us
I20260709 12:13:16.933391 19324 consensus_queue.cc:1048] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:13:17.016158 19340 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:16.934885 19376 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.020203 19376 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:16.879060 19333 consensus_queue.cc:237] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.022614 19344 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:16.993443 18945 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:17.028931 19317 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.889300 19267 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:16.920773 19375 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.003662 19357 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.032191 19267 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.001706 11110 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:17.032793 11110 leader_election.cc:403] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:17.033485 19375 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.034231 11210 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:17.034725 19168 raft_consensus.cc:993] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:13:17.035271 19168 raft_consensus.cc:1081] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Signalling peer 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:13:17.035702 11144 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:13:17.036507 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.037370 11144 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:17.037807 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.038740 11137 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:13:17.038870 11144 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:13:17.039085 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.039342 11136 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:13:17.041898 19255 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.042354 19213 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:17.042964 19213 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.045174 19213 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.046639 11287 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:13:17.048600 19324 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:17.059875 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:17.059401 19380 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.061142 19346 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:17.061566 19346 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.062009 19346 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.062846 18985 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.002202 19373 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:17.069105 11139 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:13:17.070765 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.071508 11136 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:17.006834 19013 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.007388 19385 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:17.073012 19385 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.008921 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.005105 19362 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.028513 19149 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.075627 11284 raft_consensus.cc:2368] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
W20260709 12:13:17.066454 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.073426 19385 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.076704 11825 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:17.074848 19235 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:17.087121 19344 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.087399 19235 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.088204 19324 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:13:17.088831 19324 raft_consensus.cc:697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:17.090003 19321 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.091744 11136 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:13:17.091861 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.013761 19242 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.089788 19324 consensus_queue.cc:237] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.095678 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:17.094487 11285 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:17.075376 19255 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.101732 11292 raft_consensus.cc:606] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:17.111162 11292 raft_consensus.cc:614] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:17.102408 19242 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.104759 18945 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.098327 19275 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.107503 19321 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.089898 19235 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:17.094542 19339 consensus_meta.cc:287] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 12:13:17.128664  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:17.131008  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:17.131212 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.131896  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.131946 11144 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.133337 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.133965 11138 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.138569 19339 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.143420 11144 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:17.143555 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.144454 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.144670 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.145565 11144 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:17.145723 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.152525 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:17.152820 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 335916us
W20260709 12:13:17.154693 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 317565us
I20260709 12:13:17.138199 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.162209 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:17.169353 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 329253us
I20260709 12:13:17.171674 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.172863 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.182817 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:17.173385 11292 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:17.173722 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:17.145882 11138 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:17.184643 11284 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:17.177901 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.187088 11289 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:17.138168 19373 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.178385 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:13:17.192377 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.194284 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.195335 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.195990 11137 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:17.196791 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.197623 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.199030 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.199777 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.200611 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.200834 11136 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.201793 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.203315 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.204137 11138 raft_consensus.cc:2368] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:17.204363 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:17.204933 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.205199 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:17.205765 11854 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:17.205883 11860 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:17.202554 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 281) took 3664 ms. Trace:
I20260709 12:13:17.207216 11856 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:13:17.211010 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.211257 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.185777 11258 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:17.210675 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.208559 11107 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:17.217053 11288 raft_consensus.cc:2368] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24.
I20260709 12:13:17.177532 11285 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:17.221964 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.222764 11135 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:17.205960 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.228973 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.219265 19327 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:17.230355 19111 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:17.231096 19168 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:17.185271 19149 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.232463 19213 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:17.175559 19275 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.234069 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.234580 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.226094 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:17.283754 11144 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.225378 19370 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.236999 11138 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.237020 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.242772 11210 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:17.245993 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.287569 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.289402 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.249140 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.290619 11211 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:17.291749 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:17.249436 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.251775 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.243862 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.244868 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.293509 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.294613 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.250663 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:17.267628 11136 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:17.295912 11217 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.268190 11135 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:17.207176 11042 rpcz_store.cc:276] 0709 12:13:13.538307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.538504 (+   197us) service_pool.cc:224] Handling call
0709 12:13:17.202466 (+3663962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:15.559365 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:15.720939 (+161574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:15.720974 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:13:15.720988 (+    14us) tablet.cc:662] Decoding operations
0709 12:13:15.721662 (+   674us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:15.721717 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:15.721754 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:15.722264 (+   510us) tablet.cc:701] Row locks acquired
0709 12:13:15.722281 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:15.722428 (+   147us) write_op.cc:270] Start()
0709 12:13:15.735853 (+ 13425us) write_op.cc:276] Timestamp: P: 1783599195722377 usec, L: 0
0709 12:13:15.740194 (+  4341us) op_driver.cc:348] REPLICATION: starting
0709 12:13:15.834595 (+ 94401us) log.cc:844] Serialized 2090 byte log entry
0709 12:13:16.860203 (+1025608us) op_driver.cc:464] REPLICATION: finished
0709 12:13:17.067379 (+207176us) write_op.cc:301] APPLY: starting
0709 12:13:17.067517 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:17.071898 (+  4381us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:17.072015 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:17.125972 (+ 53957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:17.126263 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:13:17.128393 (+  2130us) write_op.cc:312] APPLY: finished
0709 12:13:17.128671 (+   278us) log.cc:844] Serialized 57 byte log entry
0709 12:13:17.128833 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:17.128931 (+    98us) write_op.cc:454] Released schema lock
0709 12:13:17.128990 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:17.129448 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:17.129477 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":209938,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":206908,"apply.run_cpu_time_us":9868,"apply.run_wall_time_us":62040,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25087,"num_ops":5,"prepare.queue_time_us":219019,"prepare.run_cpu_time_us":20290,"prepare.run_wall_time_us":553177,"raft.queue_time_us":376534,"raft.run_cpu_time_us":37213,"raft.run_wall_time_us":226318,"replication_time_us":1117683,"thread_start_us":705484,"threads_started":4,"wal-append.queue_time_us":350237}]]}
I20260709 12:13:17.273607 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.277499 19401 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.279493 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:17.281035 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:17.300684 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:17.302075 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 76063.1us
I20260709 12:13:17.303332 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:17.241518 19344 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:17.292982 11215 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:17.242926 19154 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:17.311714 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74795.7us
I20260709 12:13:17.349913 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:17.298931 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 457519us
I20260709 12:13:17.321005 11139 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 12:13:17.321393 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.295383 11214 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:17.323678 11212 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:13:17.346635 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.358402 11210 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:13:17.322285 19370 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.409482 19370 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.321946 19346 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.426539 19339 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.426765 19346 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.346093 19401 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.427692 11137 raft_consensus.cc:2368] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:17.426788 19414 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:17.428838 19401 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.429467 19401 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:17.347113 19406 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:17.429805 19261 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:17.358007 19149 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:17.368450 19344 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:17.349118 19358 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:17.423619 19171 raft_consensus.cc:3055] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:13:17.432412 11218 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:13:17.346412 19235 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:17.386551 19276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.018s
I20260709 12:13:17.430534 19149 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:17.446843 19247 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.448339 19385 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.449354 19373 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.430428 19261 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:17.446615 19370 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:17.454735 19344 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.402034 19267 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:17.457373 19353 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:13:17.458666 19235 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.386806 19327 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:17.380623 19382 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.466106 19255 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:17.444854 19171 raft_consensus.cc:740] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:17.429822 19401 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:17.467276 18945 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.359028 19242 consensus_queue.cc:1059] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:13:17.471724 11143 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:17.581025 11860 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:17.553511 19353 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:17.590587 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 317046us
W20260709 12:13:17.590536 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 240726us
I20260709 12:13:17.479178 11853 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:17.482626 11861 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:17.594050 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.544978 19247 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.484371 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:17.598678 11858 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.491860 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 158) took 1279 ms. Trace:
I20260709 12:13:17.491977 19416 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:17.492579 11138 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:17.490401 19337 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.520994 11290 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:17.523128 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.610750 11292 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:17.607957 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.523572 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.524083 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.599741 11039 rpcz_store.cc:276] 0709 12:13:16.212614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.217558 (+  4944us) service_pool.cc:224] Handling call
0709 12:13:17.491761 (+1274203us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:17.241683 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:17.457927 (+216244us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:17.457965 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:13:17.457983 (+    18us) tablet.cc:662] Decoding operations
0709 12:13:17.458590 (+   607us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:17.458668 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:17.458694 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:17.459070 (+   376us) tablet.cc:701] Row locks acquired
0709 12:13:17.459087 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:17.459225 (+   138us) write_op.cc:270] Start()
0709 12:13:17.459337 (+   112us) write_op.cc:276] Timestamp: P: 1783599197459180 usec, L: 0
0709 12:13:17.459362 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:13:17.460021 (+   659us) log.cc:844] Serialized 1686 byte log entry
0709 12:13:17.462095 (+  2074us) op_driver.cc:464] REPLICATION: finished
0709 12:13:17.462668 (+   573us) write_op.cc:301] APPLY: starting
0709 12:13:17.462759 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:17.465204 (+  2445us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:17.465290 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:17.467699 (+  2409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:17.467892 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:13:17.467938 (+    46us) write_op.cc:312] APPLY: finished
0709 12:13:17.468171 (+   233us) log.cc:844] Serialized 49 byte log entry
0709 12:13:17.468974 (+   803us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:17.469089 (+   115us) write_op.cc:454] Released schema lock
0709 12:13:17.469135 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:17.469534 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:17.469563 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":318,"apply.run_cpu_time_us":6202,"apply.run_wall_time_us":6816,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16768,"num_ops":4,"prepare.queue_time_us":540907,"prepare.run_cpu_time_us":3572,"prepare.run_wall_time_us":244694,"replication_time_us":2559,"thread_start_us":295030,"threads_started":1}]]}
I20260709 12:13:17.612185 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.612840 11293 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.497440 11852 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:17.525774 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.499141 11217 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:17.526557 11042 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 12 to 13, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 13 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.543581 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.614349 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.615092 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.615748 11289 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:17.615608 11042 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 27 to 31, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 31 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.544469 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:17.529130 19276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.011s	sys 0.019s
I20260709 12:13:17.618062 11291 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:17.535427 19149 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:17.569540 11141 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
W20260709 12:13:17.571414 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 268169us
W20260709 12:13:17.546304 19333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.028s	sys 0.049s
I20260709 12:13:17.618716 11042 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 20 to 22, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:17.546435 19370 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.620551 19370 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:17.545882 19194 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.622864 19194 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.625916 19194 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.626686 11284 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:13:17.628281 19149 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.592509 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.597087 11142 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:17.483217 11144 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:17.577073 19356 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:17.602351 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 313051us
I20260709 12:13:17.643739 11184 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.577409 19401 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:17.602200 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
W20260709 12:13:17.619737 19333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.029s	sys 0.049s
I20260709 12:13:17.569619 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:17.655740 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 86203.9us
I20260709 12:13:17.573685 19382 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:17.652088 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:17.653563 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 51374.7us
I20260709 12:13:17.647171 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.608983 19154 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:17.660882 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 68455.6us
I20260709 12:13:17.573722 19327 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.672001 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.675263 11110 leader_election.cc:400] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:17.675005 19339 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:17.676810 19339 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:17.677395 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.677553 19339 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:17.677987 19339 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:17.679034 19109 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:17.678781 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.680779 19109 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:17.681257 19109 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.681679 19109 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.682322 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.610911 19414 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:17.678853 19339 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.692780 11184 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.657366 19267 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:17.654268 19406 raft_consensus.cc:2764] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:13:17.668512 19213 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:17.723470 11858 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:17.668639 19194 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:13:17.740381 19247 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.601464 19264 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.071s
I20260709 12:13:17.739843 19194 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:17.686808 19346 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:17.742980 19194 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:17.744454 19426 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:17.744088 19194 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.745522 19194 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:17.603806 19389 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
W20260709 12:13:17.694943 19422 log.cc:927] Time spent T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:17.689354 19380 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:17.752732 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60043us
I20260709 12:13:17.753806 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.668860 18985 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
I20260709 12:13:17.756320 19432 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:17.759025 19427 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:13:17.760205 19235 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.761741 19382 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:17.668220 19261 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.763087 19327 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.668691 19321 consensus_queue.cc:1059] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.080s
I20260709 12:13:17.763922 19385 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.655001 19356 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.764933 19376 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:13:17.765961 19421 log.cc:927] Time spent T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:13:17.725040 19154 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:17.767344 19356 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.722285 19373 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:17.644857 19416 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:17.757437 19419 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:13:17.772413 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.774735 11184 leader_election.cc:400] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:17.775066 11184 leader_election.cc:403] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:13:17.720319 19221 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:17.688004 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.720039 19013 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:17.725387 19255 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:17.782534 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 94639.9us
I20260709 12:13:17.783583 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:17.782886 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:17.809325 11185 leader_election.cc:400] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24.
I20260709 12:13:17.814778 11185 leader_election.cc:403] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:13:17.773772 19370 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.815426 11858 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:17.781348 19339 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.779615 19380 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:17.782150 19337 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.806370 19149 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.810976 19013 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.805502 19255 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.806191 19213 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:17.851812 19255 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.852005 19213 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.855351 19431 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.780104 19412 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:17.817978 19376 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:17.818979 19414 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.865059 19416 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.865572 19353 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.884567 11142 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:13:17.886780 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.887323 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.887884 11139 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 31.
I20260709 12:13:17.887928 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.888664 11143 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:17.889289 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:17.891144 11293 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:17.892222 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:17.869627 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.893112 11293 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:17.883677 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:17.893404 11140 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:13:17.894920 11216 raft_consensus.cc:1275] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:17.895071 11217 raft_consensus.cc:1240] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:13:17.895097 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.897297 11210 raft_consensus.cc:1240] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:17.898988 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:17.899537 11218 raft_consensus.cc:1240] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:17.899607 11210 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:17.900610 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:17.900686 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.902068 11217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:39588
I20260709 12:13:17.902796 11217 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.903139 11217 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:17.903191 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:17.904752 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.905397 11285 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:17.909107 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.909749 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.909909 11289 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 18: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:17.908430 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:17.912513 11291 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 31 index: 16. (term mismatch)
I20260709 12:13:17.912916 11291 pending_rounds.cc:85] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 15
I20260709 12:13:17.913148 11291 pending_rounds.cc:107] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 30.16
I20260709 12:13:17.913435 11291 raft_consensus.cc:2889] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:17.917490 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.918082 11143 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.918741 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:17.921262 11210 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:17.882020 19389 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.923207 19389 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.924324 19275 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:17.925311 19389 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.919523 11217 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:17.928275 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:17.881583 19418 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.929694 19418 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.931002 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:17.931898 19418 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:17.932724 11292 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:13:17.932852 19339 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:17.933156 11292 pending_rounds.cc:85] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 11
I20260709 12:13:17.933514 11292 pending_rounds.cc:107] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:13:17.933770 11292 raft_consensus.cc:2889] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:17.928287 11217 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.874383 19353 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:17.944028 19380 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:17.945264 19327 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:17.937173 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.933750 19360 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:17.947009 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:17.947506 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:17.947887 11138 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 18: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:17.948167 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.878810 19406 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:17.940346 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:17.947135 19360 raft_consensus.cc:2764] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:13:17.874723 19376 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:17.965607 11143 raft_consensus.cc:2468] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 25.
I20260709 12:13:17.950623 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:17.871496 19242 raft_consensus.cc:3055] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 LEADER]: Stepping down as leader of term 29
W20260709 12:13:17.956269 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 180540us
I20260709 12:13:17.956851 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.971694 11217 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:17.958820 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.906937 19276 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:17.893913 19370 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:17.962776 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:17.980882 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.986581 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:17.986852 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.961172 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.989758 11210 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:17.950567 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:17.990854 11861 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:17.952399 19013 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:17.993589 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.993779 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.933521 19339 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:17.974525 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:17.959682 19416 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:18.005669 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:17.996111 11825 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:17.972491 19376 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.971217 19154 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:18.019654 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45246.9us
I20260709 12:13:17.984896 19276 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.971061 19242 raft_consensus.cc:740] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:17.932760 19275 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260709 12:13:18.021355 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:18.022126 11291 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:18.025699 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:17.996524 19360 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:18.078389 19370 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:18.089614 19430 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.348s	user 0.001s	sys 0.001s
I20260709 12:13:18.077553 19149 raft_consensus.cc:2804] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:18.006834 19389 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:18.129689 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:18.135882 11215 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:18.061165 19317 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:18.034541 19416 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:18.021027 19247 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.129465 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.032262 19276 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:18.128762 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.230453 11211 raft_consensus.cc:2368] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:13:18.119132 19013 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.128139 19431 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24.
I20260709 12:13:18.105749 19109 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.240833 19109 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:18.087065 19339 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.012437 19327 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:18.241672 19327 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.242136 19327 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:18.138969 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.128013 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:18.079699 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:18.243973 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 219977us
W20260709 12:13:18.083048 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61332.3us
I20260709 12:13:18.087361 11861 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:18.078250 19242 consensus_queue.cc:260] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:18.034752 11256 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1f091d9f19d495da80e2f33e1044577. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:18.247058 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 241808us
W20260709 12:13:18.139714 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.953974 19406 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.003721 19435 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:13:18.097344 19425 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 12:13:18.101891 11142 raft_consensus.cc:1275] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:13:18.144351 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:18.148406 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:18.257169 11213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 2995) took 1010 ms. Trace:
I20260709 12:13:18.249446 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:18.257721 11213 rpcz_store.cc:276] 0709 12:13:17.246830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.246970 (+   140us) service_pool.cc:224] Handling call
0709 12:13:17.247327 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.247592 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:17.247629 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:17.278612 (+ 30983us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:13:17.278974 (+   362us) log.cc:844] Serialized 26 byte log entry
0709 12:13:17.554832 (+275858us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:17.554888 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.554989 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:18.088756 (+533767us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:18.256945 (+168189us) raft_consensus.cc:1685] finished
0709 12:13:18.256968 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.257104 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34040960,"thread_start_us":275416,"threads_started":1,"wal-append.queue_time_us":394914}
W20260709 12:13:18.150883 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 129580us
I20260709 12:13:18.086283 19401 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.153271 19382 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:18.154376 19221 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:18.268129 11184 leader_election.cc:400] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Vote denied by peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503) with higher term. Message: Invalid argument: T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:18.269330 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:18.174369 11290 raft_consensus.cc:2410] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:13:18.175742 11210 raft_consensus.cc:1240] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:18.201524 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60997.6us
I20260709 12:13:18.233564 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.238571 19013 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.203434 19317 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.244681 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:18.203032 19149 raft_consensus.cc:697] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 25 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:18.207264 19360 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.169032 19171 consensus_queue.cc:260] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.287488 19149 consensus_queue.cc:237] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.292243 19154 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:18.292960 19154 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:18.293722 19267 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:18.232591 19247 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.293877 19154 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.296245 19247 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:18.292187 11110 leader_election.cc:400] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:13:18.288309 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 2143) took 1234 ms. Trace:
I20260709 12:13:18.301077 11287 rpcz_store.cc:276] 0709 12:13:17.053542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.064607 (+ 11065us) service_pool.cc:224] Handling call
0709 12:13:17.064934 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.065260 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:17.065287 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:17.065808 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:13:17.529999 (+464191us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:17.530060 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.530167 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:18.096545 (+566378us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:18.288019 (+191474us) raft_consensus.cc:1685] finished
0709 12:13:18.288042 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.288249 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1094,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":15890,"spinlock_wait_cycles":12407040,"thread_start_us":463715,"threads_started":1,"wal-append.queue_time_us":577705}
I20260709 12:13:18.272567 11218 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:13:18.276661 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 132391us
W20260709 12:13:18.305873 11826 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.130:41137 timed out after 1.600s (SENT) [suppressed 11 similar messages]
I20260709 12:13:18.264736 19109 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:18.276002 19362 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:18.284121 19317 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:18.267130 19441 consensus_queue.cc:1048] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:13:18.316087 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.284500 19217 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:18.280166 19373 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 12:13:18.313548 19171 raft_consensus.cc:3060] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:18.366524 11142 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 12:13:18.364508 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 112920us
W20260709 12:13:18.357769 19261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.032s	sys 0.028s
I20260709 12:13:18.300184 19360 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.312567 19431 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:18.310917 19109 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.382455 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:18.383457 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:18.363566 19340 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:18.373693 19261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.032s	sys 0.032s
W20260709 12:13:18.374955 19443 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:18.389503 11852 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:13:18.360309 19194 consensus_queue.cc:1048] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:13:18.395375 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:18.384899 19109 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:18.396368 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:18.373507 19217 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:18.395051 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:18.403501 11139 raft_consensus.cc:1240] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:13:18.404752 11291 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:18.411715 11291 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:18.380908 19370 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:18.410328 19446 log.cc:927] Time spent T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:13:18.421257 11285 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:18.422344 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:18.423185 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:18.412480 11291 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.426964 11142 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:18.388000 19431 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:18.434837 11291 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:18.311348 19416 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.451187 19013 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:18.456054 19360 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:18.458076 19444 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:13:18.402550 19340 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.460569 19376 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.461673 19340 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:18.462919 19406 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:18.463824 19401 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:18.382450 18945 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:13:18.445227 19217 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:18.446332 19447 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:13:18.447932 19333 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:18.473027 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 224651us
W20260709 12:13:18.473042 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 49959.2us
I20260709 12:13:18.496942 19276 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.498793 11219 raft_consensus.cc:2368] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20.
I20260709 12:13:18.509204 19317 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.518275 11288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 2146) took 1046 ms. Trace:
I20260709 12:13:18.518836 11288 rpcz_store.cc:276] 0709 12:13:17.472164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.472370 (+   206us) service_pool.cc:224] Handling call
0709 12:13:17.491646 (+ 19276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:18.465807 (+974161us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:13:18.465848 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:18.465889 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:13:18.465921 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.517968 (+ 52047us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54004263d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:18.518022 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.518181 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7988,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8189,"spinlock_wait_cycles":2239524736}
I20260709 12:13:18.506475 19109 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.526342 19317 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:18.528200 19109 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:18.479133 11291 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:18.556110 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:18.563055 11290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2924) took 1027 ms. Trace:
I20260709 12:13:18.563644 11290 rpcz_store.cc:276] 0709 12:13:17.535664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.651711 (+116047us) service_pool.cc:224] Handling call
0709 12:13:18.562768 (+911057us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400062cd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:18.562941 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172771712}
I20260709 12:13:18.567008 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:18.570713 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85930.1us
I20260709 12:13:18.572065 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:18.578752 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:18.581199 11143 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 13. Current term is 14. Ops: []
I20260709 12:13:18.602550 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:18.584436 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:18.614882 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.618036 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:18.619024 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:18.619715 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:18.647312 11135 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:18.484395 19255 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:18.651535 11137 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:18.430145 19370 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.656810 11142 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:18.662585 11139 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 18.
I20260709 12:13:18.670683 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:18.677371 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 105421us
I20260709 12:13:18.610661 19385 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:18.492437 19389 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.175s
I20260709 12:13:18.649948 19376 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:18.702541 11110 leader_election.cc:400] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20.
I20260709 12:13:18.705111 11285 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:18.705400 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:18.706254 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:18.707584 11291 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:18.492024 19333 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:18.704365 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 81292.5us
I20260709 12:13:18.716033 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:18.716830 11290 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:18.714576 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:18.609678 19340 consensus_queue.cc:1059] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 12:13:18.723165 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 417300us
I20260709 12:13:18.698908 19255 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:18.712854 19171 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:18.748895 19370 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:18.753683 19327 consensus_meta.cc:287] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
I20260709 12:13:18.727452 19382 consensus_queue.cc:1059] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 12:13:18.762437 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 45804.6us
I20260709 12:13:18.763499 19382 raft_consensus.cc:3055] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:18.764011 19382 raft_consensus.cc:740] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:18.764468 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:18.765726 19461 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:18.766450 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50794.9us
I20260709 12:13:18.777402 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:18.778370 19418 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:18.780478 19247 consensus_queue.cc:1059] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:18.781533 19247 raft_consensus.cc:3055] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:18.781980 19247 raft_consensus.cc:740] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:18.782661 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:18.766839 19353 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:18.768392 19458 raft_consensus.cc:3055] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:18.773905 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:18.718909 19231 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.775345 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:18.776429 11860 raft_consensus.cc:1240] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 25 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:18.720876 19261 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:13:18.698791 19431 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:18.829246 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:18.781662 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:18.676302 19221 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:18.726886 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:18.724269 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:18.833468 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 109300us
I20260709 12:13:18.767925 19457 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:18.840265 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 58683.9us
I20260709 12:13:18.722837 19351 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.841934 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:18.855517 11857 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:18.786158 19353 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.875190 11219 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:18.877255 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.877482 11213 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:18.878405 11139 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:18.876579 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:18.882197 11210 raft_consensus.cc:2468] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
W20260709 12:13:18.882969 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 156151us
I20260709 12:13:18.878832 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:18.767769 19382 consensus_queue.cc:260] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.879683 11137 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 12:13:18.893101 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 127196us
W20260709 12:13:18.895717 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 61337.2us
I20260709 12:13:18.896214 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:18.754308 19327 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:18.898025 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:18.886195 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44362.1us
I20260709 12:13:18.902838 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.906222 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:18.839272 19149 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:18.822803 19412 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 12:13:18.909299 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:18.945367 11215 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:18.713603 19385 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.912036 11217 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:18.908020 11212 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:18.912751 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:18.914518 11259 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:18.884047 19353 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:18.952483 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:18.918871 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:18.953776  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.914979 11219 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.908857 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:18.834740 19458 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:18.838979 19436 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:18.859905 19418 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:18.955241 11211 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 18.
I20260709 12:13:18.966006 11213 raft_consensus.cc:1275] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:13:18.911800 19457 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:18.925383 19362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.033s	sys 0.043s
I20260709 12:13:18.982365 11288 raft_consensus.cc:1240] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 32 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 31. Current term is 32. Ops: [31.16-31.16]
I20260709 12:13:18.915351 19380 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:18.911800 19373 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:18.915644 19321 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:18.832352 19231 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.925786 19337 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 12:13:18.991796 19418 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.882107 19351 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:19.019984 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.008s
W20260709 12:13:19.019057 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 269406us
W20260709 12:13:19.015491 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 169287us
I20260709 12:13:18.927003 19242 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:19.101207 19456 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.388s	user 0.005s	sys 0.000s
W20260709 12:13:19.020553 19362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.034s	sys 0.043s
I20260709 12:13:18.944664 19255 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.109058 19414 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:18.926471 19247 consensus_queue.cc:260] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:18.983210 19382 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:19.020313 19276 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:18.979974 19376 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.123s
I20260709 12:13:19.111285 19356 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:19.056738 19321 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:19.111644 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.009s	sys 0.008s
I20260709 12:13:18.984004 19459 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.152s
I20260709 12:13:19.057691 19303 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:19.108928 19418 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:19.111656 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:18.993904 19436 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.139583 11212 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:19.141456 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:19.155887 11212 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:19.156507 11213 raft_consensus.cc:2393] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 30: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:19.017680 19221 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.119525 19362 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:19.126744 19416 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.157037 11212 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.166376 11212 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:19.160091 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2929) took 1280 ms. Trace:
I20260709 12:13:19.107271 19373 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.169950 19435 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.218077 11215 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:19.170324 19333 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:19.226590 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 332138us
I20260709 12:13:19.171772 19327 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:19.137516 19321 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.174203 19385 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.154640 19467 ts_tablet_manager.cc:933] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:19.175825 19466 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:13:19.186664 19470 log.cc:927] Time spent T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:13:19.190651 19247 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:19.192569 19231 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:19.211819 19462 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:13:19.123627 19255 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.213961 19416 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.167824 11286 rpcz_store.cc:276] 0709 12:13:17.879363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.882115 (+  2752us) service_pool.cc:224] Handling call
0709 12:13:17.882572 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.882959 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:17.882990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:17.910619 (+ 27629us) log.cc:844] Serialized 26 byte log entry
0709 12:13:18.152799 (+242180us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18003e3080. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:13:18.405060 (+252261us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:18.405111 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.405191 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.073928 (+668737us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:19.159846 (+ 85918us) raft_consensus.cc:1685] finished
0709 12:13:19.159870 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:19.160029 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15259,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":16294,"spinlock_wait_cycles":15725056,"thread_start_us":251521,"threads_started":1,"wal-append.queue_time_us":750080}
W20260709 12:13:19.217005 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53184.1us
I20260709 12:13:19.221890 11219 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:19.225417 11290 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:19.226369 11212 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:13:19.171109 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:19.274080 11212 pending_rounds.cc:85] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 15
I20260709 12:13:19.274397 11212 pending_rounds.cc:107] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 20.16
W20260709 12:13:19.274654 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 103626us
I20260709 12:13:19.274667 11212 raft_consensus.cc:2889] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.276171 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:19.277660 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:13:19.275892 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 357567us
I20260709 12:13:19.281860 11140 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:19.231896 19376 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.054s
I20260709 12:13:19.165472 19414 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:19.259778 19459 consensus_queue.cc:1059] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:13:19.227903 19435 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.277456 19449 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:19.309063 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 356626us
I20260709 12:13:19.291225 19406 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:19.285637 19385 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:13:19.290927 19460 consensus_queue.cc:1059] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:13:19.310514 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:19.293637 19013 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:19.348839 19356 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.349448 19356 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.351461 19416 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:19.354959 19436 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.370604 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:19.371170 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 60746.8us
I20260709 12:13:19.385789 11290 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:13:19.259166 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 346488us
I20260709 12:13:19.400442 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 32 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:19.301196 19380 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.408751 11139 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:13:19.411757 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:19.412462 11142 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:19.333122 19406 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:19.402508 19444 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:13:19.401463 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:19.403204 19154 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:19.481655 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:19.482753 19242 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.482658 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:19.301864 19362 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:19.482389 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 67484.8us
I20260709 12:13:19.484994 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:19.485651 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 74927.9us
W20260709 12:13:19.485738 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 70164.8us
I20260709 12:13:19.490376 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:19.491634 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 207349us
I20260709 12:13:19.407593 19457 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:19.423708 19373 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.403424 19013 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:19.494828 11285 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:19.496767 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:19.498363 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:19.360221 19401 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 12:13:19.503607 11288 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:19.345860 19458 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.426271 19406 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:19.414798 19460 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.424467 19327 consensus_queue.cc:1059] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.160s
W20260709 12:13:19.505926 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 104547us
I20260709 12:13:19.620796 19460 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.621778 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:19.508631 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:19.585139 19275 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:13:19.587525 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.592782 11286 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:19.414624 19441 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:13:19.594784 19484 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.498874 19376 consensus_queue.cc:1243] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 2b4f4725b82b481ab53f0717a429e94a log is divergent from this leader: its last log entry 25.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 12:13:19.500089 19154 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:19.613989 19221 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.583197 19436 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:19.606565 19457 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:19.416996 19380 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.591409 19483 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.424083 18945 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.160s
I20260709 12:13:19.494524 19418 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.596073 19461 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:19.601079 19476 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:19.618907 19455 log.cc:927] Time spent T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:13:19.602684 19389 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.602847 19373 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.700248 19373 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.582546 19242 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.703203 11284 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 30.
I20260709 12:13:19.704255 19242 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:19.704823 19255 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.652823 19484 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.706401 11292 raft_consensus.cc:2410] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:13:19.707285 19484 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:19.708297 19360 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:19.709425 19475 log.cc:927] Time spent T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 12:13:19.709224 19360 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:19.690737 19382 consensus_meta.cc:287] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.005s
W20260709 12:13:19.650739 19480 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 12:13:19.632700 19275 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:19.625576 19385 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:19.697252 19149 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:19.716387 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 45810.1us
I20260709 12:13:19.730176 11287 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:13:19.650851 19459 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.721726 11288 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:19.653198 19317 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:13:19.675390 19507 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.740600 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 2076) took 1184 ms. Trace:
W20260709 12:13:19.759505 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 175732us
I20260709 12:13:19.728413 19373 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:19.739812 19353 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.002s
I20260709 12:13:19.671144 19221 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:19.785050 19479 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.458s	user 0.001s	sys 0.001s
I20260709 12:13:19.817729 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:19.819588 11139 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:19.798454 11144 rpcz_store.cc:276] 0709 12:13:18.548794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.553532 (+  4738us) service_pool.cc:224] Handling call
0709 12:13:18.553914 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:18.554359 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:18.554399 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:18.555122 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 12:13:18.944646 (+389524us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:13:18.944693 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.944757 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.708616 (+763859us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:19.724639 (+ 16023us) raft_consensus.cc:1685] finished
0709 12:13:19.724667 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:19.733347 (+  8680us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26289,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":53899,"spinlock_wait_cycles":22052224,"thread_start_us":389093,"threads_started":1,"wal-append.queue_time_us":745165}
I20260709 12:13:19.825132 19513 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.825906 19513 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.699811 19389 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.786655 19460 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.734421 19385 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.784181 19356 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:19.727602 19436 consensus_queue.cc:1059] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.069s
W20260709 12:13:19.848670 19493 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:13:19.741683 19459 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.717871 19461 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.681255 19483 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.736469 19149 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.803002 19370 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:13:19.791839 19435 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:19.897557 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:19.898325 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:19.724037 19476 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.943306 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:19.943989 11289 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 15.
I20260709 12:13:19.793571 19376 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:19.801199 19353 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.728825 19013 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.895553 19247 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:19.784086 19401 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 12:13:19.800869 19344 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 12:13:19.787168 19500 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:19.841559 19467 tablet_copy_client.cc:323] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:13:19.939867 19370 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:19.835176 19507 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.950657 19508 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:19.959198 19321 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.693s	user 0.021s	sys 0.007s
I20260709 12:13:19.870862 19275 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:19.970152 19506 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:13:19.970420 19414 raft_consensus.cc:3055] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:19.970841 19321 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:19.972494 19502 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:13:19.982084 19414 raft_consensus.cc:740] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:19.973246 19491 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:13:19.982988 19414 consensus_queue.cc:260] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.16, Last appended by leader: 16, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:19.973598 19517 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:19.973886 19507 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.975602 19461 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:19.984210 19414 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:19.976130 19483 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.986997 19370 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.980057 19508 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:19.977255 19459 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.837922 19457 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.990147 19508 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:19.965675 19490 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 12:13:19.956664 19376 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.990869 19406 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:19.984174 19321 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:19.992830 19376 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:19.979405 19353 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:19.994005 19418 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:19.998006 19380 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:19.984506 19517 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.035076 19517 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:20.079120 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 455326us
I20260709 12:13:20.081246 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:13:20.078367 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.086052 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:20.095486 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:20.099974 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 3024) took 1189 ms. Trace:
I20260709 12:13:20.100696 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 3015) took 1202 ms. Trace:
W20260709 12:13:20.101015 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 432202us
I20260709 12:13:20.101565 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:20.103757 11213 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:20.103575 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:20.100663 11210 rpcz_store.cc:276] 0709 12:13:18.910126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.912940 (+  2814us) service_pool.cc:224] Handling call
0709 12:13:18.913307 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:18.913558 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:18.913595 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:19.092861 (+179266us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:13:19.093395 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:13:19.231510 (+138115us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:19.231702 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.231794 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:20.099027 (+867233us) raft_consensus.cc:1685] finished
0709 12:13:20.099108 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.099663 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10386176,"thread_start_us":137595,"threads_started":1,"wal-append.queue_time_us":318377}
I20260709 12:13:20.111176 11290 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:20.112885 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:20.101322 11218 rpcz_store.cc:276] 0709 12:13:18.897860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.899308 (+  1448us) service_pool.cc:224] Handling call
0709 12:13:18.899691 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:19.015806 (+116115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.015834 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:19.024006 (+  8172us) log.cc:844] Serialized 26 byte log entry
0709 12:13:19.297153 (+273147us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:19.297199 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.297273 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:20.099957 (+802684us) raft_consensus.cc:1685] finished
0709 12:13:20.100014 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.100395 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121536,"raft.queue_time_us":202142,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":14336,"thread_start_us":168108,"threads_started":1,"wal-append.queue_time_us":370740}
I20260709 12:13:20.100016 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.127368 11212 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:20.126576 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.119661 11291 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:20.128715 11860 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:20.123524 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:20.134131 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:19.796558 19154 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.138787 19154 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.140110 19149 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.141047 19149 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.141304 19194 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:20.142109 19194 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.142880 19194 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:20.142064 19149 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.137111 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:19.962432 19247 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.149361 19149 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:20.156296 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.001s	sys 0.009s
I20260709 12:13:20.153357 19149 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:20.166882 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.001s	sys 0.009s
I20260709 12:13:20.169134 19353 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:20.169505 19321 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:20.170181 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.010s	sys 0.031s
I20260709 12:13:20.171037 19339 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.170900 19412 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:20.175218 19376 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.177121 19373 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.178117 19459 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:20.179246 19468 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.179857 19276 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.180639 19487 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.181334 19500 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:20.182803 19317 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:20.202207 19468 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.183754 19503 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:20.196353 19353 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.179889 19469 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:20.187314 19380 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:20.190662 19247 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:20.164671 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 69502.1us
I20260709 12:13:20.202780 19317 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.205529 19353 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:20.210420 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:20.211385 19469 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.205255 19487 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.216048 19435 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:20.216401 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.217382 19512 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:20.219506 19376 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:20.204458 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.011s	sys 0.031s
I20260709 12:13:20.297832 19351 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:20.299805 19534 log.cc:927] Time spent T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:13:20.300015 19487 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:20.303877 19488 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.634s	user 0.005s	sys 0.000s
I20260709 12:13:20.222745 19380 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:20.322149 19380 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.224226 19276 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.328369 19276 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.225488 19339 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.331429 19339 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.341419 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.345358 19194 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.251417 19468 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.204422 19503 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.256542 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.419292 19503 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.420327 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.257243 19317 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.258033 19327 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:13:20.259852 19529 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:13:20.259706 19382 raft_consensus.cc:3055] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:20.423382 19382 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:20.424324 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 3018) took 1520 ms. Trace:
I20260709 12:13:20.426548 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3321) took 1145 ms. Trace:
I20260709 12:13:20.269752 19465 raft_consensus.cc:3055] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:20.273805 19476 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.278738 19149 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.427160 19465 raft_consensus.cc:740] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:20.428224 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 32 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:20.281337 19498 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.606s	user 0.000s	sys 0.005s
I20260709 12:13:20.282346 19512 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.287091 19458 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.431326 19512 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.287442 19435 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.429231 11218 raft_consensus.cc:2410] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 32 because replica has last-logged OpId of term: 31 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 15.
I20260709 12:13:20.433676 19435 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.289196 19221 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.293995 19360 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.294853 19416 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.434644 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:20.429081 19465 consensus_queue.cc:260] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.435016 19416 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.435904 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.436879 11218 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 15: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:20.436961 19465 raft_consensus.cc:3060] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.437623 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.438241 19416 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.305395 11217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 3028) took 1166 ms. Trace:
I20260709 12:13:20.438549 19389 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.306764 11861 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:20.438249 11218 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:20.424782 11214 rpcz_store.cc:276] 0709 12:13:18.904017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.904151 (+   134us) service_pool.cc:224] Handling call
0709 12:13:18.942203 (+ 38052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:19.015869 (+ 73666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.015896 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:19.023490 (+  7594us) log.cc:844] Serialized 26 byte log entry
0709 12:13:19.270745 (+247255us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:19.270797 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.270903 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.715691 (+444788us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b48000030d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:13:20.303066 (+587375us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b24000fd9e8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d8749c4 00007f982d872acb 00007f982da2ddc9 00007f982da2da55 00007f982da2d09d 00007f983065f10e 00007f983067688c 00007f9830675bb6 00007f98306757d8 00007f983067f221
0709 12:13:20.423848 (+120782us) raft_consensus.cc:1685] finished
0709 12:13:20.423869 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.424135 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73295,"raft.queue_time_us":160928,"raft.run_cpu_time_us":10408,"raft.run_wall_time_us":609976,"spinlock_wait_cycles":39783680,"thread_start_us":209612,"threads_started":1,"wal-append.queue_time_us":541356}
I20260709 12:13:20.440111 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.315811 11211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39602 (request call id 3026) took 1177 ms. Trace:
I20260709 12:13:20.371580 19513 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.221102 19321 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.370329 19385 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.440971 11211 rpcz_store.cc:276] 0709 12:13:19.138437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.138578 (+   141us) service_pool.cc:224] Handling call
0709 12:13:19.138861 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:19.260737 (+121876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.260787 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:19.260852 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:19.260916 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.315278 (+1054362us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400294fd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:20.315351 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.315622 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279503232}
I20260709 12:13:20.241154 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.379278 19217 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.442518 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:20.443076 19217 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.443703 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.444831 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.369753 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.445798 11211 raft_consensus.cc:2393] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:20.349170 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.383509 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.446791 11219 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 30.
I20260709 12:13:20.446879 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:20.447206 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.447808 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.448468 11219 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:13:20.448558 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.448664 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:20.449680 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.429193 19149 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.425529 19382 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:20.451380 19321 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.383467 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.452615 19221 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.453127 11215 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:13:20.453296 19221 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.386864 11284 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:20.388556 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.365307 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.389794 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.397432 11289 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 12:13:20.454453 11215 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:20.455018 11219 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:20.265133 19370 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:20.440949 11218 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:20.368564 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.401639 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet f1f091d9f19d495da80e2f33e1044577 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:13:20.403342 19275 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.460063 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet f1f091d9f19d495da80e2f33e1044577 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-f1f091d9f19d495da80e2f33e1044577
I20260709 12:13:20.399581 19303 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.456591 11858 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:20.462570 19303 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.464286 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:20.438829 11217 rpcz_store.cc:276] 0709 12:13:19.139011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.140441 (+  1430us) service_pool.cc:224] Handling call
0709 12:13:19.144350 (+  3909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:19.215037 (+ 70687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.215071 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:19.215109 (+    38us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:19.215138 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.304789 (+1089651us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54002959d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:20.304920 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.305183 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162130304}
I20260709 12:13:20.406268 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.408402 11136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3315) took 1787 ms. Trace:
W20260709 12:13:20.467738 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83987.4us
I20260709 12:13:20.468168 19486 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:20.412400 19406 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.371336 19376 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.420522 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.467406 11136 rpcz_store.cc:276] 0709 12:13:18.620858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.621013 (+   155us) service_pool.cc:224] Handling call
0709 12:13:18.621394 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:18.951121 (+329727us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:19.228676 (+277555us) log.cc:844] Serialized 14 byte log entry
0709 12:13:19.414191 (+185515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:19.414248 (+    57us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:19.414289 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.221411 (+807122us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54001248d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:20.221504 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.280124 (+ 58620us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:20.408169 (+128045us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8340,"prepare.queue_time_us":186656,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":8615,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":783578752,"thread_start_us":423943,"threads_started":2,"wal-append.queue_time_us":402670}
I20260709 12:13:20.421833 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.295588 19469 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.440333 19535 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:20.407872 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.445302 19217 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.381919 19337 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.455549 19221 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:20.410941 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.440670 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.390378 19353 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.397588 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.490794 11284 pending_rounds.cc:85] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 8
I20260709 12:13:20.490630 19317 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:20.491175 19382 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.426947 11137 rpcz_store.cc:276] 0709 12:13:19.280893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.281034 (+   141us) service_pool.cc:224] Handling call
0709 12:13:19.281700 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:19.289264 (+  7564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.289316 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:19.290646 (+  1330us) log.cc:844] Serialized 506 byte log entry
0709 12:13:19.584332 (+293686us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:19.584406 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.425935 (+841529us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b54003403d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:20.425992 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:20.426074 (+    82us) raft_consensus.cc:1685] finished
0709 12:13:20.426086 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.426364 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16294784,"thread_start_us":263523,"threads_started":1,"wal-append.queue_time_us":545086}
I20260709 12:13:20.493063 19360 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.493363 19406 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:20.495317 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 78086.6us
I20260709 12:13:20.498751 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.499526 11039 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 23 to 25, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 25 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:20.501544 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.501737 19267 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.503320 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.545724 19267 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.548723 19267 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.549449 19267 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:20.549849 11853 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 11.
I20260709 12:13:20.551106 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.551607 19406 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.554388 19416 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.554821 19337 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.555454 19416 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.556325 11039 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 10 to 11, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 11 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:20.557700 19337 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.558064 19416 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.502422 11214 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 24.
I20260709 12:13:20.558307 19535 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.559008 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.558682 19317 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.582291 11857 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:20.561393 19275 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:20.583444 19275 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:20.584103 19317 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.537299 19194 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.505703 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 284) took 3072 ms. Trace:
I20260709 12:13:20.554767 19389 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.558324 11039 catalog_manager.cc:5697] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.564719 19406 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.575215 19303 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.560148 19469 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.561589 19353 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.609228 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.554855 11293 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 12.
I20260709 12:13:20.589350 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.543756 11284 pending_rounds.cc:107] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:13:20.619073 11284 raft_consensus.cc:2889] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:20.641207 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.642764 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:20.645085 11288 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:20.645706 11287 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:20.588440 19327 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.644223 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.651155 11136 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:20.658737 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.662840 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.665539 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.668695 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.666246 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.674561 11293 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:20.612130 19503 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.666608 19275 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.699465 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.658098 19327 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.702184 11039 catalog_manager.cc:5697] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.704017 11039 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.706698 19401 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:20.706965 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.707867 11859 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:20.710996 19221 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:20.712316 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.713169 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.713193 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.714064 11216 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:13:20.714478 11213 raft_consensus.cc:1275] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 20. (term mismatch)
I20260709 12:13:20.714900 11213 pending_rounds.cc:85] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 19
I20260709 12:13:20.715148 11213 pending_rounds.cc:107] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 24.20
I20260709 12:13:20.715097 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.715863 11213 raft_consensus.cc:2889] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:20.716907 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.717082 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.717990 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.718186 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.719825 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.722308 19503 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:20.723021 11217 raft_consensus.cc:1240] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:20.586865 11042 rpcz_store.cc:276] 0709 12:13:17.444959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.450009 (+  5050us) service_pool.cc:224] Handling call
0709 12:13:20.505359 (+3055350us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:17.638389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:17.805306 (+166917us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:17.807348 (+  2042us) write_op.cc:435] Acquired schema lock
0709 12:13:17.810309 (+  2961us) tablet.cc:662] Decoding operations
0709 12:13:17.915045 (+104736us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:17.933895 (+ 18850us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:17.933932 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:13:17.934292 (+   360us) tablet.cc:701] Row locks acquired
0709 12:13:17.934311 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:13:17.955553 (+ 21242us) write_op.cc:270] Start()
0709 12:13:17.973148 (+ 17595us) write_op.cc:276] Timestamp: P: 1783599197950441 usec, L: 0
0709 12:13:17.980139 (+  6991us) op_driver.cc:348] REPLICATION: starting
0709 12:13:18.090560 (+110421us) log.cc:844] Serialized 1308 byte log entry
0709 12:13:18.380355 (+289795us) op_driver.cc:464] REPLICATION: finished
0709 12:13:19.851581 (+1471226us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b180034ab60. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:13:19.851759 (+   178us) write_op.cc:301] APPLY: starting
0709 12:13:19.851860 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:19.976304 (+124444us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:19.976328 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:19.982415 (+  6087us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:19.982819 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:13:19.982891 (+    72us) write_op.cc:312] APPLY: finished
0709 12:13:19.983224 (+   333us) log.cc:844] Serialized 41 byte log entry
0709 12:13:20.188462 (+205238us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.188888 (+   426us) write_op.cc:454] Released schema lock
0709 12:13:20.188994 (+   106us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:20.190194 (+  1200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.190235 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":340368,"apply.run_cpu_time_us":14732,"apply.run_wall_time_us":338178,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16703,"num_ops":3,"prepare.queue_time_us":173,"prepare.run_cpu_time_us":9281,"prepare.run_wall_time_us":452609,"replication_time_us":388311,"spinlock_wait_cycles":133364992,"thread_start_us":518042,"threads_started":2,"wal-append.queue_time_us":52520}]]}
I20260709 12:13:20.705648 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.726468 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:20.729043 11039 catalog_manager.cc:5697] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.731820 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:20.733067 11137 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:20.712137 19221 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.739493 11290 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:20.740568 19221 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.740934 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.669993 19389 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.745463 19389 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.672731 19360 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.747798 19360 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.748436 11137 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:13:20.758042 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57714.8us
I20260709 12:13:20.758916 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:20.760218 19337 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:13:20.760795 19337 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.761346 19337 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:13:20.764150 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:20.765437 19401 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.748490 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:20.702580 19482 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:20.768065 19482 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.771113 19535 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.772616 19231 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:13:20.773118 19231 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.773499 19231 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:20.742340 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.766247 19401 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.786645 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.787971 11293 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
W20260709 12:13:20.799755 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 110601us
I20260709 12:13:20.800745 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.802791 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:20.803687 11854 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:20.804376 11107 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:20.805256 19360 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:20.805704 19360 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.794020 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:20.801021 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:20.788432 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:20.808079 19360 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.810037 11854 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:20.791702 19303 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:20.820791 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:20.789047 19267 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:20.825114 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:20.827857 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.822075 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.832726 19317 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:20.846695 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:20.851171 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50232.3us
I20260709 12:13:20.851801 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:20.847025 19276 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.832537 19353 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:20.855405 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:20.857137 11286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.082s	sys 0.241s
I20260709 12:13:20.857906 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:20.862246 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.864665 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:20.860242 11286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.083s	sys 0.242s
I20260709 12:13:20.871896 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.872162 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.873206 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.872699 11210 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:20.859750 19353 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.877269 19353 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.858438 19276 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:20.864583 19327 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:20.883656 11218 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 21: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:20.882396 19276 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:20.890707 19351 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:20.891394 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:20.873127 11211 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:20.853080 19317 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.833014 19267 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:20.917795 11136 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:13:20.920397 11854 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:20.900646 19317 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:20.929028 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.931893 19401 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:20.933552 19538 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:13:20.931985 19537 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.075s	user 0.002s	sys 0.001s
I20260709 12:13:20.934325 19401 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:20.952577 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 86989.6us
I20260709 12:13:20.953075 11854 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:20.955865 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:20.929952 19221 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 12:13:20.952224 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:20.949164 19389 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:20.967743 19401 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:13:20.985541 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:20.980026 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:20.982342 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:20.991891 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.000101 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 2153) took 1136 ms. Trace:
I20260709 12:13:21.000607 11286 rpcz_store.cc:276] 0709 12:13:19.863448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.863728 (+   280us) service_pool.cc:224] Handling call
0709 12:13:19.864196 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:20.112475 (+248279us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:20.197886 (+ 85411us) log.cc:844] Serialized 14 byte log entry
0709 12:13:20.872827 (+674941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:20.872888 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:20.872958 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.931098 (+ 58140us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:20.999756 (+ 68658us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000613d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:20.999813 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.000008 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6815,"prepare.queue_time_us":116586,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":3678,"raft.queue_time_us":7267,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":23372,"spinlock_wait_cycles":568743040,"thread_start_us":732094,"threads_started":2,"wal-append.queue_time_us":656044}
I20260709 12:13:21.002586 11285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49838 (request call id 2154) took 1047 ms. Trace:
I20260709 12:13:21.002995 11285 rpcz_store.cc:276] 0709 12:13:19.896335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.897901 (+  1566us) service_pool.cc:224] Handling call
0709 12:13:19.898193 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:19.898567 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:19.898592 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:20.224747 (+326155us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b2c0009b4c8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e4372 00007f9830b16a01 00007f9830adb43a 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2
0709 12:13:20.225534 (+   787us) log.cc:844] Serialized 26 byte log entry
0709 12:13:20.665516 (+439982us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:20.665581 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.689607 (+ 24026us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:20.932822 (+243215us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:20.943750 (+ 10928us) raft_consensus.cc:1685] finished
0709 12:13:20.943779 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:20.943958 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5027,"raft.queue_time_us":9818,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4989,"spinlock_wait_cycles":61797632,"thread_start_us":439349,"threads_started":1,"wal-append.queue_time_us":619183}
I20260709 12:13:21.005213 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:21.014415 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 44035.2us
I20260709 12:13:21.028225 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:21.029076 19351 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:21.029661 19351 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:20.969163 19389 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.032589 19389 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.033694 19535 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:21.036723 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.036885 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:21.033787 11825 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.039461 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.040305 19527 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:21.040786 19416 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:21.041082 19527 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:21.041620 19527 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:21.041996 19527 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.042419 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.009837 19194 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:21.050797 11287 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:13:21.029605 19327 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:21.043979 19303 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:21.060045 19303 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.087332 19303 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:21.088124 19389 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.088698 19389 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:21.089888 19382 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.546s	user 0.014s	sys 0.000s
I20260709 12:13:21.030136 19231 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.091058 19389 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.093535 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:21.095049 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.095619 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.096057 11141 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:21.097201 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.097816 11141 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:21.099023 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.100085 11289 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:21.102635 11140 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:21.102699 19194 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.105948 19194 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:21.108349 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.109887 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.055588 11287 pending_rounds.cc:85] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 9
I20260709 12:13:21.113657 11287 pending_rounds.cc:107] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:13:21.114074 11287 raft_consensus.cc:2889] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:21.106211 19231 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.109211 11142 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
W20260709 12:13:21.116993 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.120841 11141 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:21.123507 11852 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:21.125118 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:21.125734 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.085111 19482 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.060767 19535 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.137866 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.113802 19382 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:13:21.139009 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.140383 19267 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.119149 19221 consensus_queue.cc:1059] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:13:21.085409 19317 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.143167 19317 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.126776 19503 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:21.144165 19503 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.144488 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:21.144773 19360 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.144537 19503 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.095124 19458 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:13:21.147035 19360 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.133562 19469 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:21.131136 11303 tablet_copy_source_session.cc:215] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.082551 19337 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.155893 11860 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:21.156662 19337 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.157912 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.166774 11185 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.170781 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.171417 11144 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:21.119344 19351 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.172513 11140 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:13:21.119473 19276 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:13:21.174186 19351 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.174795 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:21.180492 11860 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:13:21.108055 19370 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:13:21.115796 19327 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:21.187904 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 426139us
W20260709 12:13:21.185351 19380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.005s	sys 0.031s
I20260709 12:13:21.191488 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.131101 19468 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:13:21.204166 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:21.202702 11140 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
W20260709 12:13:21.199420 19380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.006s	sys 0.031s
I20260709 12:13:21.193248 19459 raft_consensus.cc:3055] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:21.213039 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:21.214895 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 48231.4us
I20260709 12:13:21.218084 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.219025 11140 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:21.220954 11143 raft_consensus.cc:1240] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:21.223904 19465 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:21.224251 19221 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:21.224345 19465 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:21.224953 19221 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:21.226660 19382 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:13:21.227258 19382 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:21.228312 19382 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.231251 19376 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:21.189625 19353 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.225729 19465 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.246969 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.197108 19500 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 12:13:21.216117 19459 raft_consensus.cc:740] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:21.251077 11290 raft_consensus.cc:1240] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:21.208480 19535 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:13:21.255100 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.226058 19221 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.261044 19465 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.257301 19337 consensus_queue.cc:1048] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:13:21.255144 19380 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.270813 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.246271 19370 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:21.293218 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 531014us
I20260709 12:13:21.299927 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.300781 11139 raft_consensus.cc:2410] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 12:13:21.301704 19013 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:21.302021 19380 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:21.302502 19013 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.302802 19380 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.304767 19327 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:21.299677 19370 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.297885 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:21.309631 19217 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.314668 19380 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.317219 19527 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.318625 11860 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:21.320300 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:21.322252 19535 consensus_queue.cc:1048] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:21.325021 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:21.325845 11290 raft_consensus.cc:606] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:21.326227 11290 raft_consensus.cc:614] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:21.327849 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.328050 19370 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.328549 11139 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:21.256182 19303 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.343786 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.349745 11140 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:21.354509 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.345070 19221 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.355204 11135 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:21.359529 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.344695 11143 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 29.
I20260709 12:13:21.365908 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:21.292043 19503 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.366843 11290 raft_consensus.cc:606] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:21.367381 11290 raft_consensus.cc:614] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:21.373569 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.374693 11139 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 12.
I20260709 12:13:21.347682 19360 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.388876 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.389312 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.407169 11140 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:21.408581 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.389014 19231 consensus_queue.cc:1059] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.015s
I20260709 12:13:21.403185 19013 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.410219 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.414167 19360 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.417919 19360 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.414381 19353 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:21.424001 19529 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
I20260709 12:13:21.415073 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:21.428490 11291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 2951) took 1002 ms. Trace:
I20260709 12:13:21.432111 19303 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:21.430066 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.434685 19503 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.435113 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.436600 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.436877 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:21.437299 19276 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:21.430544 11291 rpcz_store.cc:276] 0709 12:13:20.425725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.690625 (+264900us) service_pool.cc:224] Handling call
0709 12:13:20.698729 (+  8104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:20.782786 (+ 84057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:20.782818 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:20.792180 (+  9362us) log.cc:844] Serialized 26 byte log entry
0709 12:13:21.185643 (+393463us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:21.185690 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.185780 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:21.428063 (+242283us) raft_consensus.cc:1685] finished
0709 12:13:21.428096 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.428405 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":14092,"thread_start_us":366391,"threads_started":1,"wal-append.queue_time_us":554611}
I20260709 12:13:21.437734 19276 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.438637 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.438967 19276 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:21.430644 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.435433 19503 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:21.445556 19267 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.446142 19267 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.448436 19267 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.430567 11290 raft_consensus.cc:606] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:21.449465 11290 raft_consensus.cc:614] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:21.450207 19267 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:21.450773 19267 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.453955 19267 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.458843 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:21.459892 11290 raft_consensus.cc:606] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:21.463163 19194 raft_consensus.cc:3055] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:21.463598 11290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:21.464295 11290 raft_consensus.cc:606] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:21.449489 19459 consensus_queue.cc:260] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.463753 19194 raft_consensus.cc:740] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:21.468392 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.468798 11140 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:21.469775 19500 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:21.499042 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.500478 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:21.503708 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.505690 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.473425 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.507579 11143 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
W20260709 12:13:21.511806 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.509156 11292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 4439) took 1391 ms. Trace:
I20260709 12:13:21.490149 11135 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:21.534533 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.537155 19276 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.553275 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.510368 19217 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.524216 19459 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:21.566031 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 478004us
I20260709 12:13:21.569285 11139 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 12: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:21.526793 19013 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:21.571951 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 250040us
W20260709 12:13:21.569651 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 322753us
I20260709 12:13:21.570712 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:21.573483 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 100183us
I20260709 12:13:21.570703 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.572974 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.574582 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.581611 11143 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:21.562270 19380 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.590328 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.571910 19013 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:21.570945 19267 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.597075 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.597980 11290 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:21.599732 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.604486 11284 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:13:21.605641 11259 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:21.632329 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:21.633564 11288 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.635349 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:21.637900 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 47468us
I20260709 12:13:21.639377 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.640622 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:21.599691 19013 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.582664 19468 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:13:21.646733 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.644361 11286 raft_consensus.cc:1240] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:21.654706 11137 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Advancing to term 31
W20260709 12:13:21.653111 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 80241.6us
I20260709 12:13:21.647343 11135 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
I20260709 12:13:21.632939 19503 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.646209 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.661587 11143 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:13:21.643959 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:21.652397 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77957.9us
I20260709 12:13:21.663647 11184 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.605967 19527 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.659435 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.667337 11139 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.655263 11285 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:21.664121 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:21.651494  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:21.669059 19482 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:21.669436 11138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.025s
W20260709 12:13:21.669867 11138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.008s	sys 0.025s
I20260709 12:13:21.669574 19482 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.599622 19401 consensus_queue.cc:1059] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 12:13:21.670660 19351 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:21.671239 19401 raft_consensus.cc:3055] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:21.671661 19401 raft_consensus.cc:740] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:21.672650 19401 consensus_queue.cc:260] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.674062 19401 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:21.591873 19194 consensus_queue.cc:260] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 23.20, Last appended by leader: 20, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.675559  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.675874 19194 raft_consensus.cc:3060] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.666127 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.678400 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.631910 19376 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:21.677716  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.680425 11289 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 26: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:21.596202 19380 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.652186 19231 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:21.691865 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:21.628331 19303 consensus_queue.cc:1059] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 12:13:21.634711 19267 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.698288 11135 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 19: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:21.702916 19337 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:21.703510 19337 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.705665 19337 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:21.707386 19303 raft_consensus.cc:3055] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:21.707942 19303 raft_consensus.cc:740] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:21.708986 19303 consensus_queue.cc:260] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.713503 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:21.716467 11137 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 31.
I20260709 12:13:21.519779 11292 rpcz_store.cc:276] 0709 12:13:20.117470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.507807 (+390337us) service_pool.cc:224] Handling call
0709 12:13:20.553304 (+ 45497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:20.640140 (+ 86836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:20.640187 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:20.678071 (+ 37884us) log.cc:844] Serialized 26 byte log entry
0709 12:13:21.199951 (+521880us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:21.508325 (+308374us) log.cc:844] Serialized 14 byte log entry
0709 12:13:21.508745 (+   420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.508845 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:21.508898 (+    53us) raft_consensus.cc:1685] finished
0709 12:13:21.508916 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.509081 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33101,"raft.queue_time_us":84606,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":29231,"thread_start_us":716058,"threads_started":2,"wal-append.queue_time_us":530001}
W20260709 12:13:21.730273 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97611.3us
I20260709 12:13:21.707494 19412 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:21.683244 19376 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:21.737222 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:21.732687 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 69152.9us
I20260709 12:13:21.693737 19231 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:21.698576 19527 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:21.750379 11135 raft_consensus.cc:1240] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 18. Current term is 19. Ops: []
W20260709 12:13:21.758846 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.759687 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:21.717818 19267 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:21.776064 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:21.776341 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:21.779332 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:21.779577 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:21.739283 19469 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:21.781384 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:21.782537 11210 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 12:13:21.747828 19557 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:21.773273 11211 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:21.735836 19276 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:21.765367 19543 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:21.746665 19303 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:21.785702 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:21.786576 11288 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:21.739591 19465 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.765092 19376 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:21.757086 19231 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.708675 19503 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.791145 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:21.792023 11211 raft_consensus.cc:3060] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:21.751245 19571 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:21.777135 19217 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:21.809684 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:13:21.810664 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 125622us
W20260709 12:13:21.811128 19561 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 12:13:21.812347 19327 raft_consensus.cc:993] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 5d1ee1ef054240338e0a9e05a67acdfc to start an election
I20260709 12:13:21.814210 11215 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:21.788980 19482 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:21.789043 19382 raft_consensus.cc:2764] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:13:21.818770 19564 consensus_queue.cc:1059] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:21.819087 19573 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:21.827889 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.756163 19013 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:21.826367 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:21.831234 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 92614.2us
I20260709 12:13:21.808894 19571 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.833443 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:21.834306 11137 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 14: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:21.802428 19465 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:21.828230 19353 raft_consensus.cc:1081] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Signalling peer 5d1ee1ef054240338e0a9e05a67acdfc to start an election
W20260709 12:13:21.851073 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.863718 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.848680 11139 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:21.802620 19469 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.870030 11825 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:21.865233 11138 raft_consensus.cc:1240] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:21.867326 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:21.868175 19013 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:21.875407 19459 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:21.878917 19337 raft_consensus.cc:2804] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:21.879575 19337 raft_consensus.cc:697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:21.837625 19535 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:21.878214 19459 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.882938 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.868501 19579 raft_consensus.cc:3055] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:13:21.903041 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 112329us
I20260709 12:13:21.914006 19573 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:21.888602 19459 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.917157 11185 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:21.931684 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
W20260709 12:13:21.935014 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.909370 19360 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:21.894208 19579 raft_consensus.cc:740] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:21.938565 11143 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:13:21.908365 19564 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:21.949990 19564 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:21.952009 11216 raft_consensus.cc:2410] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:21.953966 19564 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.955567 19564 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:21.942610 19579 consensus_queue.cc:260] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:21.961287 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 152451us
I20260709 12:13:21.943620 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:21.944221 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.914690 19573 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:21.946923 19465 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:13:21.947285 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.880731 19337 consensus_queue.cc:237] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 23.20, Last appended by leader: 20, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:21.942904 19567 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:21.967804 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.981882 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:21.969079 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 101822us
I20260709 12:13:21.902670 19412 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:13:21.982689 11292 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:21.983110 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:21.984282 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:21.973390 19573 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.020732 11288 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 32.
I20260709 12:13:21.974936 19360 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:22.007211 19579 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:21.986503 19468 consensus_queue.cc:1059] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:13:22.008505 19535 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:22.025215 19221 consensus_meta.cc:287] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.002s
I20260709 12:13:22.038966 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.036074 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.036408 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:22.022861 19581 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.038439 19577 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:22.079571 19577 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:22.080631 19577 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.044580 19580 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.090883 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:22.033931 19587 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:22.098126 11852 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 13.
I20260709 12:13:22.099905 19469 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.044668 19582 raft_consensus.cc:2804] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:22.120206 19582 raft_consensus.cc:697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:22.121315 19582 consensus_queue.cc:237] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.038846 19578 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:22.074116 19581 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.122792 19360 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.124209 19401 raft_consensus.cc:3055] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:22.124856 19401 raft_consensus.cc:740] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:22.122828 19578 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.125954 19382 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:22.127031 19535 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:22.126814 19382 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.127478 19535 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:22.128003 19535 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:22.103876 19580 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:22.126051 19578 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.132477 19380 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:22.135150 19566 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.384s	user 0.000s	sys 0.003s
W20260709 12:13:22.136991 19568 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.300s	user 0.002s	sys 0.000s
I20260709 12:13:22.039168 19571 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.058202 19465 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:22.146708 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 111480us
I20260709 12:13:22.046792 19013 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.060067 19567 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:22.166169 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 155769us
W20260709 12:13:22.169603 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.174453 11185 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:22.174925 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 131530us
W20260709 12:13:22.176666 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 238813us
I20260709 12:13:22.143750 19587 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.105427 19327 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.043587 19586 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.127s
I20260709 12:13:22.190419 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.190778 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.200963 19580 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.215690 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.192332 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.194197 19467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f091d9f19d495da80e2f33e1044577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.126067 19401 consensus_queue.cc:260] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.225659 19401 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:22.228535 19587 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.207084 19581 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.197992 19503 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.194131 19573 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.221801 19327 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.187777 19600 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.176012 19013 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.178807 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.239090 11211 raft_consensus.cc:2468] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 31.
I20260709 12:13:22.198151 19382 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.244910 11184 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:22.246208 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67520.8us
W20260709 12:13:22.247395 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.217971 19500 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:22.252514 19013 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.253048 19581 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:22.253393 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61141.8us
I20260709 12:13:22.253929 11854 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:13:22.255138 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:22.256894 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.257447 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:22.257915 11285 raft_consensus.cc:2468] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:22.260844 11184 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.300494 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.301384 11288 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:22.301915 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:22.213234 19465 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.299113 11292 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:13:22.246876 19468 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:22.307377 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 52343.1us
W20260709 12:13:22.246922 19389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.027s
I20260709 12:13:22.304863 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:22.313102 11182 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.213814 19567 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.316820 11259 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:22.260332 19500 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.319554 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:22.321206 11218 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:22.321764 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.294348 19581 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.298478 19503 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:22.323985 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:22.318100 19389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.028s
I20260709 12:13:22.303115 19382 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:22.333734 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:22.309960 19303 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:22.317390 19587 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:22.318187 11216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:39588
I20260709 12:13:22.344834 11216 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.345377 11216 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:22.340451 19606 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:22.346416 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.322351 19221 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:22.295393 19580 consensus_queue.cc:1059] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 12:13:22.326946 19500 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:22.329401 19581 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:22.335134 19582 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:22.324898 19556 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:22.254367 19600 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.355702 11259 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.373451 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:22.384232 19600 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.386299 19573 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.361140 19353 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:22.369710 19376 consensus_meta.cc:287] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.012s
I20260709 12:13:22.344444 19587 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:22.386770 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.368752 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 63959.2us
I20260709 12:13:22.337942 19351 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:22.399763 19353 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:22.400458 19556 raft_consensus.cc:2804] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:22.401937 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:22.411754 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.346055 19382 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.460769 11852 raft_consensus.cc:2410] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:13:22.386572 19565 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:13:22.478981 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 118057us
I20260709 12:13:22.414075 19587 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:13:22.410470 19560 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.659s	user 0.000s	sys 0.004s
W20260709 12:13:22.459177 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 47527.3us
I20260709 12:13:22.371521 19370 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:22.414974 19353 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:22.460575 19602 log.cc:927] Time spent T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:13:22.457685 19013 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:22.479532 19459 consensus_meta.cc:287] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.006s
I20260709 12:13:22.497644 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.484089 11216 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:22.485266 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 111929us
W20260709 12:13:22.501734 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.505621 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.414237 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.491245 19603 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:22.462347 19600 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:22.509107 11185 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.509735 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.520901 11142 raft_consensus.cc:3060] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:22.515879 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.414541 19376 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.511075 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.513089 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.524111 11216 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.531580 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.532274 11137 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 31.
I20260709 12:13:22.535534 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.534945 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.537932 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.510039 19603 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.542964 11214 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:22.537997 11138 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:13:22.540071 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:22.544848 11861 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.526170 19380 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:22.540881 11143 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 14.
I20260709 12:13:22.549755 19327 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.529286 19276 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:22.548586 19567 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.561081 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.563133 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:22.546626 19603 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.554418 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 4750) took 1430 ms. Trace:
I20260709 12:13:22.571344 11141 rpcz_store.cc:276] 0709 12:13:21.123717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.133834 (+ 10117us) service_pool.cc:224] Handling call
0709 12:13:21.134155 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:21.173259 (+ 39104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:21.173290 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:21.173755 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:13:21.505098 (+331343us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:21.505154 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.505232 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:22.208273 (+703041us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:22.550672 (+342399us) raft_consensus.cc:1685] finished
0709 12:13:22.550692 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:22.554361 (+  3669us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":618,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"spinlock_wait_cycles":30184320,"thread_start_us":330867,"threads_started":1,"wal-append.queue_time_us":577593}
I20260709 12:13:22.573510 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:22.574046 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.556506 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.519881 19459 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.575436 11211 raft_consensus.cc:2393] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:22.575524 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.576527 19459 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.509397 19013 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.578557 19013 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:22.565200 19608 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:13:22.562252 19276 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.583554 19276 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:13:22.585443 19607 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:13:22.553092 19380 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
W20260709 12:13:22.560914 19231 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.748s	user 0.021s	sys 0.000s
I20260709 12:13:22.563891 11856 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
W20260709 12:13:22.541735 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 186129us
I20260709 12:13:22.574115 11141 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:13:22.545485 19465 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.554917 19194 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.598151 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.600872 19459 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.600872 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.606218 11216 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:22.594784 19380 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.606820 11218 raft_consensus.cc:2410] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:13:22.606659 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:22.608623 11213 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:22.620358 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:22.607517 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.614413 19382 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.614765 19564 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.649537 19564 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.650364 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:22.651347 19567 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:22.651808 19567 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:22.652134 19564 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.652246 19567 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:22.613371 19578 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.653941 11215 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:22.619544 19376 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.654799 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.656008 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:22.658659 19351 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:22.659576 19586 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:22.660023 19586 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:22.660435 19586 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.607023 19459 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.644744 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:22.647136 19535 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.004s
I20260709 12:13:22.617734 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:22.662950 19535 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.663470 19578 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.615082 19503 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.664585 19503 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.665534 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.665689 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.666210 11217 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
W20260709 12:13:22.607314 19610 log.cc:927] Time spent T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:13:22.641635 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:22.665570 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 58998.1us
I20260709 12:13:22.670178 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.670533 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.671517 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.672175 11287 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.674353 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.602947 19613 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.064s
I20260709 12:13:22.669737 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.675953 19613 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:22.678835 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.682718 11142 raft_consensus.cc:2468] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:22.685191 11184 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:22.686472 11215 raft_consensus.cc:2410] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:13:22.637348 11135 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:22.688215 11861 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:22.689445 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.624675 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.681900 19267 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:22.617350 19579 consensus_meta.cc:287] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.004s
I20260709 12:13:22.700457 19603 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.701514 19586 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.702721 19503 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.703066 19603 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.705847 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.622069 19194 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.706748 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.705881 19267 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.708024 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.708604 11289 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:22.690438 19598 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:22.702015 11140 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:22.708694 11217 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:22.710162 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:22.710911 11144 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:22.710975 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.665069 19535 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.693372 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.709945 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.729745 11138 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.708176 19194 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:22.717203 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.728473 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.596501 19231 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.745646 19620 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:22.746778 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.754649 11287 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:22.755303 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.747623 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.754856 11856 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 22. Current term is 24. Ops: []
I20260709 12:13:22.758507 11284 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:13:22.759052 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 73951.8us
I20260709 12:13:22.760110 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.763451 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.756057 11292 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 22.
I20260709 12:13:22.739504 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:22.769923 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.709304 19267 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.727715 19600 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:22.778129 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.779755 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.786404 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:22.710431 19581 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.782147 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.782637 11258 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:22.788034 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.794230 11215 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:22.794994 11292 raft_consensus.cc:2368] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:22.796609 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.785295 11185 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.804095 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:22.804914 19556 raft_consensus.cc:697] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 31 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:22.810025 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.777666 19578 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:22.775137 19599 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:22.813105 11285 raft_consensus.cc:2393] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 32: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:22.739889 19276 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.806340 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:22.807480 19627 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:13:22.796533 11110 connection.cc:256] RPC call timeout handler was delayed by -1.9259138840000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 12:13:22.820514 19353 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.821818 19556 consensus_queue.cc:237] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.794694 19267 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:22.796186 19582 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.819132 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:22.824232 11110 connection.cc:256] RPC call timeout handler was delayed by -1.8884246600000552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2745s for a response
I20260709 12:13:22.825119 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:22.830734 11110 connection.cc:256] RPC call timeout handler was delayed by -1.6730138840000564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:13:22.818032 11213 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:22.822875 19580 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:22.833745 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:22.833844 11219 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:22.832947 19267 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:22.831012 11210 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:22.836760 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.838797 11213 raft_consensus.cc:2410] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:13:22.839428 19621 raft_consensus.cc:2804] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:22.839986 11214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 3567) took 1098 ms. Trace:
I20260709 12:13:22.840389 11214 rpcz_store.cc:276] 0709 12:13:21.741801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.741974 (+   173us) service_pool.cc:224] Handling call
0709 12:13:21.770355 (+ 28381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.551558 (+781203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:22.839760 (+288202us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001d3154. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:22.839928 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772585728}
I20260709 12:13:22.841584 19624 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:22.842809 11287 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:22.842998 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.845875 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.847455 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:22.847632 19581 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.849306 19459 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.850208 19591 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:22.850695 19591 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:22.851063 19591 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:22.853267 11286 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:13:22.841497 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 50652.4us
I20260709 12:13:22.854331 11286 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:22.854748 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.859210 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.860401 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.860566 19382 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:22.861001 19382 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.861336 19382 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.861524 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:22.861605 19580 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:22.837631 19469 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:22.863047 19581 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:22.863464 19581 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:22.864192 19267 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.864282 19581 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.865711 19581 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.866304 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.860693 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.866959 11293 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:22.867654 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.867871 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.868487 11291 raft_consensus.cc:2393] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:22.853230 19500 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:22.869938 19620 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:22.870371 19620 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:22.870821 19620 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:22.871379 19500 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 33 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:22.872372 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.873984 11138 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:22.874110 19231 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.841424 19353 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.876178 11285 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:22.883386 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.876570 11217 raft_consensus.cc:2368] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 32. Current term is 33.
I20260709 12:13:22.884289 19267 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:22.877326 19621 raft_consensus.cc:697] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:22.886094 19621 consensus_queue.cc:237] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.834457 19582 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:22.877828 11257 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.862705 19580 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:13:22.881218 11211 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:22.841511 19616 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:22.862376 11292 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:22.891870 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:22.893376 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.905004 19412 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:22.855677 11286 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.913787 11286 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.920853 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:22.921451 11211 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:22.912185 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.920318 11284 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:22.928860 11185 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:22.862087 19587 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.935606 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.942587 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:22.943182 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:22.906376 19579 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:22.943503 11141 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Advancing to term 33
I20260709 12:13:22.948065 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:22.951313 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:22.952219 11216 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:22.944149 11219 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:22.911530 19616 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:22.918594 19459 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:22.954533 19380 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.961676 19380 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.965513 19620 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.967746 19582 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.970892 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:22.971069 11218 raft_consensus.cc:2368] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15.
I20260709 12:13:22.940007 19599 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:22.975031 19599 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:22.976804 19276 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:22.938850 19370 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:22.977653 19370 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.978099 19370 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:22.979745 19469 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.980172 19469 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:22.980237 19587 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.906672 19567 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:22.976154 19599 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.984691 19567 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:22.958321 19586 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:22.956908 19616 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:22.986429 19459 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:22.987483 19459 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:22.991060 19577 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.991940 19382 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:22.997445 19467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37100 (request call id 1635) took 4561 ms. Trace:
I20260709 12:13:22.998584 19382 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:23.005883 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:23.024266 11857 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:23.006752 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:23.025211 11861 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:13:23.024858 11212 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:13:23.027009 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:23.027590 11212 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.024466 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:23.007071 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 66503.4us
I20260709 12:13:23.007746 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:23.008502 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:23.008598 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:23.009900 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:23.011536 19579 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.012125 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:23.016778 11286 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:22.957341 11211 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:23.032811 11138 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:23.031286 11219 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:22.944275 19013 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:23.023577 11143 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 23 index: 20. Preceding OpId from leader: term: 24 index: 21. (index mismatch)
I20260709 12:13:23.024572 11141 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 33.
I20260709 12:13:23.031806 11140 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
W20260709 12:13:23.080154 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 68105.6us
I20260709 12:13:23.081015 11182 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.084712 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:23.081477 11184 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.086575 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:23.087329 11143 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:23.129354 11861 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:13:23.131682 11144 raft_consensus.cc:1275] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:23.131989 11217 raft_consensus.cc:1240] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:23.132994 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 48495.1us
I20260709 12:13:23.136319 11215 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 12:13:23.064971 19632 log.cc:927] Time spent T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:13:23.142877 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:23.143548 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62171.5us
I20260709 12:13:23.144845 11143 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:13:23.149930 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:23.146922 11212 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:23.154405 11286 raft_consensus.cc:1275] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 23 index: 20. Preceding OpId from leader: term: 24 index: 21. (index mismatch)
I20260709 12:13:23.149533 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 159) took 5135 ms. Trace:
I20260709 12:13:23.155980 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:23.156631 11216 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:23.156810 11138 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:13:23.159179 11286 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:23.078681 19613 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 24 is higher.
I20260709 12:13:23.153267 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.132691 19401 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:23.168519 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:23.143235 19621 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:23.176213 11216 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:23.147725 19601 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:23.064839 19579 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.157089 19276 raft_consensus.cc:2804] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:23.155815 11039 rpcz_store.cc:276] 0709 12:13:18.007636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.007866 (+   230us) service_pool.cc:224] Handling call
0709 12:13:18.236547 (+228681us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:13:23.142399 (+4905852us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:21.217048 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:21.324891 (+107843us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:21.324963 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:13:21.324989 (+    26us) tablet.cc:662] Decoding operations
0709 12:13:21.326116 (+  1127us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:21.326253 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:21.326297 (+    44us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:13:21.327232 (+   935us) tablet.cc:701] Row locks acquired
0709 12:13:21.327296 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:13:21.327521 (+   225us) write_op.cc:270] Start()
0709 12:13:21.327710 (+   189us) write_op.cc:276] Timestamp: P: 1783599201327439 usec, L: 0
0709 12:13:21.327752 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:13:21.328669 (+   917us) log.cc:844] Serialized 2835 byte log entry
0709 12:13:21.752181 (+423512us) op_driver.cc:464] REPLICATION: finished
0709 12:13:21.881014 (+128833us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f9834511ef0
0709 12:13:22.043691 (+162677us) write_op.cc:301] APPLY: starting
0709 12:13:22.043798 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:22.082224 (+ 38426us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:22.082275 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:22.397207 (+314932us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:22.397566 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:13:22.397639 (+    73us) write_op.cc:312] APPLY: finished
0709 12:13:22.398007 (+   368us) log.cc:844] Serialized 73 byte log entry
0709 12:13:22.398204 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:22.398330 (+   126us) write_op.cc:454] Released schema lock
0709 12:13:22.398385 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:22.481584 (+ 83199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:22.483432 (+  1848us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87672,"reported_tablets":11,"spinlock_wait_cycles":77364608,"child_traces":[["op",{"apply.queue_time_us":270425,"apply.run_cpu_time_us":16203,"apply.run_wall_time_us":423702,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33471,"num_ops":7,"prepare.queue_time_us":459801,"prepare.run_cpu_time_us":5508,"prepare.run_wall_time_us":128647,"replication_time_us":411573,"spinlock_wait_cycles":47216384,"thread_start_us":421853,"threads_started":2}]]}
I20260709 12:13:22.997887 19467 rpcz_store.cc:276] 0709 12:13:18.435792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.435947 (+   155us) service_pool.cc:224] Handling call
0709 12:13:19.264923 (+828976us) ts_tablet_manager.cc:934] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
0709 12:13:22.192486 (+2927563us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:22.656364 (+463878us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:22.656496 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:22.996502 (+340006us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:22.996827 (+   325us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:22.997168 (+   341us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:22.997318 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":38554,"tablet-copy.queue_time_us":657121,"thread_start_us":624079,"threads_started":2}
I20260709 12:13:23.164340 19578 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.197557 11138 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:13:23.174757 19564 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:23.148958 19370 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.160558 19573 consensus_queue.cc:1048] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:13:23.156471 19535 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 12:13:23.189702 19621 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:23.179311 19527 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.084s
I20260709 12:13:23.263652 11184 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.174084 19401 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:23.253163 19303 raft_consensus.cc:3055] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:23.269348 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.253659 19276 raft_consensus.cc:697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:23.294199 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 146002us
I20260709 12:13:23.179854 19591 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.314688 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:23.315819 19621 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:23.327832 19634 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:23.333495 19579 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:23.264258 19586 raft_consensus.cc:2764] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:13:23.339803 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:23.354025 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:23.338579 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.364508 11182 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:23.365645 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:23.367429 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 302355us
I20260709 12:13:23.359694 11259 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:23.189488 19601 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.298790 19401 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.338093 19380 raft_consensus.cc:2804] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:23.298112 19303 raft_consensus.cc:740] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.296877 19467 tablet_copy_client.cc:806] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:23.378321 11259 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:23.369273 19351 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:23.355931 19587 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.355782 19267 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:23.377481 19465 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.350582 11140 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:13:23.264029 19578 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.355672 19613 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:13:23.370703 19221 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:23.374624 19579 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:23.374782 19353 raft_consensus.cc:2804] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:23.373742 19598 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:23.380914 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 84985.8us
W20260709 12:13:23.379381 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.381476 11259 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:23.297531 19564 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:23.402922 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:23.415337 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:23.430126 11143 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.425177 19598 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:23.391224 19631 log.cc:927] Time spent T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:13:23.444526 11143 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
W20260709 12:13:23.390997 19635 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:13:23.450181 11216 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:23.411875 19503 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.398406 19581 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:23.389804 19467 tablet_copy_client.cc:670] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:23.396375 19327 raft_consensus.cc:2804] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:23.385334 19351 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.385069 19620 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:23.410013 19221 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:23.453737 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 184487us
I20260709 12:13:23.455971 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:23.389967 19575 raft_consensus.cc:2764] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader pre-election decision vote started in defunct term 29: won
I20260709 12:13:23.408313 19380 raft_consensus.cc:697] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:23.392455 19591 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:23.396317 19370 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:23.427417 19527 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:23.435286 19580 raft_consensus.cc:2804] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:23.464470 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 61668.6us
I20260709 12:13:23.463312 11184 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.410000 19267 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.390857 19276 consensus_queue.cc:237] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.16, Last appended by leader: 16, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:23.391104 19587 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.457635 19353 raft_consensus.cc:697] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.457314 19581 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.480618 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:23.466748 19351 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.493114 11138 raft_consensus.cc:3055] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:23.493737 11138 raft_consensus.cc:740] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:23.466779 19579 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:23.478209 19571 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:13:23.471725 19327 raft_consensus.cc:697] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.453416 19584 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:13:23.472105 19221 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.475585 19577 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:23.490733 11826 leader_election.cc:400] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15.
I20260709 12:13:23.521446 11826 leader_election.cc:403] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:23.491210 11210 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.468921 19617 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:23.461500 19564 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.459556 19503 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.495018 11138 consensus_queue.cc:260] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.527925 11138 raft_consensus.cc:3060] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:23.454941 19303 consensus_queue.cc:260] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.485340 19573 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:23.511173 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 60331.1us
W20260709 12:13:23.496444 19616 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 12:13:23.488135 19591 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:23.535848 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:23.513247 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 173616us
I20260709 12:13:23.490531 19580 raft_consensus.cc:697] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.540009 19580 consensus_queue.cc:237] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.490345 19527 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:23.542924 19503 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:23.543262 19527 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:23.544041 19641 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:13:23.546471 19469 consensus_meta.cc:287] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.566s	user 0.013s	sys 0.000s
I20260709 12:13:23.497680 19579 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.536810 19616 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.547269 19579 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.547118 19469 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.547780 11293 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:23.537483 19617 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.551577 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:23.552351 11861 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:23.540047 19353 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.553719 19617 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:23.555456 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:23.556941 11216 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:13:23.557693 19645 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 14. Current term is 15.
I20260709 12:13:23.557458 19591 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.558998 19382 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:23.559394 19382 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.559747 19591 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:23.557490 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 76134.8us
I20260709 12:13:23.560251 19382 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.560405 19581 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.561756 19639 consensus_queue.cc:1048] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:13:23.562685 19217 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:23.563251 19620 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:23.564291 11138 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 12:13:23.564852 11138 pending_rounds.cc:85] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 15
I20260709 12:13:23.565083 11138 pending_rounds.cc:107] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:13:23.565317 11138 raft_consensus.cc:2889] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:23.488018 19380 consensus_queue.cc:237] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.563505 19642 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:23.566784 19617 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.582896 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:23.571794 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:23.537825 19573 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:23.573179 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:23.574476 19603 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:23.574774 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:23.584877 11289 raft_consensus.cc:3060] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:23.585443 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:23.585743 11858 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:23.575914 19642 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:23.576292 19194 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:23.578874 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:23.570375 19620 consensus_queue.cc:1243] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 25.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:13:23.580677 19267 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:23.581244 19327 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:23.602957 19581 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.582472 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:23.605221 11293 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:13:23.611045 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 45886.3us
I20260709 12:13:23.611549 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:23.612080 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:23.612241 11218 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
I20260709 12:13:23.613081 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:23.614897 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:23.615787 11135 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:23.616102 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:23.616745 11143 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:23.588847 19573 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.590533 19603 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:23.591702 19616 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:23.570815 19577 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:23.594719 19598 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.563808 19217 raft_consensus.cc:3055] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:23.572691 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.599457 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:23.615053 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:23.649117 11136 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:23.530404 19601 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:23.596743 19617 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.621357 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:23.587580 19303 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.632489 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:23.598071 19642 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:13:23.645339 19649 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:23.645467 19584 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:23.646171 19267 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:23.637784 11210 raft_consensus.cc:2468] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
W20260709 12:13:23.674181 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 101556us
I20260709 12:13:23.652227 11110 leader_election.cc:400] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:23.664301 11293 raft_consensus.cc:3060] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:23.618419 19567 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:23.675052 11110 leader_election.cc:403] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:23.666266 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.646680 19598 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:23.648483 19217 raft_consensus.cc:740] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:23.677743 11286 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:23.642751 19624 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:23.722070 11258 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.625s (SENT)
W20260709 12:13:23.737207 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71056.1us
I20260709 12:13:23.737493 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:23.721079 19467 tablet_copy_client.cc:538] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:23.738937 11184 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:23.663012 19500 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:13:23.743333 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:23.725977 11259 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:23.743017 11292 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:23.740330 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:23.744908 11288 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:23.724385 19578 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:23.724781 19465 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:23.753291 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:23.724465 19567 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:23.769263 19351 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.778298 19601 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:23.780282 19601 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:23.781697 19601 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:23.767416 19382 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.772121 19640 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:23.770886 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48423.3us
I20260709 12:13:23.764158 11289 raft_consensus.cc:2468] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 33.
I20260709 12:13:23.775120 19567 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:23.779307 19587 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:23.741047 19621 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:23.784582 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.751876 19468 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:23.766388 11136 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:23.784847 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:23.786602 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:23.787209 11286 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:23.741942 19577 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:23.766170 19465 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.741309 19624 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.755863 19620 raft_consensus.cc:2804] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:23.751519 19650 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:23.763614 19647 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.801625 11285 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:23.817670 11286 raft_consensus.cc:1275] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:23.793741 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:23.805074 19468 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.827255 19468 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:23.827773 19351 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:23.797749 11258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.583s (SENT) [suppressed 16 similar messages]
I20260709 12:13:23.732451 19603 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:23.831733 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:23.899194 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 69237.2us
I20260709 12:13:23.902350 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:23.903575 11286 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:23.814599 19465 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:23.795894 19640 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:23.814988 19401 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:23.912146 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 260097us
I20260709 12:13:23.913462 19603 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.848443 19620 raft_consensus.cc:697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:23.805097 19621 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.940248 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:23.955482 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:23.847451 19565 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:23.955525 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:24.054349 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.934794 19613 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.062966 11285 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:24.059245  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:24.065599 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 110179us
I20260709 12:13:24.066325 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.062867 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.069643 11289 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:23.953510 19621 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:24.080966 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:24.084854 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.130052 11185 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.146713 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:13:24.085907 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.816272 19642 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.059083 19665 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:24.062425 19221 consensus_meta.cc:287] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.004s
I20260709 12:13:24.070920 19389 raft_consensus.cc:2764] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:24.143620 19565 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:24.146363 19564 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:24.070959 19267 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:24.263500 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 194213us
I20260709 12:13:24.267797 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.239213 19617 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.240201 19578 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:24.305410 19578 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.306948 19468 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.307762 19578 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.270087 19620 consensus_queue.cc:237] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.309144 19468 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.310797 19669 consensus_queue.cc:1059] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:24.313347 19389 raft_consensus.cc:3055] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:24.313861 19389 raft_consensus.cc:740] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
W20260709 12:13:24.315511 19662 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:13:24.315105 19389 consensus_queue.cc:260] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.249457 19598 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.274250 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:13:24.319350 11215 raft_consensus.cc:606] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:24.319825 11215 raft_consensus.cc:614] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:24.274812 19575 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.252648 19221 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.323433 19221 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.324400 11216 raft_consensus.cc:2393] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:24.275745 19579 consensus_meta.cc:287] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.005s
I20260709 12:13:24.278539 19656 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:24.325254 19579 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.325373 19656 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.326807 11218 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:24.327414 19303 consensus_meta.cc:287] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.004s
I20260709 12:13:24.328094 19656 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:24.291731 19581 consensus_meta.cc:287] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.003s
W20260709 12:13:24.295125 19657 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.446s	user 0.001s	sys 0.000s
I20260709 12:13:24.086709 19613 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.328756 19579 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.299876 19646 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:24.329427 19646 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.330086 11289 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 12:13:24.330430 11289 pending_rounds.cc:85] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 12
I20260709 12:13:24.330667 19613 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:24.302533 19658 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:13:24.331877 19646 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:24.235939 19591 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 12:13:24.265112 19565 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:24.303473 19655 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:13:24.332758 11285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:24.333432 11285 raft_consensus.cc:606] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:24.304992 19652 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 12:13:24.333791 11285 raft_consensus.cc:614] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:24.304293 19660 log.cc:927] Time spent T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 12:13:24.330672 11289 pending_rounds.cc:107] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:13:24.336577 11289 raft_consensus.cc:2889] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:24.299302 19624 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:24.338151 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.339469 19624 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.340103 19624 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.338174 11284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:24.342943 11284 raft_consensus.cc:606] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.343389 11284 raft_consensus.cc:614] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:24.334429 19565 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.346786 11284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:24.347414 11284 raft_consensus.cc:606] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Received request to transfer leadership to TS 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.347945 11284 raft_consensus.cc:614] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:24.350857 11143 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:24.352828 11143 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:13:24.354471 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.356320 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.357244 11143 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25.
I20260709 12:13:24.344161 19621 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.362934 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.363690 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.364305 11136 raft_consensus.cc:2468] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:13:24.369987 11293 consensus_meta.cc:287] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.695s	user 0.016s	sys 0.008s
I20260709 12:13:24.370469 11293 raft_consensus.cc:2468] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:13:24.369093 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.359947 19613 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.374732 11144 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:24.376338 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.377504 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.382336 11140 raft_consensus.cc:2376] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 31. Re-sending same reply.
I20260709 12:13:24.384121 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.384460 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.384877 11143 raft_consensus.cc:2376] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13. Re-sending same reply.
I20260709 12:13:24.385485 11140 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:24.382783 11185 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:24.394984 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.395941 11136 raft_consensus.cc:2393] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 22: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:24.398874 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.402561 11215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:13:24.403373 11215 raft_consensus.cc:606] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Received request to transfer leadership to TS 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:24.404023 11258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.009s
W20260709 12:13:24.404479 11258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.000s	sys 0.009s
W20260709 12:13:24.404793 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 607124us
I20260709 12:13:24.368058 19401 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.401278 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:24.409927 11258 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.662s (SENT)
I20260709 12:13:24.410032 11140 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.367556 19624 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:24.393980 19581 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.420782 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.421526 11143 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.409341 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.416456 11284 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:24.411495 11258 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.771s (SENT)
I20260709 12:13:24.418915 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.423944 11136 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:24.405076 19468 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:24.420138 19580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.004s	sys 0.011s
I20260709 12:13:24.428041 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.429353 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.434006 11284 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.429922 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.434885 11292 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 26: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:24.429337 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:24.430398 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:24.436272 11854 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:24.440068 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:24.440284 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.441335 11135 raft_consensus.cc:2393] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 16: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:24.441668 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.442302 11285 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:24.404865 19578 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:13:24.394563 19613 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.445410 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.422693 19013 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:24.423818 19581 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.449910 19013 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:24.433566 19580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.004s	sys 0.011s
I20260709 12:13:24.452200 19581 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:24.456025 19650 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.457280 19578 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.457772 19578 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.460191 11853 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:24.460358 19578 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.432433 19624 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:24.442303 19601 consensus_meta.cc:287] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.001s
I20260709 12:13:24.462414 19601 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.464752 19601 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:24.452610 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.426838 19671 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:24.430639 19468 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:24.452364 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.471129 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.472007 11292 raft_consensus.cc:2393] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:24.471758 19574 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:24.473848 19469 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:24.475054 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.474743 19671 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.477237 19671 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:24.478847 19276 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.479427 19276 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.481616 19276 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.435472 19656 consensus_queue.cc:1059] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:13:24.483708 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.484840 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.485479 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.485975 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.488487 11135 raft_consensus.cc:1240] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:24.468783 11258 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.798s (SENT)
I20260709 12:13:24.489909 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.468080 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:24.469324 11140 raft_consensus.cc:2410] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:24.417102 19587 consensus_queue.cc:1048] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 12:13:24.490747 11285 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:24.452283 19013 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.492081  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:24.500396 11293 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:24.493120 11861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:24.503517 11861 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:24.503625 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.504511 11137 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:24.494246 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:24.508796 11860 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.515261 19603 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:24.490257 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:24.515861 19603 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.516880 19617 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:24.518085 19603 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.502362  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:24.519717  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.521446 19467 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:13:24.522796 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.523075 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:24.523322 19621 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.523732 11136 raft_consensus.cc:2368] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for earlier term 21. Current term is 22.
W20260709 12:13:24.518154 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49409.9us
I20260709 12:13:24.487723 19468 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.538414 11143 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:24.436717 19465 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.531525 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.543505 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.499266 19620 raft_consensus.cc:2764] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
W20260709 12:13:24.550998 11258 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.704s (SENT)
I20260709 12:13:24.543370 11215 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:24.531076 19617 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:24.563349 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.562647 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.589123 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.589869 11141 raft_consensus.cc:2410] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 26 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:13:24.589926 11139 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.564364 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.591447 11140 raft_consensus.cc:3060] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:24.592446 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.593108 11285 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:24.593463 11288 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:13:24.594024 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.594725 11285 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:24.594971 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.595613 11290 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:24.594864 11292 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 12:13:24.599776 11143 raft_consensus.cc:1275] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:13:24.563458 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.565903 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:24.566632 11137 raft_consensus.cc:1240] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:13:24.603799 11855 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:24.568842 19465 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.569726 19681 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:24.571734 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.570590 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:24.570529 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.572453 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:24.573107 11184 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.575132 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.577729 11860 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:24.608922 11854 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:24.581907 11861 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:24.582813 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.584255 19389 raft_consensus.cc:3060] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.613095 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.584353 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.614661 11211 raft_consensus.cc:2410] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:13:24.587108 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.615360 11289 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:24.564183 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.615128 11140 raft_consensus.cc:2468] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:24.608871 11213 raft_consensus.cc:2368] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21.
I20260709 12:13:24.610596 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:24.609120 11212 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:24.611433 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 60466.6us
I20260709 12:13:24.613258 11291 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:24.613792 11217 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:24.621848 11215 raft_consensus.cc:2368] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23.
I20260709 12:13:24.622503 11139 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:13:24.625154 11258 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.752s (SENT)
I20260709 12:13:24.625654 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:24.628695 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.626281 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:24.632855 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:24.634380 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.901s (SENT)
I20260709 12:13:24.636165 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.636327 11860 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:13:24.543946 19656 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 12:13:24.552170 19565 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.085s
I20260709 12:13:24.671780 11140 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:13:24.760587 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:24.648942 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.797166 11139 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 19.
I20260709 12:13:24.682787 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:24.798382 11259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.677734 11826 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.799170 11138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40324 (request call id 2111) took 1228 ms. Trace:
I20260709 12:13:24.639096 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.800722 11285 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:24.734898 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.802654 11144 raft_consensus.cc:3060] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:24.681257 11141 raft_consensus.cc:1275] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:13:24.778466 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 144112us
I20260709 12:13:24.614111 19351 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:24.799677 11138 rpcz_store.cc:276] 0709 12:13:23.571043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.617954 (+ 46911us) service_pool.cc:224] Handling call
0709 12:13:23.618300 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.722772 (+104472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:23.722817 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:23.722874 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:23.722922 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.798936 (+1076014us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400253ad4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:24.798984 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.799113 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239678848}
W20260709 12:13:24.682607 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.620748 19587 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:24.622165 19567 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.625833 19681 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.780010 19613 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.810635 19567 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.812415 19681 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:24.789281 19217 consensus_queue.cc:260] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.786109 19468 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.812810 19567 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.813270 19217 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:24.636236 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:24.816084 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 179965us
I20260709 12:13:24.639248 11182 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.748994 11284 raft_consensus.cc:2468] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
W20260709 12:13:24.803998 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 126358us
I20260709 12:13:24.780900 11854 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:24.818174 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.675576 19276 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:24.806186 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:24.809356 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.813388 11139 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 12:13:24.823797 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 184666us
I20260709 12:13:24.824033 11138 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:24.671795 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:24.819520 11258 leader_election.cc:336] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.941s (SENT)
I20260709 12:13:24.825074 11143 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:24.826185 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.829383 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:24.829591 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.830384 11860 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:13:24.637044 19582 consensus_queue.cc:1059] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 12:13:24.806949 19591 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:24.814656 19468 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.833630 11826 leader_election.cc:400] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21.
I20260709 12:13:24.845377 11826 leader_election.cc:403] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:13:24.845681 11293 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:24.846315 11258 leader_election.cc:336] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 1.985s (SENT)
I20260709 12:13:24.846462 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.816866 11855 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:24.608268 19617 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.833084 19527 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.835443 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.825008 19587 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:24.814641 19621 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:13:24.820698 19581 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:24.820947 19327 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:24.822064 19681 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:24.848758 11826 leader_election.cc:400] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23.
I20260709 12:13:24.849504 19675 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21.
I20260709 12:13:24.849802 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.855780 11826 leader_election.cc:403] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:24.856195 11139 raft_consensus.cc:2376] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24. Re-sending same reply.
I20260709 12:13:24.850113 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:24.857268 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 48049.7us
I20260709 12:13:24.850967 19587 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.857543 11287 raft_consensus.cc:2410] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:13:24.857753 11285 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
W20260709 12:13:24.858876 11258 leader_election.cc:336] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Timed out: RequestConsensusVote RPC to 127.9.180.129:43503 timed out after 2.105s (SENT)
I20260709 12:13:24.858958 11182 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.862087 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:24.864121 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.832039 19465 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:24.868758 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.871785 11284 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:24.844895 19646 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.875391 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.876328 11139 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:24.880657 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.881356 11292 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:24.882324 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.868005 19370 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.886588 19370 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.889109 19370 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:24.870738 19578 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:24.872519 19503 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:13:24.859488 19591 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a for earlier term 22. Current term is 23.
I20260709 12:13:24.862537 19380 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:13:24.892478 11256 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.828279 19567 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:24.896245 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:24.862874 19600 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:24.900606 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.899000 19468 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:24.903321 19468 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.903658 19468 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:24.893240 19469 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:13:24.909631 11144 raft_consensus.cc:2468] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:24.911247 11184 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.873203 19353 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:24.912707 11287 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:24.913836 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:24.914363 11136 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.916882 11293 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:24.917146 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.919780 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.919901 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.923024 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.924899 11139 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:24.931492 11184 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:24.933727 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:24.908474 19600 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.944181 11860 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:24.944628 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.946035 11859 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:24.946696 11135 raft_consensus.cc:2468] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:24.909904 19578 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:24.948858 19578 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:24.945672 19401 raft_consensus.cc:2804] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:24.895387 19582 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.033s
I20260709 12:13:24.952142 11040 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.954651 19617 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:24.946130 19600 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:24.933049 19571 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:24.958616 11824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.961364 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:24.975566 11136 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
I20260709 12:13:24.907720 19650 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:13:24.976294 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 111849us
I20260709 12:13:24.954007 11040 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 28 to 29, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 29 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:24.981532 11144 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:24.983184 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:24.975096 19401 raft_consensus.cc:697] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:24.958837 19571 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:24.981866 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:24.964233 19370 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:24.986405 11040 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.963594 19389 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:24.988981 11139 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:24.990926 11040 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 25, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 25 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.986634 19598 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:24.997516 11040 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.001554 11040 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 19 to 21, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.993978 19692 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:25.004169 19692 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:25.004839 11858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1847) took 1069 ms. Trace:
I20260709 12:13:25.005200 19692 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:24.994182 19681 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.008507 19681 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.010993 19681 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.018043 11216 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:25.019481 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.023017 11143 raft_consensus.cc:1275] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 12:13:25.005334 11858 rpcz_store.cc:276] 0709 12:13:23.935276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.950375 (+ 15099us) service_pool.cc:224] Handling call
0709 12:13:23.950743 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.128976 (+178233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.129011 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.129054 (+    43us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:24.129097 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.004499 (+875402us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400658bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:25.004573 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.004742 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409317632}
I20260709 12:13:24.988489 19465 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:25.036791 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.036938 11040 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 18 to 19, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 19 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:24.994725 19642 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.022480 19389 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:25.046939 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63838.4us
I20260709 12:13:25.046146 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:24.999792 19276 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:25.048113 11291 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:25.049072 11292 raft_consensus.cc:1240] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:25.049484 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.054594 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.052692 19468 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.061589 19567 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.061996 19567 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.046623 19401 consensus_queue.cc:237] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:25.056629 19682 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.487s	user 0.002s	sys 0.003s
I20260709 12:13:25.057504 19500 raft_consensus.cc:993] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:13:25.044013 19571 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.066252 19500 raft_consensus.cc:1081] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Signalling peer 2b4f4725b82b481ab53f0717a429e94a to start an election
I20260709 12:13:25.066747 19571 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.058096 19465 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.060550 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.062340 19567 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.064640 19389 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:25.065650 19468 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:25.071467 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.073382 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.073125 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.083647 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:25.084189 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.043352 19646 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:13:25.081460 19603 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:25.058137 19600 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.097980 11856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23"
dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
 from {username='slave'} at 127.0.0.1:37092
I20260709 12:13:25.093142 19616 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:25.099931 19616 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.100315 19616 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:25.102813 19389 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:25.103993 19650 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.103754 19276 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.099553 11856 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.104903 11856 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.104532 19650 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.108862 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.110648 11143 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:25.094056 19698 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:25.117419 19639 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:13:25.119947 19650 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:25.131486 19650 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:25.132027 19650 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.110386 19217 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 12:13:25.136672 19650 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:25.153028 19640 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.154170 19617 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:25.154878 19617 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.157159 19617 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:25.159598 11290 raft_consensus.cc:2368] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:25.160764 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.171998 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:25.173422 11144 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.154341 19640 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.174532 11856 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.170917 19613 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.171963 19650 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:25.168912 19578 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.050s
W20260709 12:13:25.281229 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.284232 11856 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.180653 19581 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.285008 11144 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:25.285596 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:25.288740 11285 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.233110 19681 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.300040 11285 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 26.
I20260709 12:13:25.305231 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:25.305442 11826 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.306452 11214 raft_consensus.cc:3055] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:25.306878 11214 raft_consensus.cc:740] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:25.239096 19698 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:25.185861 19353 consensus_queue.cc:1048] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.118s
I20260709 12:13:25.283035 19370 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.328550 19370 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.329754 11214 consensus_queue.cc:260] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.330734 19370 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.330900 11214 raft_consensus.cc:3060] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.185590 19616 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.333328 19616 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:25.318106 19704 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:25.238196 19613 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.340509 19613 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:25.320032 19625 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:25.320634 19698 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:25.344743 19678 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.762s	user 0.005s	sys 0.002s
I20260709 12:13:25.345345 19698 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:25.310091 19681 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:25.347743 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 531094us
I20260709 12:13:25.348066 19681 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.322698 19567 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.349148 19013 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:25.350757 19567 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.351542 19013 consensus_queue.cc:1048] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:25.353703 19579 raft_consensus.cc:3055] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:25.354182 19579 raft_consensus.cc:740] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:25.355166 19579 consensus_queue.cc:260] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.356491 19579 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.356256 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:25.323678 19696 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:13:25.298698 19697 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.360356 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:25.360111 19697 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.360970 11290 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.362583 19697 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:25.363372 11853 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:25.372355 11860 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: [24.20-24.20]
W20260709 12:13:25.303987 19682 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:13:25.386766 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.387610 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:25.388763 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:25.396559 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 312982us
I20260709 12:13:25.397890 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:25.398108 11290 raft_consensus.cc:2468] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 25.
I20260709 12:13:25.408862 11214 raft_consensus.cc:2468] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 26.
I20260709 12:13:25.410640 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:25.411195 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.412005 11284 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:25.411383 11290 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:25.418011 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:25.315367 19217 raft_consensus.cc:2804] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:25.281692 19650 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.428650 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.430028 11284 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:25.409509 11826 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:25.411339 19703 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:13:25.439873 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:25.447431 11285 raft_consensus.cc:1240] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:25.447330 11290 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
I20260709 12:13:25.422609 19194 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:25.423251 19697 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:25.425400 19603 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:25.452960 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.394618 19370 consensus_queue.cc:1048] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:13:25.438112 19646 raft_consensus.cc:2804] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:25.459077 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:25.459594 11110 leader_election.cc:400] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 32. Current term is 33.
I20260709 12:13:25.462987 11110 leader_election.cc:403] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:25.463275 11214 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:25.467332 11210 raft_consensus.cc:1240] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:25.467531 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:25.441593 19217 raft_consensus.cc:697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 26 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:25.468832 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.472744 11213 raft_consensus.cc:1240] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:25.473081 11210 raft_consensus.cc:2368] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:13:25.469084 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.455188 19697 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.453642 19194 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.478900 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.480329 11212 raft_consensus.cc:2368] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:25.481752 11214 raft_consensus.cc:1240] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:25.484126 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.485994 11215 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:25.460490 19571 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:25.488927 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39588 (request call id 3605) took 1651 ms. Trace:
I20260709 12:13:25.494787 11218 rpcz_store.cc:276] 0709 12:13:23.831201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.831395 (+   194us) service_pool.cc:224] Handling call
0709 12:13:25.482750 (+1651355us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400295ed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:25.482904 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965520256}
I20260709 12:13:25.473687 19698 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Leader pre-election lost for term 32. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 32. Current term is 33.
I20260709 12:13:25.502601 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.476570 19646 raft_consensus.cc:697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 25 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:25.483081 19697 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:25.510697 11215 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:25.527210 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:25.483713 19194 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:25.569571 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 82104.7us
I20260709 12:13:25.574648 11215 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:25.586227 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.587013 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.588183 11290 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 19: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:25.588595 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.590188 11857 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:25.593987 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.597954 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.599804 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:25.600622 11138 raft_consensus.cc:2376] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21. Re-sending same reply.
I20260709 12:13:25.601768 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:25.604486 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.605324 11138 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:25.607776 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.608793 11214 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:25.594619 19640 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:25.611675 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.611639 19640 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:25.612102 19707 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:13:25.613036 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:25.613950 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.614200 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.614780 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.615147 11144 raft_consensus.cc:2393] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:25.615676 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.615908 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:25.617033 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.594741 19617 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:25.628690 19617 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.629172 19617 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:25.636760 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.606822 19581 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:25.639962 19650 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:25.592625 19217 consensus_queue.cc:237] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.642889 19642 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:25.643537 19642 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.645778 19642 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.650760 11858 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:25.651597 19646 consensus_queue.cc:237] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.655571 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.656855 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.589900 19353 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:25.666042 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.668124 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.679525 11140 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:25.699307 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:25.704988 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.705986 11218 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:25.711992 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.713130 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:25.614075 19640 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.719805 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:25.735072 11214 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:25.733839 19697 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.740173 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.745489 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:25.751865 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:25.757647 11135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36066 (request call id 3377) took 1190 ms. Trace:
I20260709 12:13:25.757812 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:25.758558 11852 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:25.758180 11135 rpcz_store.cc:276] 0709 12:13:24.563454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.563974 (+   520us) service_pool.cc:224] Handling call
0709 12:13:25.750427 (+1186453us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400264654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:25.754253 (+  3826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740454272}
I20260709 12:13:25.707558 19684 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:13:25.766635 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:25.759477 19601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.014s
I20260709 12:13:25.777637 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:25.774888 19601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.015s
I20260709 12:13:25.788038 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.792320 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.794800 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.802525 19603 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.803006 19603 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:25.803409 19603 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.820443 19681 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.821357 19327 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:25.821113 19681 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.821943 11856 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:25.824519 19681 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:25.825381 19681 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:25.786074 19389 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:13:25.828269 19389 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:25.828639 19389 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:25.829453 19389 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.831787 19617 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.836309 11855 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:25.836653 11212 raft_consensus.cc:2410] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:25.838101 11185 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:25.842723 19681 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:25.842972 11857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37100 (request call id 1692) took 1763 ms (client timeout 2135 ms). Trace:
W20260709 12:13:25.843557 11857 rpcz_store.cc:269] 0709 12:13:24.079690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.079797 (+   107us) service_pool.cc:224] Handling call
0709 12:13:25.842773 (+1762976us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006563d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:25.842889 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429435136}
I20260709 12:13:25.847090 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:25.847641 11185 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:25.852612 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:13:25.853880 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 64421.1us
I20260709 12:13:25.855330 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.852015 19579 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:13:25.854650 19327 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:13:25.856755 19698 consensus_queue.cc:1059] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:25.857563 19698 consensus_queue.cc:1243] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer ba2779405e8d452e95f42421b2b60928 log is divergent from this leader: its last log entry 26.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:25.858217 19698 raft_consensus.cc:3055] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:25.860055 11110 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:25.810144 19613 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.863718 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.865355 11110 leader_election.cc:400] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:25.866264 11110 leader_election.cc:403] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:25.864899 19582 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.858570 19698 raft_consensus.cc:740] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:25.850621 19389 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.876415 19582 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.876672 11216 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:25.876981 19582 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.854194 19370 raft_consensus.cc:2804] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:25.867022 19327 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:13:25.855044 19650 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:25.877426 19624 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:25.885190 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:25.887892 11288 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:25.862267 19276 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:25.892964 11292 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:25.893728 19617 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:25.867477 19571 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:25.865065 19598 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:13:25.896387 19370 raft_consensus.cc:697] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:25.896854 19650 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:25.897404 19370 consensus_queue.cc:237] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.892110 19624 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.877987 19710 raft_consensus.cc:3060] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:25.899036 19624 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.854898 19621 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:13:25.877053 19351 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:13:25.892604 19276 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.903144 19276 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.897842 19650 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:25.904387 19698 consensus_queue.cc:260] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.891721 19693 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:25.895434 19194 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:25.925092 11852 raft_consensus.cc:2468] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:25.871253 19579 consensus_queue.cc:1059] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.049s
W20260709 12:13:25.916946 19467 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:25.905769 19698 raft_consensus.cc:3060] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:25.919915 19726 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.088s	user 0.004s	sys 0.000s
I20260709 12:13:25.945302 11256 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:25.949674 11284 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 26: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:13:25.931360 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63265.9us
I20260709 12:13:25.953748 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
W20260709 12:13:25.955154 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 85726.4us
I20260709 12:13:25.964306 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:25.964629 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:25.978808 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:25.980165 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 90716.7us
I20260709 12:13:25.917382 19684 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:13:25.959625 19697 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:25.995888 19736 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.995641 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:25.983096 19353 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:25.980479 19731 raft_consensus.cc:2804] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:26.004551 11218 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:26.016525 19719 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:13:26.023468 11142 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 12:13:26.028134 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.018894 19697 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:13:26.059072 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 80353.3us
I20260709 12:13:25.920243 19693 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.035140 19671 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:26.042778 19681 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:26.006335 19579 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
I20260709 12:13:26.064733 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:26.045764 19731 raft_consensus.cc:697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:26.043632 19581 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:26.075354 11210 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:26.106442 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:26.111455 11213 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:26.067077 19603 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.136909 19389 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:26.137753 19389 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.139463 11288 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:26.141362 19389 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.141515 19601 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:26.147742 19731 consensus_queue.cc:237] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.151665 19693 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.071817 19671 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.113607 19194 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:26.088625 19581 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.156769 19581 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:26.158838 19603 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.158955 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:26.173372 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:26.154343 19624 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.220959 19624 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:26.229171 19710 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:26.173858 19276 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.232184 19276 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:26.233549 11853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37092 (request call id 1849) took 1766 ms (client timeout 1959 ms). Trace:
I20260709 12:13:26.199046 19567 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:26.234206 11853 rpcz_store.cc:269] 0709 12:13:24.467054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.467813 (+   759us) service_pool.cc:224] Handling call
0709 12:13:26.233290 (+1765477us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400361d54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:26.233448 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006351104}
W20260709 12:13:26.236459 19725 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
W20260709 12:13:26.236706 19680 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 1.654s	user 0.000s	sys 0.012s
I20260709 12:13:26.118019 19582 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.234424 19567 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.243517 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.259719 11142 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
W20260709 12:13:26.229002 19742 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
W20260709 12:13:26.239881 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.241472 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:26.239957 19671 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:26.272790 11219 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:26.241271 19600 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.242966 19582 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.283447 11825 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.287298 19601 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:26.288497 11110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.288691 11825 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.289628 19601 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.289925 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.299690 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:26.291400 19721 log.cc:927] Time spent T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 12:13:26.292415 19601 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:26.308514 19601 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:26.308954 19601 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:26.309301 19698 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:26.309849 19601 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.311273 19601 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:26.312033 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:26.312470 19735 log.cc:927] Time spent T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.266s	user 0.002s	sys 0.002s
I20260709 12:13:26.312738 11139 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:26.313830 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.293337 11825 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:26.314947 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.315438 19217 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:26.299109 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.315845 11137 raft_consensus.cc:2410] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 22 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:26.316124 11143 raft_consensus.cc:3060] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:26.315820 19217 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:26.317602 19217 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:26.320186 19723 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.487s	user 0.001s	sys 0.002s
W20260709 12:13:26.315078 19728 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 12:13:26.305724 11135 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:26.329551 11110 leader_election.cc:400] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:13:26.330338 11110 leader_election.cc:403] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:26.338642 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.339174 11110 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.342187 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.344579 11110 leader_election.cc:400] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28.
I20260709 12:13:26.347096 11143 raft_consensus.cc:2468] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:26.342334 19731 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:26.352381 19581 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:26.354614 19603 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:26.355419 19697 consensus_queue.cc:1059] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:26.356521 19697 raft_consensus.cc:3055] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:26.356887 19697 raft_consensus.cc:740] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:26.359308 11853 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:26.359760 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.361536 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.362027 11219 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:26.305347 19736 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:26.365446 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:26.365577 11138 raft_consensus.cc:1275] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:26.368204 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.369339 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.370419 11210 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:26.372032 19669 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:26.364938 11184 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:26.373039 19669 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:26.373382 19669 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:26.373663 19582 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:26.374198 19582 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:26.375098 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3391) took 1618 ms. Trace:
I20260709 12:13:26.375593 11141 rpcz_store.cc:276] 0709 12:13:24.757048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.807887 (+ 50839us) service_pool.cc:224] Handling call
0709 12:13:25.750933 (+943046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.751289 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.751320 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:25.751364 (+    44us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:25.751406 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.751469 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.374845 (+623376us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400264650. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ada8ad 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:26.375000 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2257,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2455,"spinlock_wait_cycles":2123477888}
I20260709 12:13:26.375339 19582 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.342126 19710 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 23. Current term is 24.
I20260709 12:13:26.365250 19567 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:26.379778 19194 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:26.380456 19194 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:26.373056 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.374207 11860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37092 (request call id 1866) took 1200 ms. Trace:
I20260709 12:13:26.377529 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.386895 11141 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:26.391458 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:26.385447 11860 rpcz_store.cc:276] 0709 12:13:25.174035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.174208 (+   173us) service_pool.cc:224] Handling call
0709 12:13:25.174574 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:25.372866 (+198292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.373842 (+1000976us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54005703d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:26.374030 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454206848}
I20260709 12:13:26.392614 11219 raft_consensus.cc:2368] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
W20260709 12:13:26.365057 19725 log.cc:927] Time spent T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:13:26.337132 19465 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:26.391420 11184 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:26.408175 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.412760 11184 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.394737 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:26.413443 11285 raft_consensus.cc:2393] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 26: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:26.395433 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.395648 19617 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:26.364809 19624 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:26.374312 19669 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.414661 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.416709 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.429852 11138 raft_consensus.cc:3060] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:26.419642 19731 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.420655 11136 raft_consensus.cc:1275] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:26.433434 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.433552 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.434336 11136 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:26.426594 19217 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.415442 19469 raft_consensus.cc:2764] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:13:26.394767 19733 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:26.416966 19579 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:26.439994 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 174080us
W20260709 12:13:26.446630 11825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.447984 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.436435 19625 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.431679 11184 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:26.472451 19467 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:26.473832 19467 tablet_bootstrap.cc:492] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:13:26.429014 19465 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.474733 19467 ts_tablet_manager.cc:1403] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 1.954s	user 0.063s	sys 0.019s
I20260709 12:13:26.438997 19676 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.462316 11138 raft_consensus.cc:2468] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:26.478958 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:26.456277 11136 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.481452 19741 consensus_queue.cc:1048] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:26.481192 19616 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:26.484498 19467 raft_consensus.cc:359] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.486981 19754 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:26.436162 19599 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:13:26.495688 19217 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:26.503680 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:26.414661 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.456687 19669 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.518085 11218 raft_consensus.cc:3055] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:26.521849 11218 raft_consensus.cc:740] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:26.521651 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.476965 19465 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:26.523996 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 109409us
I20260709 12:13:26.524537 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:26.496956 19579 raft_consensus.cc:2804] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:26.531994 11219 raft_consensus.cc:1275] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:13:26.519937 19727 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.007s	sys 0.004s
I20260709 12:13:26.539947 19581 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.555464 11289 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:26.513049 19582 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:26.544723 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:26.568544 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:26.538169 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 155477us
I20260709 12:13:26.522927 11218 consensus_queue.cc:260] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.570307 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.570674 11218 raft_consensus.cc:3060] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:26.547953 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:26.573051 11291 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:26.497359 19625 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:26.543311 19727 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.008s	sys 0.005s
W20260709 12:13:26.557401 19650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.028s	sys 0.043s
I20260709 12:13:26.543947 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:26.551385 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:26.579232 11286 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.547679 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:26.580901 11284 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:26.521449 19736 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:26.547003 11136 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:26.572245 19582 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:26.557574 19579 raft_consensus.cc:697] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:26.572711 19389 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:26.615232 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.572841 19698 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:26.578847 19650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.028s	sys 0.043s
I20260709 12:13:26.617491 11141 raft_consensus.cc:2393] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 20: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:26.620245 11293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 4536) took 1162 ms. Trace:
W20260709 12:13:26.629773 19724 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.798s	user 0.004s	sys 0.000s
W20260709 12:13:26.625916 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48919.6us
W20260709 12:13:26.631474 19737 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.530s	user 0.000s	sys 0.001s
I20260709 12:13:26.622771 11293 rpcz_store.cc:276] 0709 12:13:25.458153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.458362 (+   209us) service_pool.cc:224] Handling call
0709 12:13:26.473783 (+1015421us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:13:26.474025 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:26.474271 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:26.475317 (+  1046us) log.cc:844] Serialized 14 byte log entry
0709 12:13:26.619834 (+144517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:26.619888 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:26.619945 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.620019 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.620173 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39464,"prepare.queue_time_us":1964,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":39630,"spinlock_wait_cycles":23464320,"thread_start_us":104637,"threads_started":1}
I20260709 12:13:26.634438 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3405) took 1034 ms. Trace:
W20260709 12:13:26.634618 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64390.9us
I20260709 12:13:26.525699 19754 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.640636 11286 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:26.634888 11144 rpcz_store.cc:276] 0709 12:13:25.599798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.616830 (+ 17032us) service_pool.cc:224] Handling call
0709 12:13:25.617288 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:25.617998 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:25.618028 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:25.618746 (+   718us) log.cc:844] Serialized 52 byte log entry
0709 12:13:25.762857 (+144111us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:25.792586 (+ 29729us) log.cc:844] Serialized 14 byte log entry
0709 12:13:25.817867 (+ 25281us) log.cc:844] Serialized 14 byte log entry
0709 12:13:25.818223 (+   356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.818338 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:26.629141 (+810803us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:26.634216 (+  5075us) raft_consensus.cc:1685] finished
0709 12:13:26.634241 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.634382 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30229,"prepare.queue_time_us":51456,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":115,"raft.queue_time_us":394,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":2731,"spinlock_wait_cycles":31426432,"thread_start_us":143485,"threads_started":1,"wal-append.queue_time_us":213005}
I20260709 12:13:26.632380 11259 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:26.639024 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:26.612850 19582 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:26.647269 11284 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:26.612850 19467 raft_consensus.cc:740] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:13:26.651425 11110 leader_election.cc:400] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
W20260709 12:13:26.638687 19756 log.cc:927] Time spent T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:13:26.643003 19698 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:26.660386 19710 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.663766 19650 raft_consensus.cc:2804] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:26.664230 19389 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.681180 19600 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.704255 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:26.693331 19603 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:26.710072 19698 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.700837 19194 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.715112 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:26.711138 19773 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:26.719848 19625 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.711903 11219 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:13:26.721479 19587 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260709 12:13:26.724876 11135 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:26.703657 19650 raft_consensus.cc:697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:26.741248 19650 consensus_queue.cc:237] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:26.743233 19722 log.cc:927] Time spent T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.910s	user 0.004s	sys 0.003s
I20260709 12:13:26.729283 19754 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.731563  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.688359 19579 consensus_queue.cc:237] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.700259 19389 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.759663 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.765143 11860 raft_consensus.cc:1240] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:26.738652 19710 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.687922 19467 consensus_queue.cc:260] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:26.768352 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:26.770365 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:26.771556 11858 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:26.771907 11857 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:26.773480 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.773649 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.772017 11860 raft_consensus.cc:2368] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:26.708526 19600 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.776151 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:26.776623 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:26.778956 19764 log.cc:927] Time spent T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:13:26.779385 19353 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:26.779737 19613 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:26.776801 11860 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:26.755229 19774 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:26.780840 19774 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.781303 19389 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:26.782163 19757 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:13:26.782877 19774 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.782582 19710 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.784698 19710 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.785940 19467 ts_tablet_manager.cc:1434] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.309s	user 0.009s	sys 0.005s
I20260709 12:13:26.789654 11287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 4535) took 1333 ms. Trace:
I20260709 12:13:26.790220 11287 rpcz_store.cc:276] 0709 12:13:25.456328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.456436 (+   108us) service_pool.cc:224] Handling call
0709 12:13:26.373307 (+916871us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800003098. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835af30ab 00007f9835af3131 00007f9835ab4fc0 00007f9835a9f929 00007f9835a9f3d2 00007f982f016bd4
0709 12:13:26.373491 (+   184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.441843 (+ 68352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.441892 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.442525 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.559846 (+117321us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:26.649400 (+ 89554us) log.cc:844] Serialized 14 byte log entry
0709 12:13:26.660684 (+ 11284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.789247 (+128563us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b54003f0a54. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:26.789307 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:26.789372 (+    65us) raft_consensus.cc:1685] finished
0709 12:13:26.789393 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:26.789577 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6331,"prepare.queue_time_us":110382,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":32917,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":22307,"spinlock_wait_cycles":177819776,"thread_start_us":147996,"threads_started":2,"wal-append.queue_time_us":168771}
I20260709 12:13:26.730535 19603 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.735736 19773 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:26.823817 19769 log.cc:927] Time spent T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:26.824327 19773 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.817791 19389 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:26.825404 19351 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.825716 19389 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.826938 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:26.827865 19389 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.828938 19774 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:26.829499 19774 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:26.712257 19697 consensus_queue.cc:260] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.831640 19774 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.820878 11826 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:26.810514 19598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.015s	sys 0.020s
I20260709 12:13:26.825894 19351 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.792104 19527 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.806603 19616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46840 (request call id 9) took 9642 ms. Trace:
W20260709 12:13:26.836035 19598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.015s	sys 0.021s
I20260709 12:13:26.849262 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:26.853505 11287 raft_consensus.cc:1275] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:13:26.854918 19013 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:26.855377 19013 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:26.839075 19639 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:26.839989 19710 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:26.862138 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 83105.7us
I20260709 12:13:26.863983 11287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
W20260709 12:13:26.864868 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.861547 11182 leader_election.cc:400] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:26.868211 11287 raft_consensus.cc:606] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:26.868324 11182 leader_election.cc:403] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:26.865867 19013 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.868867 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:26.869382 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:26.868739 11287 raft_consensus.cc:614] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:26.871852 11284 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:26.840196 19601 consensus_queue.cc:1048] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 12:13:26.885308 19573 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:26.885782 19573 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:26.886135 19573 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:26.887292 11287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:26.887861 11287 raft_consensus.cc:606] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:26.888185 11287 raft_consensus.cc:614] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:26.890651 19778 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:26.891021 11287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "ba2779405e8d452e95f42421b2b60928"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:49216
I20260709 12:13:26.891194 19778 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.891562 11287 raft_consensus.cc:606] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:26.875695 19353 consensus_queue.cc:1048] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:13:26.895605 19741 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:26.843964 19616 rpcz_store.cc:276] 0709 12:13:17.126713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.127428 (+   715us) service_pool.cc:224] Handling call
0709 12:13:17.428560 (+301132us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b4c00040a40. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982ed7e644 00007f982eda5f2d 00007f982eda5b93 00007f9830a341af 00007f9830a33f3e 00007f9830ab9888 00007f9830ad675c 00007f9830ad776a 00007f9830ad691b
0709 12:13:17.430454 (+  1894us) log.cc:844] Serialized 506 byte log entry
0709 12:13:17.879327 (+448873us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b5400458420. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a54142 00007f9830a34eaa 00007f9830a3bd53 00007f9830a3bcd9 00007f9830a3bc69 00007f9830a3bc31 00007f9830a3adfd 0000000000388634 0000000000388479 00007f982d9ee475
0709 12:13:26.758581 (+8879254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54686,"raft.queue_time_us":67100,"raft.run_cpu_time_us":8777,"raft.run_wall_time_us":389710,"spinlock_wait_cycles":74629248,"thread_start_us":217929,"threads_started":1,"wal-append.queue_time_us":376638,"wal-append.run_cpu_time_us":1838,"wal-append.run_wall_time_us":1016460}
I20260709 12:13:26.905224 11287 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:26.875563 19676 raft_consensus.cc:3060] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:26.858553 19736 consensus_queue.cc:1059] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:13:26.894676 19778 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:26.902159 19731 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:26.870075 19599 consensus_queue.cc:1059] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.055s
I20260709 12:13:26.869542 19640 consensus_queue.cc:1048] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.047s
I20260709 12:13:26.879372 19710 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:26.952792 11140 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:26.943179 19599 raft_consensus.cc:3055] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:26.960809 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.964727 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.969357 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.970204 11287 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 28.
I20260709 12:13:26.972998 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.976205 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:26.977218 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:26.957377 19772 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:13:26.990571 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:27.000306 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 252192us
I20260709 12:13:27.003499 19603 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:26.960600 19599 raft_consensus.cc:740] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:27.029883 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:27.038425 11285 raft_consensus.cc:1240] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:27.042783 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 142554us
W20260709 12:13:27.087106 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73368.6us
W20260709 12:13:27.084194 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 49141.6us
I20260709 12:13:27.096163 11218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:13:27.097337 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:27.098183 11140 raft_consensus.cc:2410] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 29 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:27.037305 19773 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:27.087057 19728 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:13:27.008574 19582 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.082983 19600 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:27.142702 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 57069.4us
I20260709 12:13:27.143630 19013 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:13:27.155185 11210 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:13:27.112821 19773 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:27.175455 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.151773 19669 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.615s	user 0.013s	sys 0.003s
W20260709 12:13:27.168975 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 67677.7us
I20260709 12:13:27.192988 11137 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:27.155078 19351 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:27.199888 11090 auto_rebalancer.cc:629] Failed to schedule move for tablet ddd0a7b2bb3645519f8c5c9bf85633d9: Illegal state: Replica ba2779405e8d452e95f42421b2b60928 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 26 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:27.170607 19698 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.203006 19698 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.206033 19698 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.157240 19599 consensus_queue.cc:260] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.211529 19599 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:27.215890 19792 log.cc:927] Time spent T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:13:27.218916 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 130607us
I20260709 12:13:27.217175 19766 raft_consensus.cc:993] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:27.170270 19773 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.228268 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:27.237636 19782 log.cc:927] Time spent T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:13:27.240899 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:27.232517 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 376481us
W20260709 12:13:27.227262 19728 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:27.251953 19353 raft_consensus.cc:1081] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:27.265569 19579 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:13:27.271399 19789 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:13:27.271445 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.271775 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.273312 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.273416 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.275300 19567 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:27.276002 19567 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.283762 19527 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.283991 19582 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:27.284598 19710 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.284361 19527 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.285113 19601 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:27.285823 19601 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.286391 19527 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.287778 19527 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:27.288538 19601 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.288249 19527 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.290607 19527 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.299031 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:27.299765 11860 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:13:27.282204 19786 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 12:13:27.300037 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:27.308046 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44942us
I20260709 12:13:27.251948 19600 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:27.313534 11140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36066
I20260709 12:13:27.329108 11140 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.329692 11140 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:13:27.336966 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 94224.7us
I20260709 12:13:27.294322 19676 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21.
I20260709 12:13:27.361406 11853 raft_consensus.cc:3060] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEARNER]: Advancing to term 24
I20260709 12:13:27.366955 11140 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.312309 19642 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.372936 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.373413 19013 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:27.381882 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.389333 11292 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:27.394837 19013 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.396458 11859 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:27.395364 19013 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.398145 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:27.409751 11107 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:27.370333 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 59966us
I20260709 12:13:27.371297 19600 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:27.307054 19573 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.428062 19013 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.430651 11107 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:27.400334 19670 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:27.440950 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.442163 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.443008 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.444092 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.384824 19567 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.449687 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.388548 19676 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:13:27.450834 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.454263 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:27.461050 11218 raft_consensus.cc:606] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:27.458102 11853 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:27.421572 19791 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.468210 19600 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.471154 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:27.472891 19801 log.cc:927] Time spent T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:27.432097 19669 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:27.453559 19670 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.480885 19670 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.399875 19642 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.482298 19469 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:27.453012 19573 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:27.461265 19777 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:27.501122 11860 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:27.545912 11858 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:27.556244 19642 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.556145 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44734 (request call id 1623) took 1032 ms. Trace:
I20260709 12:13:27.556854 11210 rpcz_store.cc:276] 0709 12:13:26.523979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.524248 (+   269us) service_pool.cc:224] Handling call
0709 12:13:27.555957 (+1031709us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400239bd4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:27.556072 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448763776}
I20260709 12:13:27.547899 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:27.562752 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 117520us
W20260709 12:13:27.561591 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 198037us
I20260709 12:13:27.494339 19469 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.568040 11144 raft_consensus.cc:1240] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 16. Current term is 17. Ops: []
W20260709 12:13:27.569871 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 152647us
I20260709 12:13:27.566504 11185 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:27.530565 19773 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.579967 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:27.581735 11139 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:27.583964 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.585237 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:27.568001 19800 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:27.592262 11216 pending_rounds.cc:85] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 19
I20260709 12:13:27.592589 11216 pending_rounds.cc:107] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 24.20
I20260709 12:13:27.592842 11216 raft_consensus.cc:2889] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:27.595350 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:27.597360 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:27.600572 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-f1f091d9f19d495da80e2f33e1044577 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:13:27.601117 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-f1f091d9f19d495da80e2f33e1044577 on tablet f1f091d9f19d495da80e2f33e1044577 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:27.602325 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:27.608124 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.609277 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:27.613961 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.588680 19670 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:27.621181 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:27.630384 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.635344 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.637343 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.615816 19710 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:27.641063 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.623456 19787 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:27.622542 19800 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:27.627621 19670 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.651160 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.622675 19669 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:27.618870 19818 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:27.634981 19698 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:27.634821 19600 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:27.654840 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:27.647614 19731 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:27.654034 19676 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:27.667506 19807 log.cc:927] Time spent T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:13:27.664012 19794 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:13:27.656205 19670 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.660528 19818 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.673736 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:27.666302 19600 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.679841 19469 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:27.676573 19621 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:27.681227 19600 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:27.681157 19621 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.688479 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.676374 19671 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:27.689303 19808 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:13:27.678625 19818 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.691417 19773 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.683337 19800 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.677939 19676 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.696822 19676 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:27.688412 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.699038 11856 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:27.704816 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:27.704843 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.705571 11856 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:27.706704 11211 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:27.709313 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:27.709981 11293 raft_consensus.cc:3055] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:27.710412 11293 raft_consensus.cc:740] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:27.710667 19676 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:27.711151 19676 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:27.711673 19676 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:27.711256 11293 consensus_queue.cc:260] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.709908 11182 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:27.716321 19600 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:27.716763 19600 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:27.717198 19600 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.719496 11287 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:27.686391 19754 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.720815 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:27.723011 19732 raft_consensus.cc:3055] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:27.726722 19810 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:27.726773 19773 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:27.729199 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:27.710898 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:27.729616 11290 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:27.725939 19811 consensus_queue.cc:1059] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:27.730310 19732 raft_consensus.cc:740] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:27.728663 19621 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:27.807173 19774 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:27.747599 19773 consensus_queue.cc:1243] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer 5d1ee1ef054240338e0a9e05a67acdfc log is divergent from this leader: its last log entry 26.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:27.819976 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.823007 11292 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:27.826924 11288 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:27.807632 19603 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:27.830708 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.834746 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.836081 11290 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 29.
W20260709 12:13:27.827230 19829 log.cc:927] Time spent T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:13:27.849129 11287 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 28. Current term is 29. Ops: [26.15-28.16]
I20260709 12:13:27.838339 19603 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.865655 19603 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:27.824193 19774 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.869426 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:27.888464 19831 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:27.836431 19732 consensus_queue.cc:260] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.891991 19732 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:27.867575 19698 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:27.871506 19669 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:27.882961 19808 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.931572 19773 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.931143 19698 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:27.932291 19669 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.933835 19808 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.944072 19773 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:27.960966 19825 log.cc:927] Time spent T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:13:27.952673 19676 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.960546 19670 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.990694 19833 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:27.991611 19833 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.003126 19831 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.007472 19831 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.009819 19831 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.003158 19603 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:28.012066 19808 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.012048 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.013345 11144 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:28.019060 19787 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.017637 19600 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.019618 19787 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:27.978268 19676 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.029315 19774 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.036157 19833 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.047509 19581 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.048146 19581 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:28.050674 19826 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.272s	user 0.003s	sys 0.000s
W20260709 12:13:28.051939 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.055119 19581 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.066306 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:28.067387 11108 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.066720 19774 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.012042 19603 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.074864 19774 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.079025 11137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 4855) took 1747 ms. Trace:
W20260709 12:13:28.080056 19832 log.cc:927] Time spent T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:13:28.083437 19603 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.084314 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.078169 19774 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.069661 19710 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:28.086309 19710 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.088828 19710 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.091621 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.079541 11137 rpcz_store.cc:276] 0709 12:13:26.331504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.363963 (+ 32459us) service_pool.cc:224] Handling call
0709 12:13:26.391595 (+ 27632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.193431 (+801836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:28.078754 (+885323us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540033fed4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:28.078954 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842138496}
W20260709 12:13:28.097375 11109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.133647 19787 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.133803 19698 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.134975 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.097055 19818 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.143303 19736 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:28.144104 19736 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:28.145066 19736 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.147688 19831 raft_consensus.cc:1064] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:13:28.146358 19736 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.149721 19818 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.150461 19831 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.152037 11218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42804 (request call id 90) took 1056 ms. Trace:
I20260709 12:13:28.152427 11218 rpcz_store.cc:276] 0709 12:13:27.095589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.096012 (+   423us) service_pool.cc:224] Handling call
0709 12:13:28.151850 (+1055838us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54002954d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830ad5853 00007f9835aa360a 00007f982f0297d4 00007f982f029762 00007f982f029691 00007f982f02960c 00007f982f0288c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:28.151944 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837508352}
I20260709 12:13:28.154512 19600 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.164705 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:28.165584 11291 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:28.166731 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:28.161957 19751 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:28.169618 19751 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.171775 11287 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:13:28.177213 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.178113 11285 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:28.179118 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.178056 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.184579 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.185253 11290 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:28.185897 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.186599 11137 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:28.186530 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:28.171694 19751 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.189059 11135 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:28.189286 11136 raft_consensus.cc:1275] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:28.190819 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.200037 11291 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:28.200539 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.204236 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.205156 11136 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:28.206314 19697 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:28.207085 19840 log.cc:927] Time spent T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:13:28.187244 19698 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:28.187645 19732 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.207993 19698 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.208634 19732 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.210234 19698 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.211485 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.183051 19710 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.212750 19710 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.212751 19013 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.221925 19013 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.203195 19624 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:28.222949 19624 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.223348 19624 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.223398 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.224445 11135 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:28.225387 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.214968 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.219909 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:28.229413 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:28.200076 19787 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:28.224656 19774 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:28.203850 11110 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:28.239274 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:28.240612 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.243206 11143 raft_consensus.cc:2393] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 25: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:28.248047 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:28.241219 19733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.011s	sys 0.012s
W20260709 12:13:28.253934 19733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.011s	sys 0.012s
I20260709 12:13:28.255595 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.256901 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.250137 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:28.257885 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.267186 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.268500 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.269218 11143 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:28.270313 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.272019 11143 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:13:28.272953 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.214689 19797 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:28.274451 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.288441 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.249207 19787 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:28.308641 19787 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:28.309703 19787 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.311764 19816 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:28.312378 19816 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:28.287750 11825 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.322702 11853 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:28.302186 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.324326 11137 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 21: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:28.253545 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.263381 19603 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:28.324656 11825 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.251050 19777 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:28.325752 11852 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:28.250695 19698 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:28.305526 11136 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:28.339525 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.336006 11143 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:28.277202 19650 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:28.369179 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.372798 11852 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:28.372993 11143 raft_consensus.cc:1275] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:13:28.375775 11136 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:28.372035 11141 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
I20260709 12:13:28.314342 19732 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.344640 19616 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.335633 19833 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:28.383035 11143 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 12:13:28.410418 11143 pending_rounds.cc:85] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting all ops after (but not including) 14
I20260709 12:13:28.410740 11143 pending_rounds.cc:107] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 12:13:28.411051 11143 raft_consensus.cc:2889] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:28.383801 19773 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.378994 19733 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 12:13:28.371454 19650 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.398867 19837 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.300534 19797 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.343395 19842 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.355808 19640 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:28.344796 19603 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.408320 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.418936 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:28.371031 19816 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.276706 19766 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.094s
I20260709 12:13:28.427865 11211 raft_consensus.cc:1275] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:28.412539 19732 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.371618 19710 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.418756 11210 raft_consensus.cc:1275] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:28.425452 11217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
mode: GRACEFUL
new_leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:42804
I20260709 12:13:28.348560 19698 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.431078 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.432650 11218 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:28.416137 19650 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:28.419800 19793 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 1.056s	user 0.000s	sys 0.004s
I20260709 12:13:28.477164 11217 raft_consensus.cc:606] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Received request to transfer leadership to TS 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:28.478533 19698 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.413478 19616 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.429749 19603 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:28.490721 19850 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:28.491531 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:28.492448 19844 log.cc:927] Time spent T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:13:28.493451 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:28.481873 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 51992.3us
I20260709 12:13:28.495935 11218 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:28.426123 19842 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.485129  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:28.497628 19852 consensus_queue.cc:1048] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:28.476667 19732 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.499837 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.489521 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.489952 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.501868 11136 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:28.416622 19837 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.496227 19731 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.504268 11136 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:28.482681 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 63773.5us
I20260709 12:13:28.492574 19850 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:13:28.489058 19838 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:13:28.481720 19849 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:28.570899 19851 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:28.572367 19846 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:13:28.578855 19669 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.593746 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.601982 11135 raft_consensus.cc:3060] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:28.594591 19853 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 12:13:28.596352 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.605517 19616 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.621855 19791 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.622563 19791 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.623358 19837 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:28.624085 19793 log.cc:927] Time spent T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:28.625597 11142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36066 (request call id 3428) took 1670 ms. Trace:
I20260709 12:13:28.626184 11142 rpcz_store.cc:276] 0709 12:13:26.954927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.955041 (+   114us) service_pool.cc:224] Handling call
0709 12:13:26.955408 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.955780 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.955810 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.959890 (+  4080us) log.cc:844] Serialized 26 byte log entry
0709 12:13:27.106124 (+146234us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:27.115574 (+  9450us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.156265 (+ 40691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.156354 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.269701 (+113347us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b180036b080. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee522 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:13:28.007786 (+738085us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b48000d08d8. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9835a04aa1 00007f98359fbb37 00007f98359fb9ca 00007f9835af326f 00007f9835af2f37 00007f9835b0755c 00007f9835b07508 00007f9835b07488 00007f9835b07443 00007f9835b066ec 00007f9834a30a96
0709 12:13:28.307306 (+299520us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:28.625306 (+318000us) raft_consensus.cc:1685] finished
0709 12:13:28.625337 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:28.625517 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40364,"prepare.queue_time_us":14761,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":45959,"raft.run_cpu_time_us":3235,"raft.run_wall_time_us":875008,"spinlock_wait_cycles":55292544,"thread_start_us":142000,"threads_started":1,"wal-append.queue_time_us":281985}
W20260709 12:13:28.569204 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55123us
I20260709 12:13:28.597438 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.503131 19842 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.598326 19850 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:28.659489 11135 raft_consensus.cc:2468] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:28.659759 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.531462 19731 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.661904 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.653739 19788 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.613340 19650 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.677325 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.600639 19849 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:28.686671 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 191040us
I20260709 12:13:28.649875 19851 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.682055 19624 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.697219 11184 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:28.698067 19624 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.675961 19788 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.697489 19731 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.703176 11184 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:28.683152 19835 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:28.707751 19850 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.709254 19732 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.711018 19849 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.711618 19013 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.683463 19797 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:28.715150 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65404.5us
I20260709 12:13:28.741506 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.699100 19469 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:28.745301 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 77708.1us
I20260709 12:13:28.746562 19013 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:28.747749 19013 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:28.747786 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44599us
I20260709 12:13:28.751945 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.752866 11852 raft_consensus.cc:2410] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:13:28.753250 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.754279 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.754563 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:28.754956 11217 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
W20260709 12:13:28.758672 11258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.761297 11140 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.762703 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:28.782400 11140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36066 (request call id 3433) took 1484 ms. Trace:
I20260709 12:13:28.782800 11140 rpcz_store.cc:276] 0709 12:13:27.312401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.313377 (+   976us) service_pool.cc:224] Handling call
0709 12:13:28.760699 (+1447322us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4c001b7940. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982edb913f 00007f982ed7d2ab 00007f982edaaf3c 00007f982edab3fe 00007f982f03888b 00007f9830a37495 00007f9830a8830f 00007f9830ad2a55 00007f9835aa2cd0
0709 12:13:28.782301 (+ 21602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42319744}
I20260709 12:13:28.784238 19766 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.764276 19858 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:28.765394 19582 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:28.784765 19766 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.785847 19858 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:28.786304 19858 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.786738 19858 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:28.786532 19582 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:28.766381 19852 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:28.769134 19848 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.262s	user 0.000s	sys 0.003s
I20260709 12:13:28.769217 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:28.809744 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 153992us
I20260709 12:13:28.770062 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.811487 11291 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:28.771898 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:28.772794 19791 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.774504 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:28.810570 11287 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:28.776147 19788 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.776674 19013 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.791684 19732 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.792013 19624 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.793337 19650 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.798280 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:28.819423 11852 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:28.806286 19851 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:28.808549 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:28.821115 11144 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:28.841526 11853 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
W20260709 12:13:28.844542 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 76546.3us
I20260709 12:13:28.845278 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.851598 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.811532 19598 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:28.855727 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.815313 19697 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.846298 19833 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.820581 19669 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.866931 11182 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:28.825573 19791 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.820358 19624 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.881407 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.882326 11135 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
I20260709 12:13:28.884946 11184 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:28.818229 19698 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:28.956732 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 89889.2us
I20260709 12:13:28.865089 19851 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:28.966607 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 80689.4us
I20260709 12:13:28.969087 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.970309 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:28.971632 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.975139 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.818585 19603 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.984655 19603 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:28.987018 19624 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.987877 19800 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:28.885308 19781 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.988370 19800 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.988880 19781 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.991571 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.992290 11141 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:28.825711 19732 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:28.981127 19681 raft_consensus.cc:993] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:28.885497 19841 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.981375 19852 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:13:28.871462 19861 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.115s
I20260709 12:13:28.993055 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:28.887409 19766 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.999718 11852 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:13:29.001451 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:28.996496 19763 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.990823 19816 raft_consensus.cc:2804] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:28.976707 19617 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.003535  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.868247 19598 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.009943 11144 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:28.977926 19851 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.015791 11107 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:28.878782 19697 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.997694 19624 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:28.998939 19681 raft_consensus.cc:1081] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:28.988894 19800 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.889007 19669 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.882231 19833 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:28.997062 19351 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.026583 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:29.047142 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.036494 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.027527 19836 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:13:29.011160 19778 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:28.922897 19791 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.061347 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:29.064018 11291 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.031790 19861 consensus_queue.cc:1243] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer 018d40ceb45d4447aa293f4c1d929bb8 log is divergent from this leader: its last log entry 29.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:29.031744 19851 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.035780 19816 raft_consensus.cc:697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:29.074129 19601 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.086953 19598 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.087206 19601 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.087345 19816 consensus_queue.cc:237] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.089641 19601 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:28.999503 19841 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.066694 19773 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:29.090812 19773 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.077919 19858 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.091224 19773 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.092799 19858 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.101253 19773 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.075525 19733 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:29.033825 19710 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:29.102803 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.102988 19710 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:29.104070 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.104223 19710 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.104957 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:29.068583 11144 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:29.028854 19763 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.085290 19698 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.066905 19351 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.124086 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:29.125116 11286 raft_consensus.cc:2393] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 26: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:29.095286 19833 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.095806 19841 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.108536 11143 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:29.104673 11140 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
I20260709 12:13:29.128677 19791 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.129526 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.108335 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:29.042979 19624 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:29.127595 19351 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.062217 19836 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:29.032711 19617 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.079175 19781 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:29.131186 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 346677us
I20260709 12:13:29.163551 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.120189 19650 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:29.131330 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.152906 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.158900 11284 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:29.121094 19797 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:29.176331 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:29.157950 19194 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:29.153566 19861 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:29.159014 19836 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:29.188684 11290 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.183458 11291 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:29.174983 19650 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.163673 19780 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.202186 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.175356 19773 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.181835 19579 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:29.207244 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 177289us
I20260709 12:13:29.209004 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.210134 11859 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 25: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:29.214762 11290 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:29.216271 19013 consensus_queue.cc:1059] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:29.189894 19670 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.224786 11859 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 12:13:29.224946 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 116699us
I20260709 12:13:29.227389 19013 consensus_queue.cc:1048] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:29.203620 19650 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.191103 19797 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.219210 19194 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.242259 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:29.198092 19861 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.246541 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.230118 19871 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.267391 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.270949 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.242503 19194 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:29.215199 19780 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.274718 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.277684 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.330403 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.320037 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:29.304611 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 88880.5us
W20260709 12:13:29.315066 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 59265.7us
W20260709 12:13:29.337343 19878 log.cc:927] Time spent T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:29.278710 19766 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:29.273515 19697 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.442364 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.447678 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.343971 19465 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:29.345167 19763 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.343716 19616 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:29.443265 19875 log.cc:927] Time spent T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:13:29.458045 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.444186 19766 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.441288 19624 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:29.451737 19791 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:29.472466 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.338165 19669 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:29.461066 19870 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:13:29.463500 11110 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:29.469060 19877 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:13:29.469291 19732 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.455987 19773 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:29.455336 19465 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.483850 19465 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.473912 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.486811 11140 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:29.487509 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.487762 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:29.488654 11140 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 27: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:29.488680 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.489806 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.490908 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.492573 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.493619 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.495167 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.481729 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.497200 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.482061 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.490474 11140 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:29.499537 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.500375 19797 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.501099 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.502265 19465 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.499589 11140 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:29.505053 11213 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 27: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:29.503648 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.486899 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:29.507714 19867 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:13:29.510627 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.511545 19780 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.512687 19861 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.463214 19603 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:13:29.514158 19869 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:13:29.463828 19617 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.516788 11142 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:29.481505 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.519088 19732 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.473848 19766 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.515049 11218 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:29.520555 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57125.8us
I20260709 12:13:29.523694 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.461115 19616 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.527418 19465 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.528568 19616 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:29.476081 19874 log.cc:927] Time spent T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:13:29.530859 11138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:13:29.531509 11138 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.531937 11138 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.533928 19732 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:29.537038 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.538182 19773 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.540251 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.547660 19194 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.548537 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:29.546916 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 108799us
I20260709 12:13:29.553710 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.557165 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.552932 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.561249 11138 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.552091 19800 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.587263 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.588425 19800 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:29.589203 19851 consensus_meta.cc:287] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 12:13:29.589690 19851 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.589224 19616 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:29.591861 19851 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.600091 11138 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.551704 19773 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:29.603120 11210 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:29.603467 11217 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:29.603295 11259 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.558303 19603 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:29.607879 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.559302 19732 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:29.609647 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.610281 11218 raft_consensus.cc:3055] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:29.610602 11218 raft_consensus.cc:740] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:29.611277 19650 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.611418 11218 consensus_queue.cc:260] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.612592 11218 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.613051 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.613739 19650 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.606283 19617 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.614871 19624 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 12:13:29.607486 19780 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.629496 11218 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:29.615422 19763 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.635107 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.635886 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.638031 11110 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:29.604266 19799 consensus_queue.cc:1048] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:13:29.614393 19650 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.639202 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.639967 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.605123 19616 consensus_queue.cc:1048] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:13:29.648893 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.649696 11291 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:29.606130 19841 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:13:29.655350 19773 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.657693 11285 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:29.661230 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.661979 11857 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 25.
I20260709 12:13:29.655541 19841 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:29.664520 11293 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:29.665010 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.665818 19841 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:29.681826 19841 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.661923 19732 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:29.688108 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 75121.8us
I20260709 12:13:29.692979 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.662202 19873 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:29.697155 19624 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:29.697204 19732 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:29.698482 19732 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.679592 19669 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:29.703183 19669 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.703536 19669 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:29.642968 19780 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.705277 19780 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.710666 19873 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.712002 19766 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.712870 19873 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:29.714807 11286 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:29.716689 11857 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:29.716854 19791 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.638190 19617 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:29.717324 19791 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.719303 19617 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.687422 19841 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.720598 19694 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:29.721309 19694 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.723821 19694 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.724522 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:29.725898 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.727191 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:29.731738 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.732506 19835 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:29.733068 19835 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:29.734922 19837 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.735468 19616 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:29.735945 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.735498 19837 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.738261 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.739028 19837 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.739552 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.740526 11211 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:29.740815 19778 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:29.742446 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.744102 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.745272 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.746513 19766 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:29.747213 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.748564 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.749183 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.749560 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.750324 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.750841 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.751677 11290 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 19.
I20260709 12:13:29.752664 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.754699 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.755319 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:29.755950 11137 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:13:29.756248 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.756769 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:29.757524 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.757893 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:29.758702 11137 raft_consensus.cc:3060] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.760497 11211 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:29.761349 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.762075 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.764091 11212 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:29.768749 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:29.769515 11290 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:29.775938 19370 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.776443 19370 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.777726 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:29.778864 19837 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:29.779072 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:29.779310 19837 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.779676 19837 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:29.779874 19780 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.780368 19780 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.777967 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:29.785109 11139 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.784289 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:29.792309 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.796592 19013 consensus_queue.cc:1059] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:29.797154 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.799053 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.802325 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:29.656966 19836 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.804509 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.805172 11293 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 17.
I20260709 12:13:29.806499 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.719321 19791 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.782383 19780 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:29.822115 19013 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:29.822201 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:29.811553 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.831620 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:29.832247 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:29.778411 19370 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:29.851313 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 57099.2us
W20260709 12:13:29.901932 11293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 2996) took 2116 ms (client timeout 2099 ms). Trace:
W20260709 12:13:29.909459 11293 rpcz_store.cc:269] 0709 12:13:27.708876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.709035 (+   159us) service_pool.cc:224] Handling call
0709 12:13:29.664129 (+1955094us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b58005e07d0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad1fe7 00007f9830ad37de 00007f9830adf27c 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c
0709 12:13:29.825069 (+160940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995741568}
W20260709 12:13:29.903301 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72725.9us
I20260709 12:13:29.910521 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.911059 11185 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.911808 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.795640 19624 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:13:29.912495 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 106145us
I20260709 12:13:29.914402 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.918195 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:29.919812 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:29.921247 11293 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:29.808724 19799 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:29.928629 19013 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:29.929347 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.925624 11860 raft_consensus.cc:1240] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 13. Current term is 14. Ops: []
I20260709 12:13:29.925853 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:29.931665 11290 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 27: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:29.926867 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
W20260709 12:13:29.933040 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 171075us
I20260709 12:13:29.933841 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:29.942878 11139 raft_consensus.cc:2468] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:29.955775 11135 raft_consensus.cc:1240] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:29.834028 19880 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.961760 11292 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 26. Current term is 28. Ops: []
I20260709 12:13:29.963374 11137 raft_consensus.cc:2468] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
W20260709 12:13:29.977777 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44020.2us
W20260709 12:13:29.978085 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 56263.7us
I20260709 12:13:29.978624 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.906419 19791 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.808956 19821 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.128s
I20260709 12:13:29.924427 19778 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.928153 19799 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.917860 19650 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:29.963559 11292 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:29.924841 19624 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:29.932819 19616 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:30.017608 19669 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:29.998870 19894 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:30.010465 19849 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:29.025477  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.015393 19821 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Stepping down as leader of term 26
W20260709 12:13:30.016337 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 87136.9us
I20260709 12:13:30.043481 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:30.025549 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 74038.6us
I20260709 12:13:30.045445 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.999162 19732 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:30.003100 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 179484us
I20260709 12:13:30.047950 11185 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:30.048857 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.023167 19842 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:30.025188 19465 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.019659 19799 raft_consensus.cc:3060] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:30.022841 19624 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:30.059521 11185 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.038990 19603 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:30.048539 19894 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.042877 19821 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:30.072831 19821 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.074159 19821 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:30.046378 19791 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.081429 19669 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:30.083819 11259 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:29.987991 19880 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.090943 19763 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:30.053369 19861 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.082540 19751 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.100526 19624 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.102953 19836 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.118142 19194 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.104298 19894 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.085924 19849 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.086424 19842 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:30.121341 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:30.125679 11293 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:30.061390 11184 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:30.112123 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 133605us
I20260709 12:13:30.114782 11289 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:30.118958 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.128230 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.129027 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.129803 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.130342 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.131601 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.146904 19194 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:30.147852 19194 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:30.155736 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 94506.6us
I20260709 12:13:30.156662 11184 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.090691 19791 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.162534 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.163436 19902 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:30.119691 19601 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.164867 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.124428 19731 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.165760 19751 raft_consensus.cc:2804] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:30.205775 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:30.202839 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:30.207279 19194 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:30.210767 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.211470 11139 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:30.211592 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:30.211417 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 78981.4us
I20260709 12:13:30.166777 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.159091 19774 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:30.214133 11826 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.158402 19833 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.158273 19836 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:30.158363 19669 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:30.165833 19849 raft_consensus.cc:2804] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:30.175721 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:30.158077 19886 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:30.167064 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.219481 11258 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.224568 11140 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:30.239799 11138 raft_consensus.cc:2393] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 23: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:30.127871 19799 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.202271 19732 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.244418 11140 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:30.205241 19731 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.223198 19862 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.250176 11138 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:13:30.206089 19601 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.226624 19751 raft_consensus.cc:697] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:30.256460 11138 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:30.228891 19774 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:30.235239 19669 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.239468 19833 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:30.297415 19836 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.298220 19836 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.301036 19836 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.304874 19669 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:30.306447 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:30.307842 11138 raft_consensus.cc:2393] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:30.310252 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:30.315023 19835 consensus_meta.cc:287] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.008s
I20260709 12:13:30.262812 19862 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.316635 19697 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:30.317166 19697 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.313922 11219 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:13:30.268966 19900 log.cc:927] Time spent T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:13:30.268716 19751 consensus_queue.cc:237] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.269860 19694 raft_consensus.cc:993] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: : Instructing follower 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:30.274701 19601 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.278374 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.256240 19617 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:30.284175 19774 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.287055 19582 raft_consensus.cc:3055] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:13:30.289892 11284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45942 (request call id 3010) took 1243 ms (client timeout 1545 ms). Trace:
I20260709 12:13:30.251626 19849 raft_consensus.cc:697] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:30.290994 19903 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:30.293191 19799 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.294170 19909 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:30.295874 19624 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:30.296178 19837 consensus_meta.cc:287] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.005s
I20260709 12:13:30.234112 19842 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.319339 19697 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:30.344547 19582 raft_consensus.cc:740] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:30.329986 19902 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:30.326973 19863 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:30.350734 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 122948us
I20260709 12:13:30.318437 19862 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.315621 19835 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.346549 19694 raft_consensus.cc:1081] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Signalling peer 018d40ceb45d4447aa293f4c1d929bb8 to start an election
I20260709 12:13:30.339756 19617 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.382916 19791 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.371592 19370 consensus_queue.cc:1059] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 12:13:30.369901 19909 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.362411 19401 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:13:30.373798 19831 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:30.373200 19837 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.397684 19582 consensus_queue.cc:260] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.399266 19909 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.399467 19833 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:30.394632 19617 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:30.381861 19902 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.385102 19863 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.425719 19849 consensus_queue.cc:237] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.430013 19863 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.428701 19902 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.431443 19835 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.481683 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.482257 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
W20260709 12:13:30.344915 11284 rpcz_store.cc:269] 0709 12:13:29.046589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.046796 (+   207us) service_pool.cc:224] Handling call
0709 12:13:30.289628 (+1242832us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003f1954. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:30.289779 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255091072}
I20260709 12:13:30.400642 11858 raft_consensus.cc:1240] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:30.517659 19902 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.519491 19902 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.522997 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:30.524004 19902 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.526095 19582 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:30.527150 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.528843 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.529767 11137 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 21.
I20260709 12:13:30.533317 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.535570 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.515707 19837 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.545091 19603 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:30.546383 19603 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.424494 19731 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:30.550709 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 150477us
I20260709 12:13:30.558005 19370 raft_consensus.cc:3055] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:30.558697 19370 raft_consensus.cc:740] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:30.568713 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.579917 11144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36052 (request call id 4904) took 1580 ms. Trace:
I20260709 12:13:30.580659 11144 rpcz_store.cc:276] 0709 12:13:28.999629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.036145 (+ 36516us) service_pool.cc:224] Handling call
0709 12:13:30.579408 (+1543263us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54002e31d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adf2fa 00007f9835aa0b17 00007f982f01b6d4 00007f982f01b662 00007f982f01b591 00007f982f01b50c 00007f982f01a7c2 00007f982ee1648c 00007f982ee158c6 00007f982ee1526f
0709 12:13:30.579640 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34817920}
I20260709 12:13:30.550138 19603 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.591120 19469 consensus_queue.cc:1059] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:30.592854 19849 raft_consensus.cc:3055] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:30.593652 19849 raft_consensus.cc:740] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:30.594208 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 508647us
I20260709 12:13:30.592988 11216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44734 (request call id 1634) took 1349 ms. Trace:
I20260709 12:13:30.596603 11216 rpcz_store.cc:276] 0709 12:13:29.242951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.243096 (+   145us) service_pool.cc:224] Handling call
0709 12:13:29.244863 (+  1767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:29.269507 (+ 24644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.269538 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:29.269593 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:29.269640 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.592252 (+1322612us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54000e79d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:30.592348 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:30.592737 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56210304}
I20260709 12:13:30.598464 11219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.602394 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:30.603946 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 197001us
I20260709 12:13:30.607360 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.607703 19469 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:30.610013 19827 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.610855 19837 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.611904 19837 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.613565 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.617707 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.619150 19799 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.620216 19799 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.621140 19799 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.619284 19731 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:30.623181 19733 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.624436 19799 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.633279 11137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:30.631170 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.595698 19849 consensus_queue.cc:260] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.652249 19849 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:30.644469 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:30.647522 11143 raft_consensus.cc:1240] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:30.661104 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 126093us
I20260709 12:13:30.643473 19777 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.670600 19926 raft_consensus.cc:2764] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:13:30.670737 19777 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.671319 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:30.672559 11857 raft_consensus.cc:1240] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:30.675799 11853 raft_consensus.cc:1240] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:30.675841 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:30.682821 19886 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:13:30.683866 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 129694us
W20260709 12:13:30.683921 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.687328 19880 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:30.687755 11184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.691004 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:30.691675 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:30.691923 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 44437.3us
I20260709 12:13:30.691066 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.694320 19835 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:30.675791 19370 consensus_queue.cc:260] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.694849 19835 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.695353 19835 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:30.695952 19370 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.700157 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.702919 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:30.703675 11858 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:30.705623 19837 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.707254 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.708350 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.708400 19880 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:30.711272 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.712991 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:30.712474 11042 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.714282 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.717196 11182 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.718559 11259 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.719017 19465 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.722097 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.722625 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.724515 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:30.724912 19873 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:30.727078 19873 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:30.727558 19873 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.732798 19640 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:30.733960 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.734913 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:30.735253 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:30.737650 19777 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.738816 19880 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:30.740588 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 282) took 9810 ms. Trace:
I20260709 12:13:30.741438 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:30.741822 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.742998 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:30.743855 19880 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:30.745208 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71859us
I20260709 12:13:30.747860 19587 raft_consensus.cc:3055] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:30.748368 19587 raft_consensus.cc:740] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:30.749255 11289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45942 (request call id 3018) took 1002 ms. Trace:
I20260709 12:13:30.749744 11289 rpcz_store.cc:276] 0709 12:13:29.746869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.008512 (+261643us) service_pool.cc:224] Handling call
0709 12:13:30.008793 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:30.127958 (+119165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.748674 (+620716us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540017f7d4. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830adbe01 00007f9830ada83e 00007f9835a9f419 00007f982f016bd4 00007f982f016b62 00007f982f016a91 00007f982f016a0c 00007f982f015cc2 00007f982ee1648c 00007f982ee158c6
0709 12:13:30.749048 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242793728}
I20260709 12:13:30.750002 19587 consensus_queue.cc:260] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.763195 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.764148 19587 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:30.764542 11144 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:30.770007 11291 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:13:30.773217 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.762699 11042 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.766873 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:30.708961 19898 log.cc:927] Time spent T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
W20260709 12:13:30.785640 11185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.789179 11858 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:30.816519 11853 raft_consensus.cc:1240] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:13:30.820533 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:30.741103 11040 rpcz_store.cc:276] 0709 12:13:20.929695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.931678 (+  1983us) service_pool.cc:224] Handling call
0709 12:13:30.740293 (+9808615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:25.318149 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:25.322150 (+  4001us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:25.322192 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:13:25.322216 (+    24us) tablet.cc:662] Decoding operations
0709 12:13:25.323143 (+   927us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:25.323252 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:25.323290 (+    38us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:13:25.323747 (+   457us) tablet.cc:701] Row locks acquired
0709 12:13:25.323759 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:13:25.323869 (+   110us) write_op.cc:270] Start()
0709 12:13:25.323951 (+    82us) write_op.cc:276] Timestamp: P: 1783599205323828 usec, L: 0
0709 12:13:25.323966 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:13:25.324659 (+   693us) log.cc:844] Serialized 2855 byte log entry
0709 12:13:25.895491 (+570832us) op_driver.cc:464] REPLICATION: finished
0709 12:13:26.358476 (+462985us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f9834511ef0
0709 12:13:26.620439 (+261963us) write_op.cc:301] APPLY: starting
0709 12:13:26.632628 (+ 12189us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:26.717201 (+ 84573us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:26.717245 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:27.208042 (+490797us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:27.208404 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:13:27.208482 (+    78us) write_op.cc:312] APPLY: finished
0709 12:13:27.208876 (+   394us) log.cc:844] Serialized 73 byte log entry
0709 12:13:27.431802 (+222926us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:27.445266 (+ 13464us) write_op.cc:454] Released schema lock
0709 12:13:27.461704 (+ 16438us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:27.479954 (+ 18250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:27.479989 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22888,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":684336,"apply.run_cpu_time_us":43680,"apply.run_wall_time_us":886689,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33471,"num_ops":7,"prepare.queue_time_us":214811,"prepare.run_cpu_time_us":10123,"prepare.run_wall_time_us":147034,"raft.queue_time_us":219564,"raft.run_cpu_time_us":13494,"raft.run_wall_time_us":711161,"replication_time_us":571333,"spinlock_wait_cycles":48789760,"thread_start_us":1211055,"threads_started":5,"wal-append.queue_time_us":575700,"wal-append.run_cpu_time_us":30049,"wal-append.run_wall_time_us":2233206}]]}
W20260709 12:13:30.825873 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 109044us
W20260709 12:13:30.828981 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 104642us
W20260709 12:13:30.847214 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 71276.7us
W20260709 12:13:30.848677 19669 consensus_meta.cc:287] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.543s	user 0.022s	sys 0.002s
I20260709 12:13:30.849166 19669 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:30.859064 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 148050us
I20260709 12:13:30.859544 11859 raft_consensus.cc:2468] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 26.
I20260709 12:13:30.862155 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.869874 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:30.865002 11042 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 17 to 18, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 18 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.875087 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.876582 11138 raft_consensus.cc:1240] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:30.876610 11218 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.880601 19788 consensus_queue.cc:1059] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
W20260709 12:13:30.881395 19928 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:13:30.882783 19650 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.883555 19650 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.884703 19465 raft_consensus.cc:3055] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:30.885157 19465 raft_consensus.cc:740] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:30.894836 19927 log.cc:927] Time spent T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 12:13:30.894603 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:30.890563 11215 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:30.886343 19650 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:30.905483 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.873296 19835 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.906463 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.909539 11141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36052 (request call id 4900) took 1937 ms. Trace:
I20260709 12:13:30.902714 11042 catalog_manager.cc:5697] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 23 to 24, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.915375 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.918049 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.918390 11182 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.918931 11139 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:30.922919 19881 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:30.923847 19881 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:30.912885 11138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fab38430e77f4f78916480f9b0041989"
dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
 from {username='slave'} at 127.0.0.1:36052
I20260709 12:13:30.925071 11138 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.925413 11138 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:30.927294 11854 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:30.928401 19835 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.910053 11141 rpcz_store.cc:276] 0709 12:13:28.972393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.995682 (+ 23289us) service_pool.cc:224] Handling call
0709 12:13:28.997420 (+  1738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:29.010086 (+ 12666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.010135 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:29.026935 (+ 16800us) log.cc:844] Serialized 26 byte log entry
0709 12:13:30.572753 (+1545818us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b18004d1400. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b0d1 00007f9830a96a0f
0709 12:13:30.724324 (+151571us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:30.724408 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.730434 (+  6026us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:30.903486 (+173052us) raft_consensus.cc:1685] finished
0709 12:13:30.903512 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:30.909342 (+  5830us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12215,"raft.queue_time_us":24983,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6302,"spinlock_wait_cycles":8847616,"thread_start_us":85312,"threads_started":1,"wal-append.queue_time_us":1752086}
W20260709 12:13:30.916356 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48226.3us
I20260709 12:13:30.886219 19465 consensus_queue.cc:260] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:30.935444 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:30.946950 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 123827us
I20260709 12:13:30.952759 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:30.946069 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:30.955526 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:30.954910 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:30.961033 19831 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.961903 11214 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:30.961727 19831 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.961748 11182 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:30.964027 19831 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:30.964701 19858 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:13:30.965884 11182 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0c432ae03684756b937dd1aa2541cbd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.966423 11289 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:30.966596 11182 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:30.967535 11210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39588 (request call id 3682) took 1217 ms. Trace:
I20260709 12:13:30.968000 19469 raft_consensus.cc:2804] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:30.945185 19650 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.968601 19469 raft_consensus.cc:697] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:30.969089 19650 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.952808 19669 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:30.981300 11107 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:30.983291 19697 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:30.983899 19697 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:30.985085 11216 raft_consensus.cc:2410] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:13:30.986057 11219 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:30.981324 11214 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:30.959012 19835 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:30.970659 19465 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:30.997872 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:30.999444 19650 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:31.007907 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64074.3us
I20260709 12:13:30.967909 11210 rpcz_store.cc:276] 0709 12:13:29.749896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.758837 (+  8941us) service_pool.cc:224] Handling call
0709 12:13:29.759249 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:29.774680 (+ 15431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:29.774712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:29.775271 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 12:13:30.026881 (+251610us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:30.215042 (+188161us) log.cc:844] Serialized 14 byte log entry
0709 12:13:30.220026 (+  4984us) log.cc:844] Serialized 14 byte log entry
0709 12:13:30.234418 (+ 14392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.234592 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:30.271620 (+ 37028us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18003cdb40. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9ee3f3 00007f982d9f07c1 00007f982d9f0779 00007f982d9f0709 00007f982d9f06d1 00007f982d9ef9cd 0000000000388634 0000000000388479 00007f982d9d183a
0709 12:13:30.707945 (+436325us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f983067686e 00007f9830675bb6 00007f98306757d8 00007f983067f221 00007f983067f1d9 00007f983067f169
0709 12:13:30.938803 (+230858us) raft_consensus.cc:1685] finished
0709 12:13:30.938829 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:30.967376 (+ 28547us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19735,"prepare.queue_time_us":263042,"prepare.run_cpu_time_us":168,"prepare.run_wall_time_us":168,"raft.queue_time_us":18944,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":18914,"spinlock_wait_cycles":8861824,"thread_start_us":411004,"threads_started":2,"wal-append.queue_time_us":345774}
I20260709 12:13:31.011659 19773 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:31.012234 19773 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:30.969709 19469 consensus_queue.cc:237] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.013185 19841 consensus_queue.cc:1059] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:13:31.014444 19841 raft_consensus.cc:3055] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:13:31.006036 19831 consensus_queue.cc:1059] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:13:31.014957 19841 raft_consensus.cc:740] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:31.013218 11289 raft_consensus.cc:1240] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 28. Current term is 29. Ops: [26.15-28.16]
I20260709 12:13:31.015707 11288 raft_consensus.cc:1240] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:31.016229 19831 raft_consensus.cc:3055] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:31.016441 19841 consensus_queue.cc:260] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.017127 19831 raft_consensus.cc:740] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:30.985059 19697 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.018050 19841 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:13:31.021636 19669 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:31.025020 19669 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.021749 19582 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:13:31.029697 19873 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.031891 19617 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.045872 11136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.046182 11139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.014359 19773 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.047308 11141 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:13:31.040968 19929 log.cc:927] Time spent T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:13:31.029762 19582 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:31.051051 19582 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:31.052487 19582 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.055431 11218 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 28 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:31.018433 19831 consensus_queue.cc:260] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:31.059232 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 92506.1us
I20260709 12:13:31.058691 19669 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.075584 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.060385 11286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45930 (request call id 4601) took 1231 ms. Trace:
I20260709 12:13:31.061720 19865 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:31.076633 19831 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:31.077225 19865 raft_consensus.cc:3055] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:31.077610 19865 raft_consensus.cc:740] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:31.072705 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 68335.3us
I20260709 12:13:31.069291 19617 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.085341 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.080341 11138 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.060572 19873 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.095919 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.097515 11138 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.098169 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.099643 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.078847 11286 rpcz_store.cc:276] 0709 12:13:29.771615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.014138 (+242523us) service_pool.cc:224] Handling call
0709 12:13:30.021799 (+  7661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:30.022110 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:30.042240 (+ 20130us) log.cc:844] Serialized 14 byte log entry
0709 12:13:30.745566 (+703326us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b180032bfc0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f98368b6ab1 00007f98368c3281 00007f982d9d0e07 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b 00007f983067ad23 00007f983067b23a 00007f9830ae5a2a
0709 12:13:30.937804 (+192238us) log.cc:844] Serialized 14 byte log entry
0709 12:13:30.951272 (+ 13468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:30.954832 (+  3560us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:30.977546 (+ 22714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:30.977935 (+   389us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:31.002984 (+ 25049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":271623,"prepare.queue_time_us":59561,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":2861,"raft.queue_time_us":20238,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":3325,"spinlock_wait_cycles":15466880,"thread_start_us":109609,"threads_started":1,"wal-append.queue_time_us":856764}
I20260709 12:13:31.121428 19886 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:31.078600 19865 consensus_queue.cc:260] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.124595 19401 consensus_queue.cc:1059] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:31.139142 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
W20260709 12:13:31.140846 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.142463 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44418.7us
I20260709 12:13:31.143323 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.144694 19886 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.147913 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.149437 19640 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:31.118522 19837 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:31.151934 11825 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.184448 19837 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.186888 19837 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.187896 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.188575 11289 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:31.189551 19865 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:31.189734 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:31.148411 19814 consensus_queue.cc:1059] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:13:31.195102 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.205037 11286 raft_consensus.cc:2410] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 25 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:31.180596 19582 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:31.146589 19401 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:13:31.218894 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:31.190688 19837 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:31.210923 19670 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:31.235105 11138 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:31.236928 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:31.241641 11286 raft_consensus.cc:2393] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:13:31.243119 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 105663us
I20260709 12:13:31.226718 19837 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:31.236858 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.268033 11142 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:31.271528 11288 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 23: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:31.238616 19650 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:31.274997 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:31.279184 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.265851 19837 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:31.237830 19788 consensus_queue.cc:1059] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 12:13:31.292953 19731 consensus_meta.cc:287] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: Time spent flushing consensus metadata: real 0.566s	user 0.015s	sys 0.001s
I20260709 12:13:31.303303 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:31.315608 11288 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:31.286787 19650 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.330084 19650 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.325131 19773 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:13:31.332309 19773 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:31.333811 19773 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:31.326769 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.336555 11825 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.337679 19876 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:31.338122 19876 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:31.303947 19669 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:31.338692 19876 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.339033 19669 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.341364 19669 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.342250 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.343797 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.344516 19926 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:31.345373 19926 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:31.346778 19835 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:13:31.324774 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 162786us
W20260709 12:13:31.323722 19935 log.cc:927] Time spent T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:13:31.355661 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 196352us
I20260709 12:13:31.323233 19873 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.358953 11291 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28. Ops: []
W20260709 12:13:31.367106 11183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.385484 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.389988 11291 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:31.392889 11256 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.395509 19849 raft_consensus.cc:3055] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:31.396055 19849 raft_consensus.cc:740] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:31.397181 19849 consensus_queue.cc:260] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.400802 19465 raft_consensus.cc:3055] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:31.411375 19465 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:31.412398 19465 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:31.398336 19849 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:31.373886 19873 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:31.434811 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 140476us
I20260709 12:13:31.389793 19773 consensus_queue.cc:1059] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
W20260709 12:13:31.445616 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 109191us
I20260709 12:13:31.451020 11825 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.423591 19669 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:13:31.468986 11285 raft_consensus.cc:1275] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:31.453795 19788 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:31.469784 19788 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.472379 19788 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.453655 19926 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:31.474887 11290 raft_consensus.cc:1275] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:31.455363 11855 raft_consensus.cc:1240] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:13:31.476935 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.488767 19886 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:31.495389 11107 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.495544 19939 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.496232 19939 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.499197 19773 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:31.501682 19469 consensus_peers.cc:313] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Unable to generate Tablet Copy request for peer: Not found: Peer not tracked or queue not in leader mode.
I20260709 12:13:31.502094 19944 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.502754 19944 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.504004 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:31.505110 19944 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.506331 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:31.485512 19835 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:31.508765 11292 raft_consensus.cc:1275] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:31.510385 19873 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.512823 19831 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:31.513329 19831 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:31.490068 19876 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.513736 19831 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:31.498471 19939 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.515902 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.466212 19837 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.516891 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.517546 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.516144 19465 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:31.519378 11216 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:31.519392 19777 raft_consensus.cc:3055] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:31.520604 19777 raft_consensus.cc:740] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:31.521478 19777 consensus_queue.cc:260] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.507828 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.523880 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.516999 19876 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.523958 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.529296 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.530084 19194 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:31.530659 19194 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.531383 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.533195 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:31.537963 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:31.535272 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:31.543956 11219 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:31.544190 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:31.545085 11852 raft_consensus.cc:2393] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:31.545853 19194 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.542335 11860 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:31.548480 11859 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 15 to 17, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:31.552994 11288 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:31.566098 11216 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:31.566642 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.568202 19194 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:31.568629 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 58810.5us
I20260709 12:13:31.550561 19777 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:31.575304 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.576344 11141 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:31.580103 11210 raft_consensus.cc:1240] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:31.575991 11142 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
W20260709 12:13:31.581485 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.578884 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.583247 11852 raft_consensus.cc:1240] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:31.584259 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.585001 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.585628 11216 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:31.589154 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 81418.7us
I20260709 12:13:31.590760 11212 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:31.590854 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.569454 19370 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:13:31.594970 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.596148 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:31.601142 11258 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:31.603554 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.609923 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.610358 19944 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:31.610791 19944 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.611130 19944 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:31.582803 19837 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.620664 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:31.621412 19194 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:31.622124 11256 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:31.622936 11107 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.623798 19732 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.569808 19858 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:13:31.636053 11135 raft_consensus.cc:3060] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:31.636497 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.637199 11212 raft_consensus.cc:2393] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:31.641789 19944 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.642652 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:31.644183 11854 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:31.646946 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.647152 11293 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:31.647821 19841 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:31.649431 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.649734 19841 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.650139 11211 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:31.650240 19841 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.656680 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.659523 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.659840 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:31.661165 19881 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:31.662137 19865 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:31.662516 19865 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:31.663374 19865 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.649469 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:31.666930 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:31.672987 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.675104 19835 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:31.675827 19835 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:31.676749 19835 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.680596 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.681416 19640 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.683635 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.683854 11216 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 21.
I20260709 12:13:31.686816 11852 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:31.670207 19865 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:31.688727 19194 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:13:31.690171 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58817.8us
I20260709 12:13:31.689543 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.703692 11135 raft_consensus.cc:1275] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:31.692399 19777 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:31.718560 11214 raft_consensus.cc:2410] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:31.654412 19831 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.720916 19194 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:31.731390 11182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.733481 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 130053us
I20260709 12:13:31.734200 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.710747 19732 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:31.731006 19194 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.760013 11291 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:31.741966 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 57170.6us
I20260709 12:13:31.707031 19841 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.713611 19849 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 12:13:31.713611 19926 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:13:31.713032 19858 consensus_queue.cc:1059] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 12:13:31.739836 19880 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:31.729206 19669 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:31.769807 19941 consensus_queue.cc:1048] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 12:13:31.763724 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.781213 19194 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.739388 19465 consensus_queue.cc:1048] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:13:31.790028 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.790674 19773 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:31.791801 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.792109 19773 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:31.792881 19773 raft_consensus.cc:2764] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:13:31.790846 19697 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:31.793251 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.793991 19777 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:31.728427 19587 consensus_queue.cc:1048] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:13:31.795894 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.733024 19469 consensus_queue.cc:1048] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:13:31.809607 19831 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.810722 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:31.826629 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.827857 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:31.830202 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:31.833551 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97204.8us
W20260709 12:13:31.835232 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 107378us
I20260709 12:13:31.834394 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.795250 19640 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:13:31.787844 19669 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.830576 19697 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:31.888715 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 54448.3us
I20260709 12:13:31.877830 19370 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:31.888594 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 52561.1us
W20260709 12:13:31.891472 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 59161.5us
I20260709 12:13:31.884490 19926 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.903934 11110 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:31.908967 19013 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:31.909643 19013 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.909929 19697 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:31.910070 19013 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.910641 19697 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:31.912336 19013 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.912884 19965 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:31.913013 19697 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:31.913808 19697 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:31.907886 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:31.901022 19469 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.933180 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:31.930943 19841 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.945950 19944 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:31.951495 19697 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:31.966673 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.974189 19669 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.923084 19469 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.980718 19469 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:31.982332 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:31.982559 19967 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:31.907076 19926 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:31.956533 19732 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.983554 11259 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:32.033077 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:32.034278 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 50790.1us
I20260709 12:13:32.033151 19827 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:32.036939 19827 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.037300 19827 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:32.039616 19947 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:32.040304 19947 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:32.041414 19947 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.043118 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.043871 11858 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:32.047562 19781 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:32.049304 19697 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.055393 11860 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:32.056917 11214 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:13:32.057333 11214 pending_rounds.cc:85] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 17
I20260709 12:13:32.057588 11214 pending_rounds.cc:107] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:13:32.057868 11214 raft_consensus.cc:2889] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:32.064217 11259 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:32.067595 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.067912 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:31.991266 19880 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:32.068897 19960 raft_consensus.cc:3055] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:32.070405 11140 raft_consensus.cc:2410] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc for term 29 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:32.070667 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.082353 11292 raft_consensus.cc:1240] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:32.069530 19960 raft_consensus.cc:740] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:32.124622 19194 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:32.125689 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 155223us
I20260709 12:13:32.199468 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:32.202311 19926 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:32.204342 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 126232us
W20260709 12:13:32.210949 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 80270.4us
W20260709 12:13:32.205029 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 142354us
I20260709 12:13:32.249897 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.250877 11214 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:32.252813 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:32.253497 11215 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:32.259994 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:32.260886 11140 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:32.266510 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:32.265888 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:32.269233 11213 raft_consensus.cc:3060] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:32.269109 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.270515 11210 raft_consensus.cc:2410] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
W20260709 12:13:32.269533 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51753.5us
I20260709 12:13:32.266021 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.277964 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.278015 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.277863 11860 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 23.
I20260709 12:13:32.282773 19013 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:32.283561 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 71076.8us
I20260709 12:13:32.253399 19465 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:32.283438 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:32.287216 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.285946 19465 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.298558 19013 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.288780 19732 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:32.311131 19983 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:32.313779  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.314635 19763 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:32.315380 19763 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.317616 19763 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.291337 19975 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 12:13:32.321622 19987 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.322239 19987 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.324493 19987 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.342063 11140 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:32.344975 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.345700 11289 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 20.
I20260709 12:13:32.336731 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.344760 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.346650 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.304939 19465 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:32.381969 11286 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:32.382236 11107 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:32.309554 19732 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:32.387956 11215 raft_consensus.cc:2468] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 25.
I20260709 12:13:32.380448 11143 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
W20260709 12:13:32.377350 19981 log.cc:927] Time spent T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:13:32.450295 11287 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 27: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
W20260709 12:13:32.455617 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 64543.7us
I20260709 12:13:32.456143 19013 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.381052 19865 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.460402 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.287216 19960 consensus_queue.cc:260] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.447981 19732 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:32.464468 11259 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:32.475358 19977 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
W20260709 12:13:32.478701 19956 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:13:32.485426 11213 raft_consensus.cc:2468] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:32.485807 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:32.488874 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:32.466328 19781 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.497423 19194 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:32.498503 19993 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:32.457266 19985 consensus_queue.cc:1059] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:32.472803 19984 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:32.495337 19941 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.505566 19941 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.507639 19941 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.466557 19865 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.495561 19469 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:32.510987 19469 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.512176 19865 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.513047 19469 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:32.514673 19781 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.517880 19781 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.519451 19814 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:32.519605 19985 raft_consensus.cc:3055] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:32.520117 19985 raft_consensus.cc:740] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:32.520148 19814 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.521142 19985 consensus_queue.cc:260] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.522944 19814 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:32.522383 19985 raft_consensus.cc:3060] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:32.530689 19947 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:32.537735 19967 consensus_meta.cc:287] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.003s
I20260709 12:13:32.538255 19967 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:32.542227 11215 raft_consensus.cc:1240] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Rejecting Update request from peer 2b4f4725b82b481ab53f0717a429e94a for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:32.543402 19465 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.545341 19465 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.547838 19966 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:32.549036 11210 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:32.527244 19827 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.558693 11288 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
I20260709 12:13:32.558532 19966 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.559633 11292 raft_consensus.cc:1240] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28. Ops: [25.16-27.17]
I20260709 12:13:32.561898 19827 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:32.566725 19617 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:32.567227 19732 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.566388 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:32.570343 19732 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:32.565948 19966 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.575912 11259 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:32.590965 19990 raft_consensus.cc:2804] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:32.591552 19990 raft_consensus.cc:697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 25 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:32.592440 19990 consensus_queue.cc:237] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:32.593271 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 211108us
I20260709 12:13:32.596375 19974 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:32.596851 19974 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.597185 19974 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:32.604421 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.605140 11854 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 16.
I20260709 12:13:32.607550 11259 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:32.621454 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.627023 19960 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:32.607532 19773 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:32.629210 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:32.630035 11860 raft_consensus.cc:3060] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:32.631557 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.632249 11141 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 15.
I20260709 12:13:32.633813 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.637666 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:32.638931 11140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.640173 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.648384 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.649899 11184 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:32.649252 11144 raft_consensus.cc:2468] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:32.616870 19873 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:32.653581 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.631016 19617 raft_consensus.cc:2804] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:32.659765 19617 raft_consensus.cc:697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:32.660691 19617 consensus_queue.cc:237] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.663138 19873 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.665864 19849 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:32.666420 19849 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.666875 19849 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:32.628175 19773 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.673816 11182 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:32.680687 11860 raft_consensus.cc:2468] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:32.646974 19967 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:32.686214 11182 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:32.686721 19994 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.687114 20001 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:32.687836 20001 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.688236 19967 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.690366 20001 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.692207 19773 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.695346 19873 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.708024 19865 raft_consensus.cc:2804] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:32.708714 19865 raft_consensus.cc:697] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:32.711704 19650 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.712294 19650 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.712560 19865 consensus_queue.cc:237] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.711663 19994 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.716840 19650 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:32.719276 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:32.720350 11218 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 28 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:32.690382 19967 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.728981 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.729704 11143 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 13.
W20260709 12:13:32.738245 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 98898us
I20260709 12:13:32.709983 19370 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:32.743655 11825 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:32.746367 19985 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:32.746827 19985 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.747185 19985 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:32.749771 19849 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:32.743594 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 105406us
W20260709 12:13:32.760610 19979 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.482s	user 0.004s	sys 0.000s
I20260709 12:13:32.766812 19994 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:32.782459 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.786432 11854 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:32.787566 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:32.788875 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.805347 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:32.794641 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 55452.7us
I20260709 12:13:32.808396 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.809644 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.779101 19960 consensus_queue.cc:1059] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:13:32.811733 11852 raft_consensus.cc:2393] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 16: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:32.810345 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.811555 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.824379 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.825155 11855 raft_consensus.cc:2393] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 22: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:32.819401 11292 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 14.
I20260709 12:13:32.824088 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.811697 19370 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:32.842324 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.831674 19370 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.856892 19370 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:32.841180 11042 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 281) took 12114 ms (client timeout 15000 ms). Trace:
I20260709 12:13:32.853806 19969 raft_consensus.cc:3055] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:32.872593 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.873378 11143 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
I20260709 12:13:32.876029 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.898236 19970 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.898960 19970 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.903023 19985 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.903817 19849 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.904719 11854 raft_consensus.cc:2393] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 15: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:32.908497 11143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.910626 11144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:32.911805 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:32.909225 11143 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 13.
I20260709 12:13:32.915166 11039 catalog_manager.cc:5697] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 31 to 33. New cstate: current_term: 33 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.917982 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:32.918183 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:32.918855 19944 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:32.930570 19944 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.864852 19969 raft_consensus.cc:740] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:32.933409 19944 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:32.934377 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:32.920326 11859 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:32.934998 11291 raft_consensus.cc:3060] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:32.921053 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:32.938572 19880 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:32.938951 19880 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.939395 19880 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:32.941859 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:32.937023 19974 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:32.943015 11039 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.958552 11141 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:32.959259 11039 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.961050 11039 catalog_manager.cc:5697] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 23 to 25, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 25 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:32.962841 19990 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:32.962831 11039 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.963846 19974 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.945013 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.933915 19969 consensus_queue.cc:260] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.964990 11142 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:32.967984 19990 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:32.968575 19990 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:32.972157 19990 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:32.868237 19865 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:32.950802 11138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8"
I20260709 12:13:32.973402 11138 raft_consensus.cc:3060] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:13:32.951696 19970 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:32.952816 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:32.976760 11860 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:32.978240 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:32.977219 19865 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:32.914317 19985 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:32.979643 19858 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:32.980129 19858 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.980602 19858 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:32.980952 19865 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:32.981370 11142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.982421 11142 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 28 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:32.986709 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.988564 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:32.989499 11141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "018d40ceb45d4447aa293f4c1d929bb8" is_pre_election: true
I20260709 12:13:32.990310 11141 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 28: Already voted for candidate 018d40ceb45d4447aa293f4c1d929bb8 in this term.
I20260709 12:13:32.996209 20010 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:32.996724 20010 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:32.997157 20010 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:32.998267 19969 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:33.012035 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:33.012969 11860 raft_consensus.cc:2393] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:32.966590 11039 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 18 to 19, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 19 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.020965 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:32.858883 11042 rpcz_store.cc:269] 0709 12:13:20.727253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.785955 (+ 58702us) service_pool.cc:224] Handling call
0709 12:13:32.841065 (+12055110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:31.396771 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:31.397566 (+   795us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:31.397631 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:13:31.397651 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:31.398343 (+   692us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:31.398448 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:31.398479 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:31.399068 (+   589us) tablet.cc:701] Row locks acquired
0709 12:13:31.399115 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:13:31.399310 (+   195us) write_op.cc:270] Start()
0709 12:13:31.399475 (+   165us) write_op.cc:276] Timestamp: P: 1783599211399223 usec, L: 0
0709 12:13:31.399522 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 12:13:31.400346 (+   824us) log.cc:844] Serialized 1701 byte log entry
0709 12:13:31.828213 (+427867us) op_driver.cc:464] REPLICATION: finished
0709 12:13:32.030072 (+201859us) write_op.cc:301] APPLY: starting
0709 12:13:32.030174 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:32.203344 (+173170us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:32.203472 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:32.329646 (+126174us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:32.330004 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:13:32.330079 (+    75us) write_op.cc:312] APPLY: finished
0709 12:13:32.330458 (+   379us) log.cc:844] Serialized 49 byte log entry
0709 12:13:32.330708 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:32.330831 (+   123us) write_op.cc:454] Released schema lock
0709 12:13:32.330900 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:32.331468 (+   568us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:32.331502 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63659,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":201541,"apply.run_cpu_time_us":21626,"apply.run_wall_time_us":301345,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20895,"num_ops":4,"prepare.queue_time_us":230260,"prepare.run_cpu_time_us":12927,"prepare.run_wall_time_us":186356,"raft.queue_time_us":208603,"raft.run_cpu_time_us":18129,"raft.run_wall_time_us":139816,"replication_time_us":428526,"thread_start_us":699073,"threads_started":4,"wal-append.queue_time_us":198237}]]}
I20260709 12:13:33.026190 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:33.027022 11288 raft_consensus.cc:2393] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 27: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:33.021977 11290 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:33.030119 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:33.031706 11185 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:33.036224 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:33.040900 11212 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 28.
I20260709 12:13:33.040940 11859 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:13:33.042588 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:33.043113 11039 catalog_manager.cc:5697] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 24 to 26, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 26 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.034780 19974 consensus_queue.cc:1059] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:13:33.042585 11182 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:33.042891 19970 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:33.057772 11289 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:33.057566 11185 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:33.065493 11185 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:33.065414 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:33.069137 11258 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:33.085624 11138 raft_consensus.cc:2468] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 17.
I20260709 12:13:33.085914 19968 raft_consensus.cc:2804] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:33.090785 19777 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.096124 19777 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.092662 11185 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:13:33.068691 19465 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:33.075697 19841 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:33.108441 19968 raft_consensus.cc:697] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:33.116921 19968 consensus_queue.cc:237] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.085178 19582 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:33.115741 20010 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.110829 19777 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.115447  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
I20260709 12:13:33.128698 19370 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.131477 19370 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.138087 11291 raft_consensus.cc:2468] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 15.
I20260709 12:13:33.147500 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:33.151458 11859 raft_consensus.cc:2393] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 20: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
W20260709 12:13:33.150233 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 57685.1us
I20260709 12:13:33.151623 11826 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:33.148489 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:33.157740 19970 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:33.177798 19886 raft_consensus.cc:2804] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:33.178323 19886 raft_consensus.cc:697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:33.180157 19886 consensus_queue.cc:237] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.182430 19990 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:33.176736 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:33.188199 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:33.189988 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:33.190917 11291 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 28.
I20260709 12:13:33.147693 20010 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:33.158391 19993 raft_consensus.cc:2764] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:13:33.209686 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:33.200383 11825 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 12:13:33.213410 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:33.216476 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:33.214200 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:33.201607 19669 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:33.145517 19858 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.219692 19926 raft_consensus.cc:3055] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:33.228601 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:33.229789 11291 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:33.216331 19975 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:33.194175 19880 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.259281 11290 raft_consensus.cc:2368] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:13:33.260696 19880 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:33.221819 20007 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:33.241089 20011 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:13:33.242081 19858 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:33.238471 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:33.270144 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:33.245308 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:33.271279 11859 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.229415 19469 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:33.229157 19926 raft_consensus.cc:740] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:33.209986 20005 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:13:33.242197 19401 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:33.267505 20007 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.276419 19469 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.277729 19990 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:33.293311 11291 raft_consensus.cc:2468] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 29.
I20260709 12:13:33.331808 19926 consensus_queue.cc:260] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.333289 19926 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:33.298132 19990 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:33.338783 19990 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:33.290323 20007 raft_consensus.cc:3060] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:33.298305 19469 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:33.352443 19979 log.cc:927] Time spent T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:33.298413 19401 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.356472 19401 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:33.361042 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:33.361529 11859 raft_consensus.cc:2468] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:33.362066 11860 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:33.369695 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:33.374889 11182 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:33.382086 11213 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:33.382279 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:33.383371 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:33.384052 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.384476 11214 raft_consensus.cc:2368] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23.
I20260709 12:13:33.385475 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:33.382236 11110 leader_election.cc:400] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:13:33.390354 11110 leader_election.cc:403] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:13:33.390407 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:33.391618 11216 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 29: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:33.396679 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 196317us
W20260709 12:13:33.398720 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 172873us
I20260709 12:13:33.406060 11216 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:33.413743 11213 raft_consensus.cc:1275] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:33.409914 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:33.392493 19987 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:33.392068 19967 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:33.425462 11859 raft_consensus.cc:1275] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 12:13:33.425921 11859 pending_rounds.cc:85] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Aborting all ops after (but not including) 15
I20260709 12:13:33.426182 11859 pending_rounds.cc:107] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 12:13:33.426433 11859 raft_consensus.cc:2889] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:33.429754 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:33.438159 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:33.453020 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:33.453384 19777 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:33.453754 11860 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:33.454758 19827 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:33.457300 19697 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:33.417985 19964 raft_consensus.cc:3060] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:33.493793 11211 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:33.416318 19941 raft_consensus.cc:2804] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:33.508791 11185 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:33.512003 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 56884.3us
I20260709 12:13:33.512681 19966 raft_consensus.cc:2804] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:33.513295 19966 raft_consensus.cc:697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:33.443295 19967 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.516463 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:33.517431 11293 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:33.522975 19990 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.514304 19966 consensus_queue.cc:237] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.516660 19967 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.452062 19881 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:33.542900 19881 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:33.543465 19881 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:33.452279 20010 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:33.547875 19941 raft_consensus.cc:697] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
W20260709 12:13:33.597213 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 265532us
I20260709 12:13:33.602173 11860 raft_consensus.cc:2468] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
W20260709 12:13:33.605163 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.548964 19941 consensus_queue.cc:237] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.631004 11256 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:33.558712 19469 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
W20260709 12:13:33.649767 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 206835us
I20260709 12:13:33.583715 19617 consensus_queue.cc:1048] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
W20260709 12:13:33.685400 20020 log.cc:927] Time spent T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.098s	user 0.005s	sys 0.001s
I20260709 12:13:33.621273 20007 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.687448 19990 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:33.688381 19964 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 20. Current term is 21.
I20260709 12:13:33.693898 19469 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.652133 19998 raft_consensus.cc:2804] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:13:33.706317 20025 log.cc:927] Time spent T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:13:33.713310 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 202919us
W20260709 12:13:33.712083 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 273973us
I20260709 12:13:33.724253 11110 leader_election.cc:400] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23.
I20260709 12:13:33.724924 11110 leader_election.cc:403] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:33.739295 19964 raft_consensus.cc:3060] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:33.723570 19998 raft_consensus.cc:697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:33.770437 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.770308 19926 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.770078 19831 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:33.778415 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.796084 19831 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.803828 19831 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:33.804982 19865 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.805733 19865 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.789997 19944 consensus_queue.cc:1048] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 12:13:33.799069 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:33.831715 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.791509 19926 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.856410 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:33.858639 11210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:33.860334 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:33.859434 11210 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
W20260709 12:13:33.862563 11107 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.867005 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:33.836731 20005 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.866448 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:33.869194 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.852201 19947 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.812670 19998 consensus_queue.cc:237] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.883303 20031 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:33.884563 20031 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.883236 19967 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:33.881830 19947 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:33.887880 19967 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.889559 19947 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:33.890426 19967 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.887360 20031 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.891587 19926 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.901301 11215 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 28.
I20260709 12:13:33.903617 19865 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.904815 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:33.905859 20030 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:33.906500 20030 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 28 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:33.907589 20030 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:33.870428 20007 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.880457 20005 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:33.925210 19831 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:33.973834 19975 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:33.954135 20005 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:33.994683 11285 raft_consensus.cc:1275] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:13:33.999150 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:33.980185 19831 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:33.997607 19975 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.007745 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:34.032655 11284 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.014266 19985 consensus_queue.cc:1048] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:34.023326 19964 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 22. Current term is 23.
I20260709 12:13:34.028755 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.033023 19831 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:34.052723 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.053421 11218 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 28.
I20260709 12:13:34.050391 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:34.055020 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.056031 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:34.057876 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.058622 11218 raft_consensus.cc:2393] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:34.059934 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.060534 11213 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:34.061367 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:34.042189 19370 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.044862 19926 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:34.072664 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:34.074290 11293 raft_consensus.cc:2393] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 in current term 29: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:34.075064 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:34.078641 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:34.079219 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.080102 20031 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:34.069556 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.086402 11258 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:34.087622 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61042.8us
I20260709 12:13:34.089481 11854 raft_consensus.cc:1275] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:13:34.092057 11825 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.099225 19858 consensus_queue.cc:1048] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:34.074750 19370 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.086413 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.114506 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:34.115839 11184 consensus_peers.cc:597] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.116422 11184 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.135823 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.141891 11854 raft_consensus.cc:1275] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:13:34.112226 19881 consensus_meta.cc:287] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.003s
I20260709 12:13:34.143446 19370 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.143388 19881 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.145861 19881 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Requested vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:34.117272 11184 consensus_peers.cc:597] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.147225 11184 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.150405 19975 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.154503 19975 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:34.097726 19926 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:34.122355 20005 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:34.169329 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:34.170363 11859 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:34.140723 20007 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:34.146891 19967 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:34.167447 20043 log.cc:927] Time spent T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:13:34.182839 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:34.176846 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:34.190106 19926 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:34.192106 20044 log.cc:927] Time spent T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:13:34.194367 11285 raft_consensus.cc:2393] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:34.195798 11858 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 20.
I20260709 12:13:34.192212 11284 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:34.169600 20005 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.200565 11185 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:34.205798 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.206774 11212 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 25.
I20260709 12:13:34.177611 19967 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.203689 20005 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:34.229563 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 49696.3us
I20260709 12:13:34.246687 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:34.209358 19951 raft_consensus.cc:2804] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:34.255185 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
W20260709 12:13:34.254383 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 118646us
I20260709 12:13:34.186863 20007 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.209925 19967 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.260874 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.246948 19964 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
W20260709 12:13:34.265425 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 117966us
I20260709 12:13:34.207762 19465 consensus_queue.cc:1048] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 12:13:34.278558 20056 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:34.279057 20056 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.279381 20056 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:34.281116 11184 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:34.285543 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:34.272037 19951 raft_consensus.cc:697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:34.276726 19966 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:34.273404 19964 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.299010 19966 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:34.328629 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 67870.6us
I20260709 12:13:34.329704 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.327541 19966 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.329339 19926 raft_consensus.cc:3060] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.332485 20055 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.358417 11031 maintenance_manager.cc:419] P 77709ed97aed432192038c6d22f779bc: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033393
I20260709 12:13:34.377713 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:34.369911 11182 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.382472 11858 raft_consensus.cc:1275] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:13:34.374051 20049 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:13:34.369649 20059 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:13:34.450775 20053 log.cc:927] Time spent T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:13:34.411835 20007 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.379350 20055 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.518075 20010 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:34.449803 20054 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:34.356069 19951 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:34.409650 19858 consensus_queue.cc:1048] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:13:34.565294 20067 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.525132 20005 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.566973 20007 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.567561 20007 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.568091 20005 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.569809 20007 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.570902 11285 raft_consensus.cc:1275] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
W20260709 12:13:34.558728 11184 consensus_peers.cc:597] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.528946 20056 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.532534 19967 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.534118 19944 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.536621 19831 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:34.540634 20052 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.282s	user 0.003s	sys 0.000s
I20260709 12:13:34.405715 19469 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:34.558212 11852 raft_consensus.cc:1275] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:34.557312 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.561167 19926 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:34.562835 20029 log.cc:927] Time spent T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.147s	user 0.006s	sys 0.012s
I20260709 12:13:34.552767 20031 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.553180 20030 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:34.562584 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:34.566056 20067 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.624910 11860 raft_consensus.cc:2368] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:34.579936 20059 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.535517 19966 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.637869 11292 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27.
I20260709 12:13:34.572984 20010 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.658658 20075 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:34.660356 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 55033.6us
I20260709 12:13:34.625736 19469 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:34.626081 20007 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:34.666406 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 89023.7us
I20260709 12:13:34.673426 11212 raft_consensus.cc:2368] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:34.674160 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.643571 19926 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:34.619424 19944 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.579941 20054 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.680111 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
W20260709 12:13:34.677323 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.691002 11211 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:34.636763 20031 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.638866 20030 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:34.702858 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 71278us
I20260709 12:13:34.683171 20007 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:34.716969 11256 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 50625.6us
I20260709 12:13:34.650820 20059 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.690475 19926 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.703809 20005 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:34.672173 20075 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.720574 20033 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.724191 20076 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:34.726876 20055 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.713821 20069 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:34.704591 19990 consensus_queue.cc:1048] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:13:34.711542 20060 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.716228 20068 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:34.737203 19926 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.732829 20005 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.737727 20072 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.720945 19469 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.747452 20055 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.783639 11211 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 29.
W20260709 12:13:34.790508 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 116808us
I20260709 12:13:34.739249 20033 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.822156 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:34.789510 19831 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:34.832684 11853 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 26: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:34.835530 11214 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:34.837354 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:34.837971 11214 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:34.838191 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:34.787961 19881 consensus_queue.cc:1048] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:34.819995 20056 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:34.824234 19966 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.824769 19975 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.759805 20060 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.748476 20069 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.794771 20055 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:34.759512 20068 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:34.873977 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 65600.9us
I20260709 12:13:34.748206 20076 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.768231 20072 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.840055 20067 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.876375 19944 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.847766 20010 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:34.877156 20047 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.004s	sys 0.014s
I20260709 12:13:34.848049 20078 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:34.891601 11107 leader_election.cc:400] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:34.893464 11107 leader_election.cc:403] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:34.903107 20082 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.903707 20082 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.905800 20082 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.909416 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:34.910220 11853 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:34.911801 20076 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:34.892011 20047 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.004s	sys 0.015s
I20260709 12:13:34.913801 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:34.915037 11110 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:34.916029 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:34.919718 20007 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.921018 19831 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:34.921440 19831 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.921798 19831 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:34.924870 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.925437 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 233659us
I20260709 12:13:34.927543 20060 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.929385 20069 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.931195 20054 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.933233 20055 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:34.933809 20078 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:34.935000 19967 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.936112 20078 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.937479 19858 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:34.937986 19858 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.953282 11214 raft_consensus.cc:2468] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:34.883987 20070 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:34.964468 11107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 78096.2us
I20260709 12:13:34.890866 20031 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:34.874212 19975 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:34.975039 19926 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:34.974308 19858 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.974314 20080 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:34.974651 20060 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.995085 20059 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:34.997109 20033 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:34.997717 11184 consensus_peers.cc:597] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.005970 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 431875us
W20260709 12:13:35.006887 11184 consensus_peers.cc:597] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.014142 11184 consensus_peers.cc:597] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.014858 11184 consensus_peers.cc:597] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.028149 11184 consensus_peers.cc:597] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.000823 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52865.6us
I20260709 12:13:35.053629 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:35.054766 11217 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27.
I20260709 12:13:35.062031 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.076294 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.092319 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:35.116896 11184 consensus_peers.cc:597] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.117604 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 88754.8us
W20260709 12:13:35.123221 11184 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.124045 11184 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.125085 11184 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.125768 11184 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.139490 11184 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.140111 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.012394 20005 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.011739 20031 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:35.150728 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.027030 19926 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:35.104828 19998 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:34.978696 20070 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.122958 20080 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.129716 20076 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.168385 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.172806 20068 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:35.235947 20093 log.cc:927] Time spent T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:13:35.239511 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 211805us
I20260709 12:13:35.180358 19926 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.171795 19998 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.163622 20031 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.181381 20076 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.178639 20080 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.266959 20072 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.282271 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.284235 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.286664 19880 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:35.287313 19880 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.289248 19831 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.289672 19880 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.291777 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.296412 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.271664 20069 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.298878 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:35.314718 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.317067 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.320458 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.323590 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.323848 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.320036 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.294737 20072 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:35.324460 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 184210us
W20260709 12:13:35.329969 11184 consensus_peers.cc:597] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.328409 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.329360 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:35.334200 11284 raft_consensus.cc:2368] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27.
W20260709 12:13:35.333499 11184 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.319439 19858 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:35.319342 20068 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:35.338754 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.327059 20087 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:35.336952 11184 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.339285 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.337950 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.347016 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.353804 19831 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.353667 20068 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.357272 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:35.359745 11182 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0c432ae03684756b937dd1aa2541cbd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.360416 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.361747 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:35.362290 11859 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:35.345678 19858 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.364969 19964 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.365386 19858 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.367338 20070 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.368117 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.370896 11853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.370981 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.371006 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.373420 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:35.340760 20084 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:13:35.354249 20030 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:35.316027 20069 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.379809 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:35.387835 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 57411us
W20260709 12:13:35.388587 11184 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.389338 11184 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.333334 20072 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.385396 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.394444 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.382640 11859 raft_consensus.cc:2468] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:35.396517 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.397878 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.401295 11256 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:35.401949 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.403805 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.392513 19858 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:35.402927 20030 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.351497 20087 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.345993 11030 maintenance_manager.cc:643] P 77709ed97aed432192038c6d22f779bc: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.964s	user 0.052s	sys 0.005s Metrics: {"bytes_written":7948,"delete_count":0,"lbm_write_time_us":3093,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":311}
W20260709 12:13:35.464778 11825 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.413048 20088 raft_consensus.cc:2804] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:35.468130 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.472970 11031 maintenance_manager.cc:419] P 77709ed97aed432192038c6d22f779bc: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.393823
I20260709 12:13:35.474094 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.476894 20072 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.479552 20080 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.482798 20031 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.426015 20030 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.488159 19987 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:35.488476 20030 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:35.488952 19987 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.465749 20036 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:35.491351 19987 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:35.496176 20060 consensus_meta.cc:287] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
I20260709 12:13:35.500319 20088 raft_consensus.cc:697] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:35.501344 20088 consensus_queue.cc:237] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.503966 20068 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:35.505021 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.505417 19998 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:35.505548 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 579444us
W20260709 12:13:35.506567 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.507239 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.507880 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.508914 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.509488 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:35.509961 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.510390 20076 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.424317 19858 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.499245 19975 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:35.516402 20099 log.cc:927] Time spent T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:13:35.517364 20069 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:35.520496 20094 log.cc:927] Time spent T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:13:35.522028 11110 leader_election.cc:400] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:35.523376 11110 leader_election.cc:400] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27.
I20260709 12:13:35.523669 11110 leader_election.cc:403] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
W20260709 12:13:35.510414 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.527040 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.499030 20075 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.531404 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.524358 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:35.533954 11258 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:35.535197 11258 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.538704 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:35.543931 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:35.545125 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:35.497381 20060 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563) with higher term. Message: Invalid argument: T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 25. Current term is 26.
I20260709 12:13:35.550586 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.553680 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:35.577960 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.498999 20087 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.584429 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.547693 20069 raft_consensus.cc:3060] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:35.600939 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.588590 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.602234 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.588277 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.559999 20076 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:35.547470 19975 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:35.603250 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.607728 11293 raft_consensus.cc:2393] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 28: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:35.603425 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.602653 11110 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:35.608358 11214 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:35.559330 20068 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.604565 11217 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:35.609725 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.611617 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.622318 11216 raft_consensus.cc:2468] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 14.
I20260709 12:13:35.612197 20007 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:35.616961 19858 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.599339 19944 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:35.579990 20072 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:35.621816 20075 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:35.628679 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.612247 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:35.631690 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:35.644894 11293 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:35.621029 20021 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.644843 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.649466 11217 raft_consensus.cc:2393] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4f4725b82b481ab53f0717a429e94a in current term 26: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:35.646270 19941 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:35.658119 19941 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.659168 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.659715 20031 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:35.660317 19941 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.654151 19858 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:35.662799 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:35.662982 19858 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.665403 19858 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.666564 20005 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:35.666980 20005 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.667312 20005 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:35.667932 11290 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:35.668375 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:35.669342 11184 consensus_peers.cc:597] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.670274 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.670648 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.670954 11284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.672340 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.673197 11292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.652145 20021 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.674652 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:35.675707 20060 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:35.677203 20060 raft_consensus.cc:2804] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:35.677599 20060 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:35.677959 20060 raft_consensus.cc:3060] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:35.678125 20021 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.646080 20075 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.654932 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.711169 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.689457 19966 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:35.697801 11185 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.707672 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.644958 19944 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.719188 19944 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.707639 20019 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:35.720382 20019 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.722645 20019 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.724462 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.719770 20075 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.731506 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:35.735862 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 200019us
I20260709 12:13:35.737504 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.738818 11288 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 28.
I20260709 12:13:35.755769 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:35.736377 20019 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:35.776520 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 48732.8us
I20260709 12:13:35.777477 11259 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:35.779292 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 44992.8us
I20260709 12:13:35.759598 19876 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:35.754631 20030 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:13:35.793195 20075 raft_consensus.cc:493] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.834015 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.838557 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.846408 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.847400 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.848203 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.849332 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.850143 11212 raft_consensus.cc:2410] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 28 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 12:13:35.848765 11291 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:35.864359 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:35.868814 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 190968us
I20260709 12:13:35.871165 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:35.871388 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.876098 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.877806 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:35.887058 11218 raft_consensus.cc:2410] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 for term 29 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:35.887282 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:35.914049 11185 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.919612 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.840256 20005 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.930886 20076 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.923359 20088 raft_consensus.cc:2804] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:35.927704 20069 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27.
I20260709 12:13:35.848934 20075 raft_consensus.cc:515] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:35.928604 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.939702 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.942673 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.947000 20060 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:35.955765 20060 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:35.942371 20069 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:35.953349 20076 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:35.961050 11184 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.995522 11184 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:35.996816 20019 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:35.997375 11184 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:35.998061 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:35.963650 20031 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.951982 20005 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:35.967525 20070 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:35.937259 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:35.976991 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 199622us
I20260709 12:13:35.987474 11110 leader_election.cc:400] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 election: Vote denied by peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465) with higher term. Message: Invalid argument: T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 26. Current term is 27.
I20260709 12:13:35.971148 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:36.005213 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:36.009994 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 72879.4us
W20260709 12:13:36.007498 11184 leader_election.cc:336] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.015990 11184 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:36.016238 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.017663 11185 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.018754 19469 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:36.018658 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.020869 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.021792 20068 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.023100 20068 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:36.024955 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.025625 19849 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.025802 20068 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.026795 20076 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.027597 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.028143 19941 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:36.028712 19941 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:36.029199 19941 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:36.029462 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.025244 11185 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.014539 20019 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:36.030706 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.030857 19926 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:36.031930 20076 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:13:36.038967 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.031020 20005 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.007247 20031 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:36.042713 20075 leader_election.cc:290] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:36.044294 20031 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:36.045410 20068 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:13:36.036340 19926 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.036860 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:36.049638 11184 consensus_peers.cc:597] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.050839 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.057665 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.058851 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.059387 20075 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.060635 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.060770 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:36.040568 20104 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.041025 20107 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.052667 19926 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.066370 11110 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.054179 20105 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:36.076498 11259 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.063097 20031 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:36.077950 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.067215 20005 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:36.080114 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.081437 20076 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.083540 20116 raft_consensus.cc:2749] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:36.075979 20088 raft_consensus.cc:697] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:36.085345 20088 consensus_queue.cc:237] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.087296 20125 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:36.087896 20125 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:36.082695 11110 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.089989 20125 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:36.090660 20070 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:36.091988 11110 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.092805 20072 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.093503 20076 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:13:36.077721 20075 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.079339 20105 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.095283 11855 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:36.096683 20105 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:36.103243 20113 log.cc:927] Time spent T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:13:36.118831 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:36.126984 11855 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:36.126991 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.137262 19831 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:36.149475 20092 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:36.150141 20092 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
W20260709 12:13:36.178802 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 82089.9us
I20260709 12:13:36.191571 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.177744 20068 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.207267 20068 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.211371 20126 ts_tablet_manager.cc:933] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:36.186873 20021 consensus_queue.cc:1059] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:13:36.247905 20021 raft_consensus.cc:3055] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:36.225023 20057 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
W20260709 12:13:36.254086 11825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95017.3us
I20260709 12:13:36.255563 11213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.256242 11214 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 28. Current term is 29. Ops: [28.19-28.19]
I20260709 12:13:36.263641 20126 tablet_copy_client.cc:323] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.130:41137
I20260709 12:13:36.244221 20068 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:36.248350 20021 raft_consensus.cc:740] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:36.274142 20021 consensus_queue.cc:260] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:36.271945 11259 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.277287 20118 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:36.279548 11184 leader_election.cc:336] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.280194 11184 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.232800 19941 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:36.288893 20108 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.351s	user 0.005s	sys 0.000s
I20260709 12:13:36.291561 20036 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.189989 20079 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.121s
I20260709 12:13:36.219198 20092 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.340759 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.261878 20057 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:36.336726 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:36.344619 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.345386 11289 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.347038 20088 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:36.352540 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.359907 20092 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.383494 19941 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:36.389083 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 109525us
I20260709 12:13:36.366315 20060 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:36.292395 20036 raft_consensus.cc:2955] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
W20260709 12:13:36.387262 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 93642.3us
W20260709 12:13:36.407646 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 74430.5us
W20260709 12:13:36.405483 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 133664us
W20260709 12:13:36.409407 11184 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.417055 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:36.418537 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:36.420895 11218 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:36.393299 20068 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:36.425794 20068 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.407830 20060 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.454931 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec444005f2c247b18f21f2d9fcf7749e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.455718 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64dc7dbbc231456da11adb2c7a1dada9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.457247 20057 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:36.409142 20019 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.458268 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.458384 11291 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 19. (term mismatch)
W20260709 12:13:36.468767 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.457754 20036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60882 (request call id 22) took 9041 ms. Trace:
I20260709 12:13:36.469089 11291 pending_rounds.cc:85] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Aborting all ops after (but not including) 18
I20260709 12:13:36.470106 11291 pending_rounds.cc:107] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: Aborting uncommitted NO_OP operation due to leader change: 28.19
I20260709 12:13:36.470412 11291 raft_consensus.cc:2889] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:36.465541 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.476544 11214 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:36.476874 11184 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.480257 20021 raft_consensus.cc:3060] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:36.481451 20060 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:36.478161 11228 tablet_copy_service.cc:140] P 5d1ee1ef054240338e0a9e05a67acdfc: Received BeginTabletCopySession request for tablet c0c432ae03684756b937dd1aa2541cbd from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:44734)
I20260709 12:13:36.494690 11289 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 29.
W20260709 12:13:36.492847 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 81942.1us
I20260709 12:13:36.499562 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:36.499565 11110 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:36.510614 11216 raft_consensus.cc:1275] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:36.503528 11289 raft_consensus.cc:1240] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Rejecting Update request from peer 5d1ee1ef054240338e0a9e05a67acdfc for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:36.516729 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.517692 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.519243 11217 raft_consensus.cc:1240] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:36.521176 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.525281 11214 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 29.
I20260709 12:13:36.525228 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3619bd8cdd6482dad222b2265b94b48" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.505426 11288 raft_consensus.cc:2955] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:36.521394 20070 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:36.523059 20076 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.012s
I20260709 12:13:36.513036 11228 tablet_copy_service.cc:161] P 5d1ee1ef054240338e0a9e05a67acdfc: Beginning new tablet copy session on tablet c0c432ae03684756b937dd1aa2541cbd from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:44734: session id = 2b4f4725b82b481ab53f0717a429e94a-c0c432ae03684756b937dd1aa2541cbd
I20260709 12:13:36.469885 20036 rpcz_store.cc:276] 0709 12:13:27.416233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.416398 (+   165us) service_pool.cc:224] Handling call
0709 12:13:28.315837 (+899439us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b2c00010c48. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982f3d4a11 00007f982f3e3a0a 00007f982f3e3693 00007f982f3e3631 00007f9830b16902 00007f9830b166dd 00007f9830ae1f3f 00007f9830ae16b3 00007f9835aa1d29 00007f982f0201d4 00007f982f020162
0709 12:13:30.312805 (+1996968us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b580045fed0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a44571 00007f9830a370aa 00007f9830ab9447 00007f9830ad670a 00007f9830ad776a 00007f9830ad691b 00007f9830ae203c 00007f9830ae16b3 00007f9835aa1d29 00007f982f0201d4 00007f982f020162
0709 12:13:30.331707 (+ 18902us) log.cc:844] Serialized 506 byte log entry
0709 12:13:36.457570 (+6125863us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22465,"raft.run_cpu_time_us":3162,"raft.run_wall_time_us":76130,"spinlock_wait_cycles":1577179136,"thread_start_us":204626,"threads_started":1,"wal-append.queue_time_us":171991,"wal-append.run_cpu_time_us":4033,"wal-append.run_wall_time_us":1026420}
I20260709 12:13:36.527173 20031 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:13:36.529974 20092 consensus_queue.cc:1048] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:13:36.548365 11110 leader_election.cc:304] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.559741 20007 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.569123 20007 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:36.571296 20007 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:36.553803 20070 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:36.576288 20070 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.568342 20031 raft_consensus.cc:2749] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.591738 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:36.596536 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 95618.3us
W20260709 12:13:36.597321 11184 leader_election.cc:336] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.597867 11184 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.618909 11041 catalog_manager.cc:5697] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 25 to 26, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 26 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.619869 11286 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:36.620857 11041 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:36.625584 20068 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:36.630919 20134 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:36.650007 11212 raft_consensus.cc:1275] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 12:13:36.650470 11212 pending_rounds.cc:85] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting all ops after (but not including) 16
I20260709 12:13:36.650719 11212 pending_rounds.cc:107] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 12:13:36.650957 11212 raft_consensus.cc:2889] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:36.653798 20125 consensus_queue.cc:1048] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:36.655369 11041 catalog_manager.cc:5697] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 23 to 24, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 24 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:36.661401 11041 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 23 to 24, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:36.663918 11041 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 17 to 19, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:36.673743 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 125476us
I20260709 12:13:36.678517 11110 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.680687 11041 catalog_manager.cc:5697] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 19 to 23, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 23 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:36.682600 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.683727 11041 catalog_manager.cc:5697] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 22 to 25, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 25 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:36.687065 11039 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 285) took 11594 ms (client timeout 15000 ms). Trace:
I20260709 12:13:36.683198 20072 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.690209 20104 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.690696 20005 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:36.690728 20104 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.694628 11041 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 24 to 26, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 26 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:13:36.685086 11825 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.696636 11825 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.709242 11228 tablet_copy_source_session.cc:215] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:13:36.709285 11256 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 -> Peer 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563): Couldn't send request to peer 2b4f4725b82b481ab53f0717a429e94a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca6e44c82eda4c299b22957102352a23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:36.716703 11211 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:13:36.717358 11184 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.717815 11184 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.727444 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1618626d8c194b9ea8b2ac9f3554b006" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.729619 20104 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:36.687516 11039 rpcz_store.cc:269] 0709 12:13:25.092602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.092798 (+   196us) service_pool.cc:224] Handling call
0709 12:13:36.686973 (+11594175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:33.510854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:33.511687 (+   833us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:33.511723 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:13:33.511741 (+    18us) tablet.cc:662] Decoding operations
0709 12:13:33.512620 (+   879us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:33.512679 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:33.512706 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:13:33.513315 (+   609us) tablet.cc:701] Row locks acquired
0709 12:13:33.513328 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:13:33.513482 (+   154us) write_op.cc:270] Start()
0709 12:13:33.513603 (+   121us) write_op.cc:276] Timestamp: P: 1783599213513430 usec, L: 0
0709 12:13:33.513620 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:13:33.558642 (+ 45022us) log.cc:844] Serialized 2856 byte log entry
0709 12:13:33.737864 (+179222us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f983067520b
0709 12:13:34.122515 (+384651us) op_driver.cc:464] REPLICATION: finished
0709 12:13:34.738536 (+616021us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b4400022b4c. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d914c85 00007f982d9156a2 00007f98306871db 00007f9830682aaf 00007f982d9d10ac 00007f983682b9a9 00007f982d9ed69b 00007f982d9eb93f 00007f982d9edc02 00007f9834511ef0
0709 12:13:35.172603 (+434067us) write_op.cc:301] APPLY: starting
0709 12:13:35.172709 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:35.355692 (+182983us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:35.355727 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:35.679093 (+323366us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:35.679334 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=28,mrs_lookups=0
0709 12:13:35.679383 (+    49us) write_op.cc:312] APPLY: finished
0709 12:13:35.679645 (+   262us) log.cc:844] Serialized 73 byte log entry
0709 12:13:35.679833 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:35.679942 (+   109us) write_op.cc:454] Released schema lock
0709 12:13:35.679994 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:35.680405 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:35.680434 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":221,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":1022652,"apply.run_cpu_time_us":16210,"apply.run_wall_time_us":507807,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33471,"cfile_init":1,"lbm_read_time_us":21421,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"num_ops":7,"prepare.queue_time_us":355321,"prepare.run_cpu_time_us":34891,"prepare.run_wall_time_us":356389,"raft.queue_time_us":149848,"raft.run_cpu_time_us":23808,"raft.run_wall_time_us":826044,"replication_time_us":577898,"spinlock_wait_cycles":22634112,"thread_start_us":1386423,"threads_started":4,"wal-append.queue_time_us":374480,"wal-append.run_cpu_time_us":39107,"wal-append.run_wall_time_us":2747335}]]}
I20260709 12:13:36.735196 20057 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.697845 19926 consensus_queue.cc:1059] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:13:36.743646 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d8b59f386d4565b0103c44f0baa84d" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.745414 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.746196 11291 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 29.
I20260709 12:13:36.783676 20125 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:13:36.786146 20145 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.788653 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:36.814873 11258 leader_election.cc:336] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:36.815970 11258 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.816370 11258 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.755841 20132 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:13:36.817736 11258 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:36.819769 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 71246.3us
I20260709 12:13:36.820895 11110 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:36.819952 19926 raft_consensus.cc:3055] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:36.826300 19926 raft_consensus.cc:740] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:36.828974 19926 consensus_queue.cc:260] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:36.831261 20070 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:13:36.817619 20143 log.cc:927] Time spent T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:13:36.818373 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.831318 11110 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:36.838198 11258 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.838676 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:36.839444 20125 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:36.840003 11258 leader_election.cc:336] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.840473 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.843997 11110 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.846439 20005 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.848393 20126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c432ae03684756b937dd1aa2541cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.836570 20019 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:36.833954 20068 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:36.817370 20145 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:36.854106 20145 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:36.818857 20088 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:36.857846 11258 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.859674 11258 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:36.861464 19880 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.841266 20127 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.841055 20070 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:36.860257 19926 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:36.882642 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:36.891057 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:36.886142 20070 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:36.896009 20070 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:36.898103 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:36.873147 20005 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.877074 19944 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.955862 20019 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:36.964077 20019 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:36.969916 11184 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:36.979316 11218 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:36.986106 20088 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:37.012908 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.016079 20005 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:37.018422 20153 log.cc:927] Time spent T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:13:37.020037 11030 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.236s	user 0.028s	sys 0.031s
I20260709 12:13:37.020617 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:37.039232 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.042287 11110 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:37.041193 20149 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: Append to log took a long time: real 0.297s	user 0.000s	sys 0.004s
I20260709 12:13:37.046520 20070 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:37.069911 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.080205 11290 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 12:13:37.086534 11258 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.088125 20155 log.cc:927] Time spent T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 12:13:37.093212 20146 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:37.098335 20126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37092 (request call id 2046) took 1133 ms. Trace:
I20260709 12:13:37.113166 20126 rpcz_store.cc:276] 0709 12:13:35.958597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.959444 (+   847us) service_pool.cc:224] Handling call
0709 12:13:36.211988 (+252544us) ts_tablet_manager.cc:934] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
0709 12:13:36.783754 (+571766us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:36.962640 (+178886us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:36.962765 (+   125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:37.061928 (+ 99163us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:37.074831 (+ 12903us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:37.088356 (+ 13525us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:37.089418 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":6964,"tablet-copy.queue_time_us":251043,"thread_start_us":154986,"threads_started":2}
I20260709 12:13:37.134089 20019 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.135433 20126 tablet_copy_client.cc:806] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:37.139012 20126 tablet_copy_client.cc:670] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:37.140355 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.146267 20019 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.146420 11218 raft_consensus.cc:1240] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Rejecting Update request from peer 018d40ceb45d4447aa293f4c1d929bb8 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:37.159075 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:37.160475 20146 consensus_queue.cc:1059] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:37.161403 20146 raft_consensus.cc:3055] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:37.161769 20146 raft_consensus.cc:740] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:37.162645 20146 consensus_queue.cc:260] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.163885 20146 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:37.166549 19926 consensus_queue.cc:1175] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ba2779405e8d452e95f42421b2b60928" responder_term: 29 status { last_received { term: 29 index: 19 } last_committed_idx: 19 last_received_current_leader { term: 29 index: 19 } }
I20260709 12:13:37.168488 20126 tablet_copy_client.cc:538] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:13:37.178048 11184 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:37.183024 20005 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:37.184422 20005 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.184713 11184 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.190445 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.191267 20005 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.191651 20138 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:37.188416 20126 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:13:37.201823 11218 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:37.202834 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.207363 20005 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:37.209486 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:37.211316 20005 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:37.349354  9938 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 11169)
I20260709 12:13:37.352090 20167 ts_tablet_manager.cc:933] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: Initiating tablet copy from peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.348335 11030 maintenance_manager.cc:643] P 77709ed97aed432192038c6d22f779bc: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.833s	user 0.193s	sys 0.062s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29385,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":100388,"dirs.run_cpu_time_us":458,"dirs.run_wall_time_us":4494,"lbm_read_time_us":21251,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":21,"lbm_write_time_us":1945,"lbm_writes_lt_1ms":12,"peak_mem_usage":581897,"raft.queue_time_us":116063,"raft.run_cpu_time_us":3638,"raft.run_wall_time_us":11078,"reinsert_count":0,"spinlock_wait_cycles":10547584,"thread_start_us":317403,"threads_started":4,"update_count":333,"wal-append.queue_time_us":148823}
I20260709 12:13:37.358181 11031 maintenance_manager.cc:419] P 77709ed97aed432192038c6d22f779bc: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:13:37.359006 20126 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:37.360149 20126 tablet_bootstrap.cc:492] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:13:37.360956 20126 ts_tablet_manager.cc:1403] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.173s	user 0.048s	sys 0.006s
I20260709 12:13:37.361743 11030 maintenance_manager.cc:643] P 77709ed97aed432192038c6d22f779bc: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 12:13:37.375145 11041 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 160) took 10892 ms. Trace:
I20260709 12:13:37.368690 11040 catalog_manager.cc:5697] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 25 to 26, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 26 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.382280 20146 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:37.379138 11040 catalog_manager.cc:5697] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 26 to 27, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 27 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.382897 20146 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.389648 20146 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.391649 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.384292 11040 catalog_manager.cc:5697] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 29 to 31. New cstate: current_term: 31 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.398672 11218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d5a128ee9974008ab01b0d55cfbb77e" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.400396 11110 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:37.399107 11040 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 19 to 23, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 23 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.402911 20146 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.377419 11041 rpcz_store.cc:276] 0709 12:13:26.482664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.483081 (+   417us) service_pool.cc:224] Handling call
0709 12:13:26.730459 (+247378us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b5400039654. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f9830a45090 00007f9830ae3f3a 00007f9836899e9c 00007f983699804e 00007f9834e592a4 00007f9834e59232 00007f9834e59161 00007f9834e590dc 00007f9834e58392 00007f982ee1648c 00007f982ee158c6
0709 12:13:37.375068 (+10644609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:36.815203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:36.816018 (+   815us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:36.816052 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:13:36.816069 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:36.859176 (+ 43107us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:36.865683 (+  6507us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:36.867775 (+  2092us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:13:36.888868 (+ 21093us) tablet.cc:701] Row locks acquired
0709 12:13:36.888890 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:13:36.928090 (+ 39200us) write_op.cc:270] Start()
0709 12:13:36.936591 (+  8501us) write_op.cc:276] Timestamp: P: 1783599216926066 usec, L: 0
0709 12:13:36.938183 (+  1592us) op_driver.cc:348] REPLICATION: starting
0709 12:13:36.950934 (+ 12751us) log.cc:844] Serialized 3218 byte log entry
0709 12:13:37.207344 (+256410us) op_driver.cc:464] REPLICATION: finished
0709 12:13:37.243586 (+ 36242us) write_op.cc:301] APPLY: starting
0709 12:13:37.243682 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:37.267197 (+ 23515us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:37.267316 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:37.281127 (+ 13811us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:37.281387 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:13:37.281431 (+    44us) write_op.cc:312] APPLY: finished
0709 12:13:37.281744 (+   313us) log.cc:844] Serialized 81 byte log entry
0709 12:13:37.284898 (+  3154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:37.285029 (+   131us) write_op.cc:454] Released schema lock
0709 12:13:37.285079 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:37.285536 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:37.285568 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":172049,"reported_tablets":20,"spinlock_wait_cycles":215573888,"child_traces":[["op",{"apply.queue_time_us":35968,"apply.run_cpu_time_us":11627,"apply.run_wall_time_us":41925,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37663,"cfile_init":1,"lbm_read_time_us":6888,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"num_ops":8,"prepare.queue_time_us":94867,"prepare.run_cpu_time_us":4621,"prepare.run_wall_time_us":136034,"replication_time_us":268988,"thread_start_us":128488,"threads_started":2}]]}
I20260709 12:13:37.403450 20146 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.408722 11040 catalog_manager.cc:5697] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.409969 11040 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 16 to 17, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 17 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.418180 20146 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.407120 20167 tablet_copy_client.cc:323] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Beginning tablet copy session from remote peer at address 127.9.180.131:41465
I20260709 12:13:37.417959 11040 catalog_manager.cc:5697] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 17 to 20, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 20 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.406411 20005 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:37.421638 20126 raft_consensus.cc:359] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:37.424531 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.437494 20126 raft_consensus.cc:740] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:13:37.437963 11854 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:37.428049 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.438241 20126 consensus_queue.cc:260] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:37.439097 11214 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 26.
I20260709 12:13:37.440470 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:37.441869 11040 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 18 to 21, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 21 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:37.442344 20005 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:37.444424 11040 catalog_manager.cc:5697] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 28, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 28 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.445528 20005 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.452203 11040 catalog_manager.cc:5697] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 14 to 16, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 16 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.441169 11303 tablet_copy_service.cc:140] P ba2779405e8d452e95f42421b2b60928: Received BeginTabletCopySession request for tablet ca6e44c82eda4c299b22957102352a23 from peer 2b4f4725b82b481ab53f0717a429e94a ({username='slave'} at 127.0.0.1:49838)
I20260709 12:13:37.455579 11040 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 26, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 26 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.459720 11040 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 29, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 29 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.454579 20005 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.461702 11040 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 26, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 26 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.466710 11040 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.457981 11303 tablet_copy_service.cc:161] P ba2779405e8d452e95f42421b2b60928: Beginning new tablet copy session on tablet ca6e44c82eda4c299b22957102352a23 from peer 2b4f4725b82b481ab53f0717a429e94a at {username='slave'} at 127.0.0.1:49838: session id = 2b4f4725b82b481ab53f0717a429e94a-ca6e44c82eda4c299b22957102352a23
I20260709 12:13:37.469576 11040 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.491281 20126 ts_tablet_manager.cc:1434] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.000s
I20260709 12:13:37.494333 11228 tablet_copy_service.cc:342] P 5d1ee1ef054240338e0a9e05a67acdfc: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-c0c432ae03684756b937dd1aa2541cbd received from {username='slave'} at 127.0.0.1:44734
I20260709 12:13:37.494915 11228 tablet_copy_service.cc:434] P 5d1ee1ef054240338e0a9e05a67acdfc: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-c0c432ae03684756b937dd1aa2541cbd on tablet c0c432ae03684756b937dd1aa2541cbd with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:37.471053 11040 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 23 to 27, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 27 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.501142 11040 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: config changed from index -1 to 17, term changed from 22 to 24, VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:37.503417 11854 raft_consensus.cc:1217] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Deduplicated request from leader. Original: 22.13->[24.14-24.14]   Dedup: 24.14->[]
I20260709 12:13:37.502979 11040 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 27, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 27 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.511323 11040 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 16 to 19, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 19 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:37.514106 11040 catalog_manager.cc:5697] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.515496 11040 catalog_manager.cc:5697] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 reported cstate change: term changed from 21 to 24, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.503822 20005 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.527734 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:37.528342 11854 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:37.533622 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.536515 11854 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:37.547693 11107 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a; no voters: 
I20260709 12:13:37.549549 20146 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:37.550309 20146 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:37.551286 20146 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.538599 20005 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.539629 11303 tablet_copy_source_session.cc:215] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:37.562873 20167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6e44c82eda4c299b22957102352a23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:37.565816 20070 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:37.567306 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:37.567870 11212 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.566450 20070 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.569327 19926 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:37.569813 19926 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.570465 20070 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.571671 19926 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.576812 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.580157 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.582144 11212 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
I20260709 12:13:37.582288 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86632bf64d844f6f8f1356ac45447bcc" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.582759 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75d2c70008a4d06a2db7185a2b623e2" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.603322 11110 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:37.617591 20070 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:37.612636 19926 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:37.624847 19926 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } attrs { replace: true } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.627921 19926 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.633023 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.636049 11110 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.619331 20072 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:37.678093 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.680698 11110 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.681831 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.681744 20070 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:37.641904 20072 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.700593 20072 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.701906 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:37.702600 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.665158 19926 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:37.717547 20072 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:37.718204 20072 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.721966 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.720996 20072 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.725256 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.732963 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.736851 11110 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.737681 20072 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:37.744824 11110 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.748086 20072 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:37.762197 20072 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:37.767719 20072 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.769899 20072 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:37.775092 11184 consensus_peers.cc:597] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.783633 20072 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:37.787727 11184 consensus_peers.cc:597] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.789551 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.784302 20072 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:37.805965 20072 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:37.808931 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed3eea68d84fed917f13cdd6cc9820" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.807610 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:37.812287 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255c201215d14e89bc735bb8b57682cb" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.814294 20070 raft_consensus.cc:493] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:37.814894 20070 raft_consensus.cc:515] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.816958 20070 leader_election.cc:290] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.818392 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.818709 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6068dd70dc8045fc8ad3d39311dc7428" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.822613 11107 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:37.823798 20167 tablet_copy_client.cc:806] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 0 data blocks...
W20260709 12:13:37.831861 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.823801 20070 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:37.828622 11110 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.833786 11110 leader_election.cc:304] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.834296 20070 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:37.834839 19926 raft_consensus.cc:2749] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:37.835321 20167 tablet_copy_client.cc:670] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:37.862870 20167 tablet_copy_client.cc:538] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:13:37.881212 11184 consensus_peers.cc:597] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.901945 11040 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50644 (request call id 283) took 6024 ms. Trace:
I20260709 12:13:37.904572 11040 rpcz_store.cc:276] 0709 12:13:31.885421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.899889 (+ 14468us) service_pool.cc:224] Handling call
0709 12:13:37.901848 (+6001959us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:37.623374 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:37.624293 (+   919us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:37.624354 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:13:37.624385 (+    31us) tablet.cc:662] Decoding operations
0709 12:13:37.627954 (+  3569us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:37.628047 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:37.628096 (+    49us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:13:37.693675 (+ 65579us) tablet.cc:701] Row locks acquired
0709 12:13:37.693696 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:13:37.693866 (+   170us) write_op.cc:270] Start()
0709 12:13:37.694044 (+   178us) write_op.cc:276] Timestamp: P: 1783599217693802 usec, L: 0
0709 12:13:37.694060 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:13:37.694930 (+   870us) log.cc:844] Serialized 8340 byte log entry
0709 12:13:37.704092 (+  9162us) op_driver.cc:464] REPLICATION: finished
0709 12:13:37.704471 (+   379us) write_op.cc:301] APPLY: starting
0709 12:13:37.704576 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:37.758805 (+ 54229us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:37.764110 (+  5305us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:37.851188 (+ 87078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:37.851463 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 12:13:37.851506 (+    43us) write_op.cc:312] APPLY: finished
0709 12:13:37.851901 (+   395us) log.cc:844] Serialized 188 byte log entry
0709 12:13:37.855070 (+  3169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:37.859981 (+  4911us) write_op.cc:454] Released schema lock
0709 12:13:37.860050 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:37.860432 (+   382us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:37.860464 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":24447,"apply.run_wall_time_us":155939,"cfile_cache_hit":84,"cfile_cache_hit_bytes":88032,"num_ops":21,"prepare.queue_time_us":79292,"prepare.run_cpu_time_us":8218,"prepare.run_wall_time_us":82075,"replication_time_us":9828,"spinlock_wait_cycles":100992,"thread_start_us":62836,"threads_started":1}]]}
I20260709 12:13:37.903524 11042 catalog_manager.cc:5697] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.909823 11042 catalog_manager.cc:5697] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 22 to 27, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 27 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.912479 11042 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 25 to 28, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 28 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.913968 11042 catalog_manager.cc:5697] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 22 to 24, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.915880 20167 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap starting.
I20260709 12:13:37.920917 11042 catalog_manager.cc:5697] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 13 to 15, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 15 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:37.922855 11042 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 19 to 21, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 21 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.924378 11042 catalog_manager.cc:5697] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 19 to 21, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.927510  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:37.928722  9938 tablet_replica.cc:333] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:37.927444 11042 catalog_manager.cc:5697] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 21 to 23, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 23 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:37.929736  9938 raft_consensus.cc:2243] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.930523 11042 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 18 to 21, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 21 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:37.932372 11042 catalog_manager.cc:5697] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.935274  9938 raft_consensus.cc:2272] T 7e660be03b734102a4ad43c954498a96 P 018d40ceb45d4447aa293f4c1d929bb8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.938427 20070 raft_consensus.cc:493] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.939359  9938 tablet_replica.cc:333] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:37.939039 20070 raft_consensus.cc:515] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.941186  9938 raft_consensus.cc:2243] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.941342 20070 leader_election.cc:290] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.942404  9938 raft_consensus.cc:2272] T f1f091d9f19d495da80e2f33e1044577 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.946005  9938 tablet_replica.cc:333] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:37.947124  9938 raft_consensus.cc:2243] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:37.949589 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.950729 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923b3bc9b7424aa9bdc5a7952136dbba" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.955595 19926 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:37.956171 19926 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.958456 19926 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.961797 19926 raft_consensus.cc:493] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:37.962328 19926 raft_consensus.cc:515] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:37.963443 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.963819 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776da81ff0064a87b29c2949e7bc5291" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.964641 19926 leader_election.cc:290] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:37.969902  9938 raft_consensus.cc:2272] T 84d8da0a42f045c0919f6b93b4a3ca15 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.964607 11110 leader_election.cc:304] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:37.973713 11184 consensus_peers.cc:597] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.975637 19926 raft_consensus.cc:2749] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:37.978099 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:37.988641 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539267f9f49c4c16b3ec8b1c92be6d29" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:37.989248 11110 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.992197  9938 tablet_replica.cc:333] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:37.993170  9938 raft_consensus.cc:2243] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:37.993742  9938 raft_consensus.cc:2272] T 5fd2e22241c745b9aa339da0259546f0 P 018d40ceb45d4447aa293f4c1d929bb8 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:37.995482 11110 leader_election.cc:304] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:37.994470 19926 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:37.997349 20070 raft_consensus.cc:2749] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:38.002411 11212 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:38.009491 20146 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260709 12:13:38.012769 20070 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:38.013258 20070 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.007323 19926 raft_consensus.cc:493] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:38.016703 19926 raft_consensus.cc:515] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.019356 19926 leader_election.cc:290] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.024272 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.019886 20072 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.025264 20072 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.027573 20072 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.025539 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e27c7f8a6b4e82a1ffee4fc5743515" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.032284 20070 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.039033 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:38.039374 11184 consensus_peers.cc:597] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.039737 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 27.
W20260709 12:13:38.040383 11184 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.042070 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.048600 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:38.051076 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.051774 11214 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 28.
I20260709 12:13:38.055542 20070 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:38.055970 20070 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.056310 20070 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:38.058104 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.062485 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd0a7b2bb3645519f8c5c9bf85633d9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.065527 11110 leader_election.cc:304] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.068048  9938 tablet_replica.cc:333] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.068486 11110 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.066797 20072 raft_consensus.cc:2749] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:38.069758 11041 catalog_manager.cc:5697] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.076735 20146 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:38.078513  9938 raft_consensus.cc:2243] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.080826  9938 raft_consensus.cc:2272] T c75d2c70008a4d06a2db7185a2b623e2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.083736  9938 tablet_replica.cc:333] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.084571  9938 raft_consensus.cc:2243] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.089908 20138 raft_consensus.cc:1064] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:13:38.092711 20138 consensus_queue.cc:237] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:38.098289 20146 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.100349  9938 raft_consensus.cc:2272] T a5275fafd0e7457694ac49b17b3fcfc1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.101428 11041 catalog_manager.cc:5697] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 19 to 21, leader changed from 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.099071 20146 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:38.124650 11184 consensus_peers.cc:597] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.125514 20070 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.126611 20072 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:38.127113 20072 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.128372 19926 raft_consensus.cc:493] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:38.129128 20072 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.128913 19926 raft_consensus.cc:515] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.130256 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:38.130936 19926 leader_election.cc:290] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.133647 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.135794 20070 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.138389 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "557f4814dd3c4d4bb57340a9834ebd32" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.140497 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.142113 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893ed9b3a6054165a7d66c6d7ae1249c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.135790 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c488a2c80e4e21bde9ae92cfae70b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.137609  9938 tablet_replica.cc:333] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.104295 11041 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index -1 to 13, term changed from 22 to 24, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to <none>, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 24 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } }
I20260709 12:13:38.147653 11854 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Refusing update from remote peer 018d40ceb45d4447aa293f4c1d929bb8: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:38.152438 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:38.153116 11290 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 29
I20260709 12:13:38.155898  9938 raft_consensus.cc:2243] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.156834  9938 raft_consensus.cc:2272] T 255c201215d14e89bc735bb8b57682cb P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.165699 11110 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:38.166783 11110 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.168190 19926 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:38.169034 19926 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.169457  9938 tablet_replica.cc:333] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.170528  9938 raft_consensus.cc:2243] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.171334  9938 raft_consensus.cc:2272] T d3619bd8cdd6482dad222b2265b94b48 P 018d40ceb45d4447aa293f4c1d929bb8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.180153 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:38.181221 11214 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:38.191530 11214 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 29.
I20260709 12:13:38.153952 20070 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:38.146550 20146 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:38.154021 20072 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:38.195643  9938 tablet_replica.cc:333] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.218442 20070 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.220773  9938 raft_consensus.cc:2243] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.152544 11041 catalog_manager.cc:5697] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.221534  9938 raft_consensus.cc:2272] T e8f20890b5ce4b0294cf6746a2a341ff P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.222046 20070 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:38.211002 11184 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 224 similar messages]
I20260709 12:13:38.222544 11041 catalog_manager.cc:5697] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.225239  9938 tablet_replica.cc:333] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.225016 11041 catalog_manager.cc:5697] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 21 to 24, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.226166 11042 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50670 (request call id 282) took 2439 ms. Trace:
I20260709 12:13:38.226282  9938 raft_consensus.cc:2243] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:38.217751 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51039.7us
W20260709 12:13:38.223842 11184 consensus_peers.cc:597] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.214707 11288 consensus_queue.cc:237] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:38.228526 11184 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.226900  9938 raft_consensus.cc:2272] T 776da81ff0064a87b29c2949e7bc5291 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.211824 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018d40ceb45d4447aa293f4c1d929bb8 in term 29.
I20260709 12:13:38.232932  9938 tablet_replica.cc:333] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.227833 11110 leader_election.cc:304] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.244306 20072 raft_consensus.cc:2749] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:38.244802 11110 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:38.245587 20072 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:38.246682 19926 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:38.247125 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.247229 19926 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:38.249449 11854 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEARNER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:38.246271 20072 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Becoming Leader. State: Replica: 018d40ceb45d4447aa293f4c1d929bb8, State: Running, Role: LEADER
I20260709 12:13:38.250007 20178 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:38.250576 20178 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.250968 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.250913 20072 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.253892 20173 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:38.255128 19926 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:38.255300 20178 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.257120 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:38.264314 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.266106 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.269085 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f5b53b1974dc083d6b840e190fbf9" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.275063 11290 raft_consensus.cc:1275] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:38.282979  9938 raft_consensus.cc:2243] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.226586 11042 rpcz_store.cc:276] 0709 12:13:35.792723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.800237 (+  7514us) service_pool.cc:224] Handling call
0709 12:13:38.226074 (+2425837us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:37.940859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:37.941419 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:37.941492 (+    73us) write_op.cc:435] Acquired schema lock
0709 12:13:37.941504 (+    12us) tablet.cc:662] Decoding operations
0709 12:13:37.942418 (+   914us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:37.942805 (+   387us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:37.942852 (+    47us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:13:37.943744 (+   892us) tablet.cc:701] Row locks acquired
0709 12:13:37.943758 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:13:37.943930 (+   172us) write_op.cc:270] Start()
0709 12:13:37.944082 (+   152us) write_op.cc:276] Timestamp: P: 1783599217943877 usec, L: 0
0709 12:13:37.944099 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:13:37.944787 (+   688us) log.cc:844] Serialized 4005 byte log entry
0709 12:13:37.954185 (+  9398us) op_driver.cc:464] REPLICATION: finished
0709 12:13:37.954684 (+   499us) write_op.cc:301] APPLY: starting
0709 12:13:37.954767 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:37.959811 (+  5044us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:37.959906 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:38.027593 (+ 67687us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:38.027828 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:13:38.027873 (+    45us) write_op.cc:312] APPLY: finished
0709 12:13:38.028146 (+   273us) log.cc:844] Serialized 97 byte log entry
0709 12:13:38.028881 (+   735us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:38.029051 (+   170us) write_op.cc:454] Released schema lock
0709 12:13:38.029102 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:38.029464 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:38.029492 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":707203,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":274,"apply.run_cpu_time_us":12899,"apply.run_wall_time_us":74734,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41920,"num_ops":10,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":3953,"prepare.run_wall_time_us":5892,"replication_time_us":9954}]]}
I20260709 12:13:38.289673 11110 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.290525 19926 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:38.290446 20107 consensus_queue.cc:1048] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:38.291384 19926 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:38.296958 20146 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:38.297555 20146 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:38.304266 11856 raft_consensus.cc:1275] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:38.299002 20178 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:38.311437 20070 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:38.321271 20178 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.323624 20146 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:38.323438 20178 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.329408 19926 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:38.338259 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:38.339696 20175 consensus_queue.cc:1048] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:38.358589  9938 raft_consensus.cc:2272] T ee56790b88674a68962bb5866affcd4f P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.368865  9938 tablet_replica.cc:333] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.369678  9938 raft_consensus.cc:2243] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.372754  9938 raft_consensus.cc:2272] T f482641e4e2a4d109ab2f3acbbaebbb2 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:38.385355 11110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 95767.1us
I20260709 12:13:38.386173 11110 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.389168 11110 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:38.405786 11184 consensus_peers.cc:597] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.406455 11184 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.394547 20072 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:38.412065 20167 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:38.416251 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.419950 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa499c4330145abb0fb264ec515ea63" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.418397 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.418622 20187 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.421586 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.423681 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "809626de5a674cba911a83815f1e05ca" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.420423  9938 tablet_replica.cc:333] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
W20260709 12:13:38.424903 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.428403 11110 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.437355 20187 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:13:38.441260 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.448585 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:38.451224 20167 tablet_bootstrap.cc:492] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: Bootstrap complete.
I20260709 12:13:38.452158 20167 ts_tablet_manager.cc:1403] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent bootstrapping tablet: real 0.537s	user 0.035s	sys 0.017s
I20260709 12:13:38.454975 19926 raft_consensus.cc:493] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:38.455546 19926 raft_consensus.cc:515] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:38.456291 20167 raft_consensus.cc:359] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:38.457150 20167 raft_consensus.cc:740] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Initialized, Role: LEARNER
I20260709 12:13:38.457847 19926 leader_election.cc:290] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:38.458575  9938 raft_consensus.cc:2243] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.459559  9938 raft_consensus.cc:2272] T fab38430e77f4f78916480f9b0041989 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.459576 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:38.477873  9938 tablet_replica.cc:333] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
W20260709 12:13:38.478590 11184 consensus_peers.cc:597] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.478906  9938 raft_consensus.cc:2243] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:38.480253 11184 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:38.481950 11184 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.494767 20092 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.496682  9938 raft_consensus.cc:2272] T 382f5b53b1974dc083d6b840e190fbf9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.500527  9938 tablet_replica.cc:333] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.501536  9938 raft_consensus.cc:2243] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.502324  9938 pending_rounds.cc:70] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Trying to abort 1 pending ops.
W20260709 12:13:38.502594 11184 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.507182 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.499258 11039 catalog_manager.cc:5697] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 25 to 27, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 27 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:38.482749 20167 consensus_queue.cc:260] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:38.513653 20167 ts_tablet_manager.cc:1434] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:13:38.510106 11039 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: leader changed from <none> to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.502595  9938 pending_rounds.cc:77] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 29 index: 17 } timestamp: 7305622397982076928 op_type: NO_OP noop_request { }
I20260709 12:13:38.519469  9938 raft_consensus.cc:2889] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:38.519862 19926 raft_consensus.cc:493] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.520427 19926 raft_consensus.cc:515] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:38.521709  9938 raft_consensus.cc:2272] T a5303488c195434ca5cfdb88d6256a0c P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.514802 11852 raft_consensus.cc:2955] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.523970 11039 catalog_manager.cc:5697] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 27 to 29, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 29 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.528766 19926 leader_election.cc:290] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:38.530285 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:38.532670 11039 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 28 to 29, leader changed from ba2779405e8d452e95f42421b2b60928 (127.9.180.131) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 29 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:38.532683  9938 tablet_replica.cc:333] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.540674 11303 tablet_copy_service.cc:342] P ba2779405e8d452e95f42421b2b60928: Request end of tablet copy session 2b4f4725b82b481ab53f0717a429e94a-ca6e44c82eda4c299b22957102352a23 received from {username='slave'} at 127.0.0.1:49838
I20260709 12:13:38.542246 11303 tablet_copy_service.cc:434] P ba2779405e8d452e95f42421b2b60928: ending tablet copy session 2b4f4725b82b481ab53f0717a429e94a-ca6e44c82eda4c299b22957102352a23 on tablet ca6e44c82eda4c299b22957102352a23 with peer 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:38.544330  9938 raft_consensus.cc:2243] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.545876 11110 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.548105 20187 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:38.548646 11110 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.549441 20187 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:38.551005  9938 raft_consensus.cc:2272] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 018d40ceb45d4447aa293f4c1d929bb8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:38.556015 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.556967  9938 tablet_replica.cc:333] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.557971  9938 raft_consensus.cc:2243] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.560338 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1f091d9f19d495da80e2f33e1044577 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:38.595052  9938 pending_rounds.cc:70] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Trying to abort 3 pending ops.
I20260709 12:13:38.606377  9938 pending_rounds.cc:77] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305622359197384704 op_type: NO_OP noop_request { }
I20260709 12:13:38.610074  9938 raft_consensus.cc:2889] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:38.611915  9938 pending_rounds.cc:77] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 20 index: 15 } timestamp: 7305622340810014720 op_type: NO_OP noop_request { }
W20260709 12:13:38.604094 11184 consensus_peers.cc:597] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.598253 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.629758 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.632463  9938 raft_consensus.cc:2889] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:38.637514 20138 raft_consensus.cc:2955] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index 13 to 15, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.641495 11041 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 24 to 27, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129). New cstate: current_term: 27 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.648518 20092 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:38.649209 20092 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:38.654451 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:38.655529 20092 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:38.664855 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e017decd61a34a2cbc717412a4ed64ea" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.668097 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8857ecbbb0c7485d9d6ff255660d2547" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.671669 11852 raft_consensus.cc:2955] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 13 to 15, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.672825 11293 raft_consensus.cc:2955] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 13 to 15, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.638804  9938 pending_rounds.cc:77] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305622316904931328 op_type: NO_OP noop_request { }
I20260709 12:13:38.682837  9938 raft_consensus.cc:2889] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:38.683321  9938 raft_consensus.cc:2272] T 64dc7dbbc231456da11adb2c7a1dada9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.686344  9938 tablet_replica.cc:333] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
W20260709 12:13:38.703895 11184 consensus_peers.cc:597] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.717541 11110 leader_election.cc:304] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:38.725613 19926 raft_consensus.cc:2749] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:38.725672 11184 consensus_peers.cc:597] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.699623 11042 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "018d40ceb45d4447aa293f4c1d929bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } }
I20260709 12:13:38.733162 11110 leader_election.cc:304] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:38.734042 19926 raft_consensus.cc:2749] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:38.735323 11042 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index -1 to 12, NON_VOTER 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) added. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.744268  9938 raft_consensus.cc:2243] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.843513  9938 raft_consensus.cc:2272] T 8d5a128ee9974008ab01b0d55cfbb77e P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.862022 19926 raft_consensus.cc:493] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:38.863140 19926 raft_consensus.cc:515] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:38.865377 19926 leader_election.cc:290] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:38.867786 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.868829 11212 raft_consensus.cc:2393] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 30: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
I20260709 12:13:38.886237 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:38.893478  9938 tablet_replica.cc:333] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.900291 11041 catalog_manager.cc:5697] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 13 to 15, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.925213 11259 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:38.916098 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a24a63c03ef4eb980303acb738b9641" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:38.925813 11041 catalog_manager.cc:5697] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 17 to 18, VOTER 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) evicted. New cstate: current_term: 24 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:38.927526 20092 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:38.937808 11110 leader_election.cc:304] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:38.939013  9938 raft_consensus.cc:2243] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.941044 20187 raft_consensus.cc:2749] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:38.942441  9938 raft_consensus.cc:2272] T 92ccd088b1904dd1aae6563124beb655 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.945628  9938 tablet_replica.cc:333] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.946303 20092 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:38.947749 11852 raft_consensus.cc:1217] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 12:13:38.948242  9938 raft_consensus.cc:2243] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.948963  9938 raft_consensus.cc:2272] T 8857ecbbb0c7485d9d6ff255660d2547 P 018d40ceb45d4447aa293f4c1d929bb8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.951587  9938 tablet_replica.cc:333] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.952312  9938 raft_consensus.cc:2243] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.953233  9938 raft_consensus.cc:2272] T bc7de5348ade43f196ccf4a393cc5bb8 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.955875  9938 tablet_replica.cc:333] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.956650  9938 raft_consensus.cc:2243] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:13:38.957705  9938 raft_consensus.cc:2272] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.960475  9938 tablet_replica.cc:333] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.961278  9938 raft_consensus.cc:2243] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:13:38.962015 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.963367 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 62288.5us
I20260709 12:13:38.962268  9938 raft_consensus.cc:2272] T 14c3c7c84ef94275814f49349db79a72 P 018d40ceb45d4447aa293f4c1d929bb8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.966354  9938 tablet_replica.cc:333] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.983162  9938 raft_consensus.cc:2243] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:38.983935  9938 raft_consensus.cc:2272] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:38.987177  9938 tablet_replica.cc:333] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:38.997304 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet f1f091d9f19d495da80e2f33e1044577 with delete_type TABLET_DATA_TOMBSTONED (TS 5d1ee1ef054240338e0a9e05a67acdfc not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:38310
W20260709 12:13:38.998512 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.012702 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:39.013134  9938 raft_consensus.cc:2243] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.013892  9938 raft_consensus.cc:2272] T 59b9f42c7ee544898eee55760f7287b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.010448 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50656 (request call id 286) took 1922 ms. Trace:
I20260709 12:13:38.999244 20185 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.019649 20185 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.023720 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:39.019374 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:39.025652 11184 leader_election.cc:336] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.026173 11184 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:39.027139 20173 raft_consensus.cc:2749] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:39.027915 20173 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.028402 20173 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.029090  9938 tablet_replica.cc:333] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.029808 20185 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:39.018982 11039 rpcz_store.cc:276] 0709 12:13:37.087667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.091045 (+  3378us) service_pool.cc:224] Handling call
0709 12:13:39.010353 (+1919308us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:38.600740 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:38.601349 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:38.601405 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:13:38.601425 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:38.602123 (+   698us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:38.602186 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:38.602213 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:38.602684 (+   471us) tablet.cc:701] Row locks acquired
0709 12:13:38.602701 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:38.602850 (+   149us) write_op.cc:270] Start()
0709 12:13:38.603019 (+   169us) write_op.cc:276] Timestamp: P: 1783599218602809 usec, L: 0
0709 12:13:38.603047 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:13:38.603790 (+   743us) log.cc:844] Serialized 1764 byte log entry
0709 12:13:38.606053 (+  2263us) op_driver.cc:464] REPLICATION: finished
0709 12:13:38.606578 (+   525us) write_op.cc:301] APPLY: starting
0709 12:13:38.606659 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:38.609227 (+  2568us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:38.609331 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:38.613488 (+  4157us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:38.613705 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:13:38.613775 (+    70us) write_op.cc:312] APPLY: finished
0709 12:13:38.614414 (+   639us) log.cc:844] Serialized 49 byte log entry
0709 12:13:38.615310 (+   896us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:38.615438 (+   128us) write_op.cc:454] Released schema lock
0709 12:13:38.615489 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:38.615939 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:38.615969 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75685,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":288,"apply.run_cpu_time_us":6771,"apply.run_wall_time_us":9307,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16768,"num_ops":4,"prepare.queue_time_us":4692,"prepare.run_cpu_time_us":3377,"prepare.run_wall_time_us":5162,"replication_time_us":2890}]]}
I20260709 12:13:39.035542 20173 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.037083  9938 raft_consensus.cc:2243] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.037709  9938 raft_consensus.cc:2272] T 893ed9b3a6054165a7d66c6d7ae1249c P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.039063 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:39.039776 11288 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 30.
I20260709 12:13:39.040412  9938 tablet_replica.cc:333] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.045939 20187 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.047912  9938 raft_consensus.cc:2243] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.047560 20187 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } }
I20260709 12:13:39.048518  9938 raft_consensus.cc:2272] T 539267f9f49c4c16b3ec8b1c92be6d29 P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.049786 20187 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.041373 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:39.052845 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:39.053936 20173 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:39.054066 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:39.054447 20173 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.054893 20173 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:39.059512  9938 tablet_replica.cc:333] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.060322  9938 raft_consensus.cc:2243] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.060956  9938 raft_consensus.cc:2272] T 8ce10840f1d143948ae8836765fb74d1 P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.063074 11110 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:39.063812  9938 tablet_replica.cc:333] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.064123 20187 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.064721  9938 raft_consensus.cc:2243] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:39.065105 11184 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.065361  9938 raft_consensus.cc:2272] T e7c488a2c80e4e21bde9ae92cfae70b3 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.072046  9938 tablet_replica.cc:333] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.072811  9938 raft_consensus.cc:2243] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.073359  9938 raft_consensus.cc:2272] T 6250f2432a8a4fbb8c99e0f703ecd269 P 018d40ceb45d4447aa293f4c1d929bb8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.081539 19987 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.082141 19987 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.085184  9938 tablet_replica.cc:333] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.085942 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:39.087488 11258 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.087778 19987 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:39.088012 11256 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:39.088915 19987 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:39.082230 20173 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.086047  9938 raft_consensus.cc:2243] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.094909  9938 raft_consensus.cc:2272] T ec444005f2c247b18f21f2d9fcf7749e P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.112329 20173 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.114677 20187 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.115233 20187 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.116031 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2e22241c745b9aa339da0259546f0" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:39.116703 11288 raft_consensus.cc:3060] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:39.117225 20187 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.118981 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:39.119290 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f8f77c6e8c4a66b41088646a9c8c90" candidate_uuid: "018d40ceb45d4447aa293f4c1d929bb8" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:39.120807 11110 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 018d40ceb45d4447aa293f4c1d929bb8; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:39.121717  9938 tablet_replica.cc:333] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.122597  9938 raft_consensus.cc:2243] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.121918 20187 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:39.123232  9938 raft_consensus.cc:2272] T e017decd61a34a2cbc717412a4ed64ea P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.140511 20194 tablet_replica.cc:333] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:39.148185 11288 raft_consensus.cc:2468] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 31.
I20260709 12:13:39.150965  9938 tablet_replica.cc:333] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.166527  9938 raft_consensus.cc:2243] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.167388  9938 raft_consensus.cc:2272] T 1618626d8c194b9ea8b2ac9f3554b006 P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.167860 11185 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:39.168994 20173 raft_consensus.cc:2804] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:39.151877 20194 raft_consensus.cc:2243] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.170384 20173 raft_consensus.cc:697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:39.171262 20194 raft_consensus.cc:2272] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.172916  9938 tablet_replica.cc:333] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.173719  9938 raft_consensus.cc:2243] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.174196  9938 pending_rounds.cc:70] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Trying to abort 2 pending ops.
I20260709 12:13:39.174412  9938 pending_rounds.cc:77] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 27 index: 15 } timestamp: 7305622365796044800 op_type: NO_OP noop_request { }
I20260709 12:13:39.174765  9938 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:39.175015  9938 pending_rounds.cc:77] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7305622316861894656 op_type: NO_OP noop_request { }
I20260709 12:13:39.175302  9938 raft_consensus.cc:2889] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:39.175622  9938 raft_consensus.cc:2272] T 35f8f77c6e8c4a66b41088646a9c8c90 P 018d40ceb45d4447aa293f4c1d929bb8 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.176378 20173 consensus_queue.cc:237] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.19, Last appended by leader: 19, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.178730 20194 ts_tablet_manager.cc:1916] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:39.181143  9938 tablet_replica.cc:333] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.199359  9938 raft_consensus.cc:2243] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.200040  9938 raft_consensus.cc:2272] T 4fed3eea68d84fed917f13cdd6cc9820 P 018d40ceb45d4447aa293f4c1d929bb8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.203121  9938 tablet_replica.cc:333] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.203915  9938 raft_consensus.cc:2243] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.204483  9938 raft_consensus.cc:2272] T 86632bf64d844f6f8f1356ac45447bcc P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:39.188457 11184 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.232606  9938 tablet_replica.cc:333] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.233599  9938 raft_consensus.cc:2243] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.234549  9938 raft_consensus.cc:2272] T 6068dd70dc8045fc8ad3d39311dc7428 P 018d40ceb45d4447aa293f4c1d929bb8 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.238456 20194 ts_tablet_manager.cc:1929] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.17
I20260709 12:13:39.239823 20194 log.cc:1199] T f1f091d9f19d495da80e2f33e1044577 P 5d1ee1ef054240338e0a9e05a67acdfc: Deleting WAL directory at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/wals/f1f091d9f19d495da80e2f33e1044577
I20260709 12:13:39.241849 11029 catalog_manager.cc:5028] TS 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): tablet f1f091d9f19d495da80e2f33e1044577 (table test-workload [id=8a8afda7208d44b0999532d2e7694e6c]) successfully deleted
I20260709 12:13:39.257231  9938 tablet_replica.cc:333] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.261649  9938 raft_consensus.cc:2243] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:39.262952  9938 raft_consensus.cc:2272] T d969a53adb784388b9e0819cd9786e2f P 018d40ceb45d4447aa293f4c1d929bb8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.262583 11039 catalog_manager.cc:5697] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 29 to 31, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 31 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.275563  9938 tablet_replica.cc:333] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.276624  9938 raft_consensus.cc:2243] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.294219  9938 pending_rounds.cc:70] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Trying to abort 1 pending ops.
I20260709 12:13:39.294551  9938 pending_rounds.cc:77] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305622353602637824 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c0c432ae03684756b937dd1aa2541cbd" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: NON_VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: true } } } }
I20260709 12:13:39.307793  9938 raft_consensus.cc:2917] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Aborting config change with OpId 22.13: Aborted: Op aborted
I20260709 12:13:39.308509  9938 raft_consensus.cc:2889] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:13:39.308910  9938 raft_consensus.cc:2272] T c0c432ae03684756b937dd1aa2541cbd P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.318248  9938 tablet_replica.cc:333] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.335246  9938 raft_consensus.cc:2243] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.335996  9938 raft_consensus.cc:2272] T aaa499c4330145abb0fb264ec515ea63 P 018d40ceb45d4447aa293f4c1d929bb8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.339025  9938 tablet_replica.cc:333] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.339860  9938 raft_consensus.cc:2243] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.340575  9938 raft_consensus.cc:2272] T 7a24a63c03ef4eb980303acb738b9641 P 018d40ceb45d4447aa293f4c1d929bb8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.345765  9938 tablet_replica.cc:333] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.346593  9938 raft_consensus.cc:2243] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.347620 20173 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.348170 20173 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.350350 20173 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.351982 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:39.354540 11184 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.355038 11184 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:39.356159 20173 raft_consensus.cc:2749] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:39.364881  9938 raft_consensus.cc:2272] T 809626de5a674cba911a83815f1e05ca P 018d40ceb45d4447aa293f4c1d929bb8 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.369299  9938 tablet_replica.cc:333] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.378230  9938 raft_consensus.cc:2243] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.379288  9938 raft_consensus.cc:2272] T 923b3bc9b7424aa9bdc5a7952136dbba P 018d40ceb45d4447aa293f4c1d929bb8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.383961  9938 tablet_replica.cc:333] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.384824  9938 raft_consensus.cc:2243] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.385545  9938 raft_consensus.cc:2272] T ca6e44c82eda4c299b22957102352a23 P 018d40ceb45d4447aa293f4c1d929bb8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.388521  9938 tablet_replica.cc:333] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.399706  9938 raft_consensus.cc:2243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.400588  9938 raft_consensus.cc:2272] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.429224 20175 raft_consensus.cc:1064] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: attempting to promote NON_VOTER 2b4f4725b82b481ab53f0717a429e94a to VOTER
I20260709 12:13:39.432235 20175 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:39.434321 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:39.435727 20193 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.436285 20193 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.441753 20193 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:39.441959 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
W20260709 12:13:39.443267 11825 leader_election.cc:336] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.446652 11212 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 26.
I20260709 12:13:39.451001 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:39.453266  9938 tablet_replica.cc:333] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.454006 20193 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:39.454161  9938 raft_consensus.cc:2243] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.454478 20193 raft_consensus.cc:493] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.454906 20193 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:39.454887  9938 raft_consensus.cc:2272] T 557f4814dd3c4d4bb57340a9834ebd32 P 018d40ceb45d4447aa293f4c1d929bb8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.466861  9938 tablet_replica.cc:333] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.467811 20193 raft_consensus.cc:515] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:39.476676 11825 leader_election.cc:336] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.479820  9938 raft_consensus.cc:2243] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:39.481940  9938 raft_consensus.cc:2272] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 018d40ceb45d4447aa293f4c1d929bb8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.485374  9938 tablet_replica.cc:333] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8: stopping tablet replica
I20260709 12:13:39.489207 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d8da0a42f045c0919f6b93b4a3ca15" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:39.489858 11212 raft_consensus.cc:3060] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:39.492120 20193 leader_election.cc:290] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:39.497071 11212 raft_consensus.cc:2468] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 27.
I20260709 12:13:39.500969 11826 leader_election.cc:304] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:39.502729 19876 raft_consensus.cc:2804] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:39.503255 19876 raft_consensus.cc:697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 27 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:39.504158 19876 consensus_queue.cc:237] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.507181 11852 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 LEARNER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:39.509378 20092 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:39.512262 11212 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:39.515177 20092 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:39.496039  9938 raft_consensus.cc:2243] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:39.523545 11258 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:39.524988  9938 raft_consensus.cc:2272] T c4d8b59f386d4565b0103c44f0baa84d P 018d40ceb45d4447aa293f4c1d929bb8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:39.541673 20193 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.543360 20193 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.550375 20193 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:39.556206 11825 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:39.594895 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 63894.2us
I20260709 12:13:39.598927 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:39.599677 11288 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 17.
I20260709 12:13:39.616865 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:39.619346 20200 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:39.622968 20200 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.626830 19987 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.624457 20092 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:39.627424 19987 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.625471 20200 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:39.633476 19987 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:39.639173 11258 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.640818 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:39.643043 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:39.644562 20122 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:39.650070 20200 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.659484 11290 raft_consensus.cc:1275] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 31 index: 20. (index mismatch)
I20260709 12:13:39.671345 11039 catalog_manager.cc:5697] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 26 to 27, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 27 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.674265 11852 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:39.706179 20191 consensus_queue.cc:1048] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 12:13:39.680137 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:39.676201 11041 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 reported cstate change: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:39.714769 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:39.736016 11288 consensus_queue.cc:237] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.741011 19876 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.741618 19876 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:39.742271 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 97399.3us
I20260709 12:13:39.743739 19876 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:39.746042 11214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:39.747349 11216 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } attrs { replace: true } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:39.751230 11854 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:39.751526 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:39.752247 11288 raft_consensus.cc:3060] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:39.759070 20192 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.759662 20192 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.761197 20092 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:39.771004 20200 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:39.771116 11184 consensus_peers.cc:597] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:39.772187 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:39.772867 11854 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 27.
I20260709 12:13:39.774034 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:39.774989 20191 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:39.775439 20191 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.776126 20191 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:39.782575 11825 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.783118 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:39.784421 11288 raft_consensus.cc:2468] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:39.784847 20202 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:39.785809 11826 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:39.786798 11216 raft_consensus.cc:1275] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:39.790990 19876 raft_consensus.cc:2804] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:39.791589 19876 raft_consensus.cc:697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:39.792523 19876 consensus_queue.cc:237] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.795801 20192 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:39.802865 11825 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.804435 20175 consensus_queue.cc:1048] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:39.807497 20175 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:39.833153 11854 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:39.859184 11042 catalog_manager.cc:5697] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 17 to 18, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 18 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.897341 11216 raft_consensus.cc:2955] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
W20260709 12:13:39.902230 11184 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.903162 11042 catalog_manager.cc:5697] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: config changed from index 13 to 14, VOTER 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) evicted. New cstate: current_term: 21 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } } }
I20260709 12:13:39.907491 20192 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.908265 20192 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:39.906766 20191 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.910670 20192 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.912350 20191 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:39.919342 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee56790b88674a68962bb5866affcd4f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:39.920039 11854 raft_consensus.cc:3060] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:39.921694 19987 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.922264 19987 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.924543 19987 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:39.930019 11854 raft_consensus.cc:2468] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 28.
I20260709 12:13:39.931813 11182 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:39.932713 20185 raft_consensus.cc:2804] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:39.933218 20185 raft_consensus.cc:697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:39.934052 20185 consensus_queue.cc:237] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.934839 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:39.939222 19987 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.939877 19987 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:39.942185 11258 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.944519 11258 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:39.942149 19987 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:39.949209 11029 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca6e44c82eda4c299b22957102352a23 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:39.948542 20203 raft_consensus.cc:2749] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:39.961356 11258 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.967777 11216 raft_consensus.cc:1275] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:39.968261 20200 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.974103 20200 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:39.976478 20200 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:39.979447 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:39.979823 11825 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.980340 11290 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 22.
I20260709 12:13:39.981527 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:39.990479 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:39.991165 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:39.991182 11211 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 29.
W20260709 12:13:39.991200 11184 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.991919 11288 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 29.
W20260709 12:13:39.992789 11184 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:39.992834 20202 consensus_queue.cc:1048] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:39.984043 20200 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:39.994897 20200 raft_consensus.cc:493] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.995280 20200 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:39.995639 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:39.996879 20203 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:39.997282 20203 raft_consensus.cc:493] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:39.997630 20203 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:39.999275 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:40.001986 20191 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:40.002389 20191 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.002835 20191 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:40.005987 11028 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 53976.9us
W20260709 12:13:40.007781 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:13:40.041038 20203 raft_consensus.cc:515] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.057031 20203 leader_election.cc:290] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:40.060596 11258 leader_election.cc:336] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:40.063074 20191 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.073460 20191 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:40.074863 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5303488c195434ca5cfdb88d6256a0c" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:40.091477 11290 raft_consensus.cc:3060] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.078683 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f482641e4e2a4d109ab2f3acbbaebbb2" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:40.094830 11216 raft_consensus.cc:3060] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:40.084105 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.086978 20200 raft_consensus.cc:515] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:40.088021 11184 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:40.150823 11184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 62839us
I20260709 12:13:40.162048 20200 leader_election.cc:290] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:40.161640 11039 catalog_manager.cc:5697] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 27 to 28, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 28 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.162842 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b5563d41fc84c36a8d7eafa0e6a4968" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:40.163425 11288 raft_consensus.cc:3060] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.169871 11216 raft_consensus.cc:2468] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 30.
I20260709 12:13:40.168814 11290 raft_consensus.cc:2468] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 30.
I20260709 12:13:40.175730 20191 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.181367 20191 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.184859 11288 raft_consensus.cc:2468] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 23.
I20260709 12:13:40.186448 11826 leader_election.cc:304] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:40.187784 20202 raft_consensus.cc:2804] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:40.188287 20202 raft_consensus.cc:697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:40.188475 20173 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.189142 20202 consensus_queue.cc:237] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:40.189157 20173 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.193357 20173 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:40.201678 11259 leader_election.cc:304] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:40.201987 11185 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:40.204111 20185 raft_consensus.cc:2804] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:40.204766 20185 raft_consensus.cc:697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:40.207093 20191 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:40.216825 20175 raft_consensus.cc:2804] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:40.217442 20175 raft_consensus.cc:697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:40.218283 20175 consensus_queue.cc:237] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.221673 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:40.205804 20185 consensus_queue.cc:237] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.252249 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:40.253225 11288 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 21.
I20260709 12:13:40.287716 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:40.318200 11039 catalog_manager.cc:5697] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 22 to 23, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 23 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:40.328063 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 53143.3us
I20260709 12:13:40.329034 20185 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:40.329480 20185 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.329859 20185 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:40.344719 11825 leader_election.cc:336] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:40.346124 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.350378 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.361270 11288 raft_consensus.cc:1275] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:40.399653 11042 catalog_manager.cc:5697] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 29 to 30, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 30 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:40.384786 19876 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.413903 19876 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:40.417730 20221 log.cc:927] Time spent T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:13:40.417954 11184 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:40.420607 20175 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.421270 20175 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.395198 20193 consensus_queue.cc:1048] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
W20260709 12:13:40.425160 11184 consensus_peers.cc:597] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.425763 11184 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:40.426208 11184 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:40.427209 20211 raft_consensus.cc:2749] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:40.433535 20175 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:40.434660 20192 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.435273 20192 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.437288 20192 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:40.438534 20226 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.440510 20226 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:40.440205 11041 catalog_manager.cc:5697] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 26 to 30. New cstate: current_term: 30 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:40.449714 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.450796 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 52729.7us
W20260709 12:13:40.451680 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 121859us
I20260709 12:13:40.457762 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:40.416275 19876 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:40.458611 11212 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 29.
I20260709 12:13:40.465451 11217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:40.466146 11217 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:13:40.470005 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:40.479537 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 
I20260709 12:13:40.480751 20231 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:40.481355 20231 raft_consensus.cc:493] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.481875 20231 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:40.495599 20185 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.497820 20185 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:40.498941 20226 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:40.514436 20224 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:40.514935 20224 raft_consensus.cc:493] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.515295 20224 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:40.572973 11259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 95145.3us
W20260709 12:13:40.584631 11258 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:40.585227 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:40.628742 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.629267 11825 leader_election.cc:336] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:40.629590 11855 raft_consensus.cc:1275] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
W20260709 12:13:40.647287 11184 consensus_peers.cc:597] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.647821 11184 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:40.648429 11184 leader_election.cc:336] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:40.649449 11184 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.649854 11184 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:40.650277 11184 consensus_peers.cc:597] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.659897 11288 raft_consensus.cc:1275] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:40.659979 20231 raft_consensus.cc:515] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:40.662166 20231 leader_election.cc:290] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:40.662968 20224 raft_consensus.cc:515] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.664109 11852 raft_consensus.cc:2393] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 20: Already voted for candidate 2b4f4725b82b481ab53f0717a429e94a in this term.
I20260709 12:13:40.668255 20234 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.677024 20234 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:40.677992 20224 leader_election.cc:290] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:40.679123 20234 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:40.673708 20191 consensus_queue.cc:1048] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.007s
I20260709 12:13:40.668885 19876 consensus_queue.cc:1048] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 12:13:40.688910 11182 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:40.690145 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:40.691162 11289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab38430e77f4f78916480f9b0041989" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:40.691747 11289 raft_consensus.cc:3060] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:40.730273 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:40.734637 11290 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 23.
I20260709 12:13:40.749694 11214 raft_consensus.cc:1275] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:40.752044 11211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c3c7c84ef94275814f49349db79a72" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:40.770782 11289 raft_consensus.cc:2468] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 22.
I20260709 12:13:40.747488 20210 raft_consensus.cc:3060] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:40.849623 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 153990us
I20260709 12:13:40.861466 11212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2864b976ac5946a7b7a41c9a5e2f7f26" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:40.863516 11212 raft_consensus.cc:3060] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:40.868010 11216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" is_pre_election: true
I20260709 12:13:40.869359 11216 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 23.
I20260709 12:13:40.886466 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
W20260709 12:13:40.899194 11184 consensus_peers.cc:597] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:40.912045 11212 raft_consensus.cc:2468] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 30.
I20260709 12:13:40.939146 20225 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:40.939932 20225 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:40.940470 20225 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:40.970695 11258 leader_election.cc:336] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:40.971599 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:40.973824 11825 leader_election.cc:336] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:40.937594 20224 consensus_queue.cc:1048] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.062s
I20260709 12:13:41.017556 20210 raft_consensus.cc:2749] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:41.056074 11258 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:41.064582 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.065320 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.075635 11211 raft_consensus.cc:2468] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 20.
W20260709 12:13:41.095170 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 153426us
W20260709 12:13:41.132010 11184 consensus_peers.cc:597] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.137019 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:13:41.122377 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:41.143440 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.153728 20248 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:41.154551 20248 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 018d40ceb45d4447aa293f4c1d929bb8)
I20260709 12:13:41.155138 20248 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:41.169543 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.178077 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.183030 20225 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:41.221303 20248 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:41.233269 20225 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:41.234388 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.240338 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:41.252949 11184 consensus_peers.cc:597] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.262238 20248 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:41.268955 11826 leader_election.cc:304] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:13:41.270428 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:41.272418 20247 raft_consensus.cc:2804] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:41.273180 20247 raft_consensus.cc:697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:41.274415 20247 consensus_queue.cc:237] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:41.276136 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.276875 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.284808  9938 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11165)
I20260709 12:13:41.280797 11185 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
W20260709 12:13:41.317240 11185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 63161.4us
I20260709 12:13:41.317242 20192 raft_consensus.cc:2804] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:41.318332 20192 raft_consensus.cc:697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:41.320319 20192 consensus_queue.cc:237] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:41.324333 11293 raft_consensus.cc:1275] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
W20260709 12:13:41.324981 11184 consensus_peers.cc:597] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.331661 11184 consensus_peers.cc:597] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.332454 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:41.333268 11293 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d1ee1ef054240338e0a9e05a67acdfc in current term 24: Already voted for candidate ba2779405e8d452e95f42421b2b60928 in this term.
I20260709 12:13:41.338188 11259 leader_election.cc:304] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:41.343868 20225 raft_consensus.cc:2804] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:41.344555 20225 raft_consensus.cc:697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:41.345577 20225 consensus_queue.cc:237] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:41.348376 11184 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.348943 11184 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.349375 11184 consensus_peers.cc:597] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.384752 11215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5d1ee1ef054240338e0a9e05a67acdfc"
I20260709 12:13:41.385602 11215 raft_consensus.cc:2393] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ba2779405e8d452e95f42421b2b60928 in current term 24: Already voted for candidate 5d1ee1ef054240338e0a9e05a67acdfc in this term.
W20260709 12:13:41.393854 11184 consensus_peers.cc:597] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.405248 11184 consensus_peers.cc:597] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.405835 11184 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.406294 11184 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.407344 11184 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:41.412173 20246 consensus_queue.cc:1048] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:41.424448 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:41.425472 20235 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:41.428743 11041 catalog_manager.cc:5697] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 29 to 30, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 30 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.445449 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:41.446373 20224 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:41.439267 11042 catalog_manager.cc:5697] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 19 to 20, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 20 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:41.505398 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.515754 11184 consensus_peers.cc:597] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.556830 11039 catalog_manager.cc:5697] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 21 to 22, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 22 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:41.576292 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.630712 11184 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:41.631379 11184 consensus_peers.cc:597] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:41.679850 11215 raft_consensus.cc:1275] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:41.681962 20200 consensus_queue.cc:1048] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:41.781525 11825 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.801805 11288 raft_consensus.cc:1275] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:41.803335 20246 consensus_queue.cc:1048] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:13:41.820134 11184 consensus_peers.cc:597] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:41.824014 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:41.857327 11258 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:41.875594 11215 raft_consensus.cc:1275] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:13:41.942808 20238 consensus_queue.cc:1048] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:41.980113 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:42.000392 11184 consensus_peers.cc:597] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:42.245371 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.286562  9938 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11165)
W20260709 12:13:42.500486 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.530346 11182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:46563, user_credentials={real_user=slave}} blocked reactor thread for 46553.2us
W20260709 12:13:42.693560 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.739979 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.778355 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.795387 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:42.978092 20271 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.978772 20271 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:42.984272 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:42.984920 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 24.
I20260709 12:13:42.986478 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:42.987888 20248 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:42.988327 20248 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.988703 20248 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:42.989642 11184 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:42.994009 20271 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:43.011292 11184 consensus_peers.cc:597] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.014322 11184 consensus_peers.cc:597] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.020267 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.040256 11184 consensus_peers.cc:597] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:43.040506 20248 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:43.052182 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:43.052382 20248 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Requested vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:43.054857 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d969a53adb784388b9e0819cd9786e2f" candidate_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:43.055539 11286 raft_consensus.cc:3060] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:43.064152 11184 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:43.068312 11286 raft_consensus.cc:2468] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1ee1ef054240338e0a9e05a67acdfc in term 25.
I20260709 12:13:43.076936 11185 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8
I20260709 12:13:43.079072 20248 raft_consensus.cc:2804] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:43.080601 20248 raft_consensus.cc:697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Becoming Leader. State: Replica: 5d1ee1ef054240338e0a9e05a67acdfc, State: Running, Role: LEADER
I20260709 12:13:43.081861 20248 consensus_queue.cc:237] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:43.124821 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.133777 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:43.192131 11042 catalog_manager.cc:5697] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc reported cstate change: term changed from 23 to 25, leader changed from 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129) to 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130). New cstate: current_term: 25 leader_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:43.217238 11258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111) [suppressed 439 similar messages]
W20260709 12:13:43.233065 11258 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.287096  9938 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 11165)
W20260709 12:13:43.305346 11184 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.338346 11184 consensus_peers.cc:597] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.376446 11184 consensus_peers.cc:597] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.387359 11184 consensus_peers.cc:597] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.402091 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.432195 11184 consensus_peers.cc:597] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.481509 11184 consensus_peers.cc:597] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.496367 11184 consensus_peers.cc:597] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.496994 11184 consensus_peers.cc:597] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.507272 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.570740 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.574878 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:43.591144 11286 raft_consensus.cc:1275] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Refusing update from remote peer 5d1ee1ef054240338e0a9e05a67acdfc: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:43.593318 20270 consensus_queue.cc:1048] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:43.594728 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.597108 11184 consensus_peers.cc:597] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.614387 11184 consensus_peers.cc:597] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.621215 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.630362 11184 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.651826 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.686328 11184 consensus_peers.cc:597] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:43.726382 11184 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.789340 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.807545 11184 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.832582 11184 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.985194 11184 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.985808 11184 consensus_peers.cc:597] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.096522 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.142825 11184 consensus_peers.cc:597] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.143646 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.169627 11825 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:44.222922 11258 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:44.260315 11184 consensus_peers.cc:597] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.287635  9938 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 11165)
W20260709 12:13:44.305716 11184 consensus_peers.cc:597] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:44.461369 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.504249 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:44.688035 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:44.770529 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.083068 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.150811 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.233851 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.255877 11028 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 52840.8us
W20260709 12:13:45.258692 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:45.282763 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.288214  9938 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 11165)
W20260709 12:13:45.541877 11184 consensus_peers.cc:597] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.564137 11184 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.670331 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.701179 11184 consensus_peers.cc:597] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.721549 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.738312 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.741124 11184 consensus_peers.cc:597] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.746084 11258 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.747710 11184 consensus_peers.cc:597] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.758392 11184 consensus_peers.cc:597] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.771581 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.861608 11184 consensus_peers.cc:597] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.862323 11184 consensus_peers.cc:597] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:45.870759 11184 consensus_peers.cc:597] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.871387 11184 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.929405 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:45.935716 11184 consensus_peers.cc:597] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:45.976089 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.013634 11184 consensus_peers.cc:597] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.014401 11184 consensus_peers.cc:597] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.082691 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.101989 11184 consensus_peers.cc:597] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.115615 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:46.191071 11184 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.227170 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.245657 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.247238 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.263108 11184 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.280628 11184 consensus_peers.cc:597] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.288782  9938 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 11165)
W20260709 12:13:46.387910 11184 consensus_peers.cc:597] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:46.450655 11184 consensus_peers.cc:597] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.470928 11825 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:46.585582 11258 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:46.586802 11184 consensus_peers.cc:597] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:46.591150 11184 consensus_peers.cc:597] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.601202 11184 consensus_peers.cc:597] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.668802 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.676534 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:46.896755 11184 consensus_peers.cc:597] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:46.937101 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:46.965634 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:47.236019 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:47.289328  9938 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 11165)
W20260709 12:13:47.487509 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:47.627502 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:47.630226  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
W20260709 12:13:47.665589 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:47.678092 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:47.815049 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:47.901552 11184 consensus_peers.cc:597] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:47.939747 11184 consensus_peers.cc:597] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.006304 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.086817 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.106473 11184 consensus_peers.cc:597] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:48.011153  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
W20260709 12:13:48.113677 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.149480 11184 consensus_peers.cc:597] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.173061 11259 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.195268 11826 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.226071 11258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111) [suppressed 471 similar messages]
W20260709 12:13:48.229923 11258 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.261538 11826 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.277771 11826 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.326437 11259 consensus_peers.cc:597] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.347095 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:48.363019  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:48.364256  9938 tablet_replica.cc:333] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.365869  9938 raft_consensus.cc:2243] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.366612  9938 raft_consensus.cc:2272] T 84d8da0a42f045c0919f6b93b4a3ca15 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.370260 11184 consensus_peers.cc:597] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.377492 11826 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.380473  9938 tablet_replica.cc:333] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.381445  9938 raft_consensus.cc:2243] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.382092  9938 raft_consensus.cc:2272] T cbfeda1095314856b34426f3195f5c23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.390755 11259 consensus_peers.cc:597] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.401021  9938 tablet_replica.cc:333] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.402069  9938 raft_consensus.cc:2243] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.403102  9938 raft_consensus.cc:2272] T 255c201215d14e89bc735bb8b57682cb P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.405856  9938 tablet_replica.cc:333] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
W20260709 12:13:48.406582 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:48.426218 11184 consensus_peers.cc:597] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.436848 11826 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.440388 11184 consensus_peers.cc:597] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.443960 11259 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.446739  9938 raft_consensus.cc:2243] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.448016  9938 raft_consensus.cc:2272] T 776da81ff0064a87b29c2949e7bc5291 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.463539  9938 tablet_replica.cc:333] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.464746  9938 raft_consensus.cc:2243] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.465941  9938 raft_consensus.cc:2272] T ee56790b88674a68962bb5866affcd4f P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.469179  9938 tablet_replica.cc:333] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
W20260709 12:13:48.465868 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.473500 11184 consensus_peers.cc:597] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.474138 11184 consensus_peers.cc:597] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.483074 11184 consensus_peers.cc:597] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:48.520227 11184 consensus_peers.cc:597] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.520826 11259 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.520301  9938 raft_consensus.cc:2243] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:13:48.522384 11259 consensus_peers.cc:597] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.523351 11259 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.534955  9938 raft_consensus.cc:2272] T d3619bd8cdd6482dad222b2265b94b48 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.540184  9938 tablet_replica.cc:333] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.546650  9938 raft_consensus.cc:2243] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.547586  9938 raft_consensus.cc:2272] T 25bbe9f3cd6e42aca82fdba9812b235c P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.550372  9938 tablet_replica.cc:333] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.559149  9938 raft_consensus.cc:2243] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:48.559712 11259 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.559899  9938 raft_consensus.cc:2272] T 8857ecbbb0c7485d9d6ff255660d2547 P 5d1ee1ef054240338e0a9e05a67acdfc [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.560678 11259 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.561533 11259 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.570513  9938 tablet_replica.cc:333] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.572821  9938 raft_consensus.cc:2243] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:13:48.578251 11259 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:48.580053 11259 consensus_peers.cc:597] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.580142  9938 raft_consensus.cc:2272] T d9d29c78e55e4b76a84881d4f97aaec8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.589573  9938 tablet_replica.cc:333] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.590471  9938 raft_consensus.cc:2243] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.591277  9938 raft_consensus.cc:2272] T f482641e4e2a4d109ab2f3acbbaebbb2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.611371  9938 tablet_replica.cc:333] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.612263  9938 raft_consensus.cc:2243] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.613031  9938 raft_consensus.cc:2272] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.623907  9938 tablet_replica.cc:333] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
W20260709 12:13:48.624051 11184 consensus_peers.cc:597] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:48.624830  9938 raft_consensus.cc:2243] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 LEADER]: Raft consensus shutting down.
W20260709 12:13:48.640264 11259 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.641233  9938 raft_consensus.cc:2272] T 2fa9c55aa9ba49cc82db376e55f14ecc P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.643918 11184 consensus_peers.cc:597] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:48.646263  9938 tablet_replica.cc:333] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.647213  9938 raft_consensus.cc:2243] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:48.649377 11184 consensus_peers.cc:597] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.653299 11826 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.667079  9938 raft_consensus.cc:2272] T 14c3c7c84ef94275814f49349db79a72 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.673830  9938 tablet_replica.cc:333] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
W20260709 12:13:48.675935 11259 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:48.674826  9938 raft_consensus.cc:2243] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.679486  9938 raft_consensus.cc:2272] T 9a38aa6d0e35417db86aadc82bb36b04 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.692368  9938 tablet_replica.cc:333] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.693454  9938 raft_consensus.cc:2243] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.694758  9938 raft_consensus.cc:2272] T fab38430e77f4f78916480f9b0041989 P 5d1ee1ef054240338e0a9e05a67acdfc [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.719331 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.735884 11184 consensus_peers.cc:597] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:48.746166 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.757838 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:48.756265  9938 tablet_replica.cc:333] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.760891  9938 raft_consensus.cc:2243] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.776800  9938 raft_consensus.cc:2272] T 382f5b53b1974dc083d6b840e190fbf9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.793850  9938 tablet_replica.cc:333] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.794647  9938 raft_consensus.cc:2243] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.795790  9938 raft_consensus.cc:2272] T a5303488c195434ca5cfdb88d6256a0c P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.806070 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:48.811385  9938 tablet_replica.cc:333] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.812366  9938 raft_consensus.cc:2243] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.813122  9938 raft_consensus.cc:2272] T 9948214ce1cd45429598d228699aa5a8 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:48.824293 11184 consensus_peers.cc:597] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:48.829385 11825 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:48.851984  9938 tablet_replica.cc:333] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.869211  9938 raft_consensus.cc:2243] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.869903  9938 raft_consensus.cc:2272] T 539267f9f49c4c16b3ec8b1c92be6d29 P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.895730  9938 tablet_replica.cc:333] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.897101  9938 raft_consensus.cc:2243] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.898655  9938 raft_consensus.cc:2272] T 64dc7dbbc231456da11adb2c7a1dada9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.901651  9938 tablet_replica.cc:333] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.902458  9938 raft_consensus.cc:2243] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.903625  9938 raft_consensus.cc:2272] T 8d5a128ee9974008ab01b0d55cfbb77e P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.906621  9938 tablet_replica.cc:333] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.907454  9938 raft_consensus.cc:2243] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.908545  9938 raft_consensus.cc:2272] T e7c488a2c80e4e21bde9ae92cfae70b3 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.911460  9938 tablet_replica.cc:333] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.912201  9938 raft_consensus.cc:2243] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.912819  9938 raft_consensus.cc:2272] T ec444005f2c247b18f21f2d9fcf7749e P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.915764  9938 tablet_replica.cc:333] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.918783  9938 raft_consensus.cc:2243] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.919524  9938 raft_consensus.cc:2272] T e017decd61a34a2cbc717412a4ed64ea P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.922631  9938 tablet_replica.cc:333] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.923763  9938 raft_consensus.cc:2243] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.924335  9938 raft_consensus.cc:2272] T 893ed9b3a6054165a7d66c6d7ae1249c P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.927148  9938 tablet_replica.cc:333] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.927889  9938 raft_consensus.cc:2243] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.928999  9938 raft_consensus.cc:2272] T 1618626d8c194b9ea8b2ac9f3554b006 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.932448  9938 tablet_replica.cc:333] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.933444  9938 raft_consensus.cc:2243] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.934710  9938 raft_consensus.cc:2272] T 7bea72104a4f4494b28f5e58c9ce7e41 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.937574  9938 tablet_replica.cc:333] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.938369  9938 raft_consensus.cc:2243] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.939625  9938 raft_consensus.cc:2272] T 35f8f77c6e8c4a66b41088646a9c8c90 P 5d1ee1ef054240338e0a9e05a67acdfc [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.942554  9938 tablet_replica.cc:333] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.943343  9938 raft_consensus.cc:2243] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.944044  9938 raft_consensus.cc:2272] T a98f617dcc31482f9ed419423e8b50d5 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.946931  9938 tablet_replica.cc:333] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.947698  9938 raft_consensus.cc:2243] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.948395  9938 raft_consensus.cc:2272] T 2864b976ac5946a7b7a41c9a5e2f7f26 P 5d1ee1ef054240338e0a9e05a67acdfc [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.951053  9938 tablet_replica.cc:333] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.951833  9938 raft_consensus.cc:2243] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.953526  9938 raft_consensus.cc:2272] T c0c432ae03684756b937dd1aa2541cbd P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.956228  9938 tablet_replica.cc:333] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.956971  9938 raft_consensus.cc:2243] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.958084  9938 raft_consensus.cc:2272] T aaa499c4330145abb0fb264ec515ea63 P 5d1ee1ef054240338e0a9e05a67acdfc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.960834  9938 tablet_replica.cc:333] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.961650  9938 raft_consensus.cc:2243] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:48.962261  9938 raft_consensus.cc:2272] T 6068dd70dc8045fc8ad3d39311dc7428 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.964938  9938 tablet_replica.cc:333] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.965723  9938 raft_consensus.cc:2243] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.966881  9938 raft_consensus.cc:2272] T d969a53adb784388b9e0819cd9786e2f P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:48.969393  9938 tablet_replica.cc:333] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:48.970229  9938 raft_consensus.cc:2243] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:13:48.971268  9938 raft_consensus.cc:2272] T 5fd2e22241c745b9aa339da0259546f0 P 5d1ee1ef054240338e0a9e05a67acdfc [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:49.048949 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:49.046854 11184 consensus_peers.cc:597] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:49.159953  9938 tablet_replica.cc:333] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.160884  9938 raft_consensus.cc:2243] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.161934  9938 raft_consensus.cc:2272] T c75d2c70008a4d06a2db7185a2b623e2 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:49.166451 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:49.167004 11258 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:49.181424  9938 tablet_replica.cc:333] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.182636  9938 raft_consensus.cc:2243] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:49.196336  9938 raft_consensus.cc:2272] T 7a24a63c03ef4eb980303acb738b9641 P 5d1ee1ef054240338e0a9e05a67acdfc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.201812  9938 tablet_replica.cc:333] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.204638  9938 raft_consensus.cc:2243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.215374  9938 raft_consensus.cc:2272] T ddd0a7b2bb3645519f8c5c9bf85633d9 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.219075  9938 tablet_replica.cc:333] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.225371  9938 raft_consensus.cc:2243] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.226783  9938 raft_consensus.cc:2272] T f9943fa4bd634a79a891fa52086a527a P 5d1ee1ef054240338e0a9e05a67acdfc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.240325  9938 tablet_replica.cc:333] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.242570  9938 raft_consensus.cc:2243] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:49.243880  9938 raft_consensus.cc:2272] T ca6e44c82eda4c299b22957102352a23 P 5d1ee1ef054240338e0a9e05a67acdfc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.252579  9938 tablet_replica.cc:333] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.253607  9938 raft_consensus.cc:2243] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:49.254390  9938 raft_consensus.cc:2272] T a67ed18056054cad98bdf3dd430e6577 P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.273784  9938 tablet_replica.cc:333] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.276345  9938 raft_consensus.cc:2243] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:49.277624  9938 raft_consensus.cc:2272] T 923b3bc9b7424aa9bdc5a7952136dbba P 5d1ee1ef054240338e0a9e05a67acdfc [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.281745  9938 tablet_replica.cc:333] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.282692  9938 raft_consensus.cc:2243] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.284126  9938 raft_consensus.cc:2272] T 809626de5a674cba911a83815f1e05ca P 5d1ee1ef054240338e0a9e05a67acdfc [term 33 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:49.286844 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:49.287576  9938 tablet_replica.cc:333] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.288615  9938 raft_consensus.cc:2243] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.290235  9938 raft_consensus.cc:2272] T c4d8b59f386d4565b0103c44f0baa84d P 5d1ee1ef054240338e0a9e05a67acdfc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.295065  9938 tablet_replica.cc:333] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.296046  9938 raft_consensus.cc:2243] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:49.296908  9938 raft_consensus.cc:2272] T f6e27c7f8a6b4e82a1ffee4fc5743515 P 5d1ee1ef054240338e0a9e05a67acdfc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.300366  9938 tablet_replica.cc:333] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.301348  9938 raft_consensus.cc:2243] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.303257  9938 raft_consensus.cc:2272] T 557f4814dd3c4d4bb57340a9834ebd32 P 5d1ee1ef054240338e0a9e05a67acdfc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.313843  9938 tablet_replica.cc:333] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.314848  9938 raft_consensus.cc:2243] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.316290  9938 raft_consensus.cc:2272] T 86632bf64d844f6f8f1356ac45447bcc P 5d1ee1ef054240338e0a9e05a67acdfc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:49.321604  9938 tablet_replica.cc:333] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc: stopping tablet replica
I20260709 12:13:49.322427  9938 raft_consensus.cc:2243] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:49.323879  9938 raft_consensus.cc:2272] T 4fed3eea68d84fed917f13cdd6cc9820 P 5d1ee1ef054240338e0a9e05a67acdfc [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:49.431221 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:49.522558 20200 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.523329 20200 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:49.535717 20200 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:49.541333 11825 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:49.551039 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:49.551460 11826 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:49.553551 11826 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.557296 20291 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:49.599340 20200 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.599900 20200 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:49.602103 20200 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:49.611398 20293 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:49.611630 11825 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:49.612105 20293 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:49.622514 11259 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.625866 20293 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:49.630030 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:49.632254 11256 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.633620 20295 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:49.654151 20295 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.654729 20295 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:49.657902 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:49.659642 20295 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:49.661628 11258 leader_election.cc:336] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:49.674032 11259 leader_election.cc:336] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.674571 11259 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.675256 20295 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:13:49.666082 11826 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.681972 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.682693 20291 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:49.710139 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:49.866452 20291 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.867079 20291 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:49.882553 11825 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:49.894632 20293 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.895237 20293 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:49.897575 20293 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:49.911307 20291 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:49.911568 11258 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:49.912142 11259 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.912345 20295 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.912576 11259 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.912844 20295 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:49.913378 20289 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:49.914976 20295 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:49.920538 11258 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:49.931732 11259 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.932317 11259 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.933179 20295 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:49.935186 11826 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.935691 11826 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.936432 20200 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:49.937418 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:49.947682 20295 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.948196 20295 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:49.951555 20295 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:49.954227 11258 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:49.959048 20200 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.959525 20200 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:49.961529 20200 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:49.963763 11259 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.964267 11259 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.967173 20295 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:49.965054 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:49.967864 11288 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 27.
W20260709 12:13:49.970034 11826 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.971210 20295 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.971783 20295 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:49.973246 20289 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.973986 20295 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:49.973891 20289 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:49.976325 20289 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:49.977035 20289 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.977501 20289 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:49.979651 20289 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:49.985705 11259 leader_election.cc:336] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.970867 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.987614 20200 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:49.987943 20200 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:49.988246 20200 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:49.988579 11258 leader_election.cc:336] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:49.989009 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:49.989864 11258 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:49.992383 11259 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:49.994144 11259 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:49.999372 20293 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:49.992435 20295 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:49.994830 20301 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.000221 20301 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.002370 20301 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:50.002897 20301 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.003381 20301 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.008915 20301 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:50.012250 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:50.014901 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:49.996064 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:49.998374 20200 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.017516 20200 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:50.018119 11259 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.018941 11259 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.020396 20295 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:50.022799 20289 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.023264 20289 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.025251 20289 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:50.029788 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:50.030503 11854 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 21.
I20260709 12:13:50.031639 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:50.033711 20293 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:50.036116 11259 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.037165 20293 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.037608 20293 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:50.043170 20289 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.043708 20289 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:50.045822 20289 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:50.048827 20289 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.049300 20289 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:50.050529 11259 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:50.054628 11826 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.057729 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:50.071774 11826 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.074642 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:50.055105 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:50.075425 20301 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:50.057163 20289 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:50.056044 11259 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.058959 20295 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.077515 20295 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:50.079739 20295 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:50.079907 11826 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:50.070122 11314 debug-util.cc:398] Leaking SignalData structure 0x7b080015b5a0 after lost signal to thread 9941
I20260709 12:13:50.072556 20200 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:50.088376 11854 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 26.
W20260709 12:13:50.088495 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8b20 after lost signal to thread 11076
W20260709 12:13:50.089375 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08000f19a0 after lost signal to thread 11243
I20260709 12:13:50.056352 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:50.089869 11288 raft_consensus.cc:3060] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:50.090552 11314 debug-util.cc:398] Leaking SignalData structure 0x7b080031fe00 after lost signal to thread 11317
W20260709 12:13:50.091832 11314 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6320 after lost signal to thread 11885
W20260709 12:13:50.086030 11259 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.101606 11288 raft_consensus.cc:2468] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 28.
I20260709 12:13:50.103261 11826 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:50.067239 11258 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:50.108395 20200 raft_consensus.cc:2804] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:50.068982 20293 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.108908 20200 raft_consensus.cc:697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 28 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
I20260709 12:13:50.109730 20200 consensus_queue.cc:237] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.111755 20293 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:50.113696 20301 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.116428 20301 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.122619 20291 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.123106 20291 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.125387 20301 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:50.129217 20291 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:50.139410 11259 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:50.140578 11825 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:50.141196 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:50.145203 20289 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.108209 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.146364 20289 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:50.149833 20200 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.150372 20200 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.151190 20289 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:50.152456 20200 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:50.146778 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 79569.1us
I20260709 12:13:50.147279 20293 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:13:50.159881 11259 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:50.160135 11826 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.160627 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.161965 20291 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:50.162993 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
W20260709 12:13:50.156834 11825 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:50.172606 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:50.186627 11039 catalog_manager.cc:5697] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 27 to 28, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 28 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:50.189934 11258 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:50.191977 20293 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:50.189918 11826 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.193205 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.192979 20293 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.193749 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.194576 20289 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:50.195534 20293 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:50.195595 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:50.196393 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:50.200242 11259 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.199873 20293 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:50.211244 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.212102 20289 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:50.212530 20289 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.212888 20289 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.213279 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d29c78e55e4b76a84881d4f97aaec8" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:50.213946 11854 raft_consensus.cc:3060] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:50.223402 20302 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.224071 20302 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.228883 20289 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.229933 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:50.230784 11855 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 17.
I20260709 12:13:50.233767 11854 raft_consensus.cc:2468] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 22.
W20260709 12:13:50.235267 11259 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:50.236475 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:50.240914 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51027.7us
W20260709 12:13:50.241546 11826 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.242005 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:50.242926 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a38aa6d0e35417db86aadc82bb36b04" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:50.243603 11854 raft_consensus.cc:3060] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.245339 20200 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:50.249764 20302 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:50.253372 20291 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:50.254040 11258 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:50.256362 11259 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.256817 11259 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.257925 20293 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:50.244490 20289 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:50.267678 11854 raft_consensus.cc:2468] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 27.
I20260709 12:13:50.272979 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.274243 11256 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.275403 20295 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:50.275867 20295 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.276319 20295 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:50.279805 20293 raft_consensus.cc:2804] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:50.280475 20293 raft_consensus.cc:697] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:50.281607 20293 consensus_queue.cc:237] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.292892 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:50.293735 11854 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
I20260709 12:13:50.292799 11256 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.297726 20302 raft_consensus.cc:2804] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:50.298306 20302 raft_consensus.cc:697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:50.299324 20302 consensus_queue.cc:237] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.346115 20291 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.349584 20291 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.351429 20301 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.352187 20301 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:50.356046 20291 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:50.358548 20307 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:50.359109 20307 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:50.366966 20307 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:50.367688 11825 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:50.377245 20301 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:50.349153 20295 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:50.381362 11259 leader_election.cc:336] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:50.387095 20295 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:50.389690 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:50.390427 11854 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:50.396283 11259 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:50.400115 11258 leader_election.cc:336] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:50.400687 11258 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:50.433408 11854 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 18.
W20260709 12:13:52.308233  9938 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11240)
I20260709 12:13:52.443689 20315 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.442289 11039 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48006 (request call id 187) took 2272 ms. Trace:
I20260709 12:13:52.533495 20317 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.533603 20314 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.537813 20317 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.541857 20317 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.538285 20314 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.537371 11039 rpcz_store.cc:276] 0709 12:13:50.169865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.170015 (+   150us) service_pool.cc:224] Handling call
0709 12:13:52.441773 (+2271758us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:50.246361 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:50.247109 (+   748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:50.247152 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:13:50.247176 (+    24us) tablet.cc:662] Decoding operations
0709 12:13:50.247546 (+   370us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:50.247629 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:50.247666 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:50.247860 (+   194us) tablet.cc:701] Row locks acquired
0709 12:13:50.247879 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:13:50.248046 (+   167us) write_op.cc:270] Start()
0709 12:13:50.251669 (+  3623us) write_op.cc:276] Timestamp: P: 1783599230247981 usec, L: 0
0709 12:13:50.251697 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:13:50.252379 (+   682us) log.cc:844] Serialized 536 byte log entry
0709 12:13:50.336729 (+ 84350us) op_driver.cc:464] REPLICATION: finished
0709 12:13:50.531667 (+194938us) write_op.cc:301] APPLY: starting
0709 12:13:50.531792 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:50.533357 (+  1565us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:50.533524 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:50.534435 (+   911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:50.563093 (+ 28658us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:13:50.563182 (+    89us) write_op.cc:312] APPLY: finished
0709 12:13:50.563508 (+   326us) log.cc:844] Serialized 25 byte log entry
0709 12:13:50.563776 (+   268us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:50.563899 (+   123us) write_op.cc:454] Released schema lock
0709 12:13:50.563960 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:50.564579 (+   619us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:50.564625 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":188434,"apply.run_cpu_time_us":4644,"apply.run_wall_time_us":32871,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8319,"num_ops":1,"prepare.queue_time_us":51403,"prepare.run_cpu_time_us":11091,"prepare.run_wall_time_us":26441,"raft.queue_time_us":62808,"raft.run_cpu_time_us":85941,"raft.run_wall_time_us":553745,"replication_time_us":83580,"thread_start_us":291815,"threads_started":4,"wal-append.queue_time_us":17989,"wal-append.run_cpu_time_us":23111,"wal-append.run_wall_time_us":1294567}]]}
I20260709 12:13:52.544709 20314 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.537739 20315 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.551249 20315 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.557037 20317 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.557421 20314 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.558081 20317 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.558509 20314 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.560909 20317 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.561031 20314 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.561497 20317 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.562041 20314 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.562335 20317 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.563405 20314 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.566455 20314 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:52.567859 11826 leader_election.cc:336] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.569883 11826 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.570576 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.572382 20319 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:52.568763 20316 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.579459 20316 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.584609 20316 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.600805 20314 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.601936 20314 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.602770 20315 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.602982 20316 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.604274 20315 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.604946 20314 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.604436 20316 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.611327 20315 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.620697 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.622181 11288 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:52.638276 20319 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.641167 20316 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.641060 20319 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.654805 20319 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.660382 20320 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.661198 20319 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.661391 20320 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.662678 20314 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.662374 20319 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.663497 20314 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.664286 20320 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.664841 20320 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.665097 20319 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.665865 20314 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.666833 20308 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:52.665561 20320 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:52.685395 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 2.28502e+06us
I20260709 12:13:52.689170 20317 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.694386 20320 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.670099 20318 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:52.695767 20318 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.698220 20318 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.726994 20321 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.727900 20295 raft_consensus.cc:493] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.728960 20293 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.729472 20295 raft_consensus.cc:515] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.729683 20293 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.727941 20321 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:52.734853 20302 raft_consensus.cc:493] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.735821 20308 raft_consensus.cc:493] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.736105 20302 raft_consensus.cc:515] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.736564 20308 raft_consensus.cc:515] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.737335 20289 raft_consensus.cc:493] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.738678 20307 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.734889 20322 raft_consensus.cc:493] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.740200 20295 leader_election.cc:290] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.740137 20322 raft_consensus.cc:515] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.742825 20322 leader_election.cc:290] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.739137 20302 leader_election.cc:290] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.742995 20293 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.739151 20308 leader_election.cc:290] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.738109 20289 raft_consensus.cc:515] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.745801 20289 leader_election.cc:290] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.734249 20321 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
I20260709 12:13:52.739411 20307 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.753651 20307 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.759400 20289 raft_consensus.cc:493] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.759677 20326 raft_consensus.cc:493] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.760424 20289 raft_consensus.cc:515] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.760543 20326 raft_consensus.cc:515] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.768347 20326 leader_election.cc:290] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.771198 20289 leader_election.cc:290] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.767851 20308 raft_consensus.cc:493] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.781314 20308 raft_consensus.cc:515] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:52.782725 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:41137, user_credentials={real_user=slave}} blocked reactor thread for 51766.3us
W20260709 12:13:52.798779 11826 leader_election.cc:336] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.799332 11826 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.799746 11826 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.800225 11826 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.803462 20308 leader_election.cc:290] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.812131 20321 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.812923 20321 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.815568 20321 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.816565 20326 raft_consensus.cc:493] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.821410 20326 raft_consensus.cc:515] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.817113 20307 raft_consensus.cc:493] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.823125 20307 raft_consensus.cc:515] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.824246 20318 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.825587 20307 leader_election.cc:290] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.825306 20318 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.825434 11039 catalog_manager.cc:5697] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 21 to 22, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 22 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.827791 20308 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.827973 20331 raft_consensus.cc:493] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 2b4f4725b82b481ab53f0717a429e94a)
I20260709 12:13:52.827662 11039 catalog_manager.cc:5697] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 26 to 27, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 27 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.824342 20326 leader_election.cc:290] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.830333 20329 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.831051 20329 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.829078 20318 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:52.833566 20329 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.836179 20326 raft_consensus.cc:493] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.836766 20326 raft_consensus.cc:515] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.837292 20329 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.828724 20331 raft_consensus.cc:515] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.837839 11288 raft_consensus.cc:1275] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 28 index: 22. (index mismatch)
I20260709 12:13:52.839322 20326 leader_election.cc:290] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.828595 20308 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.839977 20331 leader_election.cc:290] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.842419 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67ed18056054cad98bdf3dd430e6577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.843844 11290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce10840f1d143948ae8836765fb74d1" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.844122 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1a0c01c80c45d5a5e2a78cec27d0b7" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.844339 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b238aa9f5b8450ca03fed7b6a294cf3" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.845613 11287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9948214ce1cd45429598d228699aa5a8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.845948 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.846838 11286 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:52.847019 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7de5348ade43f196ccf4a393cc5bb8" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.847735 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f091d9f19d495da80e2f33e1044577" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.850064 20308 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.850677 20308 raft_consensus.cc:493] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.851295 20308 raft_consensus.cc:515] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.853583 20308 leader_election.cc:290] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
I20260709 12:13:52.854174 20308 raft_consensus.cc:493] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.854669 20321 raft_consensus.cc:493] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.854768 20308 raft_consensus.cc:515] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.855438 20321 raft_consensus.cc:515] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.857228 20308 leader_election.cc:290] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.857898 20321 leader_election.cc:290] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:52.858983 11826 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.859622 11826 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.860116 11826 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.860641 11826 consensus_peers.cc:597] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:52.861090 11826 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.837942 20329 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:52.864842 20329 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:52.857928 20308 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:52.866158 20308 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.872638 20308 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:52.878041 11826 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.878782 11826 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.879148 11258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 58238.7us
I20260709 12:13:52.881044 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.882189 20308 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:52.882871 20308 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:52.884080 20308 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:52.885931 11291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.885848 11288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f20890b5ce4b0294cf6746a2a341ff" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.886868 11285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bbe9f3cd6e42aca82fdba9812b235c" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.887169 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6e44c82eda4c299b22957102352a23" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.886869 11291 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:52.888705 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:52.889577 11286 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 18.
I20260709 12:13:52.898049 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a98f617dcc31482f9ed419423e8b50d5" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:52.899247 11259 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.899852 11259 leader_election.cc:336] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.900296 11259 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.900753 11259 consensus_peers.cc:597] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.901165 11259 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.901652 11259 leader_election.cc:336] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.902096 11259 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.902621 11258 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:52.903618 11258 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.903983 11258 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.904574 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e660be03b734102a4ad43c954498a96" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:52.904858 20329 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:13:52.904909 11258 leader_election.cc:336] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.906075 11258 leader_election.cc:304] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.906600 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6250f2432a8a4fbb8c99e0f703ecd269" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:52.909107 20329 raft_consensus.cc:2749] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:52.909152 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ccd088b1904dd1aae6563124beb655" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:52.910321 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5275fafd0e7457694ac49b17b3fcfc1" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:52.910727 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfeda1095314856b34426f3195f5c23" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:52.912197 11258 leader_election.cc:336] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.912480 11855 raft_consensus.cc:1275] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:52.915474 11855 raft_consensus.cc:1275] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 12:13:52.879292 11826 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:52.917466 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fa9c55aa9ba49cc82db376e55f14ecc" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:52.917871 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:52.918623 11859 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 24.
W20260709 12:13:52.918742 11826 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.919387 11826 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.919561 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b9f42c7ee544898eee55760f7287b3" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 25 candidate_status { last_received { term: 24 index: 21 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
W20260709 12:13:52.920217 11826 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.920814 11826 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.923472 11259 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.934474 11259 leader_election.cc:336] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.936950 11256 leader_election.cc:304] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.938261 11256 leader_election.cc:304] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:52.939086 11825 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.939707 11825 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.940860 11825 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.941435 20318 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:52.941541 11825 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:52.942212 11825 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.942634 11825 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.940925 20331 raft_consensus.cc:2749] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:52.943638 11825 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.943852 20331 raft_consensus.cc:2749] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:52.944294 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:52.944716 20318 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:52.945206 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:52.945730 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:52.946182 11825 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.946601 11825 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.947203 11256 leader_election.cc:304] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.947378 11258 leader_election.cc:336] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:52.947687 11825 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.947978 11258 leader_election.cc:304] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.948284 11825 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.948535 20318 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:52.948393 20308 raft_consensus.cc:2749] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:52.949258 11825 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.949793 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.936041 11259 consensus_peers.cc:597] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:52.951100 20320 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:52.951328 11825 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.950973 20318 consensus_queue.cc:1048] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:13:52.952000 11825 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.950752 11259 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:52.952798 11258 leader_election.cc:336] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.953227 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:52.953704 20308 raft_consensus.cc:2749] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:52.954444 20329 consensus_queue.cc:1048] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:52.955013 20317 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:52.955253 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:52.955847 11825 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:52.956313 11825 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.956388 20331 consensus_queue.cc:1048] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:52.956758 11825 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.958019 11259 consensus_peers.cc:597] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:52.958125 20317 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:52.959182 20331 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:52.960521 11259 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.965240 11259 leader_election.cc:336] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.960911 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:52.966531 11258 leader_election.cc:336] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:52.966954 11258 leader_election.cc:304] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:52.964712 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:52.966817 11259 leader_election.cc:336] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.969480 20320 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:52.971138 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:52.972234 11259 consensus_peers.cc:597] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:52.972848 11259 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:52.973408 11259 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.974351 20320 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:52.975965 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:52.977981 20320 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:52.982977 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:52.986667 20318 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:52.980656 20331 raft_consensus.cc:2749] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:13:52.993363 11259 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.993597 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:52.994113 11259 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:52.997270 11826 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:52.999584 20318 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:53.001629 11826 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:52.999763 20320 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:53.003885 20320 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.004307 20320 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:53.010679 11259 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:53.011222 11259 leader_election.cc:336] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:53.011549 11259 leader_election.cc:304] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 2b4f4725b82b481ab53f0717a429e94a, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.012494 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:53.013525 11259 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:53.014007 11259 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:53.014546 20308 raft_consensus.cc:2749] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:53.015565 20318 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.016410 20317 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.018476 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:53.022646 20316 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:53.025233 11259 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.028605 11258 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.029139 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.029917 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
W20260709 12:13:53.031898 11258 leader_election.cc:336] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.031983 11826 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:53.032552 11258 leader_election.cc:304] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:53.034085 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.034650 20308 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:53.034893 20324 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:53.034744 20317 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:53.040290 11258 leader_election.cc:336] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.040792 11258 leader_election.cc:304] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
W20260709 12:13:53.043570 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.045822 11258 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.045533 20307 raft_consensus.cc:2749] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:53.042739 20308 raft_consensus.cc:2749] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:53.046216 11258 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.048390 20308 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:53.049396 11258 leader_election.cc:336] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.049803 11258 leader_election.cc:304] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.055780 20308 raft_consensus.cc:2749] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:13:53.056630 20317 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:53.057065 20317 raft_consensus.cc:493] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:53.057400 20317 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:53.061120 11258 leader_election.cc:336] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.061529 11258 leader_election.cc:304] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:53.062963 11258 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.063288 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.065419 20331 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:13:53.070767 11258 leader_election.cc:336] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.066540 20308 raft_consensus.cc:2749] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.074575 11258 leader_election.cc:304] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.076084 20331 raft_consensus.cc:2749] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:53.075924 11258 leader_election.cc:336] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.077384 11258 leader_election.cc:304] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 2b4f4725b82b481ab53f0717a429e94a
I20260709 12:13:53.078238 20331 raft_consensus.cc:2749] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:53.079185 11258 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.079555 11258 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.080238 20331 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:53.082254 11258 leader_election.cc:336] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.082680 11258 leader_election.cc:304] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.083307 20331 raft_consensus.cc:2749] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:53.084802 11258 leader_election.cc:336] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:53.085139 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 51098.8us
I20260709 12:13:53.085186 11258 leader_election.cc:304] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:53.085871 11826 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:53.086002 20331 raft_consensus.cc:2749] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:53.086290 11826 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:53.086966 11258 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.091600 11258 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:53.096812 11258 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:53.097172 11258 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:53.098251 20317 raft_consensus.cc:515] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:53.094971 20324 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.099304 20331 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:53.102615 20321 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.103458 20320 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:53.112998 20320 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:53.118959 11259 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.121469 11826 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:53.126708 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:53.129258 20317 leader_election.cc:290] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:53.135849 11826 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.137181 11826 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:53.153093 11293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9943fa4bd634a79a891fa52086a527a" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928"
I20260709 12:13:53.153764 11293 raft_consensus.cc:3060] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:53.169317 11826 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:53.169893 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:53.174714 20318 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:53.177795 11293 raft_consensus.cc:2468] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 19.
I20260709 12:13:53.182811 11826 leader_election.cc:304] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:53.183672 20318 raft_consensus.cc:2804] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:53.184190 20318 raft_consensus.cc:697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Becoming Leader. State: Replica: 2b4f4725b82b481ab53f0717a429e94a, State: Running, Role: LEADER
W20260709 12:13:53.185307 11259 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.186094 11826 leader_election.cc:336] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:53.185309 20318 consensus_queue.cc:237] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:53.227748 11258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111) [suppressed 402 similar messages]
W20260709 12:13:53.259613 11259 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.265841 11259 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.281723 11259 consensus_peers.cc:597] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:53.282871 11042 catalog_manager.cc:5697] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a reported cstate change: term changed from 18 to 19, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132). New cstate: current_term: 19 leader_uuid: "2b4f4725b82b481ab53f0717a429e94a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:53.285794 11258 consensus_peers.cc:597] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.288861 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.291345 11259 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:53.292397 11039 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 17 to 18, leader changed from 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130) to ba2779405e8d452e95f42421b2b60928 (127.9.180.131). New cstate: current_term: 18 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:53.294713 11259 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.302218 11259 consensus_peers.cc:597] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:53.306183 11258 consensus_peers.cc:597] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:53.309247  9938 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11240)
W20260709 12:13:53.362074 11258 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.419318 11259 consensus_peers.cc:597] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:53.465083 11855 raft_consensus.cc:1240] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Rejecting Update request from peer ba2779405e8d452e95f42421b2b60928 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:53.469260 20329 consensus_queue.cc:1059] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:53.470232 20307 raft_consensus.cc:3055] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:53.470770 20307 raft_consensus.cc:740] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:53.471856 20307 consensus_queue.cc:260] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:53.473352 20307 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:53.497601 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:53.546343 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08003d14c0 after lost signal to thread 9941
W20260709 12:13:53.547747 11882 debug-util.cc:398] Leaking SignalData structure 0x7b0800154640 after lost signal to thread 11076
W20260709 12:13:53.549244 11882 debug-util.cc:398] Leaking SignalData structure 0x7b0800307620 after lost signal to thread 11317
W20260709 12:13:53.550544 11882 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5960 after lost signal to thread 11885
W20260709 12:13:53.664367 11826 consensus_peers.cc:597] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:53.704427 11258 consensus_peers.cc:597] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:53.736089 11825 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:53.761406 11258 consensus_peers.cc:597] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:53.775930 11286 raft_consensus.cc:1275] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Refusing update from remote peer 2b4f4725b82b481ab53f0717a429e94a: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:13:53.777693 20320 consensus_queue.cc:1048] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:13:53.866624 11258 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:53.981731 11258 consensus_peers.cc:597] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.071935 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:54.093201 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:54.251092 11258 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.309712  9938 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 11240)
I20260709 12:13:54.352759 20320 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.353475 20320 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:54.361287 20320 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:54.362102 11258 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.382577 11825 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:54.393755 11826 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.394701 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.403052 20358 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:54.487167 20358 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.487845 20358 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:54.500185 11826 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.504251 20358 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:54.505158 11825 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:54.505707 11825 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.506667 20358 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:54.520912  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
W20260709 12:13:54.581537 11258 consensus_peers.cc:597] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:54.589737 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:54.700438 20358 raft_consensus.cc:493] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.701172 20358 raft_consensus.cc:515] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } attrs { replace: true } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:54.723946 11825 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:54.727087 20358 leader_election.cc:290] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:54.734282 11826 leader_election.cc:336] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.738994 11826 leader_election.cc:304] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.746866 11286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c432ae03684756b937dd1aa2541cbd" candidate_uuid: "2b4f4725b82b481ab53f0717a429e94a" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ba2779405e8d452e95f42421b2b60928" is_pre_election: true
I20260709 12:13:54.747658 11286 raft_consensus.cc:2468] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4f4725b82b481ab53f0717a429e94a in term 24.
I20260709 12:13:54.749106 20320 raft_consensus.cc:2749] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:54.754627 20320 raft_consensus.cc:493] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.755306 20320 raft_consensus.cc:515] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:54.758551 20320 leader_election.cc:290] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:54.769145 20357 raft_consensus.cc:493] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.769901 20357 raft_consensus.cc:515] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:54.771551 20358 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.772217 20358 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:54.785349 11258 leader_election.cc:336] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:54.789872 20307 raft_consensus.cc:493] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.790663 20307 raft_consensus.cc:515] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:54.793928 20307 leader_election.cc:290] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:54.799427 11259 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.801172 20358 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:54.806246 11259 leader_election.cc:336] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.806881 11259 leader_election.cc:304] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
W20260709 12:13:54.807667 11258 leader_election.cc:336] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:54.808211 20307 raft_consensus.cc:2749] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:54.808332 11258 leader_election.cc:304] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.809291 20307 raft_consensus.cc:2749] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:54.800305 20357 leader_election.cc:290] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:54.814517 11825 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:54.838095 11825 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:54.839450 11826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:41465, user_credentials={real_user=slave}} blocked reactor thread for 73928.6us
I20260709 12:13:54.850185 20308 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.851094 20308 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:54.853628 20308 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:54.854918 11258 consensus_peers.cc:597] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:54.853777 11826 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:54.870833 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a" is_pre_election: true
I20260709 12:13:54.872689 11854 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 19.
W20260709 12:13:54.878991 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:54.884810 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 
I20260709 12:13:54.887974 20357 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:54.888441 20357 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.888792 20357 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:54.890549 20359 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:54.891191 20359 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:54.893429 20359 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:54.898316 20307 raft_consensus.cc:493] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:54.897650 11259 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.898933 20307 raft_consensus.cc:515] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:54.901855 20307 leader_election.cc:290] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:54.907157 11258 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:54.883049 11826 leader_election.cc:336] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.910511 11826 leader_election.cc:304] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.911312 20359 raft_consensus.cc:2749] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:54.913420 20359 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
W20260709 12:13:54.913705 11825 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:54.913964 20359 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:54.916440 20359 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:54.919481 20357 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:54.920954  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
W20260709 12:13:54.923663 11259 leader_election.cc:336] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.924217 11259 leader_election.cc:304] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.927206 20308 raft_consensus.cc:2749] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:54.931452 20357 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Requested vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 2b4f4725b82b481ab53f0717a429e94a (127.9.180.132:46563)
W20260709 12:13:54.933298 11825 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:54.933542 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea72104a4f4494b28f5e58c9ce7e41" candidate_uuid: "ba2779405e8d452e95f42421b2b60928" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2b4f4725b82b481ab53f0717a429e94a"
I20260709 12:13:54.934214 11857 raft_consensus.cc:3060] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:54.934247 11826 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.934998 11826 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.935817 20359 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:54.938181 11259 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:54.940881 11826 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.941357 11826 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.942104 20359 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:54.942214 11826 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:54.942754 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.943445 20359 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:54.946352 11857 raft_consensus.cc:2468] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba2779405e8d452e95f42421b2b60928 in term 20.
I20260709 12:13:54.947885 11256 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a, ba2779405e8d452e95f42421b2b60928; no voters: 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:54.950307 20308 raft_consensus.cc:2804] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:54.953403 20308 raft_consensus.cc:697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Becoming Leader. State: Replica: ba2779405e8d452e95f42421b2b60928, State: Running, Role: LEADER
I20260709 12:13:54.954260 20308 consensus_queue.cc:237] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:54.986374 11826 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.011454 11826 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.012555 20357 raft_consensus.cc:493] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:55.016147 20357 raft_consensus.cc:515] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:55.017042 11042 catalog_manager.cc:5697] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "ba2779405e8d452e95f42421b2b60928" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:55.025287 11258 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:55.031903 11259 leader_election.cc:336] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:55.032368 11826 consensus_peers.cc:597] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.032377 11259 leader_election.cc:304] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:55.033238 20357 leader_election.cc:290] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
I20260709 12:13:55.033951 20357 raft_consensus.cc:2749] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:13:55.045903 11826 consensus_peers.cc:597] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.067473 11826 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.084473 20361 raft_consensus.cc:493] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:55.085165 20361 raft_consensus.cc:515] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } }
I20260709 12:13:55.087954 20361 leader_election.cc:290] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503)
W20260709 12:13:55.095471 11258 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:55.107213 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:55.112917  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:13:55.113478 11826 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.114204  9938 tablet_replica.cc:333] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.115352  9938 raft_consensus.cc:2243] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.115970  9938 raft_consensus.cc:2272] T 7e660be03b734102a4ad43c954498a96 P ba2779405e8d452e95f42421b2b60928 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.108191 11259 leader_election.cc:336] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:55.118417 11259 leader_election.cc:304] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:55.119418  9938 tablet_replica.cc:333] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.120550  9938 raft_consensus.cc:2243] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.123131 20357 raft_consensus.cc:493] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:55.124172  9938 raft_consensus.cc:2272] T f1f091d9f19d495da80e2f33e1044577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.123782 20357 raft_consensus.cc:515] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
I20260709 12:13:55.123138 20361 raft_consensus.cc:2749] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:13:55.133723 11258 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:55.136108 20357 leader_election.cc:290] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:55.141939 11259 leader_election.cc:336] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:55.142445  9938 tablet_replica.cc:333] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.142740 11259 leader_election.cc:304] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:55.143651  9938 raft_consensus.cc:2243] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.144412  9938 raft_consensus.cc:2272] T 5fd2e22241c745b9aa339da0259546f0 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.144654 20361 raft_consensus.cc:2749] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:55.147747  9938 tablet_replica.cc:333] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.148711  9938 raft_consensus.cc:2243] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.150065  9938 raft_consensus.cc:2272] T e8f20890b5ce4b0294cf6746a2a341ff P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.157239  9938 tablet_replica.cc:333] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.158216  9938 raft_consensus.cc:2243] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.159242  9938 raft_consensus.cc:2272] T d3619bd8cdd6482dad222b2265b94b48 P ba2779405e8d452e95f42421b2b60928 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.162436  9938 tablet_replica.cc:333] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.163357  9938 raft_consensus.cc:2243] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.164013  9938 raft_consensus.cc:2272] T a5275fafd0e7457694ac49b17b3fcfc1 P ba2779405e8d452e95f42421b2b60928 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.175506 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:55.184736 20357 raft_consensus.cc:493] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:55.185606 20357 raft_consensus.cc:515] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:55.196558 11259 leader_election.cc:336] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:55.197629 11826 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.201261 20357 leader_election.cc:290] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:55.212543 11258 leader_election.cc:336] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:55.213030 11258 leader_election.cc:304] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:55.215131 20361 raft_consensus.cc:2749] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:55.216089 20361 raft_consensus.cc:493] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:55.216611 20361 raft_consensus.cc:515] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } }
W20260709 12:13:55.218772 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:55.218966 20361 leader_election.cc:290] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:55.224897 11259 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:55.226780 11258 consensus_peers.cc:597] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:55.228062  9938 tablet_replica.cc:333] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.250123  9938 raft_consensus.cc:2243] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 25 LEADER]: Raft consensus shutting down.
W20260709 12:13:55.252703 11258 leader_election.cc:336] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:55.253276 11258 leader_election.cc:304] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba2779405e8d452e95f42421b2b60928; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:55.258733 20357 raft_consensus.cc:2749] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:55.264519  9938 raft_consensus.cc:2272] T 25bbe9f3cd6e42aca82fdba9812b235c P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.292335 11259 consensus_peers.cc:597] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:55.295662 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:55.297034  9938 tablet_replica.cc:333] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.298019  9938 raft_consensus.cc:2243] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:55.298522 11826 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.310238  9938 raft_consensus.cc:2272] T 776da81ff0064a87b29c2949e7bc5291 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.318557  9938 tablet_replica.cc:333] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
W20260709 12:13:55.319590 11826 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.319708  9938 raft_consensus.cc:2243] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.321610  9938 raft_consensus.cc:2272] T f482641e4e2a4d109ab2f3acbbaebbb2 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.325327  9938 tablet_replica.cc:333] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.326267  9938 raft_consensus.cc:2243] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.327661  9938 raft_consensus.cc:2272] T d9d29c78e55e4b76a84881d4f97aaec8 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.330515 11826 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.346369 11826 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.349110 11826 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.350168  9938 tablet_replica.cc:333] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.351176  9938 raft_consensus.cc:2243] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:13:55.361357 11259 consensus_peers.cc:597] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:55.364303 11826 consensus_peers.cc:597] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:55.368027 11258 consensus_peers.cc:597] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:55.368883  9938 raft_consensus.cc:2272] T 1b238aa9f5b8450ca03fed7b6a294cf3 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.372366  9938 tablet_replica.cc:333] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.373315  9938 raft_consensus.cc:2243] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.374435  9938 raft_consensus.cc:2272] T 92ccd088b1904dd1aae6563124beb655 P ba2779405e8d452e95f42421b2b60928 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.377872  9938 tablet_replica.cc:333] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.378723  9938 raft_consensus.cc:2243] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.389428  9938 raft_consensus.cc:2272] T 2fa9c55aa9ba49cc82db376e55f14ecc P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.392697  9938 tablet_replica.cc:333] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.393621  9938 raft_consensus.cc:2243] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.394938  9938 raft_consensus.cc:2272] T 9a38aa6d0e35417db86aadc82bb36b04 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.397953  9938 tablet_replica.cc:333] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.399077  9938 raft_consensus.cc:2243] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.399777  9938 raft_consensus.cc:2272] T 382f5b53b1974dc083d6b840e190fbf9 P ba2779405e8d452e95f42421b2b60928 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.403282  9938 tablet_replica.cc:333] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.404233  9938 raft_consensus.cc:2243] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.404896  9938 raft_consensus.cc:2272] T 5b5563d41fc84c36a8d7eafa0e6a4968 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.407979  9938 tablet_replica.cc:333] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.408828  9938 raft_consensus.cc:2243] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.410038  9938 raft_consensus.cc:2272] T a5303488c195434ca5cfdb88d6256a0c P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.413358  9938 tablet_replica.cc:333] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.414273  9938 raft_consensus.cc:2243] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.415643  9938 raft_consensus.cc:2272] T 9948214ce1cd45429598d228699aa5a8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.416100 11826 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.418690  9938 tablet_replica.cc:333] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
W20260709 12:13:55.426009 11259 consensus_peers.cc:597] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.426702  9938 raft_consensus.cc:2243] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.427862  9938 raft_consensus.cc:2272] T fab38430e77f4f78916480f9b0041989 P ba2779405e8d452e95f42421b2b60928 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.431102  9938 tablet_replica.cc:333] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.432301  9938 raft_consensus.cc:2243] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.433706  9938 raft_consensus.cc:2272] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.440593 11259 consensus_peers.cc:597] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:55.449105 11259 consensus_peers.cc:597] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.484956  9938 tablet_replica.cc:333] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
W20260709 12:13:55.491207 11258 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:55.497100 11259 consensus_peers.cc:597] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.501282 11857 raft_consensus.cc:1275] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Refusing update from remote peer ba2779405e8d452e95f42421b2b60928: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:55.502919 20308 consensus_queue.cc:1048] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:55.506867  9938 raft_consensus.cc:2243] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.508227  9938 raft_consensus.cc:2272] T 893ed9b3a6054165a7d66c6d7ae1249c P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.511147  9938 tablet_replica.cc:333] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.511926  9938 raft_consensus.cc:2243] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.512497  9938 raft_consensus.cc:2272] T 59b9f42c7ee544898eee55760f7287b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.524025  9938 tablet_replica.cc:333] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.529264  9938 raft_consensus.cc:2243] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.530716  9938 raft_consensus.cc:2272] T bc7de5348ade43f196ccf4a393cc5bb8 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.534567  9938 tablet_replica.cc:333] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.535414  9938 raft_consensus.cc:2243] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.535990  9938 raft_consensus.cc:2272] T a98f617dcc31482f9ed419423e8b50d5 P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.551160 11259 consensus_peers.cc:597] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.551311  9938 tablet_replica.cc:333] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.552398  9938 raft_consensus.cc:2243] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.554584  9938 raft_consensus.cc:2272] T 2864b976ac5946a7b7a41c9a5e2f7f26 P ba2779405e8d452e95f42421b2b60928 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.562356  9938 tablet_replica.cc:333] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.563171  9938 raft_consensus.cc:2243] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.571450  9938 raft_consensus.cc:2272] T 539267f9f49c4c16b3ec8b1c92be6d29 P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.574424  9938 tablet_replica.cc:333] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.575258  9938 raft_consensus.cc:2243] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.575855  9938 raft_consensus.cc:2272] T 1618626d8c194b9ea8b2ac9f3554b006 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.578853  9938 tablet_replica.cc:333] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.579561  9938 raft_consensus.cc:2243] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.580688  9938 raft_consensus.cc:2272] T 6068dd70dc8045fc8ad3d39311dc7428 P ba2779405e8d452e95f42421b2b60928 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.583410  9938 tablet_replica.cc:333] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.584162  9938 raft_consensus.cc:2243] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.584957  9938 raft_consensus.cc:2272] T d969a53adb784388b9e0819cd9786e2f P ba2779405e8d452e95f42421b2b60928 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.588088  9938 tablet_replica.cc:333] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.588835  9938 raft_consensus.cc:2243] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.590045  9938 raft_consensus.cc:2272] T c0c432ae03684756b937dd1aa2541cbd P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.592635  9938 tablet_replica.cc:333] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.610152  9938 raft_consensus.cc:2243] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.616597  9938 raft_consensus.cc:2272] T aaa499c4330145abb0fb264ec515ea63 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.619479  9938 tablet_replica.cc:333] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.624408  9938 raft_consensus.cc:2243] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.625578  9938 raft_consensus.cc:2272] T 7bea72104a4f4494b28f5e58c9ce7e41 P ba2779405e8d452e95f42421b2b60928 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.628935  9938 tablet_replica.cc:333] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.629649  9938 raft_consensus.cc:2243] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.630445  9938 raft_consensus.cc:2272] T 6250f2432a8a4fbb8c99e0f703ecd269 P ba2779405e8d452e95f42421b2b60928 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.632922  9938 tablet_replica.cc:333] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.633829  9938 raft_consensus.cc:2243] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.634943  9938 raft_consensus.cc:2272] T 8ce10840f1d143948ae8836765fb74d1 P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.637786  9938 tablet_replica.cc:333] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.638521  9938 raft_consensus.cc:2243] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.639212  9938 raft_consensus.cc:2272] T e7c488a2c80e4e21bde9ae92cfae70b3 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.649114  9938 tablet_replica.cc:333] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.654438  9938 raft_consensus.cc:2243] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.655153  9938 raft_consensus.cc:2272] T 35f8f77c6e8c4a66b41088646a9c8c90 P ba2779405e8d452e95f42421b2b60928 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.657893  9938 tablet_replica.cc:333] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.658666  9938 raft_consensus.cc:2243] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.659252  9938 raft_consensus.cc:2272] T ddd0a7b2bb3645519f8c5c9bf85633d9 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.661784  9938 tablet_replica.cc:333] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.662437  9938 raft_consensus.cc:2243] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:55.677726 11259 consensus_peers.cc:597] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.678020  9938 raft_consensus.cc:2272] T f9943fa4bd634a79a891fa52086a527a P ba2779405e8d452e95f42421b2b60928 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.683857  9938 tablet_replica.cc:333] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.684621  9938 raft_consensus.cc:2243] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.686048  9938 raft_consensus.cc:2272] T ca6e44c82eda4c299b22957102352a23 P ba2779405e8d452e95f42421b2b60928 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.694825  9938 tablet_replica.cc:333] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.695508  9938 raft_consensus.cc:2243] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.696960  9938 raft_consensus.cc:2272] T 923b3bc9b7424aa9bdc5a7952136dbba P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.699702  9938 tablet_replica.cc:333] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.700378  9938 raft_consensus.cc:2243] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.701022  9938 raft_consensus.cc:2272] T 809626de5a674cba911a83815f1e05ca P ba2779405e8d452e95f42421b2b60928 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.712807  9938 tablet_replica.cc:333] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.713575  9938 raft_consensus.cc:2243] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:13:55.719480 11826 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.714775  9938 raft_consensus.cc:2272] T a67ed18056054cad98bdf3dd430e6577 P ba2779405e8d452e95f42421b2b60928 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.722711  9938 tablet_replica.cc:333] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.723493  9938 raft_consensus.cc:2243] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.724056  9938 raft_consensus.cc:2272] T 4fed3eea68d84fed917f13cdd6cc9820 P ba2779405e8d452e95f42421b2b60928 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.726792  9938 tablet_replica.cc:333] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.727433  9938 raft_consensus.cc:2243] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.728036  9938 raft_consensus.cc:2272] T cbfeda1095314856b34426f3195f5c23 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.740343 11826 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:55.741103  9938 tablet_replica.cc:333] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.741878  9938 raft_consensus.cc:2243] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.742553  9938 raft_consensus.cc:2272] T 86632bf64d844f6f8f1356ac45447bcc P ba2779405e8d452e95f42421b2b60928 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.745388  9938 tablet_replica.cc:333] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.746035  9938 raft_consensus.cc:2243] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.747572  9938 raft_consensus.cc:2272] T ec444005f2c247b18f21f2d9fcf7749e P ba2779405e8d452e95f42421b2b60928 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.750197  9938 tablet_replica.cc:333] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.750873  9938 raft_consensus.cc:2243] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.751955  9938 raft_consensus.cc:2272] T e017decd61a34a2cbc717412a4ed64ea P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.754649  9938 tablet_replica.cc:333] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928: stopping tablet replica
I20260709 12:13:55.755251  9938 raft_consensus.cc:2243] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.756317  9938 raft_consensus.cc:2272] T f6e27c7f8a6b4e82a1ffee4fc5743515 P ba2779405e8d452e95f42421b2b60928 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.990173 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:56.043550 20359 raft_consensus.cc:493] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:56.044217 20359 raft_consensus.cc:515] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.049777 20359 leader_election.cc:290] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:56.057291 11825 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:56.064342 11826 leader_election.cc:336] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.064806 11826 leader_election.cc:304] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:56.065493 20359 raft_consensus.cc:2749] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:56.290635 11825 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:56.371523 20359 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.372210 20359 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.374691 20359 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.389127 11826 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:56.389917 11826 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.390311 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.391139 20359 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:56.400478 11826 consensus_peers.cc:597] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:56.461630 20367 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.462329 20367 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.464982 20367 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.472133 11825 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:56.478406 11826 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.479009 11826 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.479980 20367 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:56.494300 20367 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.494966 20367 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.501868 20367 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.505996 11825 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:56.512414 20367 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.513019 20367 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:56.521370 11825 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:56.522914 20367 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.528475 11826 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.528945 11826 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.530697 20367 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:56.536350 11826 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.537046 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.537810 20367 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:56.604404 20367 raft_consensus.cc:493] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:56.605072 20367 raft_consensus.cc:515] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.607484 20367 leader_election.cc:290] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:56.612200 11825 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:56.615180 11825 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:56.621958 11826 leader_election.cc:336] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.622442 11826 leader_election.cc:304] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:56.623426 20367 raft_consensus.cc:2749] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:56.694823 11825 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:56.750957 20359 raft_consensus.cc:493] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.751621 20359 raft_consensus.cc:515] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.754112 20359 leader_election.cc:290] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:56.754814 20359 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.755365 20359 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.759080 20367 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.759752 20367 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.766511 20359 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:56.775144 20359 raft_consensus.cc:493] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.776467 20359 raft_consensus.cc:515] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.779029 20359 leader_election.cc:290] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.804409 11825 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:56.805547 20367 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.826586 11826 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:56.830982 11826 leader_election.cc:336] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.831439 11826 leader_election.cc:304] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.832226 20367 raft_consensus.cc:2749] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:56.833237 11826 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.833632 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.834332 20367 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:56.836359 11826 leader_election.cc:336] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.837425 20367 raft_consensus.cc:493] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.838402 20372 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.838954 20372 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.841423 20372 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:56.837985 20367 raft_consensus.cc:515] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.844131 20367 leader_election.cc:290] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.853098 11826 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.860674 20367 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.861217 20367 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.865850 20367 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.869004 11826 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.869480 11826 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.870229 20367 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:56.871340 11826 leader_election.cc:336] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.871773 11826 leader_election.cc:304] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.872480 20367 raft_consensus.cc:2749] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:56.882503 20367 raft_consensus.cc:493] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:56.883055 20367 raft_consensus.cc:515] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:56.885345 20367 leader_election.cc:290] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:56.891556 11825 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:56.898809 11826 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
W20260709 12:13:56.899467 11826 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
W20260709 12:13:56.900229 11826 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.900606 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.901404 20367 raft_consensus.cc:2749] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:56.902546 11826 leader_election.cc:336] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.902958 11826 leader_election.cc:304] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.903786 20367 raft_consensus.cc:2749] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:56.914917 11826 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
W20260709 12:13:56.915621 11826 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:56.916006 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.916705 20367 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:56.922585 11826 leader_election.cc:336] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:56.923039 11826 leader_election.cc:304] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:56.923806 20367 raft_consensus.cc:2749] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:56.967515  9938 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11314)
I20260709 12:13:57.030761 20367 raft_consensus.cc:493] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:57.031435 20367 raft_consensus.cc:515] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:57.033794 20367 leader_election.cc:290] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:57.044819 11826 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:57.045506 11826 leader_election.cc:336] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:57.045925 11826 leader_election.cc:304] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:57.046723 20367 raft_consensus.cc:2749] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:57.059289 20367 raft_consensus.cc:493] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:57.059839 20367 raft_consensus.cc:515] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:57.062069 20367 leader_election.cc:290] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:57.067018 11825 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:57.083396 11825 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:57.099255 11826 leader_election.cc:336] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:57.099727 11826 leader_election.cc:304] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:57.100440 20367 raft_consensus.cc:2749] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:57.182500 11825 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:57.354758 11826 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.355598 11826 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.402670 20373 raft_consensus.cc:493] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:57.403366 20373 raft_consensus.cc:515] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:57.406213 20373 leader_election.cc:290] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:57.410753 11825 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:57.411916 11826 leader_election.cc:336] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:57.412346 11826 leader_election.cc:304] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:57.413077 20373 raft_consensus.cc:2749] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:57.468791 11825 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:57.482652 20373 raft_consensus.cc:493] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:57.483423 20373 raft_consensus.cc:515] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:57.485643 11826 consensus_peers.cc:597] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:57.487057 20373 leader_election.cc:290] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:57.490417 11825 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:57.492723 11826 leader_election.cc:336] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:57.493417 11826 leader_election.cc:304] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:57.494232 20373 raft_consensus.cc:2749] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:57.508535 11826 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.596875 11826 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.609881 11826 consensus_peers.cc:597] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:57.627305 11826 consensus_peers.cc:597] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.629360 11826 consensus_peers.cc:597] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:57.649948 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:57.686251 11825 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:57.748451 11826 consensus_peers.cc:597] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.750453 11825 consensus_peers.cc:597] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:57.761724 11826 consensus_peers.cc:597] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.772374 11826 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.779649 11826 consensus_peers.cc:597] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:57.785995 20373 raft_consensus.cc:493] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5d1ee1ef054240338e0a9e05a67acdfc)
I20260709 12:13:57.786593 20373 raft_consensus.cc:515] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:57.788681 20373 leader_election.cc:290] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137)
W20260709 12:13:57.793064 11825 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:57.794145 11826 leader_election.cc:336] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:57.794714 11826 leader_election.cc:304] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, 5d1ee1ef054240338e0a9e05a67acdfc
I20260709 12:13:57.795501 20373 raft_consensus.cc:2749] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:57.831219 11826 consensus_peers.cc:597] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:57.866127 11826 consensus_peers.cc:597] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:57.911294 11826 consensus_peers.cc:597] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a -> Peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Couldn't send request to peer ba2779405e8d452e95f42421b2b60928. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.946017 11825 consensus_peers.cc:597] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:58.137480 11826 consensus_peers.cc:597] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:58.166808 20377 raft_consensus.cc:493] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.168767 20377 raft_consensus.cc:515] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.171370 20377 leader_election.cc:290] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.176220 11825 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:58.177788 11826 leader_election.cc:336] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:58.178268 11826 leader_election.cc:304] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.179070 20377 raft_consensus.cc:2749] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:58.193760 20377 raft_consensus.cc:493] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.194967 20377 raft_consensus.cc:515] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.197134 20377 leader_election.cc:290] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.203938 11826 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
W20260709 12:13:58.204831 11826 leader_election.cc:336] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:58.205219 11826 leader_election.cc:304] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.205951 20377 raft_consensus.cc:2749] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:58.235857 11825 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111) [suppressed 458 similar messages]
W20260709 12:13:58.242821 11073 debug-util.cc:398] Leaking SignalData structure 0x7b080000b620 after lost signal to thread 9941
W20260709 12:13:58.244161 11073 debug-util.cc:398] Leaking SignalData structure 0x7b0800386e80 after lost signal to thread 11076
W20260709 12:13:58.245816 11073 debug-util.cc:398] Leaking SignalData structure 0x7b080011a7c0 after lost signal to thread 11885
I20260709 12:13:58.372265  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
W20260709 12:13:58.505730 11826 consensus_peers.cc:597] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Couldn't send request to peer 5d1ee1ef054240338e0a9e05a67acdfc. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:58.543985  9938 tablet_server.cc:179] TabletServer@127.9.180.132:0 shutting down...
W20260709 12:13:58.544939 11825 consensus_peers.cc:597] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a -> Peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Couldn't send request to peer 018d40ceb45d4447aa293f4c1d929bb8. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:58.546030 20377 raft_consensus.cc:493] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.546581 20377 raft_consensus.cc:515] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.559398 20377 leader_election.cc:290] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.563563 11826 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:58.566239 11826 leader_election.cc:336] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:58.566779 11826 leader_election.cc:304] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.567677 20377 raft_consensus.cc:2749] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:58.579062 20377 raft_consensus.cc:493] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.579733 20377 raft_consensus.cc:515] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.582105 20377 leader_election.cc:290] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.606748 11826 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:58.625420 20378 raft_consensus.cc:493] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.626855 20378 raft_consensus.cc:515] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
W20260709 12:13:58.626178 11825 leader_election.cc:336] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:58.628437 11825 leader_election.cc:304] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.629504 20373 raft_consensus.cc:2749] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:58.636250 20378 leader_election.cc:290] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.654007 11826 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
W20260709 12:13:58.654935 11826 leader_election.cc:336] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:58.655377 11826 leader_election.cc:304] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.656191 20373 raft_consensus.cc:493] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.656708 20373 raft_consensus.cc:515] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.656677 20378 raft_consensus.cc:2749] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:58.659329 20373 leader_election.cc:290] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.676065 11825 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
W20260709 12:13:58.685251 11826 leader_election.cc:336] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:58.685763 11826 leader_election.cc:304] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.685729  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:58.687932 20373 raft_consensus.cc:2749] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:58.690641  9938 tablet_replica.cc:333] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.692003  9938 raft_consensus.cc:2243] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.692044 20373 raft_consensus.cc:493] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.693133  9938 raft_consensus.cc:2272] T ca6e44c82eda4c299b22957102352a23 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.692898 20373 raft_consensus.cc:515] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "018d40ceb45d4447aa293f4c1d929bb8" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 43503 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.695313 20373 leader_election.cc:290] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
I20260709 12:13:58.697475  9938 tablet_replica.cc:333] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
W20260709 12:13:58.700104 11825 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:13:58.705035  9938 raft_consensus.cc:2243] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.706187  9938 raft_consensus.cc:2272] T 25bbe9f3cd6e42aca82fdba9812b235c P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.710197  9938 tablet_replica.cc:333] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.713738 20373 raft_consensus.cc:493] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ba2779405e8d452e95f42421b2b60928)
I20260709 12:13:58.714332 20373 raft_consensus.cc:515] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d1ee1ef054240338e0a9e05a67acdfc" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41137 } } peers { permanent_uuid: "ba2779405e8d452e95f42421b2b60928" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 41465 } } peers { permanent_uuid: "2b4f4725b82b481ab53f0717a429e94a" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 46563 } attrs { promote: false } }
I20260709 12:13:58.715677  9938 raft_consensus.cc:2243] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.716447  9938 raft_consensus.cc:2272] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.716542 20373 leader_election.cc:290] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137), ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465)
W20260709 12:13:58.717361 11826 leader_election.cc:336] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
I20260709 12:13:58.717880 11826 leader_election.cc:304] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 018d40ceb45d4447aa293f4c1d929bb8, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.718631 20373 raft_consensus.cc:2749] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:58.721060  9938 tablet_replica.cc:333] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.722354  9938 raft_consensus.cc:2243] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.723465  9938 raft_consensus.cc:2272] T 557f4814dd3c4d4bb57340a9834ebd32 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.726853  9938 tablet_replica.cc:333] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.728312  9938 raft_consensus.cc:2243] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.729063  9938 raft_consensus.cc:2272] T d9d29c78e55e4b76a84881d4f97aaec8 P 2b4f4725b82b481ab53f0717a429e94a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.732023  9938 tablet_replica.cc:333] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.733011  9938 raft_consensus.cc:2243] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.734356  9938 raft_consensus.cc:2272] T f9943fa4bd634a79a891fa52086a527a P 2b4f4725b82b481ab53f0717a429e94a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:58.735797 11826 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ba2779405e8d452e95f42421b2b60928 (127.9.180.131:41465): Network error: Client connection negotiation failed: client connection to 127.9.180.131:41465: connect: Connection refused (error 111)
W20260709 12:13:58.736581 11826 leader_election.cc:336] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5d1ee1ef054240338e0a9e05a67acdfc (127.9.180.130:41137): Network error: Client connection negotiation failed: client connection to 127.9.180.130:41137: connect: Connection refused (error 111)
I20260709 12:13:58.736989 11826 leader_election.cc:304] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4f4725b82b481ab53f0717a429e94a; no voters: 5d1ee1ef054240338e0a9e05a67acdfc, ba2779405e8d452e95f42421b2b60928
I20260709 12:13:58.737498  9938 tablet_replica.cc:333] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
W20260709 12:13:58.737610 11826 raft_consensus.cc:2686] T 1b238aa9f5b8450ca03fed7b6a294cf3 P 2b4f4725b82b481ab53f0717a429e94a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:58.738906  9938 raft_consensus.cc:2243] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.739616  9938 raft_consensus.cc:2272] T e8f20890b5ce4b0294cf6746a2a341ff P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.742906  9938 tablet_replica.cc:333] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.743902  9938 raft_consensus.cc:2243] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.745308  9938 raft_consensus.cc:2272] T 84d8da0a42f045c0919f6b93b4a3ca15 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.748719  9938 tablet_replica.cc:333] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.749619  9938 raft_consensus.cc:2243] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.750311  9938 raft_consensus.cc:2272] T 8ce10840f1d143948ae8836765fb74d1 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.753405  9938 tablet_replica.cc:333] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.754345  9938 raft_consensus.cc:2243] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.755771  9938 raft_consensus.cc:2272] T 2fa9c55aa9ba49cc82db376e55f14ecc P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.759320  9938 tablet_replica.cc:333] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.760269  9938 raft_consensus.cc:2243] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.761559  9938 raft_consensus.cc:2272] T cbfeda1095314856b34426f3195f5c23 P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.765383  9938 tablet_replica.cc:333] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.766464  9938 raft_consensus.cc:2243] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.767256  9938 raft_consensus.cc:2272] T 9a38aa6d0e35417db86aadc82bb36b04 P 2b4f4725b82b481ab53f0717a429e94a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.770622  9938 tablet_replica.cc:333] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.771668  9938 raft_consensus.cc:2243] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.772917  9938 raft_consensus.cc:2272] T c75d2c70008a4d06a2db7185a2b623e2 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.776881  9938 tablet_replica.cc:333] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.777841  9938 raft_consensus.cc:2243] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.779232  9938 raft_consensus.cc:2272] T 7a24a63c03ef4eb980303acb738b9641 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.782637  9938 tablet_replica.cc:333] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.783571  9938 raft_consensus.cc:2243] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.784863  9938 raft_consensus.cc:2272] T 5b5563d41fc84c36a8d7eafa0e6a4968 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.788244  9938 tablet_replica.cc:333] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.789155  9938 raft_consensus.cc:2243] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.789851  9938 raft_consensus.cc:2272] T 7bea72104a4f4494b28f5e58c9ce7e41 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.792721  9938 tablet_replica.cc:333] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.793568  9938 raft_consensus.cc:2243] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.794308  9938 raft_consensus.cc:2272] T ee56790b88674a68962bb5866affcd4f P 2b4f4725b82b481ab53f0717a429e94a [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.797639  9938 tablet_replica.cc:333] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.798588  9938 raft_consensus.cc:2243] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.800168  9938 raft_consensus.cc:2272] T 14c3c7c84ef94275814f49349db79a72 P 2b4f4725b82b481ab53f0717a429e94a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.803725  9938 tablet_replica.cc:333] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.804682  9938 raft_consensus.cc:2243] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.806177  9938 raft_consensus.cc:2272] T a5275fafd0e7457694ac49b17b3fcfc1 P 2b4f4725b82b481ab53f0717a429e94a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.809923  9938 tablet_replica.cc:333] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.810945  9938 raft_consensus.cc:2243] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.811672  9938 raft_consensus.cc:2272] T 9948214ce1cd45429598d228699aa5a8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.814993  9938 tablet_replica.cc:333] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.815940  9938 raft_consensus.cc:2243] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.817046  9938 raft_consensus.cc:2272] T f1f091d9f19d495da80e2f33e1044577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.821126  9938 tablet_replica.cc:333] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.822022  9938 raft_consensus.cc:2243] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.822937  9938 raft_consensus.cc:2272] T 255c201215d14e89bc735bb8b57682cb P 2b4f4725b82b481ab53f0717a429e94a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.826735  9938 tablet_replica.cc:333] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.827620  9938 raft_consensus.cc:2243] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.829063  9938 raft_consensus.cc:2272] T 7e660be03b734102a4ad43c954498a96 P 2b4f4725b82b481ab53f0717a429e94a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.832353  9938 tablet_replica.cc:333] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.833240  9938 raft_consensus.cc:2243] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.834630  9938 raft_consensus.cc:2272] T 8857ecbbb0c7485d9d6ff255660d2547 P 2b4f4725b82b481ab53f0717a429e94a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.837961  9938 tablet_replica.cc:333] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.838877  9938 raft_consensus.cc:2243] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.839553  9938 raft_consensus.cc:2272] T a67ed18056054cad98bdf3dd430e6577 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.842716  9938 tablet_replica.cc:333] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.843583  9938 raft_consensus.cc:2243] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.844928  9938 raft_consensus.cc:2272] T a98f617dcc31482f9ed419423e8b50d5 P 2b4f4725b82b481ab53f0717a429e94a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.848083  9938 tablet_replica.cc:333] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.848981  9938 raft_consensus.cc:2243] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.850281  9938 raft_consensus.cc:2272] T 6250f2432a8a4fbb8c99e0f703ecd269 P 2b4f4725b82b481ab53f0717a429e94a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.853421  9938 tablet_replica.cc:333] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.854259  9938 raft_consensus.cc:2243] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.855293  9938 raft_consensus.cc:2272] T bc7de5348ade43f196ccf4a393cc5bb8 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.858937  9938 tablet_replica.cc:333] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.859783  9938 raft_consensus.cc:2243] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.860678  9938 raft_consensus.cc:2272] T 0b1a0c01c80c45d5a5e2a78cec27d0b7 P 2b4f4725b82b481ab53f0717a429e94a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.863957  9938 tablet_replica.cc:333] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.864799  9938 raft_consensus.cc:2243] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.866170  9938 raft_consensus.cc:2272] T 59b9f42c7ee544898eee55760f7287b3 P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.869448  9938 tablet_replica.cc:333] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.870474  9938 raft_consensus.cc:2243] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.871441  9938 raft_consensus.cc:2272] T c0c432ae03684756b937dd1aa2541cbd P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.875237  9938 tablet_replica.cc:333] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.876080  9938 raft_consensus.cc:2243] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.876885  9938 raft_consensus.cc:2272] T 8d5a128ee9974008ab01b0d55cfbb77e P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.879969  9938 tablet_replica.cc:333] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.880860  9938 raft_consensus.cc:2243] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.881711  9938 raft_consensus.cc:2272] T 64dc7dbbc231456da11adb2c7a1dada9 P 2b4f4725b82b481ab53f0717a429e94a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.884922  9938 tablet_replica.cc:333] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.885716  9938 raft_consensus.cc:2243] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.887059  9938 raft_consensus.cc:2272] T 92ccd088b1904dd1aae6563124beb655 P 2b4f4725b82b481ab53f0717a429e94a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.889974  9938 tablet_replica.cc:333] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a: stopping tablet replica
I20260709 12:13:58.890863  9938 raft_consensus.cc:2243] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.891654  9938 raft_consensus.cc:2272] T c4d8b59f386d4565b0103c44f0baa84d P 2b4f4725b82b481ab53f0717a429e94a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:59.540233  9938 tablet_server.cc:196] TabletServer@127.9.180.132:0 shutdown complete.
I20260709 12:13:59.636140  9938 master.cc:562] Master@127.9.180.190:38919 shutting down...
W20260709 12:13:59.686580 11090 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:13:59.686981 11090 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:59.687225 11090 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:14:14.087815 11028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111) [suppressed 42 similar messages]
W20260709 12:14:14.092211 11028 catalog_manager.cc:4755] TS 018d40ceb45d4447aa293f4c1d929bb8 (127.9.180.129:43503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ca6e44c82eda4c299b22957102352a23: Network error: Client connection negotiation failed: client connection to 127.9.180.129:43503: connect: Connection refused (error 111)
I20260709 12:14:16.698861  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:16.700217  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:16.700655  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 77709ed97aed432192038c6d22f779bc: stopping tablet replica
I20260709 12:14:16.908955  9938 master.cc:584] Master@127.9.180.190:38919 shutdown complete.
I20260709 12:14:16.968608  9938 test_util.cc:182] -----------------------------------------------
I20260709 12:14:16.968830  9938 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895524733-9938-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (298026 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:14:16.972759  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:38005
I20260709 12:14:16.973934  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:16.980674 20383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:16.980770 20384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:16.981137 20386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:16.983161  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:16.987339  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:16.987565  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:16.987794  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599256987756 us; error 0 us; skew 500 ppm
I20260709 12:14:16.988408  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:16.991375  9938 webserver.cc:533] Webserver started at http://127.9.180.190:46325/ using document root <none> and password file <none>
I20260709 12:14:16.991942  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:16.992154  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:16.992477  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:16.993896  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "06488dc712684224814be76ced523f11"
format_stamp: "Formatted at 2026-07-09 12:14:16 on dist-test-slave-lg8f"
I20260709 12:14:16.998948  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:14:17.002895 20391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.003902  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:17.004359  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "06488dc712684224814be76ced523f11"
format_stamp: "Formatted at 2026-07-09 12:14:16 on dist-test-slave-lg8f"
I20260709 12:14:17.004743  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:17.049959  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:17.051465  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:17.098994  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:38005
I20260709 12:14:17.099123 20442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:38005 every 8 connection(s)
I20260709 12:14:17.103778 20443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.115125 20443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11: Bootstrap starting.
I20260709 12:14:17.120108 20443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.125185 20443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11: No bootstrap required, opened a new log
I20260709 12:14:17.127436 20443 raft_consensus.cc:359] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06488dc712684224814be76ced523f11" member_type: VOTER }
I20260709 12:14:17.127876 20443 raft_consensus.cc:385] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.128121 20443 raft_consensus.cc:740] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06488dc712684224814be76ced523f11, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.128784 20443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06488dc712684224814be76ced523f11" member_type: VOTER }
I20260709 12:14:17.129251 20443 raft_consensus.cc:399] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:17.129487 20443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:17.129770 20443 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.134373 20443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06488dc712684224814be76ced523f11" member_type: VOTER }
I20260709 12:14:17.134979 20443 leader_election.cc:304] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06488dc712684224814be76ced523f11; no voters: 
I20260709 12:14:17.136241 20443 leader_election.cc:290] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:17.136780 20446 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.138407 20446 raft_consensus.cc:697] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 1 LEADER]: Becoming Leader. State: Replica: 06488dc712684224814be76ced523f11, State: Running, Role: LEADER
I20260709 12:14:17.139328 20443 sys_catalog.cc:565] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:17.139288 20446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06488dc712684224814be76ced523f11" member_type: VOTER }
I20260709 12:14:17.147583 20448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06488dc712684224814be76ced523f11. Latest consensus state: current_term: 1 leader_uuid: "06488dc712684224814be76ced523f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06488dc712684224814be76ced523f11" member_type: VOTER } }
I20260709 12:14:17.148367 20447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06488dc712684224814be76ced523f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06488dc712684224814be76ced523f11" member_type: VOTER } }
I20260709 12:14:17.148463 20448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:17.148995 20447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:17.151225 20454 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:17.157805 20454 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:17.158950  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:17.167387 20454 catalog_manager.cc:1383] Generated new cluster ID: ce9ee12a32fc47d386bb826bd8308ef7
I20260709 12:14:17.167685 20454 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:17.197387 20454 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:17.198731 20454 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:17.214529 20454 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11: Generated new TSK 0
I20260709 12:14:17.215131 20454 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:17.226476  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:17.233556 20464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.234890 20465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.238019 20467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:17.238974  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:17.242677  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:17.242928  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:17.243103  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599257243080 us; error 0 us; skew 500 ppm
I20260709 12:14:17.243686  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:17.246448  9938 webserver.cc:533] Webserver started at http://127.9.180.129:36255/ using document root <none> and password file <none>
I20260709 12:14:17.247042  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:17.247272  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:17.247586  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:17.248975  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "2ca675f8ab8b49e2b275294280376184"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.254155  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:14:17.258006 20472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.258934  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:17.259256  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "2ca675f8ab8b49e2b275294280376184"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.259562  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:17.272833  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:17.274163  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:17.275856  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:17.278322  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:17.278569  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:17.278841  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:17.279031  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.325318  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:34503
I20260709 12:14:17.325512 20534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:34503 every 8 connection(s)
I20260709 12:14:17.330991  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:17.339093 20539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.341754 20540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.344026 20542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:17.345077  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:17.348114  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:17.348309  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:17.348541  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599257348494 us; error 0 us; skew 500 ppm
I20260709 12:14:17.349169  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:17.351752  9938 webserver.cc:533] Webserver started at http://127.9.180.130:44985/ using document root <none> and password file <none>
I20260709 12:14:17.352269  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:17.352504  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:17.352820  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:17.354480  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.356328 20535 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38005
I20260709 12:14:17.356815 20535 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:17.357731 20535 heartbeater.cc:507] Master 127.9.180.190:38005 requested a full tablet report, sending...
I20260709 12:14:17.359704  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:14:17.360219 20408 ts_manager.cc:194] Registered new tserver with Master: 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:17.362455 20408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41872
I20260709 12:14:17.363895 20547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.364952  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:17.365247  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.365490  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:17.382130  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:17.383328  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:17.384882  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:17.387162  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:17.387341  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.387639  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:17.387794  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.433879  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:35285
I20260709 12:14:17.434006 20609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:35285 every 8 connection(s)
I20260709 12:14:17.439329  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:17.447965 20613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.449193 20614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.451869 20616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:17.453102  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:17.453801 20610 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38005
I20260709 12:14:17.454231  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:14:17.454232 20610 heartbeater.cc:461] Registering TS with master...
W20260709 12:14:17.454692  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:17.454917  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599257454900 us; error 0 us; skew 500 ppm
I20260709 12:14:17.455397 20610 heartbeater.cc:507] Master 127.9.180.190:38005 requested a full tablet report, sending...
I20260709 12:14:17.455717  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:17.457895 20408 ts_manager.cc:194] Registered new tserver with Master: d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:17.459004  9938 webserver.cc:533] Webserver started at http://127.9.180.131:38301/ using document root <none> and password file <none>
I20260709 12:14:17.459686  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:17.459833 20408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41888
I20260709 12:14:17.459928  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:17.460433  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:17.462134  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "ea25df1d72fa4708887246c33c9efcda"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.467039  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:14:17.470460 20621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.471402  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:17.471727  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "ea25df1d72fa4708887246c33c9efcda"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.472013  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:17.502456  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:17.503782  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:17.505151  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:17.507643  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:17.507874  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.508127  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:17.508307  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.552352  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:32887
I20260709 12:14:17.552639 20683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:32887 every 8 connection(s)
I20260709 12:14:17.558182  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:17.567566 20687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:17.567857 20688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:17.570971  9938 server_base.cc:1061] running on GCE node
W20260709 12:14:17.571787 20691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:17.573045  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:17.573385  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:17.573638  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599257573619 us; error 0 us; skew 500 ppm
I20260709 12:14:17.573755 20684 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38005
I20260709 12:14:17.574245 20684 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:17.574404  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:17.575350 20684 heartbeater.cc:507] Master 127.9.180.190:38005 requested a full tablet report, sending...
I20260709 12:14:17.577412  9938 webserver.cc:533] Webserver started at http://127.9.180.132:38325/ using document root <none> and password file <none>
I20260709 12:14:17.577971 20408 ts_manager.cc:194] Registered new tserver with Master: ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:17.578163  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:17.578456  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:17.578821  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:17.579887 20408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41900
I20260709 12:14:17.580384  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-3-root/instance:
uuid: "491eb72eef45486bb35575f2936538d9"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.585280  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:14:17.588776 20695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.589633  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:17.589949  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-3-root
uuid: "491eb72eef45486bb35575f2936538d9"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:17.590250  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:17.603899  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:17.605152  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:17.606812  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:17.609079  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:17.609302  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.609562  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:17.609737  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:17.657711  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.132:40653
I20260709 12:14:17.657910 20757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.132:40653 every 8 connection(s)
I20260709 12:14:17.674176 20758 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38005
I20260709 12:14:17.674839 20758 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:17.675745 20758 heartbeater.cc:507] Master 127.9.180.190:38005 requested a full tablet report, sending...
I20260709 12:14:17.677934 20408 ts_manager.cc:194] Registered new tserver with Master: 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:17.679049  9938 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017613427s
I20260709 12:14:17.679482 20408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41904
I20260709 12:14:17.708343 20408 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41906:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:14:17.954535 20499 tablet_service.cc:1511] Processing CreateTablet for tablet f74b64599c6f4b7a8b7e745cd3cf8bf3 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:17.954778 20500 tablet_service.cc:1511] Processing CreateTablet for tablet 684797a7958648ebb2abe2ea5d62a4ab (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:17.956103 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74b64599c6f4b7a8b7e745cd3cf8bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.956890 20500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684797a7958648ebb2abe2ea5d62a4ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.962584 20498 tablet_service.cc:1511] Processing CreateTablet for tablet f48d7ba791884a2daf277f9c261b1405 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:17.964385 20498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48d7ba791884a2daf277f9c261b1405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.967847 20649 tablet_service.cc:1511] Processing CreateTablet for tablet 684797a7958648ebb2abe2ea5d62a4ab (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:17.970079 20649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684797a7958648ebb2abe2ea5d62a4ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.973366 20497 tablet_service.cc:1511] Processing CreateTablet for tablet 74e746c068884fe09a59543355686d5f (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:17.974965 20497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e746c068884fe09a59543355686d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.976650 20723 tablet_service.cc:1511] Processing CreateTablet for tablet 684797a7958648ebb2abe2ea5d62a4ab (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:17.978224 20723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684797a7958648ebb2abe2ea5d62a4ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.979959 20496 tablet_service.cc:1511] Processing CreateTablet for tablet fc0a0b1fae4f4ec18e826e98ecafe0f6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:17.981554 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0a0b1fae4f4ec18e826e98ecafe0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.983853 20719 tablet_service.cc:1511] Processing CreateTablet for tablet b7a1a775a88343de81c5bc5f5bdb1b85 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:17.984025 20722 tablet_service.cc:1511] Processing CreateTablet for tablet f48d7ba791884a2daf277f9c261b1405 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:17.985530 20719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a1a775a88343de81c5bc5f5bdb1b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.986243 20721 tablet_service.cc:1511] Processing CreateTablet for tablet b327ac80d17949f8aa3f002cf22986ab (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:17.987214 20722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48d7ba791884a2daf277f9c261b1405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.987980 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b327ac80d17949f8aa3f002cf22986ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.991374 20494 tablet_service.cc:1511] Processing CreateTablet for tablet b76fe14c9d9a411b8077b228665e6008 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:17.991886 20720 tablet_service.cc:1511] Processing CreateTablet for tablet fc0a0b1fae4f4ec18e826e98ecafe0f6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:17.993059 20494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76fe14c9d9a411b8077b228665e6008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.993314 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0a0b1fae4f4ec18e826e98ecafe0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.986159 20495 tablet_service.cc:1511] Processing CreateTablet for tablet b7a1a775a88343de81c5bc5f5bdb1b85 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:17.995581 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a1a775a88343de81c5bc5f5bdb1b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:17.996469 20718 tablet_service.cc:1511] Processing CreateTablet for tablet 2a44462e219640a88b4641e632a284c6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:17.997942 20718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a44462e219640a88b4641e632a284c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.003082 20717 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd837fa16b64d78b8142773b317ff3f (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:18.004760 20717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd837fa16b64d78b8142773b317ff3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.007757 20715 tablet_service.cc:1511] Processing CreateTablet for tablet e708e6dd44c04400839f898100989df0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:18.009414 20715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e708e6dd44c04400839f898100989df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.011942 20716 tablet_service.cc:1511] Processing CreateTablet for tablet da27acfc34b4452b95b09724ccd054ac (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:18.012347 20648 tablet_service.cc:1511] Processing CreateTablet for tablet f74b64599c6f4b7a8b7e745cd3cf8bf3 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:18.013936 20648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74b64599c6f4b7a8b7e745cd3cf8bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.017567 20491 tablet_service.cc:1511] Processing CreateTablet for tablet 3e74df625baa4137a2f384e41c185f8a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:18.019119 20492 tablet_service.cc:1511] Processing CreateTablet for tablet da27acfc34b4452b95b09724ccd054ac (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:18.014901 20493 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd837fa16b64d78b8142773b317ff3f (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:18.022300 20714 tablet_service.cc:1511] Processing CreateTablet for tablet 7403d046fdc74d9aa962b9cd7c64f41b (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:18.024396 20491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e74df625baa4137a2f384e41c185f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.028731 20647 tablet_service.cc:1511] Processing CreateTablet for tablet b327ac80d17949f8aa3f002cf22986ab (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:18.030355 20647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b327ac80d17949f8aa3f002cf22986ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.041754 20646 tablet_service.cc:1511] Processing CreateTablet for tablet 74e746c068884fe09a59543355686d5f (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:18.043277 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e746c068884fe09a59543355686d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.050884 20716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27acfc34b4452b95b09724ccd054ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.059639 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403d046fdc74d9aa962b9cd7c64f41b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.060097 20645 tablet_service.cc:1511] Processing CreateTablet for tablet b7a1a775a88343de81c5bc5f5bdb1b85 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:18.062011 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a1a775a88343de81c5bc5f5bdb1b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.047993 20492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27acfc34b4452b95b09724ccd054ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.068230 20493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd837fa16b64d78b8142773b317ff3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.084493 20644 tablet_service.cc:1511] Processing CreateTablet for tablet 2a44462e219640a88b4641e632a284c6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:18.086122 20644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a44462e219640a88b4641e632a284c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.087905 20643 tablet_service.cc:1511] Processing CreateTablet for tablet b76fe14c9d9a411b8077b228665e6008 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:18.090667 20642 tablet_service.cc:1511] Processing CreateTablet for tablet da27acfc34b4452b95b09724ccd054ac (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:18.093150 20641 tablet_service.cc:1511] Processing CreateTablet for tablet e708e6dd44c04400839f898100989df0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:18.095717 20640 tablet_service.cc:1511] Processing CreateTablet for tablet 3e74df625baa4137a2f384e41c185f8a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:18.100417 20641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e708e6dd44c04400839f898100989df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.102852 20642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27acfc34b4452b95b09724ccd054ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.107991 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76fe14c9d9a411b8077b228665e6008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.110869 20640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e74df625baa4137a2f384e41c185f8a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:18.154784 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:18.171593 20718 tablet_service.cc:1511] Processing CreateTablet for tablet 47835231a92d4f15accf212d579f7d6e (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:18.173892 20648 tablet_service.cc:1511] Processing CreateTablet for tablet 47835231a92d4f15accf212d579f7d6e (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:18.174953 20645 tablet_service.cc:1511] Processing CreateTablet for tablet a7ec97c769014205af4764e131c2ba36 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:18.181929 20718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47835231a92d4f15accf212d579f7d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.192682 20648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47835231a92d4f15accf212d579f7d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.183535 20496 tablet_service.cc:1511] Processing CreateTablet for tablet 7403d046fdc74d9aa962b9cd7c64f41b (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:18.195468 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403d046fdc74d9aa962b9cd7c64f41b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.196287 20499 tablet_service.cc:1511] Processing CreateTablet for tablet 47835231a92d4f15accf212d579f7d6e (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:18.211110 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ec97c769014205af4764e131c2ba36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.220559 20646 tablet_service.cc:1511] Processing CreateTablet for tablet 7be7972679734f9ea94cced565e677c6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:18.201596 20720 tablet_service.cc:1511] Processing CreateTablet for tablet a7ec97c769014205af4764e131c2ba36 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:18.224198 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ec97c769014205af4764e131c2ba36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.237218 20573 tablet_service.cc:1511] Processing CreateTablet for tablet b327ac80d17949f8aa3f002cf22986ab (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:18.239817 20570 tablet_service.cc:1511] Processing CreateTablet for tablet 2a44462e219640a88b4641e632a284c6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:18.241308 20570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a44462e219640a88b4641e632a284c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.243459 20574 tablet_service.cc:1511] Processing CreateTablet for tablet f48d7ba791884a2daf277f9c261b1405 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:18.245652 20574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48d7ba791884a2daf277f9c261b1405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.247452 20573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b327ac80d17949f8aa3f002cf22986ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.248242 20572 tablet_service.cc:1511] Processing CreateTablet for tablet 74e746c068884fe09a59543355686d5f (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:18.240552 20575 tablet_service.cc:1511] Processing CreateTablet for tablet f74b64599c6f4b7a8b7e745cd3cf8bf3 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:18.245707 20568 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd837fa16b64d78b8142773b317ff3f (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:18.251307 20779 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:18.251838 20575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74b64599c6f4b7a8b7e745cd3cf8bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.251674 20571 tablet_service.cc:1511] Processing CreateTablet for tablet fc0a0b1fae4f4ec18e826e98ecafe0f6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:18.252753 20568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd837fa16b64d78b8142773b317ff3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.254037 20567 tablet_service.cc:1511] Processing CreateTablet for tablet e708e6dd44c04400839f898100989df0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:18.255375 20572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e746c068884fe09a59543355686d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.259907 20566 tablet_service.cc:1511] Processing CreateTablet for tablet 3e74df625baa4137a2f384e41c185f8a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:18.243816 20569 tablet_service.cc:1511] Processing CreateTablet for tablet b76fe14c9d9a411b8077b228665e6008 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:18.263413 20777 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:18.267109 20566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e74df625baa4137a2f384e41c185f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.268021 20500 tablet_service.cc:1511] Processing CreateTablet for tablet 24b9972f873044ed82799e7051a8f79c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:18.271881 20569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76fe14c9d9a411b8077b228665e6008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.274547 20649 tablet_service.cc:1511] Processing CreateTablet for tablet 74580946c1b34dca8f017310b582f20c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:18.279867 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e708e6dd44c04400839f898100989df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.271481 20717 tablet_service.cc:1511] Processing CreateTablet for tablet 74580946c1b34dca8f017310b582f20c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:18.284217 20717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74580946c1b34dca8f017310b582f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.284843 20778 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:18.285920 20571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0a0b1fae4f4ec18e826e98ecafe0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.287791 20495 tablet_service.cc:1511] Processing CreateTablet for tablet 7be7972679734f9ea94cced565e677c6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:18.288980 20722 tablet_service.cc:1511] Processing CreateTablet for tablet 51b188093e7f4e49b475a039b4dc0022 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:18.294580 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47835231a92d4f15accf212d579f7d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.249720 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be7972679734f9ea94cced565e677c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.312566 20494 tablet_service.cc:1511] Processing CreateTablet for tablet 74580946c1b34dca8f017310b582f20c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:18.285976 20721 tablet_service.cc:1511] Processing CreateTablet for tablet 24b9972f873044ed82799e7051a8f79c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:18.314097 20494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74580946c1b34dca8f017310b582f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.316110 20498 tablet_service.cc:1511] Processing CreateTablet for tablet d16e210fa30f4a9d971b30b7e5439515 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:18.317806 20642 tablet_service.cc:1511] Processing CreateTablet for tablet d16e210fa30f4a9d971b30b7e5439515 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:18.321273 20779 tablet_bootstrap.cc:654] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.343022 20500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b9972f873044ed82799e7051a8f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.345530 20498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16e210fa30f4a9d971b30b7e5439515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.346958 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b9972f873044ed82799e7051a8f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.347872 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be7972679734f9ea94cced565e677c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.349720 20722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b188093e7f4e49b475a039b4dc0022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.321029 20497 tablet_service.cc:1511] Processing CreateTablet for tablet a8c315ff4fd74be5a73f34e66c452920 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:18.327069 20491 tablet_service.cc:1511] Processing CreateTablet for tablet 46c3ec756598438db6b68df006b111ef (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:18.327514 20643 tablet_service.cc:1511] Processing CreateTablet for tablet 46c3ec756598438db6b68df006b111ef (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:18.328716 20649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74580946c1b34dca8f017310b582f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.353612 20497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c315ff4fd74be5a73f34e66c452920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.332204 20640 tablet_service.cc:1511] Processing CreateTablet for tablet 91e700eae1d14008b9b5f277207b7f47 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:18.333140 20647 tablet_service.cc:1511] Processing CreateTablet for tablet 51b188093e7f4e49b475a039b4dc0022 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:18.358366 20719 tablet_service.cc:1511] Processing CreateTablet for tablet 91e700eae1d14008b9b5f277207b7f47 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:18.360069 20719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e700eae1d14008b9b5f277207b7f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.358366 20723 tablet_service.cc:1511] Processing CreateTablet for tablet 46c3ec756598438db6b68df006b111ef (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:18.362320 20716 tablet_service.cc:1511] Processing CreateTablet for tablet 8e744c13d5a84d18965663d8e15147b8 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:18.363251 20723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c3ec756598438db6b68df006b111ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.365924 20535 heartbeater.cc:499] Master 127.9.180.190:38005 was elected leader, sending a full tablet report...
I20260709 12:14:18.367929 20491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c3ec756598438db6b68df006b111ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.370950 20642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16e210fa30f4a9d971b30b7e5439515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.372970 20647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b188093e7f4e49b475a039b4dc0022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.374661 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c3ec756598438db6b68df006b111ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.385171 20640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e700eae1d14008b9b5f277207b7f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.388360 20716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e744c13d5a84d18965663d8e15147b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.354202 20715 tablet_service.cc:1511] Processing CreateTablet for tablet a8c315ff4fd74be5a73f34e66c452920 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:18.397126 20715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c315ff4fd74be5a73f34e66c452920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.462991 20610 heartbeater.cc:499] Master 127.9.180.190:38005 was elected leader, sending a full tablet report...
I20260709 12:14:18.495263 20714 tablet_service.cc:1511] Processing CreateTablet for tablet 0b60bfb738d7452f8eed2ef5de1209f5 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:18.497130 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b60bfb738d7452f8eed2ef5de1209f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.512225 20778 tablet_bootstrap.cc:654] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.525719 20499 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5066470d3b4a1bad58285cfaad4b11 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:18.526937 20644 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5066470d3b4a1bad58285cfaad4b11 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:18.534560 20567 tablet_service.cc:1511] Processing CreateTablet for tablet 7816f77dbdd34454829a05b79e59e7f2 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:18.522131 20718 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd2f2e25de645878298811e12c1eefe (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:18.556895 20496 tablet_service.cc:1511] Processing CreateTablet for tablet 0b60bfb738d7452f8eed2ef5de1209f5 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:18.579243 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7816f77dbdd34454829a05b79e59e7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.579932 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b60bfb738d7452f8eed2ef5de1209f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.582046 20718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2f2e25de645878298811e12c1eefe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.582937 20684 heartbeater.cc:499] Master 127.9.180.190:38005 was elected leader, sending a full tablet report...
I20260709 12:14:18.552296 20493 tablet_service.cc:1511] Processing CreateTablet for tablet 8e744c13d5a84d18965663d8e15147b8 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:18.584206 20493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e744c13d5a84d18965663d8e15147b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.567881 20566 tablet_service.cc:1511] Processing CreateTablet for tablet 91e700eae1d14008b9b5f277207b7f47 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:18.590860 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5066470d3b4a1bad58285cfaad4b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.592387 20777 tablet_bootstrap.cc:654] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.596100 20569 tablet_service.cc:1511] Processing CreateTablet for tablet 7403d046fdc74d9aa962b9cd7c64f41b (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:18.558988 20494 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1aa42341cf4cefb9820116cc711eaf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:18.608466 20494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1aa42341cf4cefb9820116cc711eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.614280 20569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7403d046fdc74d9aa962b9cd7c64f41b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.624584 20492 tablet_service.cc:1511] Processing CreateTablet for tablet 11c20742313b4aeeb03cc3df575852e1 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:18.637423 20641 tablet_service.cc:1511] Processing CreateTablet for tablet 0b60bfb738d7452f8eed2ef5de1209f5 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:18.640239 20645 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd2f2e25de645878298811e12c1eefe (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:18.642344 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2f2e25de645878298811e12c1eefe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.652235 20492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c20742313b4aeeb03cc3df575852e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.651877 20721 tablet_service.cc:1511] Processing CreateTablet for tablet 11c20742313b4aeeb03cc3df575852e1 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:14:18.668277 20392 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 336795us
W20260709 12:14:18.679913 20394 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 328065us
I20260709 12:14:18.680625 20573 tablet_service.cc:1511] Processing CreateTablet for tablet a7ec97c769014205af4764e131c2ba36 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:18.682250 20778 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:18.684906 20778 ts_tablet_manager.cc:1403] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.401s	user 0.017s	sys 0.012s
I20260709 12:14:18.682469 20758 heartbeater.cc:499] Master 127.9.180.190:38005 was elected leader, sending a full tablet report...
I20260709 12:14:18.688217 20778 raft_consensus.cc:359] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:18.683758 20393 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 170800us
I20260709 12:14:18.689020 20778 raft_consensus.cc:385] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.689402 20778 raft_consensus.cc:740] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.684293 20779 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:18.691608 20779 ts_tablet_manager.cc:1403] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.441s	user 0.016s	sys 0.020s
I20260709 12:14:18.700139 20779 raft_consensus.cc:359] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:18.702747 20779 raft_consensus.cc:385] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.700495 20640 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1aa42341cf4cefb9820116cc711eaf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:18.707355 20779 raft_consensus.cc:740] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.714522 20641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b60bfb738d7452f8eed2ef5de1209f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.698599 20574 tablet_service.cc:1511] Processing CreateTablet for tablet 51b188093e7f4e49b475a039b4dc0022 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:18.721228 20646 tablet_service.cc:1511] Processing CreateTablet for tablet e63b44fdabd6441ea3397fea5da63694 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:18.725848 20644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5066470d3b4a1bad58285cfaad4b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.730733 20778 consensus_queue.cc:260] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:18.732936 20499 tablet_service.cc:1511] Processing CreateTablet for tablet e63b44fdabd6441ea3397fea5da63694 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:18.734951 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63b44fdabd6441ea3397fea5da63694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.686431 20572 tablet_service.cc:1511] Processing CreateTablet for tablet 7be7972679734f9ea94cced565e677c6 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:18.736124 20575 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5066470d3b4a1bad58285cfaad4b11 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:18.740192 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63b44fdabd6441ea3397fea5da63694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.742273 20496 tablet_service.cc:1511] Processing CreateTablet for tablet 97b49c22a2f045d083b793ec9a932dd0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:18.743722 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b49c22a2f045d083b793ec9a932dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.713977 20568 tablet_service.cc:1511] Processing CreateTablet for tablet d16e210fa30f4a9d971b30b7e5439515 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:18.719362 20566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e700eae1d14008b9b5f277207b7f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.720386 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c20742313b4aeeb03cc3df575852e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.737851 20495 tablet_service.cc:1511] Processing CreateTablet for tablet 91424c9e0aab4fc6a3b15c6359edbf9e (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:18.764361 20640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1aa42341cf4cefb9820116cc711eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.764645 20779 consensus_queue.cc:260] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:18.765856 20571 tablet_service.cc:1511] Processing CreateTablet for tablet 8e744c13d5a84d18965663d8e15147b8 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:18.764424 20570 tablet_service.cc:1511] Processing CreateTablet for tablet 24b9972f873044ed82799e7051a8f79c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:18.767030 20781 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:18.767765 20572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be7972679734f9ea94cced565e677c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.770442 20573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ec97c769014205af4764e131c2ba36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.766343 20777 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:18.771821 20777 ts_tablet_manager.cc:1403] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.509s	user 0.005s	sys 0.016s
I20260709 12:14:18.776362 20777 raft_consensus.cc:359] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:18.777371 20777 raft_consensus.cc:385] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:18.777777 20777 raft_consensus.cc:740] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:18.782904 20571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e744c13d5a84d18965663d8e15147b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.798743 20720 tablet_service.cc:1511] Processing CreateTablet for tablet e63b44fdabd6441ea3397fea5da63694 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:18.805135 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63b44fdabd6441ea3397fea5da63694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.806666 20649 tablet_service.cc:1511] Processing CreateTablet for tablet 292e7809bb4a42639e34ae1cf67f2541 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:18.808228 20649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292e7809bb4a42639e34ae1cf67f2541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.808290 20574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b188093e7f4e49b475a039b4dc0022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.810772 20570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24b9972f873044ed82799e7051a8f79c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.813246 20714 tablet_service.cc:1511] Processing CreateTablet for tablet 292e7809bb4a42639e34ae1cf67f2541 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:18.814845 20568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16e210fa30f4a9d971b30b7e5439515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.831036 20779 ts_tablet_manager.cc:1434] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.001s
I20260709 12:14:18.830731 20777 consensus_queue.cc:260] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:18.832337 20779 tablet_bootstrap.cc:492] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:18.840713 20781 tablet_bootstrap.cc:654] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.846781 20575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5066470d3b4a1bad58285cfaad4b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.850988 20567 tablet_service.cc:1511] Processing CreateTablet for tablet a8c315ff4fd74be5a73f34e66c452920 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:18.856710 20647 tablet_service.cc:1511] Processing CreateTablet for tablet 91424c9e0aab4fc6a3b15c6359edbf9e (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:18.857751 20785 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.900470 20491 tablet_service.cc:1511] Processing CreateTablet for tablet 18c9fc057a5146cc8d2ea60658b76b68 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:18.900898 20785 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:18.868629 20778 ts_tablet_manager.cc:1434] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.183s	user 0.007s	sys 0.005s
I20260709 12:14:18.874883 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91424c9e0aab4fc6a3b15c6359edbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.905560 20784 raft_consensus.cc:493] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.905766 20785 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:18.880402 20717 tablet_service.cc:1511] Processing CreateTablet for tablet 97b49c22a2f045d083b793ec9a932dd0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:18.884651 20643 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd5ef95d6fb4ce880377ca28d298a81 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:18.884178 20722 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd5ef95d6fb4ce880377ca28d298a81 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:18.892686 20716 tablet_service.cc:1511] Processing CreateTablet for tablet 7816f77dbdd34454829a05b79e59e7f2 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:14:18.917042 20759 tablet.cc:2406] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:18.931401 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292e7809bb4a42639e34ae1cf67f2541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.934604 20491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c9fc057a5146cc8d2ea60658b76b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.919020 20719 tablet_service.cc:1511] Processing CreateTablet for tablet 52d9fef03cd64257b9d1812dbdec74cf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:18.906219 20784 raft_consensus.cc:515] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:18.920953 20778 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:18.929543 20573 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd2f2e25de645878298811e12c1eefe (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:18.935953 20779 tablet_bootstrap.cc:654] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:18.960665 20784 leader_election.cc:290] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:18.948678 20647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91424c9e0aab4fc6a3b15c6359edbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.947337 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c315ff4fd74be5a73f34e66c452920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.961617 20722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd5ef95d6fb4ce880377ca28d298a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.939944 20497 tablet_service.cc:1511] Processing CreateTablet for tablet 52d9fef03cd64257b9d1812dbdec74cf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:18.935932 20720 tablet_service.cc:1511] Processing CreateTablet for tablet 59de2302cbac41d593cde64fe0aad5d8 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:18.976107 20642 tablet_service.cc:1511] Processing CreateTablet for tablet 7816f77dbdd34454829a05b79e59e7f2 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:18.990620 20640 tablet_service.cc:1511] Processing CreateTablet for tablet 18c9fc057a5146cc8d2ea60658b76b68 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:18.992136 20716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7816f77dbdd34454829a05b79e59e7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.007017 20573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd2f2e25de645878298811e12c1eefe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.012949 20574 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1aa42341cf4cefb9820116cc711eaf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:19.016479 20572 tablet_service.cc:1511] Processing CreateTablet for tablet 91424c9e0aab4fc6a3b15c6359edbf9e (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:19.025996 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd5ef95d6fb4ce880377ca28d298a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:18.944783 20498 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd5ef95d6fb4ce880377ca28d298a81 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:19.038899 20497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d9fef03cd64257b9d1812dbdec74cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.044000 20777 ts_tablet_manager.cc:1434] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.272s	user 0.013s	sys 0.012s
I20260709 12:14:19.045248 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59de2302cbac41d593cde64fe0aad5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.060356 20572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91424c9e0aab4fc6a3b15c6359edbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.060464 20781 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:19.061179 20781 ts_tablet_manager.cc:1403] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.297s	user 0.017s	sys 0.011s
I20260709 12:14:19.061671 20498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd5ef95d6fb4ce880377ca28d298a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.062852 20574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1aa42341cf4cefb9820116cc711eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.064435 20781 raft_consensus.cc:359] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:19.065184 20781 raft_consensus.cc:385] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.065449 20781 raft_consensus.cc:740] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.065613 20715 tablet_service.cc:1511] Processing CreateTablet for tablet c68b8d772da049a19db34b2f00090efe (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:19.067761 20569 tablet_service.cc:1511] Processing CreateTablet for tablet 11c20742313b4aeeb03cc3df575852e1 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:19.069114 20569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c20742313b4aeeb03cc3df575852e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.076615 20566 tablet_service.cc:1511] Processing CreateTablet for tablet 97b49c22a2f045d083b793ec9a932dd0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:19.078238 20566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b49c22a2f045d083b793ec9a932dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.081367 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:19.084864 20645 tablet_service.cc:1511] Processing CreateTablet for tablet 59de2302cbac41d593cde64fe0aad5d8 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:19.066197 20781 consensus_queue.cc:260] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:19.042266 20493 tablet_service.cc:1511] Processing CreateTablet for tablet 59de2302cbac41d593cde64fe0aad5d8 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:19.123183 20499 tablet_service.cc:1511] Processing CreateTablet for tablet 98538592057b4546a7267066f54c5732 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:19.127942 20718 tablet_service.cc:1511] Processing CreateTablet for tablet 48011569942a40d1aa1ebe657707a381 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:19.130968 20644 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 18) took 1026 ms. Trace:
I20260709 12:14:19.131572 20777 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:19.132160 20641 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 19) took 1027 ms. Trace:
I20260709 12:14:19.133575 20569 tablet_service.cc:1511] Processing CreateTablet for tablet 292e7809bb4a42639e34ae1cf67f2541 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:19.134214 20643 tablet_service.cc:1511] Processing CreateTablet for tablet c68b8d772da049a19db34b2f00090efe (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:19.136999 20717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b49c22a2f045d083b793ec9a932dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.154829 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98538592057b4546a7267066f54c5732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.160266 20492 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34206 (request call id 22) took 1012 ms. Trace:
I20260709 12:14:19.160808 20492 rpcz_store.cc:276] 0709 12:14:18.147493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.623600 (+476107us) service_pool.cc:224] Handling call
0709 12:14:18.651733 (+ 28133us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.651838 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.893722 (+241884us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.159706 (+265984us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.160197 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:19.153404 20697 leader_election.cc:343] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.162078 20778 tablet_bootstrap.cc:654] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.162694 20493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59de2302cbac41d593cde64fe0aad5d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:19.163420 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:19.163931 20648 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 10) took 1076 ms. Trace:
I20260709 12:14:19.142408 20640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c9fc057a5146cc8d2ea60658b76b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.148394 20641 rpcz_store.cc:276] 0709 12:14:18.104951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.636360 (+531409us) service_pool.cc:224] Handling call
0709 12:14:18.667412 (+ 31052us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.714036 (+ 46624us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.861339 (+147303us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.026314 (+164975us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.132099 (+105785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.179095 20641 tablet_service.cc:1511] Processing CreateTablet for tablet 98538592057b4546a7267066f54c5732 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:19.180637 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59de2302cbac41d593cde64fe0aad5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.182873 20715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68b8d772da049a19db34b2f00090efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.202947 20719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d9fef03cd64257b9d1812dbdec74cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.206878 20718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48011569942a40d1aa1ebe657707a381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.208616 20642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7816f77dbdd34454829a05b79e59e7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.210688 20721 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51878 (request call id 21) took 1064 ms. Trace:
I20260709 12:14:19.210894 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68b8d772da049a19db34b2f00090efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.144711 20644 rpcz_store.cc:276] 0709 12:14:18.104110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.516987 (+412877us) service_pool.cc:224] Handling call
0709 12:14:18.618636 (+101649us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5800003c98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b6a22 00007f98368cf8d9 00007f9835a29ee0 00007f9835b0f831 00007f9835aecac3 00007f9835a9b400 00007f982ef20af4 00007f982ef20a82 00007f982ef209b1
0709 12:14:18.720857 (+102221us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.725438 (+  4581us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.796129 (+ 70691us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.014714 (+218585us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.130885 (+116171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52391552}
I20260709 12:14:19.213668 20571 tablet_service.cc:1511] Processing CreateTablet for tablet 18c9fc057a5146cc8d2ea60658b76b68 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:19.214112 20646 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 22) took 1059 ms. Trace:
I20260709 12:14:19.218743 20646 rpcz_store.cc:276] 0709 12:14:18.154845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.701664 (+546819us) service_pool.cc:224] Handling call
0709 12:14:18.739734 (+ 38070us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.739824 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.958850 (+219026us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.169281 (+210431us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.214043 (+ 44762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.214556 20500 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34206 (request call id 13) took 1182 ms. Trace:
I20260709 12:14:19.215143 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:19.219967 20500 rpcz_store.cc:276] 0709 12:14:18.032019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.267083 (+235064us) service_pool.cc:224] Handling call
0709 12:14:18.317342 (+ 50259us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.317443 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.715201 (+397758us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.028181 (+312980us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.187894 (+159713us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5800000998. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b71a2 00007f98368f8889 00007f9835a29d88 00007f9835af0973 00007f9835aec70f 00007f9835aececd 00007f9835a9b400 00007f982ef20af4 00007f982ef20a82
0709 12:14:19.214467 (+ 26573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6335360}
I20260709 12:14:19.219626 20492 tablet_service.cc:1511] Processing CreateTablet for tablet 48011569942a40d1aa1ebe657707a381 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:19.213235 20641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98538592057b4546a7267066f54c5732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.222517 20492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48011569942a40d1aa1ebe657707a381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.222856 20569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292e7809bb4a42639e34ae1cf67f2541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.229260 20570 tablet_service.cc:1511] Processing CreateTablet for tablet 52d9fef03cd64257b9d1812dbdec74cf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:19.230721 20570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d9fef03cd64257b9d1812dbdec74cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.231900 20781 ts_tablet_manager.cc:1434] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.170s	user 0.012s	sys 0.004s
I20260709 12:14:19.267558 20781 tablet_bootstrap.cc:492] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
W20260709 12:14:19.221318 20696 leader_election.cc:343] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.270764 20696 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:19.270984 20646 tablet_service.cc:1511] Processing CreateTablet for tablet d25019682b2f4f4598912e1bee5d76e1 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:14:19.274748 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 53638us
I20260709 12:14:19.275441 20785 raft_consensus.cc:2749] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.215860 20495 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34206 (request call id 24) took 1041 ms. Trace:
I20260709 12:14:19.277653 20495 rpcz_store.cc:276] 0709 12:14:18.174904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.736760 (+561856us) service_pool.cc:224] Handling call
0709 12:14:18.818284 (+ 81524us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.824419 (+  6135us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.106113 (+281694us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.215334 (+109221us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.215802 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.243747 20723 tablet_service.cc:1511] Processing CreateTablet for tablet 9f124d084cc54b6ab38cbb14dd6b3919 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:19.250593 20649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 23) took 1083 ms. Trace:
I20260709 12:14:19.254552 20566 tablet_service.cc:1511] Processing CreateTablet for tablet c68b8d772da049a19db34b2f00090efe (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:19.213016 20721 rpcz_store.cc:276] 0709 12:14:18.146109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.650731 (+504622us) service_pool.cc:224] Handling call
0709 12:14:18.718616 (+ 67885us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.718748 (+   132us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.983566 (+264818us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.168847 (+185281us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.210613 (+ 41766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.260720 20647 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 24) took 1077 ms. Trace:
I20260709 12:14:19.260860 20500 tablet_service.cc:1511] Processing CreateTablet for tablet 9f124d084cc54b6ab38cbb14dd6b3919 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:19.263335 20722 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51878 (request call id 25) took 1065 ms. Trace:
I20260709 12:14:19.264678 20777 tablet_bootstrap.cc:654] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.275509 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25019682b2f4f4598912e1bee5d76e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.174909 20648 rpcz_store.cc:276] 0709 12:14:18.087556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.172837 (+ 85281us) service_pool.cc:224] Handling call
0709 12:14:18.192149 (+ 19312us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.192267 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.775150 (+582883us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:18.987627 (+212477us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.158888 (+171261us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b5800003c98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b71a2 00007f98368f8889 00007f9835a29d88 00007f9835af0973 00007f9835aec70f 00007f9835aececd 00007f9835a9b400 00007f982ef20af4 00007f982ef20a82
0709 12:14:19.163863 (+  4975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10424064}
I20260709 12:14:19.246173 20714 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51878 (request call id 23) took 1075 ms. Trace:
I20260709 12:14:19.286980 20721 tablet_service.cc:1511] Processing CreateTablet for tablet d25019682b2f4f4598912e1bee5d76e1 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:19.326297 20714 rpcz_store.cc:276] 0709 12:14:18.170678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.812295 (+641617us) service_pool.cc:224] Handling call
0709 12:14:18.890588 (+ 78293us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.890779 (+   191us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.196933 (+306154us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.245545 (+ 48612us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.246107 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.287847 20494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34206 (request call id 21) took 1159 ms. Trace:
I20260709 12:14:19.288900 20723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f124d084cc54b6ab38cbb14dd6b3919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.328053 20500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f124d084cc54b6ab38cbb14dd6b3919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.282581 20649 rpcz_store.cc:276] 0709 12:14:18.167174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.805603 (+638429us) service_pool.cc:224] Handling call
0709 12:14:18.807644 (+  2041us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.807828 (+   184us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:18.958399 (+150571us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.250003 (+291604us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.250521 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.291450 20796 raft_consensus.cc:493] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.329380 20796 raft_consensus.cc:515] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:19.331030 20494 rpcz_store.cc:276] 0709 12:14:18.128165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.556845 (+428680us) service_pool.cc:224] Handling call
0709 12:14:18.607768 (+ 50923us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.607926 (+   158us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.067647 (+459721us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.287266 (+219619us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.287782 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.300715 20495 tablet_service.cc:1511] Processing CreateTablet for tablet e142dcf7243c48a5a62d1a8b2cae011c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:19.291492 20641 tablet_service.cc:1511] Processing CreateTablet for tablet 9f124d084cc54b6ab38cbb14dd6b3919 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:19.308841 20644 tablet_service.cc:1511] Processing CreateTablet for tablet e142dcf7243c48a5a62d1a8b2cae011c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:19.310708 20786 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.311906 20575 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 18) took 1053 ms. Trace:
I20260709 12:14:19.346755 20786 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:19.347317 20575 rpcz_store.cc:276] 0709 12:14:18.258143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.735012 (+476869us) service_pool.cc:224] Handling call
0709 12:14:18.740747 (+  5735us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.740861 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.164349 (+423488us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.311322 (+146973us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.311835 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.315634 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:19.321224 20573 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 20) took 1022 ms. Trace:
I20260709 12:14:19.322614 20571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c9fc057a5146cc8d2ea60658b76b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.322969 20496 tablet_service.cc:1511] Processing CreateTablet for tablet a86b5f8a698448b3acb2cbe9320acf4a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:19.328441 20714 tablet_service.cc:1511] Processing CreateTablet for tablet a86b5f8a698448b3acb2cbe9320acf4a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:19.334432 20796 leader_election.cc:290] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:19.334892 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25019682b2f4f4598912e1bee5d76e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.324733 20722 rpcz_store.cc:276] 0709 12:14:18.197723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.882252 (+684529us) service_pool.cc:224] Handling call
0709 12:14:18.925883 (+ 43631us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.926002 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.160346 (+234344us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.262779 (+102433us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.263271 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:19.376188 20475 leader_election.cc:343] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.377422 20722 tablet_service.cc:1511] Processing CreateTablet for tablet 6d424a0defe14912990a5576d69fb1bb (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:19.379714 20575 tablet_service.cc:1511] Processing CreateTablet for tablet 48011569942a40d1aa1ebe657707a381 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:19.383210 20645 tablet_service.cc:1511] Processing CreateTablet for tablet 6d424a0defe14912990a5576d69fb1bb (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:19.384761 20786 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:19.293203 20781 tablet_bootstrap.cc:654] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.343504 20778 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:19.345970 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e142dcf7243c48a5a62d1a8b2cae011c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.346956 20644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e142dcf7243c48a5a62d1a8b2cae011c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.355463 20570 tablet_service.cc:1511] Processing CreateTablet for tablet 98538592057b4546a7267066f54c5732 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:19.353253 20573 rpcz_store.cc:276] 0709 12:14:18.298939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.928608 (+629669us) service_pool.cc:224] Handling call
0709 12:14:18.961322 (+ 32714us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.969613 (+  8291us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.287845 (+318232us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.320743 (+ 32898us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.321165 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.323535 20647 rpcz_store.cc:276] 0709 12:14:18.186727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.855721 (+668994us) service_pool.cc:224] Handling call
0709 12:14:18.906521 (+ 50800us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.906628 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.251442 (+344814us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.259903 (+  8461us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.260609 (+   706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.397658 20778 ts_tablet_manager.cc:1403] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.477s	user 0.011s	sys 0.009s
I20260709 12:14:19.403085 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86b5f8a698448b3acb2cbe9320acf4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.405740 20566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68b8d772da049a19db34b2f00090efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.417198 20491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34206 (request call id 27) took 1089 ms. Trace:
I20260709 12:14:19.428169 20491 rpcz_store.cc:276] 0709 12:14:18.327500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.874241 (+546741us) service_pool.cc:224] Handling call
0709 12:14:18.901394 (+ 27153us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.901521 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.138857 (+237336us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.411643 (+272786us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.417083 (+  5440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.429960 20567 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 16) took 1172 ms. Trace:
I20260709 12:14:19.429680 20494 tablet_service.cc:1511] Processing CreateTablet for tablet 6d424a0defe14912990a5576d69fb1bb (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:19.430374 20567 rpcz_store.cc:276] 0709 12:14:18.257539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.718793 (+461254us) service_pool.cc:224] Handling call
0709 12:14:18.900068 (+181275us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.900187 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.294653 (+394466us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.429416 (+134763us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.429899 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7219}
I20260709 12:14:19.434136 20567 tablet_service.cc:1511] Processing CreateTablet for tablet e142dcf7243c48a5a62d1a8b2cae011c (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:19.434762 20649 tablet_service.cc:1511] Processing CreateTablet for tablet c05ace43443b44cb8bc3ac3955248269 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:19.435776 20779 tablet_bootstrap.cc:492] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:19.421841 20569 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 23) took 1121 ms. Trace:
I20260709 12:14:19.436411 20779 ts_tablet_manager.cc:1403] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.604s	user 0.025s	sys 0.017s
I20260709 12:14:19.427425 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86b5f8a698448b3acb2cbe9320acf4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.438143 20494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d424a0defe14912990a5576d69fb1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.442176 20779 raft_consensus.cc:359] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:19.446681 20779 raft_consensus.cc:385] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.447113 20779 raft_consensus.cc:740] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.448167 20779 consensus_queue.cc:260] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:19.436358 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d424a0defe14912990a5576d69fb1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.449227 20569 rpcz_store.cc:276] 0709 12:14:18.300179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.132421 (+832242us) service_pool.cc:224] Handling call
0709 12:14:19.170382 (+ 37961us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:19.174528 (+  4146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.301814 (+127286us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.421206 (+119392us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.421777 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.461925 20722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d424a0defe14912990a5576d69fb1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.464377 20569 tablet_service.cc:1511] Processing CreateTablet for tablet a86b5f8a698448b3acb2cbe9320acf4a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:19.467279 20778 raft_consensus.cc:359] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:19.468068 20778 raft_consensus.cc:385] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.468408 20778 raft_consensus.cc:740] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.469250 20778 consensus_queue.cc:260] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:19.473008 20573 tablet_service.cc:1511] Processing CreateTablet for tablet d25019682b2f4f4598912e1bee5d76e1 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:19.451409 20568 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 15) took 1185 ms. Trace:
I20260709 12:14:19.477242 20572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 24) took 1176 ms. Trace:
I20260709 12:14:19.480413 20717 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51878 (request call id 24) took 1292 ms. Trace:
I20260709 12:14:19.494721 20717 rpcz_store.cc:276] 0709 12:14:18.188265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.821842 (+633577us) service_pool.cc:224] Handling call
0709 12:14:18.921190 (+ 99348us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.921347 (+   157us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.232225 (+310878us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.324967 (+ 92742us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.476048 (+151081us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b5800187298. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6b71 00007f982d9b71a2 00007f98368f8889 00007f9835a29d88 00007f9835af0973 00007f9835aec70f 00007f9835aececd 00007f9835a9b400 00007f982ef20af4 00007f982ef20a82
0709 12:14:19.480353 (+  4305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12368256}
I20260709 12:14:19.483050 20777 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:19.496498 20572 rpcz_store.cc:276] 0709 12:14:18.300553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.015533 (+714980us) service_pool.cc:224] Handling call
0709 12:14:19.056972 (+ 41439us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:19.059872 (+  2900us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.313048 (+253176us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.473537 (+160489us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.477176 (+  3639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.497486 20777 ts_tablet_manager.cc:1403] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.366s	user 0.014s	sys 0.010s
I20260709 12:14:19.487884 20575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48011569942a40d1aa1ebe657707a381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.498467 20572 tablet_service.cc:1511] Processing CreateTablet for tablet c05ace43443b44cb8bc3ac3955248269 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:19.499892 20572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05ace43443b44cb8bc3ac3955248269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.501060 20777 raft_consensus.cc:359] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:19.501855 20777 raft_consensus.cc:385] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.502131 20777 raft_consensus.cc:740] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.476094 20574 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 21) took 1175 ms. Trace:
I20260709 12:14:19.502905 20777 consensus_queue.cc:260] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:19.503163 20574 rpcz_store.cc:276] 0709 12:14:18.299394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.011929 (+712535us) service_pool.cc:224] Handling call
0709 12:14:19.046011 (+ 34082us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:19.054431 (+  8420us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.302459 (+248028us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.408570 (+106111us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.474958 (+ 66388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.527141 20570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98538592057b4546a7267066f54c5732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.484400 20568 rpcz_store.cc:276] 0709 12:14:18.257213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.712959 (+455746us) service_pool.cc:224] Handling call
0709 12:14:18.747030 (+ 34071us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.747133 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.247600 (+500467us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.441884 (+194284us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.442439 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.528539 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:19.531009 20473 leader_election.cc:343] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.531622 20473 leader_election.cc:304] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:19.531605 20573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25019682b2f4f4598912e1bee5d76e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.540083 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e142dcf7243c48a5a62d1a8b2cae011c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.545782 20569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86b5f8a698448b3acb2cbe9320acf4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.490087 20720 tablet_service.cc:1511] Processing CreateTablet for tablet c05ace43443b44cb8bc3ac3955248269 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:19.491547 20499 tablet_service.cc:1511] Processing CreateTablet for tablet 4477cac83a7e48809a693422fbd5b28a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:19.691530 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4477cac83a7e48809a693422fbd5b28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.490234 20642 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49094 (request call id 26) took 1177 ms. Trace:
I20260709 12:14:19.692816 20642 rpcz_store.cc:276] 0709 12:14:18.313149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.975052 (+661903us) service_pool.cc:224] Handling call
0709 12:14:19.130349 (+155297us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800003c98. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982d876db1 00007f982d9b6e9c 00007f982d9b6a5b 00007f98368cf8d9 00007f9835a29ee0 00007f9835b0f831 00007f9835aecac3 00007f9835a9b400 00007f982ef20af4 00007f982ef20a82 00007f982ef209b1
0709 12:14:19.134785 (+  4436us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:19.142869 (+  8084us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.376577 (+233708us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.489672 (+113095us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.490169 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26720512}
I20260709 12:14:19.492735 20779 ts_tablet_manager.cc:1434] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.001s
I20260709 12:14:19.695381 20779 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:19.493211 20641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f124d084cc54b6ab38cbb14dd6b3919. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.717399 20649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05ace43443b44cb8bc3ac3955248269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.721180 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05ace43443b44cb8bc3ac3955248269. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:19.781939 20392 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 277191us
W20260709 12:14:19.782764 20643 consensus_meta.cc:287] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: Time spent flushing consensus metadata: real 0.517s	user 0.025s	sys 0.026s
I20260709 12:14:19.801658 20777 ts_tablet_manager.cc:1434] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.304s	user 0.043s	sys 0.077s
I20260709 12:14:19.803180 20777 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:19.806705 20719 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51878 (request call id 27) took 1076 ms. Trace:
I20260709 12:14:19.824455 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:19.865193 20716 consensus_meta.cc:287] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.010s
W20260709 12:14:19.862264 20394 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 372867us
I20260709 12:14:19.876497 20786 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.879647 20622 leader_election.cc:343] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:19.879565 20786 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:19.873940 20785 raft_consensus.cc:493] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.865978 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 335198us
I20260709 12:14:19.886986 20786 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:19.889290 20807 raft_consensus.cc:2749] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:19.890242 20807 raft_consensus.cc:493] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.891646 20785 raft_consensus.cc:515] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:19.890784 20807 raft_consensus.cc:515] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:19.883697 20778 ts_tablet_manager.cc:1434] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.461s	user 0.019s	sys 0.039s
I20260709 12:14:19.863740 20719 rpcz_store.cc:276] 0709 12:14:18.730676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.917936 (+187260us) service_pool.cc:224] Handling call
0709 12:14:18.951619 (+ 33683us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.966945 (+ 15326us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.338598 (+371653us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.803177 (+464579us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.806630 (+  3453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.910282 20716 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51878 (request call id 26) took 1594 ms. Trace:
I20260709 12:14:19.914594 20716 rpcz_store.cc:276] 0709 12:14:18.315504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.891699 (+576195us) service_pool.cc:224] Handling call
0709 12:14:18.926392 (+ 34693us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:18.926502 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.256350 (+329848us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.878197 (+621847us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:19.908577 (+ 30380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:19.919703 20574 tablet_service.cc:1511] Processing CreateTablet for tablet 4477cac83a7e48809a693422fbd5b28a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:19.921298 20574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4477cac83a7e48809a693422fbd5b28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.929237 20785 leader_election.cc:290] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:19.929572 20643 tablet_service.cc:1511] Processing CreateTablet for tablet 4477cac83a7e48809a693422fbd5b28a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:19.931213 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4477cac83a7e48809a693422fbd5b28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:19.931815 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a44462e219640a88b4641e632a284c6" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:19.935073 20807 leader_election.cc:290] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:19.935508 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0a0b1fae4f4ec18e826e98ecafe0f6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:19.936312 20510 raft_consensus.cc:2468] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:19.938220 20778 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:19.939548 20549 leader_election.cc:304] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
W20260709 12:14:19.958257 20723 consensus_meta.cc:287] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.006s
I20260709 12:14:19.923578 20777 tablet_bootstrap.cc:654] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.961244 20500 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1f44e30cbb4f23bf23cbbe1ea47f74 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:19.961086 20779 tablet_bootstrap.cc:654] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:19.991324 20777 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:19.992093 20777 ts_tablet_manager.cc:1403] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.013s
I20260709 12:14:19.996567 20777 raft_consensus.cc:359] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:19.997605 20777 raft_consensus.cc:385] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:19.998034 20777 raft_consensus.cc:740] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:19.999267 20777 consensus_queue.cc:260] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.001361 20781 tablet_bootstrap.cc:492] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:20.024196 20499 tablet_service.cc:1511] Processing CreateTablet for tablet df74870926dd4e4a98d23dcda857942a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:14:20.008603 20549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 69165us
I20260709 12:14:20.025349 20646 tablet_service.cc:1511] Processing CreateTablet for tablet df74870926dd4e4a98d23dcda857942a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:20.026902 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df74870926dd4e4a98d23dcda857942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.036615 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0a0b1fae4f4ec18e826e98ecafe0f6" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.006460 20571 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55556 (request call id 27) took 1201 ms. Trace:
I20260709 12:14:20.017921 20781 ts_tablet_manager.cc:1403] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.751s	user 0.013s	sys 0.020s
I20260709 12:14:20.044716 20814 raft_consensus.cc:2804] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.045207 20814 raft_consensus.cc:493] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.045013 20721 tablet_service.cc:1511] Processing CreateTablet for tablet df74870926dd4e4a98d23dcda857942a (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:20.045581 20814 raft_consensus.cc:3060] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.050001 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:20.051651 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:20.052956 20723 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1f44e30cbb4f23bf23cbbe1ea47f74 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:20.038913 20500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1f44e30cbb4f23bf23cbbe1ea47f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.060649 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:20.062577 20624 leader_election.cc:343] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.063567 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df74870926dd4e4a98d23dcda857942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.064038 20499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df74870926dd4e4a98d23dcda857942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.066845 20720 tablet_service.cc:1511] Processing CreateTablet for tablet 9752dcdc33454bf381a9c8a0e91910e0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:20.068269 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752dcdc33454bf381a9c8a0e91910e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.069710 20570 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1f44e30cbb4f23bf23cbbe1ea47f74 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:20.070989 20570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1f44e30cbb4f23bf23cbbe1ea47f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.071072 20786 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.071738 20786 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.074010 20786 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:20.075634 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:20.076983 20622 leader_election.cc:343] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.077584 20567 tablet_service.cc:1511] Processing CreateTablet for tablet 9752dcdc33454bf381a9c8a0e91910e0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:20.079061 20567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752dcdc33454bf381a9c8a0e91910e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.043505 20778 tablet_bootstrap.cc:654] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.041074 20571 rpcz_store.cc:276] 0709 12:14:18.805281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.212573 (+407292us) service_pool.cc:224] Handling call
0709 12:14:19.222434 (+  9861us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:19.222562 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.939763 (+717201us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:20.005832 (+ 66069us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:20.006380 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:20.094023 20723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1f44e30cbb4f23bf23cbbe1ea47f74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:20.040584 20696 leader_election.cc:343] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.094122 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0a0b1fae4f4ec18e826e98ecafe0f6" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:20.095320 20623 leader_election.cc:343] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.095682 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:20.095925 20623 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.097220 20786 raft_consensus.cc:2749] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:20.097316 20623 leader_election.cc:343] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.097899 20623 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
W20260709 12:14:20.102653 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 64068.9us
W20260709 12:14:20.108745 20475 leader_election.cc:343] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.108634 20496 tablet_service.cc:1511] Processing CreateTablet for tablet c15c10d8005c4037b36a80fec3ac32d7 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:20.110086 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15c10d8005c4037b36a80fec3ac32d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.110515 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0a0b1fae4f4ec18e826e98ecafe0f6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:20.112083 20550 leader_election.cc:343] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.113310 20777 ts_tablet_manager.cc:1434] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.121s	user 0.012s	sys 0.000s
I20260709 12:14:20.114449 20777 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:20.107544 20644 tablet_service.cc:1511] Processing CreateTablet for tablet 9752dcdc33454bf381a9c8a0e91910e0 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:20.120362 20786 raft_consensus.cc:2749] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.122156 20649 tablet_service.cc:1511] Processing CreateTablet for tablet c15c10d8005c4037b36a80fec3ac32d7 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:20.127672 20720 tablet_service.cc:1511] Processing CreateTablet for tablet 44a303f022ac4e27aed72a4e2a4067d5 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:14:20.123394 20623 leader_election.cc:343] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.132623 20623 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.133527 20786 raft_consensus.cc:2749] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.135653 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a44462e219640a88b4641e632a284c6" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.069916 20781 raft_consensus.cc:359] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.137213 20781 raft_consensus.cc:385] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:20.137338 20696 leader_election.cc:343] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.137672 20781 raft_consensus.cc:740] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.137923 20696 leader_election.cc:304] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:20.138850 20785 raft_consensus.cc:2749] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.122579 20495 tablet_service.cc:1511] Processing CreateTablet for tablet 44a303f022ac4e27aed72a4e2a4067d5 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:20.138773 20781 consensus_queue.cc:260] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.139364 20714 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3947f06087460cbf1b9149f8e20daf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:20.123517 20571 tablet_service.cc:1511] Processing CreateTablet for tablet c15c10d8005c4037b36a80fec3ac32d7 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:20.130752 20778 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:20.128358 20649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15c10d8005c4037b36a80fec3ac32d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.140331 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a303f022ac4e27aed72a4e2a4067d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.142066 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3947f06087460cbf1b9149f8e20daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.143064 20573 tablet_service.cc:1511] Processing CreateTablet for tablet 44a303f022ac4e27aed72a4e2a4067d5 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:20.143916 20778 ts_tablet_manager.cc:1403] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.206s	user 0.013s	sys 0.005s
I20260709 12:14:20.144658 20573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a303f022ac4e27aed72a4e2a4067d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.148634 20777 tablet_bootstrap.cc:654] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.153228 20571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15c10d8005c4037b36a80fec3ac32d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.154953 20779 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:20.155592 20779 ts_tablet_manager.cc:1403] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.460s	user 0.047s	sys 0.022s
I20260709 12:14:20.158915 20493 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3947f06087460cbf1b9149f8e20daf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:20.159941 20814 raft_consensus.cc:515] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.160578 20493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3947f06087460cbf1b9149f8e20daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.170397 20585 raft_consensus.cc:2393] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:20.170979 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a303f022ac4e27aed72a4e2a4067d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.174507 20643 tablet_service.cc:1511] Processing CreateTablet for tablet 1d16336d75934db78f1ee7b4aaf2d760 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:14:20.176040 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:20.176165 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d16336d75934db78f1ee7b4aaf2d760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.177394 20779 raft_consensus.cc:359] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.178177 20779 raft_consensus.cc:385] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.177944 20473 leader_election.cc:304] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.178599 20779 raft_consensus.cc:740] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.179173 20807 raft_consensus.cc:3060] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.179435 20779 consensus_queue.cc:260] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.181715 20779 ts_tablet_manager.cc:1434] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:14:20.186271 20719 tablet_service.cc:1511] Processing CreateTablet for tablet 1d16336d75934db78f1ee7b4aaf2d760 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:20.194892 20644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752dcdc33454bf381a9c8a0e91910e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.195614 20569 tablet_service.cc:1511] Processing CreateTablet for tablet 1d300af02eb347b3a365e6c636b8e9ed (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:20.197263 20569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d300af02eb347b3a365e6c636b8e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.198803 20645 tablet_service.cc:1511] Processing CreateTablet for tablet 9b3947f06087460cbf1b9149f8e20daf (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:20.199868 20719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d16336d75934db78f1ee7b4aaf2d760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.200119 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3947f06087460cbf1b9149f8e20daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.200974 20807 raft_consensus.cc:2749] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.175689 20778 raft_consensus.cc:359] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.204006 20778 raft_consensus.cc:385] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.204353 20778 raft_consensus.cc:740] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.207798 20641 tablet_service.cc:1511] Processing CreateTablet for tablet 1d300af02eb347b3a365e6c636b8e9ed (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:20.208380 20496 tablet_service.cc:1511] Processing CreateTablet for tablet 1d300af02eb347b3a365e6c636b8e9ed (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:20.209779 20641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d300af02eb347b3a365e6c636b8e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.215394 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0a0b1fae4f4ec18e826e98ecafe0f6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:20.216171 20733 raft_consensus.cc:3060] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.218883 20778 consensus_queue.cc:260] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.220077 20814 leader_election.cc:290] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:20.220872 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc0a0b1fae4f4ec18e826e98ecafe0f6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:20.222535 20722 tablet_service.cc:1511] Processing CreateTablet for tablet 09a0ecf5d0874c90adf810893870a790 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:20.227926 20722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a0ecf5d0874c90adf810893870a790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.227643 20492 tablet_service.cc:1511] Processing CreateTablet for tablet 09a0ecf5d0874c90adf810893870a790 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:20.209820 20496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d300af02eb347b3a365e6c636b8e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.230284 20492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a0ecf5d0874c90adf810893870a790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.221472 20574 tablet_service.cc:1511] Processing CreateTablet for tablet 1d16336d75934db78f1ee7b4aaf2d760 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:20.231938 20574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d16336d75934db78f1ee7b4aaf2d760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.235034 20779 tablet_bootstrap.cc:492] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:20.240943 20509 raft_consensus.cc:2468] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:20.221222 20778 ts_tablet_manager.cc:1434] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.077s	user 0.002s	sys 0.005s
I20260709 12:14:20.251783 20781 ts_tablet_manager.cc:1434] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.210s	user 0.007s	sys 0.003s
I20260709 12:14:20.253415 20781 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:20.257038 20566 tablet_service.cc:1511] Processing CreateTablet for tablet 09a0ecf5d0874c90adf810893870a790 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:20.258504 20566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a0ecf5d0874c90adf810893870a790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.261863 20778 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:20.270723 20549 leader_election.cc:304] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:20.271314 20646 tablet_service.cc:1511] Processing CreateTablet for tablet 1372644e1ccf4558882a325df32b0a84 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:20.272735 20646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372644e1ccf4558882a325df32b0a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.272784 20814 raft_consensus.cc:2804] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.273636 20814 raft_consensus.cc:697] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:20.274608 20814 consensus_queue.cc:237] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.280295 20777 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:20.280936 20777 ts_tablet_manager.cc:1403] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.008s
I20260709 12:14:20.297211 20733 raft_consensus.cc:2468] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:20.310673 20778 tablet_bootstrap.cc:654] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.310920 20779 tablet_bootstrap.cc:654] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.310117 20818 raft_consensus.cc:493] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.318961 20818 raft_consensus.cc:515] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.320263 20777 raft_consensus.cc:359] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.321167 20777 raft_consensus.cc:385] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.321555 20777 raft_consensus.cc:740] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.322432 20777 consensus_queue.cc:260] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.325891 20777 ts_tablet_manager.cc:1434] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:14:20.318401 20495 tablet_service.cc:1511] Processing CreateTablet for tablet 1372644e1ccf4558882a325df32b0a84 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:20.330622 20495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372644e1ccf4558882a325df32b0a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.335600 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e708e6dd44c04400839f898100989df0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:20.337502 20548 leader_election.cc:343] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.341285 20721 tablet_service.cc:1511] Processing CreateTablet for tablet 1372644e1ccf4558882a325df32b0a84 (DEFAULT_TABLE table=test-workload [id=a5a8adde12314c61bc2305ea660cf50d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:20.343266 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372644e1ccf4558882a325df32b0a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:20.351528 20781 tablet_bootstrap.cc:654] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.356467 20818 leader_election.cc:290] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.358287 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e708e6dd44c04400839f898100989df0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:20.359951 20550 leader_election.cc:343] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.360499 20550 leader_election.cc:304] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:20.362033 20818 raft_consensus.cc:2749] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.380280 20408 catalog_manager.cc:5697] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.381341 20777 tablet_bootstrap.cc:492] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:20.402089 20779 tablet_bootstrap.cc:492] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:20.402776 20779 ts_tablet_manager.cc:1403] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.220s	user 0.012s	sys 0.009s
I20260709 12:14:20.406705 20786 raft_consensus.cc:493] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.407274 20786 raft_consensus.cc:515] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.409605 20786 leader_election.cc:290] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.406226 20779 raft_consensus.cc:359] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.411267 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.412009 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:20.412747 20509 raft_consensus.cc:2468] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:20.411231 20779 raft_consensus.cc:385] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:20.413621 20624 leader_election.cc:343] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.413858 20779 raft_consensus.cc:740] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.414628 20623 leader_election.cc:304] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:20.415031 20779 consensus_queue.cc:260] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.409631 20778 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:20.418560 20778 ts_tablet_manager.cc:1403] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.160s	user 0.026s	sys 0.014s
I20260709 12:14:20.418702 20786 raft_consensus.cc:2804] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.419094 20786 raft_consensus.cc:493] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.419452 20786 raft_consensus.cc:3060] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.427831 20779 ts_tablet_manager.cc:1434] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:14:20.429157 20779 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:20.430377 20781 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:20.431028 20781 ts_tablet_manager.cc:1403] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.007s
I20260709 12:14:20.433684 20778 raft_consensus.cc:359] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.434950 20778 raft_consensus.cc:385] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.434688 20781 raft_consensus.cc:359] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.435467 20778 raft_consensus.cc:740] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.435648 20781 raft_consensus.cc:385] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.436373 20781 raft_consensus.cc:740] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.437706 20781 consensus_queue.cc:260] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.438966 20777 tablet_bootstrap.cc:654] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.438616 20778 consensus_queue.cc:260] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.440232 20781 ts_tablet_manager.cc:1434] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:20.444026 20781 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:20.442746 20778 ts_tablet_manager.cc:1434] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.005s
I20260709 12:14:20.448153 20778 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:20.451198 20779 tablet_bootstrap.cc:654] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.457109 20778 tablet_bootstrap.cc:654] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.469852 20777 tablet_bootstrap.cc:492] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:20.470697 20777 ts_tablet_manager.cc:1403] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.006s
I20260709 12:14:20.474989 20777 raft_consensus.cc:359] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.480983 20777 raft_consensus.cc:385] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.475365 20786 raft_consensus.cc:515] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.479913 20779 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:20.481775 20777 raft_consensus.cc:740] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.484146 20778 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:20.484774 20778 ts_tablet_manager.cc:1403] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.007s
I20260709 12:14:20.482865 20779 ts_tablet_manager.cc:1403] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.005s
I20260709 12:14:20.486013 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:20.486745 20509 raft_consensus.cc:3060] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.488161 20778 raft_consensus.cc:359] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.488925 20778 raft_consensus.cc:385] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.489611 20778 raft_consensus.cc:740] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.488868 20779 raft_consensus.cc:359] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.490679 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:20.490427 20778 consensus_queue.cc:260] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:20.492504 20624 leader_election.cc:343] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.492918 20778 ts_tablet_manager.cc:1434] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:20.492136 20777 consensus_queue.cc:260] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.494083 20778 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:20.490899 20781 tablet_bootstrap.cc:654] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.490228 20779 raft_consensus.cc:385] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.498814 20779 raft_consensus.cc:740] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.500026 20786 leader_election.cc:290] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.504258 20509 raft_consensus.cc:2468] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:20.513047 20807 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.513772 20807 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.517961 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.518879 20659 raft_consensus.cc:2468] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:20.520694 20473 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:20.523676 20807 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.524325 20807 raft_consensus.cc:2804] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.524416 20786 raft_consensus.cc:493] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.529083 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.530609 20786 raft_consensus.cc:515] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
W20260709 12:14:20.532269 20475 leader_election.cc:343] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.529374 20807 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.533319 20786 leader_election.cc:290] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.535868 20778 tablet_bootstrap.cc:654] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.536446 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.537153 20733 raft_consensus.cc:2468] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:20.535668 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:20.538479 20624 leader_election.cc:304] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:20.540401 20807 raft_consensus.cc:3060] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.541369 20786 raft_consensus.cc:2804] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:14:20.541503 20622 leader_election.cc:343] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.541931 20786 raft_consensus.cc:493] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.529016 20779 consensus_queue.cc:260] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.542374 20786 raft_consensus.cc:3060] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.544503 20779 ts_tablet_manager.cc:1434] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:14:20.545763 20779 tablet_bootstrap.cc:492] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:20.549207 20781 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:20.549817 20781 ts_tablet_manager.cc:1403] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.003s
I20260709 12:14:20.550344 20777 ts_tablet_manager.cc:1434] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.019s
I20260709 12:14:20.551772 20777 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:20.539731 20623 leader_election.cc:304] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:20.553519 20781 raft_consensus.cc:359] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.552724 20786 raft_consensus.cc:515] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.558830 20781 raft_consensus.cc:385] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.559249 20781 raft_consensus.cc:740] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.560206 20781 consensus_queue.cc:260] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.563552 20781 ts_tablet_manager.cc:1434] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 12:14:20.564702 20781 tablet_bootstrap.cc:492] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:20.557478 20807 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.572852 20777 tablet_bootstrap.cc:654] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.572992 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:20.573886 20659 raft_consensus.cc:3060] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.575148 20807 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.577165 20781 tablet_bootstrap.cc:654] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.578898 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:20.579645 20733 raft_consensus.cc:3060] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.574378 20779 tablet_bootstrap.cc:654] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.588721 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:20.590188 20733 raft_consensus.cc:2468] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:20.590416 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
W20260709 12:14:20.590641 20622 leader_election.cc:343] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.595497 20833 raft_consensus.cc:2804] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.601843 20833 raft_consensus.cc:697] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:20.602867 20833 consensus_queue.cc:237] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:20.606463 20475 leader_election.cc:343] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.608456 20659 raft_consensus.cc:2468] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:20.584583 20786 leader_election.cc:290] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.612560 20473 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:20.613070 20624 leader_election.cc:304] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.613781 20807 raft_consensus.cc:2804] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.614092 20834 raft_consensus.cc:2804] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.614322 20807 raft_consensus.cc:697] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:20.619853 20807 consensus_queue.cc:237] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.620846 20779 tablet_bootstrap.cc:492] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:20.621439 20779 ts_tablet_manager.cc:1403] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.019s
I20260709 12:14:20.624245 20820 raft_consensus.cc:493] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.624730 20820 raft_consensus.cc:515] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.624886 20779 raft_consensus.cc:359] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.625577 20779 raft_consensus.cc:385] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.625876 20779 raft_consensus.cc:740] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.626739 20779 consensus_queue.cc:260] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.627826 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76fe14c9d9a411b8077b228665e6008" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:20.628445 20509 raft_consensus.cc:2468] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:20.633343 20820 leader_election.cc:290] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.634272 20549 leader_election.cc:304] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:20.635269 20820 raft_consensus.cc:2804] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.635609 20820 raft_consensus.cc:493] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.635869 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76fe14c9d9a411b8077b228665e6008" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:20.638151 20548 leader_election.cc:343] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.639931 20781 tablet_bootstrap.cc:492] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:20.640571 20781 ts_tablet_manager.cc:1403] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.010s
I20260709 12:14:20.635927 20820 raft_consensus.cc:3060] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.641571 20777 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:20.642359 20777 ts_tablet_manager.cc:1403] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.019s
I20260709 12:14:20.644071 20781 raft_consensus.cc:359] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.644874 20781 raft_consensus.cc:385] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.645145 20781 raft_consensus.cc:740] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.645617 20777 raft_consensus.cc:359] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.638172 20778 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:20.646076 20781 consensus_queue.cc:260] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.647130 20778 ts_tablet_manager.cc:1403] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.010s
I20260709 12:14:20.650395 20820 raft_consensus.cc:515] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.652251 20834 raft_consensus.cc:697] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:20.651454 20777 raft_consensus.cc:385] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.654909 20779 ts_tablet_manager.cc:1434] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 12:14:20.655138 20777 raft_consensus.cc:740] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.655865 20834 consensus_queue.cc:237] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.656056 20777 consensus_queue.cc:260] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.651641 20778 raft_consensus.cc:359] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.658692 20778 raft_consensus.cc:385] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.659010 20778 raft_consensus.cc:740] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.660293 20778 consensus_queue.cc:260] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.661056 20407 catalog_manager.cc:5697] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.659013 20814 raft_consensus.cc:493] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.664510 20779 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:20.664240 20814 raft_consensus.cc:515] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.665621 20781 ts_tablet_manager.cc:1434] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:14:20.666685 20814 leader_election.cc:290] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.666961 20781 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:20.668552 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.668932 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:20.670197 20548 leader_election.cc:343] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.663381 20777 ts_tablet_manager.cc:1434] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 12:14:20.675401 20779 tablet_bootstrap.cc:654] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:20.675521 20549 leader_election.cc:343] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.677969 20549 leader_election.cc:304] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:20.664244 20778 ts_tablet_manager.cc:1434] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:14:20.679745 20778 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:20.680509 20781 tablet_bootstrap.cc:654] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.675187 20777 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:20.684454 20820 leader_election.cc:290] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.685784 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76fe14c9d9a411b8077b228665e6008" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:20.686524 20659 raft_consensus.cc:3060] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.689021 20778 tablet_bootstrap.cc:654] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.691107 20820 raft_consensus.cc:493] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.691763 20820 raft_consensus.cc:515] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.692374 20814 raft_consensus.cc:2749] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.693846 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76fe14c9d9a411b8077b228665e6008" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:20.694830 20509 raft_consensus.cc:3060] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.698007 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.675261 20406 catalog_manager.cc:5697] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.704046 20807 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.704739 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.704685 20807 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.705984 20733 raft_consensus.cc:2393] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 1: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:20.707377 20550 leader_election.cc:304] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:20.708367 20814 raft_consensus.cc:3060] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.708665 20807 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.710981 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:20.713757 20473 leader_election.cc:343] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.718990 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.719967 20733 raft_consensus.cc:2468] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:20.721899 20475 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.723496 20820 leader_election.cc:290] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.731961 20807 raft_consensus.cc:2804] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.727530 20814 raft_consensus.cc:2749] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.702356 20659 raft_consensus.cc:2468] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:20.735579 20548 leader_election.cc:304] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:20.738382 20820 raft_consensus.cc:2804] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.739033 20820 raft_consensus.cc:697] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:20.738809 20814 consensus_queue.cc:1048] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:20.744062 20777 tablet_bootstrap.cc:654] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.744196 20778 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:20.744793 20778 ts_tablet_manager.cc:1403] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.009s
I20260709 12:14:20.732589 20807 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.748406 20807 raft_consensus.cc:3060] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.748759 20778 raft_consensus.cc:359] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.749872 20778 raft_consensus.cc:385] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.750247 20778 raft_consensus.cc:740] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.751288 20778 consensus_queue.cc:260] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.740285 20820 consensus_queue.cc:237] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.755784 20777 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:20.760990 20781 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:20.761636 20781 ts_tablet_manager.cc:1403] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.002s
I20260709 12:14:20.762712 20778 ts_tablet_manager.cc:1434] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:14:20.763922 20778 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:20.769284 20814 consensus_queue.cc:1048] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:20.771087 20777 ts_tablet_manager.cc:1403] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.008s
I20260709 12:14:20.778828 20509 raft_consensus.cc:2468] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:20.785439 20407 catalog_manager.cc:5697] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.787923 20835 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.788523 20835 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.791939 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:20.794757 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.795477 20659 raft_consensus.cc:2468] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:20.797058 20835 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.797806 20473 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
W20260709 12:14:20.807243 20473 leader_election.cc:343] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.810864 20781 raft_consensus.cc:359] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.812075 20781 raft_consensus.cc:385] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.811779 20807 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.812721 20781 raft_consensus.cc:740] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.813416 20835 raft_consensus.cc:2804] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.818595 20835 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.821787 20835 raft_consensus.cc:3060] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.827162 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:20.833827 20779 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:20.834419 20779 ts_tablet_manager.cc:1403] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.170s	user 0.032s	sys 0.020s
W20260709 12:14:20.835523 20473 leader_election.cc:343] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.836171 20781 consensus_queue.cc:260] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.841212 20408 catalog_manager.cc:5697] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.844815 20781 ts_tablet_manager.cc:1434] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 12:14:20.837435 20785 raft_consensus.cc:493] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.845355 20785 raft_consensus.cc:515] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.847441 20785 leader_election.cc:290] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.849720 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e708e6dd44c04400839f898100989df0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.850481 20777 raft_consensus.cc:359] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:20.851243 20696 leader_election.cc:343] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.851629 20777 raft_consensus.cc:385] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.852155 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e708e6dd44c04400839f898100989df0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:20.853048 20585 raft_consensus.cc:2468] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:20.854089 20696 leader_election.cc:304] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:20.854460 20781 tablet_bootstrap.cc:492] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:20.855198 20785 raft_consensus.cc:2804] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.855605 20785 raft_consensus.cc:493] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.855942 20785 raft_consensus.cc:3060] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.845498 20779 raft_consensus.cc:359] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.858922 20779 raft_consensus.cc:385] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.859380 20779 raft_consensus.cc:740] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.860526 20779 consensus_queue.cc:260] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.864079 20785 raft_consensus.cc:515] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.864516 20781 tablet_bootstrap.cc:654] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.867086 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e708e6dd44c04400839f898100989df0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:20.849745 20778 tablet_bootstrap.cc:654] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.867666 20585 raft_consensus.cc:3060] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.852099 20777 raft_consensus.cc:740] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.874629 20807 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:20.874100 20835 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.878739 20781 tablet_bootstrap.cc:492] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:20.884562 20781 ts_tablet_manager.cc:1403] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.004s
I20260709 12:14:20.887251 20807 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.888484 20779 ts_tablet_manager.cc:1434] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 12:14:20.888095 20807 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.889680 20779 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:20.891651 20585 raft_consensus.cc:2468] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:20.883888 20777 consensus_queue.cc:260] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.894644 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:20.895339 20584 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:20.895820 20777 ts_tablet_manager.cc:1434] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.096s	user 0.010s	sys 0.000s
I20260709 12:14:20.895473 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:20.896571 20659 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:20.897249 20785 leader_election.cc:290] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.898085 20785 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.898691 20785 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:20.898842 20473 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:20.896828 20777 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:20.909581 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:20.910240 20732 raft_consensus.cc:3060] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.910347 20835 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.910990 20835 raft_consensus.cc:2804] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.911362 20835 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.911687 20835 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.918632 20835 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.920521 20835 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.921605 20781 raft_consensus.cc:359] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.901767 20807 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:20.925141 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:20.926807 20697 leader_election.cc:343] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.929029 20779 tablet_bootstrap.cc:654] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.929214 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:20.929548 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:20.930277 20659 raft_consensus.cc:3060] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.931313 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e708e6dd44c04400839f898100989df0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:20.933605 20785 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:20.934460 20696 leader_election.cc:304] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:20.923261 20781 raft_consensus.cc:385] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.935349 20781 raft_consensus.cc:740] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.935467 20785 raft_consensus.cc:2804] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.934779 20732 raft_consensus.cc:2468] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:20.937645 20785 raft_consensus.cc:697] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:20.936375 20781 consensus_queue.cc:260] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.936970 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:20.939005 20659 raft_consensus.cc:2468] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
W20260709 12:14:20.939311 20696 leader_election.cc:343] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.943289 20475 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:20.944922 20696 leader_election.cc:343] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.940598 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:20.940964 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:20.945654 20585 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.945775 20658 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.945544 20781 ts_tablet_manager.cc:1434] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 12:14:20.947587 20781 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:20.950699 20696 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.951817 20856 raft_consensus.cc:2749] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:20.953263 20777 tablet_bootstrap.cc:654] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:20.941843 20473 leader_election.cc:343] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.939989 20785 consensus_queue.cc:237] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:20.953977 20858 raft_consensus.cc:2804] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.954478 20781 tablet_bootstrap.cc:654] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.955515 20858 raft_consensus.cc:697] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:20.958041 20834 raft_consensus.cc:493] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.958721 20834 raft_consensus.cc:515] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.963332 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27acfc34b4452b95b09724ccd054ac" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:20.963757 20658 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:20.964272 20732 raft_consensus.cc:2468] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:20.965279 20473 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:20.966228 20807 raft_consensus.cc:2804] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.966212 20624 leader_election.cc:304] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:20.967311 20807 raft_consensus.cc:697] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:20.968777 20777 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:20.968305 20807 consensus_queue.cc:237] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.969470 20833 raft_consensus.cc:2804] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:20.969807 20834 leader_election.cc:290] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:20.970009 20833 raft_consensus.cc:493] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.971410 20833 raft_consensus.cc:3060] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:20.975742 20777 ts_tablet_manager.cc:1403] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.001s
I20260709 12:14:20.980206 20777 raft_consensus.cc:359] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.980981 20777 raft_consensus.cc:385] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.981323 20777 raft_consensus.cc:740] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.982288 20777 consensus_queue.cc:260] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.982781 20858 consensus_queue.cc:237] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.970557 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27acfc34b4452b95b09724ccd054ac" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:20.984990 20778 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:20.985671 20778 ts_tablet_manager.cc:1403] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.222s	user 0.008s	sys 0.015s
W20260709 12:14:20.986013 20623 leader_election.cc:343] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.957226 20585 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:20.986263 20405 catalog_manager.cc:5697] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.988652 20778 raft_consensus.cc:359] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.985013 20777 ts_tablet_manager.cc:1434] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:20.989427 20778 raft_consensus.cc:385] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:20.970399 20473 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:20.989818 20778 raft_consensus.cc:740] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:20.990475 20777 tablet_bootstrap.cc:492] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:20.990702 20807 raft_consensus.cc:2804] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:20.983312 20833 raft_consensus.cc:515] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:20.991380 20807 raft_consensus.cc:697] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:20.990857 20778 consensus_queue.cc:260] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.992297 20807 consensus_queue.cc:237] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:20.993559 20778 ts_tablet_manager.cc:1434] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:20.994657 20778 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:20.996025 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27acfc34b4452b95b09724ccd054ac" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:20.997545 20623 leader_election.cc:343] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:20.998349 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27acfc34b4452b95b09724ccd054ac" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:20.999290 20732 raft_consensus.cc:3060] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.000424 20777 tablet_bootstrap.cc:654] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:20.994562 20833 leader_election.cc:290] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:21.013526 20781 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:21.014071 20781 ts_tablet_manager.cc:1403] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.012s
I20260709 12:14:21.034018 20778 tablet_bootstrap.cc:654] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.037577 20858 consensus_queue.cc:1048] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:21.035347 20407 catalog_manager.cc:5697] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:21.040077 20781 raft_consensus.cc:359] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.040795 20781 raft_consensus.cc:385] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.041079 20781 raft_consensus.cc:740] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.041508 20732 raft_consensus.cc:2468] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:21.041980 20781 consensus_queue.cc:260] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.043052 20624 leader_election.cc:304] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:21.044421 20833 raft_consensus.cc:2804] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:21.044929 20833 raft_consensus.cc:697] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:21.045264 20779 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:21.045795 20833 consensus_queue.cc:237] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.045776 20779 ts_tablet_manager.cc:1403] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.005s
I20260709 12:14:21.056777 20777 tablet_bootstrap.cc:492] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:21.057296 20777 ts_tablet_manager.cc:1403] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 12:14:21.058513 20778 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:21.059719 20778 ts_tablet_manager.cc:1403] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.065s	user 0.032s	sys 0.014s
I20260709 12:14:21.061048 20779 raft_consensus.cc:359] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.061764 20779 raft_consensus.cc:385] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.062013 20779 raft_consensus.cc:740] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.063298 20781 ts_tablet_manager.cc:1434] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 12:14:21.062804 20779 consensus_queue.cc:260] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.064373 20781 tablet_bootstrap.cc:492] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:21.062837 20778 raft_consensus.cc:359] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.066880 20778 raft_consensus.cc:385] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.067209 20778 raft_consensus.cc:740] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.062117 20777 raft_consensus.cc:359] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.068464 20777 raft_consensus.cc:385] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.068107 20778 consensus_queue.cc:260] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.068787 20777 raft_consensus.cc:740] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.070922 20778 ts_tablet_manager.cc:1434] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
W20260709 12:14:21.071545 20624 consensus_peers.cc:597] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda -> Peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Couldn't send request to peer 491eb72eef45486bb35575f2936538d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.072041 20778 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:21.072322 20858 raft_consensus.cc:493] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.072871 20858 raft_consensus.cc:515] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.075382 20858 leader_election.cc:290] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:21.076856 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:21.078202 20585 raft_consensus.cc:2468] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:21.070940 20777 consensus_queue.cc:260] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.076330 20407 catalog_manager.cc:5697] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.077200 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.080493 20659 raft_consensus.cc:2468] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:21.080844 20778 tablet_bootstrap.cc:654] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.081930 20473 leader_election.cc:304] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:21.083913 20835 raft_consensus.cc:2804] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.084363 20835 raft_consensus.cc:493] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.084724 20835 raft_consensus.cc:3060] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.079027 20779 ts_tablet_manager.cc:1434] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:14:21.087904 20779 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
W20260709 12:14:21.088948 20475 consensus_peers.cc:597] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 -> Peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Couldn't send request to peer 491eb72eef45486bb35575f2936538d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.088652 20408 catalog_manager.cc:5697] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.096333 20407 catalog_manager.cc:5697] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.097621 20777 ts_tablet_manager.cc:1434] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:14:21.098836 20777 tablet_bootstrap.cc:492] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:21.102984 20835 raft_consensus.cc:515] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.105024 20777 tablet_bootstrap.cc:654] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.109539 20781 tablet_bootstrap.cc:654] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.111872 20835 leader_election.cc:290] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:21.114112 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:21.114697 20778 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:21.114813 20585 raft_consensus.cc:3060] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.115288 20778 ts_tablet_manager.cc:1403] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.003s
I20260709 12:14:21.118934 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:21.120242 20658 raft_consensus.cc:3060] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.125314 20585 raft_consensus.cc:2468] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:21.127094 20473 leader_election.cc:304] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:21.128350 20835 raft_consensus.cc:2804] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:21.129271 20835 raft_consensus.cc:697] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:21.130822 20658 raft_consensus.cc:2468] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:21.131780 20779 tablet_bootstrap.cc:654] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.130656 20835 consensus_queue.cc:237] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.118460 20778 raft_consensus.cc:359] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.135001 20778 raft_consensus.cc:385] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.135442 20778 raft_consensus.cc:740] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.136269 20778 consensus_queue.cc:260] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.138687 20778 ts_tablet_manager.cc:1434] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:14:21.140957 20778 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:21.144538 20781 tablet_bootstrap.cc:492] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:21.145222 20781 ts_tablet_manager.cc:1403] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.022s
I20260709 12:14:21.146324 20778 tablet_bootstrap.cc:654] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.148787 20781 raft_consensus.cc:359] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.149731 20781 raft_consensus.cc:385] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.150053 20781 raft_consensus.cc:740] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.153066 20781 consensus_queue.cc:260] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.154403 20779 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:21.154929 20779 ts_tablet_manager.cc:1403] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.000s
I20260709 12:14:21.155911 20781 ts_tablet_manager.cc:1434] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 12:14:21.157121 20781 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:21.159101 20777 tablet_bootstrap.cc:492] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:21.159778 20777 ts_tablet_manager.cc:1403] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.003s
I20260709 12:14:21.162456 20777 raft_consensus.cc:359] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.163173 20777 raft_consensus.cc:385] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.163453 20777 raft_consensus.cc:740] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.163651 20781 tablet_bootstrap.cc:654] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.157960 20779 raft_consensus.cc:359] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.164276 20779 raft_consensus.cc:385] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.164697 20779 raft_consensus.cc:740] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.165591 20779 consensus_queue.cc:260] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.169971 20779 ts_tablet_manager.cc:1434] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:14:21.171305 20779 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:21.172093 20818 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.172688 20818 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.174985 20818 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:21.176227 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:21.176586 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:21.177299 20732 raft_consensus.cc:2393] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 1: Already voted for candidate 2ca675f8ab8b49e2b275294280376184 in this term.
I20260709 12:14:21.182209 20833 consensus_queue.cc:1048] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.183183 20549 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:21.178404 20407 catalog_manager.cc:5697] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.185559 20785 raft_consensus.cc:493] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.186082 20785 raft_consensus.cc:515] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.187605 20818 raft_consensus.cc:3060] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.188225 20785 leader_election.cc:290] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:21.190033 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:21.192330 20777 consensus_queue.cc:260] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.194947 20778 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:21.194846 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684797a7958648ebb2abe2ea5d62a4ab" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.195490 20778 ts_tablet_manager.cc:1403] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.008s
W20260709 12:14:21.195776 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:21.196179 20814 raft_consensus.cc:493] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.196444 20818 raft_consensus.cc:2749] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.196705 20814 raft_consensus.cc:515] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.199111 20814 leader_election.cc:290] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.199644 20777 ts_tablet_manager.cc:1434] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.040s	user 0.001s	sys 0.005s
I20260709 12:14:21.196779 20696 leader_election.cc:304] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:21.200265 20781 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:21.200780 20781 ts_tablet_manager.cc:1403] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.012s
I20260709 12:14:21.201520 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a44462e219640a88b4641e632a284c6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:21.202708 20785 raft_consensus.cc:2749] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.202203 20732 raft_consensus.cc:2468] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:21.203936 20781 raft_consensus.cc:359] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.204474 20550 leader_election.cc:304] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:21.204695 20781 raft_consensus.cc:385] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.204846 20833 consensus_queue.cc:1048] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:21.205585 20814 raft_consensus.cc:2804] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.206018 20814 raft_consensus.cc:493] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.206410 20814 raft_consensus.cc:3060] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.207022 20777 tablet_bootstrap.cc:492] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:21.204697 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a44462e219640a88b4641e632a284c6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.205607 20781 raft_consensus.cc:740] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.213668 20659 raft_consensus.cc:2468] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:21.223694 20777 tablet_bootstrap.cc:654] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.218981 20781 consensus_queue.cc:260] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.219388 20778 raft_consensus.cc:359] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.229923 20778 raft_consensus.cc:385] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.230180 20778 raft_consensus.cc:740] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.230906 20778 consensus_queue.cc:260] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.222577 20779 tablet_bootstrap.cc:654] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.233161 20781 ts_tablet_manager.cc:1434] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:14:21.219655 20833 consensus_queue.cc:1048] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:14:21.236373 20778 ts_tablet_manager.cc:1434] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:14:21.237416 20778 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:21.238206 20835 raft_consensus.cc:493] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.218401 20814 raft_consensus.cc:515] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.238771 20835 raft_consensus.cc:515] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.240512 20781 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:21.244824 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a44462e219640a88b4641e632a284c6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:21.245515 20733 raft_consensus.cc:3060] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.258311 20835 leader_election.cc:290] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:21.258462 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:21.260330 20475 leader_election.cc:343] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.264202 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a44462e219640a88b4641e632a284c6" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:21.264829 20659 raft_consensus.cc:3060] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.266628 20733 raft_consensus.cc:2468] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:21.266130 20818 consensus_queue.cc:1048] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.268105 20835 raft_consensus.cc:493] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.268712 20835 raft_consensus.cc:515] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.270133 20818 consensus_queue.cc:1048] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:21.271924 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:21.268949 20550 leader_election.cc:304] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:21.273488 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.273712 20818 raft_consensus.cc:2804] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:21.255903 20814 leader_election.cc:290] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.278306 20818 raft_consensus.cc:697] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
W20260709 12:14:21.279798 20473 leader_election.cc:343] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.287024 20818 consensus_queue.cc:237] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.287185 20473 leader_election.cc:304] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:21.290853 20473 leader_election.cc:343] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.291680 20807 raft_consensus.cc:2749] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.292723 20835 leader_election.cc:290] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.316031 20781 tablet_bootstrap.cc:654] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.318282 20777 tablet_bootstrap.cc:492] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:21.319696 20777 ts_tablet_manager.cc:1403] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.003s
I20260709 12:14:21.318698 20814 raft_consensus.cc:493] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.327694 20814 raft_consensus.cc:515] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.331341 20835 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.332044 20835 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.334345 20777 raft_consensus.cc:359] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.338227 20777 raft_consensus.cc:385] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.338696 20777 raft_consensus.cc:740] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.339798 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.340161 20777 consensus_queue.cc:260] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.342680 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:21.342754 20548 leader_election.cc:343] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.343353 20731 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:21.344645 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:21.323446 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:21.348074 20778 tablet_bootstrap.cc:654] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.330232 20659 raft_consensus.cc:2468] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:21.350451 20475 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
W20260709 12:14:21.351140 20550 leader_election.cc:343] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.351379 20835 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:21.351577 20475 leader_election.cc:343] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.351724 20550 leader_election.cc:304] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:21.353196 20818 raft_consensus.cc:2749] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.353434 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:21.354193 20585 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:21.356859 20475 leader_election.cc:304] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:21.358062 20835 raft_consensus.cc:2749] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.337534 20814 leader_election.cc:290] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.350533 20777 ts_tablet_manager.cc:1434] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 12:14:21.351832 20807 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.377760 20777 tablet_bootstrap.cc:492] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:21.376875 20807 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.382740 20807 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.388192 20659 raft_consensus.cc:3060] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:21.395781 20473 consensus_peers.cc:597] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.396318 20406 catalog_manager.cc:5697] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.399322 20807 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.401727 20785 consensus_queue.cc:1048] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:21.403033 20779 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:21.403532 20779 ts_tablet_manager.cc:1403] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.233s	user 0.020s	sys 0.046s
I20260709 12:14:21.405032 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:21.405640 20732 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.407119 20779 raft_consensus.cc:359] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.407795 20779 raft_consensus.cc:385] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.408046 20779 raft_consensus.cc:740] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.418473 20779 consensus_queue.cc:260] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.421842 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:21.422554 20585 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.423861 20732 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:21.425283 20475 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:21.426198 20835 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:21.426746 20835 raft_consensus.cc:697] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:21.427604 20835 consensus_queue.cc:237] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.430349 20585 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:21.430878 20807 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:21.442822 20779 ts_tablet_manager.cc:1434] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:14:21.446259 20781 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:21.446986 20781 ts_tablet_manager.cc:1403] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.213s	user 0.016s	sys 0.003s
I20260709 12:14:21.447029 20779 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:21.449887 20781 raft_consensus.cc:359] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.452399 20781 raft_consensus.cc:385] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.452958 20781 raft_consensus.cc:740] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.456476 20778 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:21.457568 20778 ts_tablet_manager.cc:1403] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.004s
I20260709 12:14:21.457724 20785 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.458478 20785 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.461184 20785 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:21.462157 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.467623 20781 consensus_queue.cc:260] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.466171 20778 raft_consensus.cc:359] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.469802 20778 raft_consensus.cc:385] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.470017 20778 raft_consensus.cc:740] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.473867 20779 tablet_bootstrap.cc:654] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.475095 20835 consensus_queue.cc:1048] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.477278 20781 ts_tablet_manager.cc:1434] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:14:21.478096 20778 consensus_queue.cc:260] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.479732 20781 tablet_bootstrap.cc:492] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:21.480481 20778 ts_tablet_manager.cc:1434] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:14:21.481551 20778 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:21.488389 20777 tablet_bootstrap.cc:654] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.490402 20781 tablet_bootstrap.cc:654] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.500164 20807 consensus_queue.cc:1048] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:21.501264 20407 catalog_manager.cc:5697] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:21.533413 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:21.544800 20807 consensus_queue.cc:1048] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.561029 20835 consensus_queue.cc:1048] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.553202 20881 consensus_queue.cc:1048] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:14:21.571681 20900 consensus_queue.cc:1048] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.571982 20807 consensus_queue.cc:1048] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.578274 20733 raft_consensus.cc:3060] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.588747 20697 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
W20260709 12:14:21.589313 20623 consensus_peers.cc:597] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.607900 20779 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:21.608489 20779 ts_tablet_manager.cc:1403] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.009s
I20260709 12:14:21.616743 20779 raft_consensus.cc:359] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.617394 20779 raft_consensus.cc:385] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.617661 20779 raft_consensus.cc:740] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.618464 20779 consensus_queue.cc:260] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.634470 20779 ts_tablet_manager.cc:1434] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.008s
I20260709 12:14:21.636039 20779 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:21.637570 20778 tablet_bootstrap.cc:654] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.640905 20781 tablet_bootstrap.cc:492] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:21.641670 20781 ts_tablet_manager.cc:1403] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.162s	user 0.035s	sys 0.037s
I20260709 12:14:21.647574 20730 raft_consensus.cc:3060] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.651292 20777 tablet_bootstrap.cc:492] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:21.646690 20779 tablet_bootstrap.cc:654] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.652030 20777 ts_tablet_manager.cc:1403] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.277s	user 0.032s	sys 0.007s
I20260709 12:14:21.651933 20900 raft_consensus.cc:493] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.658982 20895 raft_consensus.cc:2749] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.655875 20900 raft_consensus.cc:515] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.662981 20900 leader_election.cc:290] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:21.724426 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:21.730700 20696 leader_election.cc:343] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.735478 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:21.736624 20779 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:21.736706 20510 raft_consensus.cc:2468] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:21.739665 20697 leader_election.cc:304] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:21.753629 20900 raft_consensus.cc:2804] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.754268 20900 raft_consensus.cc:493] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.755051 20900 raft_consensus.cc:3060] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.745098 20777 raft_consensus.cc:359] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.738215 20779 ts_tablet_manager.cc:1403] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.000s
I20260709 12:14:21.759037 20777 raft_consensus.cc:385] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.753989 20834 raft_consensus.cc:493] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.761484 20777 raft_consensus.cc:740] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.763760 20820 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.781823 20835 consensus_queue.cc:1048] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:14:21.792315 20779 raft_consensus.cc:359] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.796849 20779 raft_consensus.cc:385] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:21.798560 20475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 57682.9us
I20260709 12:14:21.799582 20858 consensus_queue.cc:1048] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.799944 20779 raft_consensus.cc:740] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.801023 20779 consensus_queue.cc:260] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.808831 20834 raft_consensus.cc:515] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.812032 20858 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.812429 20834 leader_election.cc:290] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.812848 20858 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.813102 20781 raft_consensus.cc:359] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.813937 20781 raft_consensus.cc:385] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.813616 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ec97c769014205af4764e131c2ba36" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:21.814308 20781 raft_consensus.cc:740] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.815548 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ec97c769014205af4764e131c2ba36" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:21.815368 20781 consensus_queue.cc:260] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
W20260709 12:14:21.821801 20624 leader_election.cc:343] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.820560 20583 raft_consensus.cc:2468] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:21.821151 20777 consensus_queue.cc:260] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.833861 20913 consensus_queue.cc:1048] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:21.834764 20820 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:21.837843 20820 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:21.832955 20778 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:21.842921 20858 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.836795 20622 leader_election.cc:304] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:21.849291 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:21.849169 20779 ts_tablet_manager.cc:1434] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.004s
I20260709 12:14:21.851167 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.852609 20779 tablet_bootstrap.cc:492] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
W20260709 12:14:21.854012 20475 leader_election.cc:343] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.859359 20834 raft_consensus.cc:2804] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:21.862540 20834 raft_consensus.cc:493] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.862911 20834 raft_consensus.cc:3060] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.863032 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:21.865137 20781 ts_tablet_manager.cc:1434] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.223s	user 0.010s	sys 0.005s
I20260709 12:14:21.867810 20549 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:21.869351 20818 raft_consensus.cc:2749] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.871057 20818 consensus_queue.cc:1048] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:21.871682 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 73678.1us
I20260709 12:14:21.886880 20781 tablet_bootstrap.cc:492] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:21.889330 20779 tablet_bootstrap.cc:654] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.891522 20778 ts_tablet_manager.cc:1403] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.410s	user 0.030s	sys 0.008s
I20260709 12:14:21.881853 20900 raft_consensus.cc:515] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.894712 20777 ts_tablet_manager.cc:1434] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.241s	user 0.010s	sys 0.005s
I20260709 12:14:21.899922 20895 raft_consensus.cc:493] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.900687 20895 raft_consensus.cc:515] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:21.905071 20900 leader_election.cc:290] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:21.906005 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:21.906759 20509 raft_consensus.cc:3060] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.907471 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
W20260709 12:14:21.908932 20696 leader_election.cc:343] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.911474 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:21.913537 20895 leader_election.cc:290] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:21.914474 20697 leader_election.cc:343] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.915112 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:21.916754 20696 leader_election.cc:343] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.917251 20696 leader_election.cc:304] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:21.919209 20895 raft_consensus.cc:2749] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:21.920706 20778 raft_consensus.cc:359] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.921501 20778 raft_consensus.cc:385] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.921797 20778 raft_consensus.cc:740] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.927591 20834 raft_consensus.cc:515] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.896420 20820 consensus_queue.cc:1048] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:14:21.929704 20834 leader_election.cc:290] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:21.932122 20777 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:21.931982 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:21.942062 20778 consensus_queue.cc:260] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:21.945267 20778 ts_tablet_manager.cc:1434] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:14:21.945161 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ec97c769014205af4764e131c2ba36" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:21.945996 20585 raft_consensus.cc:3060] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.950774 20781 tablet_bootstrap.cc:654] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.953804 20778 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:21.966077 20777 tablet_bootstrap.cc:654] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.971748 20781 tablet_bootstrap.cc:492] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:21.972316 20781 ts_tablet_manager.cc:1403] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.001s
I20260709 12:14:21.975600 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ec97c769014205af4764e131c2ba36" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
W20260709 12:14:21.978132 20624 leader_election.cc:343] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:21.980473 20778 tablet_bootstrap.cc:654] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.983310 20781 raft_consensus.cc:359] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.984230 20781 raft_consensus.cc:385] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.984563 20781 raft_consensus.cc:740] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.985898 20781 consensus_queue.cc:260] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:21.989020 20781 ts_tablet_manager.cc:1434] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:14:21.991110 20781 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:21.991915 20584 raft_consensus.cc:3060] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.994902 20509 raft_consensus.cc:2468] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:21.996260 20697 leader_election.cc:304] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:21.997784 20785 raft_consensus.cc:2804] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:21.998273 20785 raft_consensus.cc:697] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:21.999320 20785 consensus_queue.cc:237] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.000942 20895 raft_consensus.cc:493] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.001791 20781 tablet_bootstrap.cc:654] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.001492 20895 raft_consensus.cc:515] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.004050 20777 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.004634 20777 ts_tablet_manager.cc:1403] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.002s
I20260709 12:14:22.005167 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:22.006878 20696 leader_election.cc:343] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.007879 20777 raft_consensus.cc:359] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.008600 20777 raft_consensus.cc:385] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.008876 20777 raft_consensus.cc:740] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.009317 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.010262 20510 raft_consensus.cc:2468] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:22.011261 20777 consensus_queue.cc:260] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.013648 20777 ts_tablet_manager.cc:1434] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:14:22.011459 20858 consensus_queue.cc:1048] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.015971 20697 leader_election.cc:304] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:22.017071 20778 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:22.016986 20900 raft_consensus.cc:2804] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.017549 20895 leader_election.cc:290] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.017630 20900 raft_consensus.cc:493] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.992065 20585 raft_consensus.cc:2468] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:22.018209 20900 raft_consensus.cc:3060] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.023240 20622 leader_election.cc:304] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:22.024595 20834 raft_consensus.cc:2804] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.025146 20834 raft_consensus.cc:697] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
W20260709 12:14:22.026355 20473 leader_election.cc:343] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.026276 20834 consensus_queue.cc:237] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.026924 20473 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:22.029644 20858 raft_consensus.cc:2749] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.039443 20778 ts_tablet_manager.cc:1403] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.007s
I20260709 12:14:22.053148 20777 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:22.055708 20779 tablet_bootstrap.cc:492] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.054883 20408 catalog_manager.cc:5697] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.056309 20779 ts_tablet_manager.cc:1403] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.204s	user 0.021s	sys 0.009s
I20260709 12:14:22.059311 20779 raft_consensus.cc:359] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.060307 20900 raft_consensus.cc:515] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.063838 20900 leader_election.cc:290] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.065107 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:22.065867 20509 raft_consensus.cc:3060] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.066026 20778 raft_consensus.cc:359] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.066864 20778 raft_consensus.cc:385] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.067142 20778 raft_consensus.cc:740] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.067850 20778 consensus_queue.cc:260] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.069480 20778 ts_tablet_manager.cc:1434] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 12:14:22.069584 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:22.070742 20778 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:22.071435 20696 leader_election.cc:343] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.060019 20779 raft_consensus.cc:385] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.074841 20779 raft_consensus.cc:740] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.075639 20779 consensus_queue.cc:260] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.076772 20407 catalog_manager.cc:5697] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.078222 20779 ts_tablet_manager.cc:1434] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:14:22.079435 20779 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.081267 20781 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.084692 20781 ts_tablet_manager.cc:1403] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.008s
I20260709 12:14:22.085526 20777 tablet_bootstrap.cc:654] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.089026 20778 tablet_bootstrap.cc:654] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.086023 20779 tablet_bootstrap.cc:654] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.086272 20509 raft_consensus.cc:2468] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:22.090297 20781 raft_consensus.cc:359] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.093276 20781 raft_consensus.cc:385] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.092989 20697 leader_election.cc:304] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:22.093827 20781 raft_consensus.cc:740] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.094347 20900 raft_consensus.cc:2804] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.095013 20900 raft_consensus.cc:697] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:22.095412 20781 consensus_queue.cc:260] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.099475 20900 consensus_queue.cc:237] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.123603 20781 ts_tablet_manager.cc:1434] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:14:22.126899 20781 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.130429 20509 raft_consensus.cc:3060] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.145756 20777 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.146215 20779 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.146522 20777 ts_tablet_manager.cc:1403] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.007s
I20260709 12:14:22.146703 20779 ts_tablet_manager.cc:1403] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.068s	user 0.027s	sys 0.024s
I20260709 12:14:22.149356 20777 raft_consensus.cc:359] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.149555 20779 raft_consensus.cc:359] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.150830 20777 raft_consensus.cc:385] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.151329 20777 raft_consensus.cc:740] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.151085 20779 raft_consensus.cc:385] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.152164 20779 raft_consensus.cc:740] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.152180 20777 consensus_queue.cc:260] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.153147 20779 consensus_queue.cc:260] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.155381 20779 ts_tablet_manager.cc:1434] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:22.156754 20779 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.157483 20778 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:22.158064 20778 ts_tablet_manager.cc:1403] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.088s	user 0.035s	sys 0.011s
I20260709 12:14:22.159507 20781 tablet_bootstrap.cc:654] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.161711 20778 raft_consensus.cc:359] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.155435 20777 ts_tablet_manager.cc:1434] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:14:22.163456 20779 tablet_bootstrap.cc:654] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.164279 20777 tablet_bootstrap.cc:492] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:22.165128 20778 raft_consensus.cc:385] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.165998 20778 raft_consensus.cc:740] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.175904 20781 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.176820 20781 ts_tablet_manager.cc:1403] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.002s
I20260709 12:14:22.179395 20778 consensus_queue.cc:260] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.182310 20778 ts_tablet_manager.cc:1434] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:14:22.182170 20781 raft_consensus.cc:359] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.183398 20781 raft_consensus.cc:385] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.183748 20781 raft_consensus.cc:740] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.184455 20781 consensus_queue.cc:260] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.186831 20781 ts_tablet_manager.cc:1434] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:14:22.187779 20777 tablet_bootstrap.cc:654] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.187801 20781 tablet_bootstrap.cc:492] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.195412 20781 tablet_bootstrap.cc:654] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.198801 20779 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.199020 20778 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:22.199373 20779 ts_tablet_manager.cc:1403] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 12:14:22.203956 20779 raft_consensus.cc:359] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.204741 20779 raft_consensus.cc:385] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.204993 20779 raft_consensus.cc:740] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.205747 20779 consensus_queue.cc:260] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.206346 20778 tablet_bootstrap.cc:654] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.208106 20779 ts_tablet_manager.cc:1434] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:22.212693 20779 tablet_bootstrap.cc:492] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.213253 20818 raft_consensus.cc:493] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.214044 20818 raft_consensus.cc:515] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.223320 20818 leader_election.cc:290] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.225062 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.228219 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7403d046fdc74d9aa962b9cd7c64f41b" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.229409 20509 raft_consensus.cc:2393] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:22.237375 20549 leader_election.cc:304] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:22.238551 20818 raft_consensus.cc:3060] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.253635 20818 raft_consensus.cc:2749] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.262440 20781 tablet_bootstrap.cc:492] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.263088 20781 ts_tablet_manager.cc:1403] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.075s	user 0.032s	sys 0.041s
I20260709 12:14:22.265303 20778 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:22.266206 20778 ts_tablet_manager.cc:1403] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.020s
I20260709 12:14:22.262079 20407 catalog_manager.cc:5697] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:22.272120 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:22.272347 20778 raft_consensus.cc:359] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.273273 20778 raft_consensus.cc:385] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.273554 20778 raft_consensus.cc:740] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.274410 20778 consensus_queue.cc:260] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.266191 20781 raft_consensus.cc:359] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.275703 20779 tablet_bootstrap.cc:654] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.276924 20781 raft_consensus.cc:385] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.277415 20781 raft_consensus.cc:740] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.278244 20781 consensus_queue.cc:260] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.276482 20777 tablet_bootstrap.cc:492] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.279654 20777 ts_tablet_manager.cc:1403] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.021s
I20260709 12:14:22.280720 20781 ts_tablet_manager.cc:1434] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:22.282138 20781 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.282907 20777 raft_consensus.cc:359] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.283682 20777 raft_consensus.cc:385] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.283952 20777 raft_consensus.cc:740] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.285545 20777 consensus_queue.cc:260] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.288918 20777 ts_tablet_manager.cc:1434] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:22.289918 20781 tablet_bootstrap.cc:654] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.290078 20777 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:22.291085 20880 raft_consensus.cc:493] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.291575 20880 raft_consensus.cc:515] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.295045 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e700eae1d14008b9b5f277207b7f47" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.295544 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e700eae1d14008b9b5f277207b7f47" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:22.296229 20584 raft_consensus.cc:2468] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
W20260709 12:14:22.296643 20624 leader_election.cc:343] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.297610 20622 leader_election.cc:304] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:22.298625 20881 raft_consensus.cc:2804] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.299118 20881 raft_consensus.cc:493] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.299521 20881 raft_consensus.cc:3060] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.302671 20880 leader_election.cc:290] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:22.310454 20778 ts_tablet_manager.cc:1434] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:14:22.312057 20778 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:22.315074 20779 tablet_bootstrap.cc:492] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.318992 20779 ts_tablet_manager.cc:1403] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.003s
I20260709 12:14:22.323093 20881 raft_consensus.cc:515] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.324923 20814 raft_consensus.cc:493] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.325505 20814 raft_consensus.cc:515] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.327450 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e700eae1d14008b9b5f277207b7f47" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:22.328351 20584 raft_consensus.cc:3060] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.328953 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e700eae1d14008b9b5f277207b7f47" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:22.328491 20779 raft_consensus.cc:359] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.329535 20779 raft_consensus.cc:385] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.330161 20881 leader_election.cc:290] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
W20260709 12:14:22.330582 20624 leader_election.cc:343] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.329896 20779 raft_consensus.cc:740] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.331259 20814 leader_election.cc:290] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:22.331164 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b188093e7f4e49b475a039b4dc0022" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.332293 20779 consensus_queue.cc:260] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.334576 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b188093e7f4e49b475a039b4dc0022" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:22.335155 20778 tablet_bootstrap.cc:654] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.335479 20658 raft_consensus.cc:2468] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:22.337642 20548 leader_election.cc:304] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:22.338792 20733 raft_consensus.cc:2468] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:22.342172 20814 raft_consensus.cc:2804] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.342734 20814 raft_consensus.cc:493] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.343182 20814 raft_consensus.cc:3060] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.344739 20777 tablet_bootstrap.cc:654] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.348337 20779 ts_tablet_manager.cc:1434] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 12:14:22.349466 20900 raft_consensus.cc:493] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.350333 20781 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.350054 20900 raft_consensus.cc:515] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.350843 20781 ts_tablet_manager.cc:1403] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.029s
I20260709 12:14:22.349584 20779 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.352249 20900 leader_election.cc:290] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:22.353941 20781 raft_consensus.cc:359] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.354616 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ec97c769014205af4764e131c2ba36" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:22.355391 20585 raft_consensus.cc:2393] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491eb72eef45486bb35575f2936538d9 in current term 1: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:22.354599 20781 raft_consensus.cc:385] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.356287 20781 raft_consensus.cc:740] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.356945 20781 consensus_queue.cc:260] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.359301 20781 ts_tablet_manager.cc:1434] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:22.359395 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ec97c769014205af4764e131c2ba36" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:22.360611 20781 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.361141 20696 leader_election.cc:304] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:22.362269 20785 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.362718 20785 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.364321 20779 tablet_bootstrap.cc:654] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.364897 20785 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.365463 20785 raft_consensus.cc:3060] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.367290 20781 tablet_bootstrap.cc:654] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.367740 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.368418 20509 raft_consensus.cc:2468] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:22.369766 20697 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:22.370870 20895 raft_consensus.cc:2804] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.371346 20895 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.371738 20895 raft_consensus.cc:3060] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.377022 20779 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.377431 20781 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.377595 20779 ts_tablet_manager.cc:1403] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 12:14:22.377977 20781 ts_tablet_manager.cc:1403] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 12:14:22.380571 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:22.381033 20779 raft_consensus.cc:359] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.381260 20658 raft_consensus.cc:2468] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:22.381265 20781 raft_consensus.cc:359] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.388896 20807 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.400357 20781 raft_consensus.cc:385] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.400614 20785 raft_consensus.cc:2749] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.400802 20781 raft_consensus.cc:740] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.400017 20779 raft_consensus.cc:385] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.401803 20881 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.400522 20807 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.402241 20781 consensus_queue.cc:260] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.397486 20584 raft_consensus.cc:2468] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:22.404562 20807 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:22.401950 20779 raft_consensus.cc:740] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.405601 20781 ts_tablet_manager.cc:1434] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:14:22.405664 20779 consensus_queue.cc:260] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.407265 20814 raft_consensus.cc:515] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.407519 20622 leader_election.cc:304] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:22.408392 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:22.408892 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:22.409215 20778 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:22.410420 20880 raft_consensus.cc:2804] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.412896 20781 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.413280 20779 ts_tablet_manager.cc:1434] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:14:22.413319 20880 raft_consensus.cc:697] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:22.414656 20779 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.414979 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b188093e7f4e49b475a039b4dc0022" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
W20260709 12:14:22.411619 20473 leader_election.cc:343] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.415683 20733 raft_consensus.cc:3060] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:22.416275 20473 leader_election.cc:343] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.416725 20473 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:22.411856 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b188093e7f4e49b475a039b4dc0022" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:22.418538 20657 raft_consensus.cc:3060] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.421478 20880 consensus_queue.cc:237] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.422698 20807 raft_consensus.cc:2749] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.430717 20833 consensus_queue.cc:1048] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:22.432758 20781 tablet_bootstrap.cc:654] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.433264 20814 leader_election.cc:290] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:22.440287 20777 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.435932 20733 raft_consensus.cc:2468] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:22.440949 20777 ts_tablet_manager.cc:1403] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.006s
I20260709 12:14:22.442086 20550 leader_election.cc:304] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:22.443274 20814 raft_consensus.cc:2804] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.443849 20814 raft_consensus.cc:697] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:22.444762 20814 consensus_queue.cc:237] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.445212 20777 raft_consensus.cc:359] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.446094 20777 raft_consensus.cc:385] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.446403 20777 raft_consensus.cc:740] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.447325 20777 consensus_queue.cc:260] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.449945 20781 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.450533 20781 ts_tablet_manager.cc:1403] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.001s
I20260709 12:14:22.451732 20834 raft_consensus.cc:493] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.452237 20834 raft_consensus.cc:515] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.453610 20781 raft_consensus.cc:359] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.454295 20781 raft_consensus.cc:385] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.455081 20834 leader_election.cc:290] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:22.455314 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be7972679734f9ea94cced565e677c6" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.456228 20509 raft_consensus.cc:2468] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:22.456947 20777 ts_tablet_manager.cc:1434] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:14:22.458061 20779 tablet_bootstrap.cc:654] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.457862 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be7972679734f9ea94cced565e677c6" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:22.459075 20585 raft_consensus.cc:2468] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:22.460592 20622 leader_election.cc:304] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:22.462167 20777 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:22.454593 20781 raft_consensus.cc:740] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.465935 20781 consensus_queue.cc:260] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.469782 20777 tablet_bootstrap.cc:654] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.468992 20405 catalog_manager.cc:5697] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.472190 20781 ts_tablet_manager.cc:1434] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:14:22.475349 20781 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.473739 20880 raft_consensus.cc:2804] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.487648 20880 raft_consensus.cc:493] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.488041 20880 raft_consensus.cc:3060] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.409461 20881 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.493263 20881 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.494571 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.495443 20510 raft_consensus.cc:2468] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:22.495611 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.496979 20623 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:22.498051 20881 raft_consensus.cc:2804] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.498451 20881 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.499415 20785 consensus_queue.cc:1048] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.500831 20779 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.501389 20779 ts_tablet_manager.cc:1403] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.007s
I20260709 12:14:22.501875 20914 raft_consensus.cc:493] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.412252 20778 ts_tablet_manager.cc:1403] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.000s
I20260709 12:14:22.502380 20914 raft_consensus.cc:515] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.505189 20779 raft_consensus.cc:359] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.506188 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.396713 20895 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.483960 20833 consensus_queue.cc:1048] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:22.506919 20730 raft_consensus.cc:2468] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:22.508337 20475 leader_election.cc:304] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:22.509268 20835 raft_consensus.cc:2804] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.508904 20880 raft_consensus.cc:515] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.509994 20914 leader_election.cc:290] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:22.511627 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:22.513224 20781 tablet_bootstrap.cc:654] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.509718 20835 raft_consensus.cc:493] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:22.520874 20473 leader_election.cc:343] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.520905 20835 raft_consensus.cc:3060] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.517382 20880 leader_election.cc:290] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:22.505975 20779 raft_consensus.cc:385] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.518694 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be7972679734f9ea94cced565e677c6" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:22.523830 20585 raft_consensus.cc:3060] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.523949 20731 raft_consensus.cc:2393] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:22.524591 20777 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.525096 20777 ts_tablet_manager.cc:1403] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.007s
I20260709 12:14:22.525537 20779 raft_consensus.cc:740] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.526469 20779 consensus_queue.cc:260] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.533896 20657 raft_consensus.cc:2468] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:22.528805 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:22.532405 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:22.539959 20508 raft_consensus.cc:3060] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.540666 20835 raft_consensus.cc:515] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.533241 20585 raft_consensus.cc:2468] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:22.533938 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be7972679734f9ea94cced565e677c6" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:22.534636 20895 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.527832 20777 raft_consensus.cc:359] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.557647 20777 raft_consensus.cc:385] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.557968 20777 raft_consensus.cc:740] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.558714 20777 consensus_queue.cc:260] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.561512 20777 ts_tablet_manager.cc:1434] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 12:14:22.566990 20785 consensus_queue.cc:1048] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:22.568655 20777 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:22.499148 20881 raft_consensus.cc:3060] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.576297 20509 raft_consensus.cc:3060] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.505826 20778 raft_consensus.cc:359] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.537923 20779 ts_tablet_manager.cc:1434] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:14:22.555398 20622 leader_election.cc:304] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:22.581797 20834 raft_consensus.cc:2804] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.582281 20834 raft_consensus.cc:697] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:22.583086 20834 consensus_queue.cc:237] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.584049 20508 raft_consensus.cc:2468] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:22.570098 20405 catalog_manager.cc:5697] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.581130 20779 tablet_bootstrap.cc:492] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.585557 20697 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:22.590469 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:22.591216 20731 raft_consensus.cc:3060] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.591799 20785 raft_consensus.cc:2804] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.592435 20785 raft_consensus.cc:697] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:22.593346 20777 tablet_bootstrap.cc:654] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.593246 20785 consensus_queue.cc:237] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.596725 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:22.596764 20880 raft_consensus.cc:493] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.597751 20880 raft_consensus.cc:515] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:22.599099 20473 leader_election.cc:343] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.604215 20881 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.604609 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c3ec756598438db6b68df006b111ef" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.605257 20730 raft_consensus.cc:2468] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:22.605543 20658 raft_consensus.cc:2393] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 491eb72eef45486bb35575f2936538d9 in current term 1: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:22.578648 20778 raft_consensus.cc:385] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.607722 20778 raft_consensus.cc:740] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.608183 20624 leader_election.cc:304] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:22.608517 20778 consensus_queue.cc:260] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.610353 20778 ts_tablet_manager.cc:1434] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.107s	user 0.003s	sys 0.002s
I20260709 12:14:22.614480 20833 raft_consensus.cc:2804] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.615017 20833 raft_consensus.cc:493] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.615417 20833 raft_consensus.cc:3060] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.610440 20835 leader_election.cc:290] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:22.610347 20880 leader_election.cc:290] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.619908 20405 catalog_manager.cc:5697] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.622664 20509 raft_consensus.cc:2468] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:22.626586 20781 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.627123 20781 ts_tablet_manager.cc:1403] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.020s
I20260709 12:14:22.629240 20778 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:22.628970 20833 raft_consensus.cc:515] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.629758 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c3ec756598438db6b68df006b111ef" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.631881 20881 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.632545 20779 tablet_bootstrap.cc:654] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.635679 20781 raft_consensus.cc:359] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.637416 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:22.642046 20781 raft_consensus.cc:385] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.642383 20781 raft_consensus.cc:740] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.644140 20781 consensus_queue.cc:260] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.653443 20509 raft_consensus.cc:2393] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
W20260709 12:14:22.654351 20623 leader_election.cc:343] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.655755 20895 raft_consensus.cc:493] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.656255 20895 raft_consensus.cc:515] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.657552 20778 tablet_bootstrap.cc:654] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.658409 20895 leader_election.cc:290] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:22.678633 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c3ec756598438db6b68df006b111ef" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:22.679198 20833 leader_election.cc:290] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.680573 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c3ec756598438db6b68df006b111ef" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:22.679255 20730 raft_consensus.cc:3060] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.681174 20814 raft_consensus.cc:493] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.682236 20814 raft_consensus.cc:515] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.684533 20814 leader_election.cc:290] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.684866 20781 ts_tablet_manager.cc:1434] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 12:14:22.660002 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e744c13d5a84d18965663d8e15147b8" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:22.686781 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.661949 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:22.661722 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e744c13d5a84d18965663d8e15147b8" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.697017 20732 raft_consensus.cc:2468] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
W20260709 12:14:22.692394 20623 leader_election.cc:343] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.689551 20785 consensus_queue.cc:1048] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:14:22.693564 20584 raft_consensus.cc:2468] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:22.704145 20696 leader_election.cc:304] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:22.709849 20777 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.710554 20777 ts_tablet_manager.cc:1403] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.148s	user 0.023s	sys 0.039s
I20260709 12:14:22.712090 20781 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.709784 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:22.714797 20550 leader_election.cc:304] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
W20260709 12:14:22.715315 20697 leader_election.cc:343] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.715869 20814 raft_consensus.cc:2804] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.716302 20814 raft_consensus.cc:493] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.716655 20814 raft_consensus.cc:3060] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:22.720414 20549 leader_election.cc:343] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.727486 20624 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:22.725754 20405 catalog_manager.cc:5697] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.730703 20962 raft_consensus.cc:2804] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.731287 20962 raft_consensus.cc:493] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.731650 20962 raft_consensus.cc:3060] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.733875 20778 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:22.734454 20778 ts_tablet_manager.cc:1403] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.014s
I20260709 12:14:22.735584 20881 raft_consensus.cc:2749] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.737586 20778 raft_consensus.cc:359] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.738315 20778 raft_consensus.cc:385] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.739728 20778 raft_consensus.cc:740] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.740477 20778 consensus_queue.cc:260] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.740924 20777 raft_consensus.cc:359] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.741634 20777 raft_consensus.cc:385] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.741901 20777 raft_consensus.cc:740] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.742971 20778 ts_tablet_manager.cc:1434] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:14:22.743525 20696 consensus_peers.cc:597] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:22.744351 20778 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:22.745393 20731 raft_consensus.cc:2468] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:22.745683 20835 raft_consensus.cc:493] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.746490 20835 raft_consensus.cc:515] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.749981 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:22.751279 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:22.751485 20781 tablet_bootstrap.cc:654] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:22.751490 20473 leader_election.cc:343] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.752131 20658 raft_consensus.cc:2468] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:22.753628 20473 leader_election.cc:304] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:22.754468 20807 raft_consensus.cc:2804] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:22.754841 20807 raft_consensus.cc:493] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.755178 20807 raft_consensus.cc:3060] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.757670 20730 raft_consensus.cc:2468] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:22.759122 20778 tablet_bootstrap.cc:654] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.737311 20814 raft_consensus.cc:515] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.746919 20779 tablet_bootstrap.cc:492] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.761644 20779 ts_tablet_manager.cc:1403] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.009s
I20260709 12:14:22.762465 20777 consensus_queue.cc:260] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.779302 20624 leader_election.cc:304] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:22.781322 20807 raft_consensus.cc:515] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.782686 20833 raft_consensus.cc:2804] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.767817 20835 leader_election.cc:290] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:22.783388 20833 raft_consensus.cc:697] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:22.784472 20833 consensus_queue.cc:237] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.788275 20814 leader_election.cc:290] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.788478 20475 leader_election.cc:304] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:22.788627 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:22.790764 20549 leader_election.cc:343] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.791129 20835 raft_consensus.cc:2804] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.792001 20835 raft_consensus.cc:697] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:22.792927 20835 consensus_queue.cc:237] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.798904 20779 raft_consensus.cc:359] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.799641 20779 raft_consensus.cc:385] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.799897 20779 raft_consensus.cc:740] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.802208 20807 leader_election.cc:290] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:22.805388 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:22.805766 20777 ts_tablet_manager.cc:1434] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.001s
I20260709 12:14:22.812829 20779 consensus_queue.cc:260] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:22.815884 20781 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:22.816377 20781 ts_tablet_manager.cc:1403] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.119s	user 0.024s	sys 0.027s
I20260709 12:14:22.816573 20779 ts_tablet_manager.cc:1434] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:14:22.818310 20779 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.807695 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:22.818544 20781 raft_consensus.cc:359] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.821911 20781 raft_consensus.cc:385] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.822367 20781 raft_consensus.cc:740] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.812037 20658 raft_consensus.cc:3060] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.825753 20781 consensus_queue.cc:260] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.827718 20814 raft_consensus.cc:493] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.832278 20814 raft_consensus.cc:515] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.829269 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:22.836159 20731 raft_consensus.cc:3060] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.837591 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c20742313b4aeeb03cc3df575852e1" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:22.843827 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c20742313b4aeeb03cc3df575852e1" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:22.844323 20550 leader_election.cc:343] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.846103 20779 tablet_bootstrap.cc:654] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.834373 20814 leader_election.cc:290] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:22.860296 20777 tablet_bootstrap.cc:492] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:22.864248 20731 raft_consensus.cc:2468] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:22.865593 20550 leader_election.cc:304] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:22.866781 20814 raft_consensus.cc:2804] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.867272 20814 raft_consensus.cc:697] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:22.868044 20814 consensus_queue.cc:237] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.868374 20962 raft_consensus.cc:515] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.870066 20777 tablet_bootstrap.cc:654] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.869133 20407 catalog_manager.cc:5697] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:22.858433 20473 leader_election.cc:343] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.873421 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e744c13d5a84d18965663d8e15147b8" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:22.859580 20549 leader_election.cc:343] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.877430 20781 ts_tablet_manager.cc:1434] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:14:22.882117 20778 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:22.882653 20778 ts_tablet_manager.cc:1403] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.139s	user 0.023s	sys 0.002s
I20260709 12:14:22.870436 20962 leader_election.cc:290] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:22.889597 20697 leader_election.cc:343] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.879938 20549 leader_election.cc:304] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:22.891964 20818 raft_consensus.cc:2749] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:22.892339 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e744c13d5a84d18965663d8e15147b8" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:22.893026 20585 raft_consensus.cc:3060] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.895733 20731 raft_consensus.cc:3060] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:22.907712 20781 tablet_bootstrap.cc:492] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:22.912799 20407 catalog_manager.cc:5697] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.915359 20778 raft_consensus.cc:359] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.916035 20778 raft_consensus.cc:385] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.916347 20778 raft_consensus.cc:740] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.921663 20778 consensus_queue.cc:260] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.923317 20778 ts_tablet_manager.cc:1434] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:14:22.924515 20778 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:22.927361 20833 consensus_queue.cc:1048] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:22.930825 20658 raft_consensus.cc:2468] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:22.932330 20473 leader_election.cc:304] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:22.934010 20807 raft_consensus.cc:2804] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.934521 20807 raft_consensus.cc:697] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:22.947644 20777 tablet_bootstrap.cc:492] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:22.948253 20777 ts_tablet_manager.cc:1403] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.012s
I20260709 12:14:22.943638 20585 raft_consensus.cc:2468] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:22.958748 20835 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.959889 20820 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.960404 20835 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.960556 20820 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.962045 20779 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:22.962616 20779 ts_tablet_manager.cc:1403] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.000s
I20260709 12:14:22.963269 20696 leader_election.cc:304] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:22.964120 20962 raft_consensus.cc:2804] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:22.965960 20962 raft_consensus.cc:697] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:22.967720 20962 consensus_queue.cc:237] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:22.968681 20778 tablet_bootstrap.cc:654] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.970724 20835 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:22.951961 20807 consensus_queue.cc:237] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:22.974294 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:22.976045 20475 leader_election.cc:343] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.977614 20779 raft_consensus.cc:359] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.978322 20779 raft_consensus.cc:385] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.978596 20779 raft_consensus.cc:740] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.979230 20779 consensus_queue.cc:260] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:22.985376 20779 ts_tablet_manager.cc:1434] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:14:22.986409 20779 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:22.987852 20404 catalog_manager.cc:5697] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.000090 20779 tablet_bootstrap.cc:654] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.006693 20818 consensus_queue.cc:1048] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.015319 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:23.015100 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:23.016292 20820 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:23.017916 20549 leader_election.cc:343] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:23.020147 20550 leader_election.cc:343] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.020730 20550 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:23.021625 20820 raft_consensus.cc:2749] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.020143 20781 tablet_bootstrap.cc:654] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.026355 20777 raft_consensus.cc:359] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.027161 20777 raft_consensus.cc:385] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.027489 20777 raft_consensus.cc:740] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.028460 20777 consensus_queue.cc:260] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.028003 20785 consensus_queue.cc:1048] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:23.057111 20820 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.057161 20777 ts_tablet_manager.cc:1434] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.000s
I20260709 12:14:23.061076 20777 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:23.057978 20820 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.084103 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:23.085840 20779 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:23.086432 20779 ts_tablet_manager.cc:1403] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.005s
I20260709 12:14:23.088694 20820 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:23.089674 20779 raft_consensus.cc:359] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.090418 20779 raft_consensus.cc:385] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.090710 20779 raft_consensus.cc:740] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
W20260709 12:14:23.090936 20473 leader_election.cc:343] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.091467 20473 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:23.092792 20914 raft_consensus.cc:2749] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.092761 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:23.093616 20509 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:23.091455 20779 consensus_queue.cc:260] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.095443 20549 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:23.096839 20818 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.097232 20818 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.097483 20779 ts_tablet_manager.cc:1434] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:23.097589 20818 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.097786 20833 consensus_queue.cc:1048] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.098709 20779 tablet_bootstrap.cc:492] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:23.098658 20814 consensus_queue.cc:1048] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.099278 20833 consensus_queue.cc:1048] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.101532 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:23.118299 20548 leader_election.cc:343] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.120658 20818 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.137583 20781 tablet_bootstrap.cc:492] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:23.138583 20781 ts_tablet_manager.cc:1403] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.251s	user 0.018s	sys 0.007s
I20260709 12:14:23.139523 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:23.140230 20509 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.143181 20777 tablet_bootstrap.cc:654] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.147524 20781 raft_consensus.cc:359] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.148509 20781 raft_consensus.cc:385] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.148819 20781 raft_consensus.cc:740] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.149603 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:23.150010 20778 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:23.149708 20781 consensus_queue.cc:260] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.150635 20778 ts_tablet_manager.cc:1403] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.226s	user 0.041s	sys 0.067s
I20260709 12:14:23.152437 20833 consensus_queue.cc:1048] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:23.152962 20548 leader_election.cc:343] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.153964 20781 ts_tablet_manager.cc:1434] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:14:23.155050 20407 catalog_manager.cc:5697] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.161602 20509 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:23.163197 20549 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:23.164438 20978 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.153811 20778 raft_consensus.cc:359] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.164908 20778 raft_consensus.cc:385] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.165755 20978 raft_consensus.cc:697] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:23.166791 20978 consensus_queue.cc:237] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.169909 20779 tablet_bootstrap.cc:654] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.165215 20778 raft_consensus.cc:740] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.145581 20818 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:23.184090 20781 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:23.206434 20880 raft_consensus.cc:493] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.205212 20820 raft_consensus.cc:493] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.244205 20820 raft_consensus.cc:515] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
W20260709 12:14:23.244978 20473 consensus_peers.cc:597] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.247658 20820 leader_election.cc:290] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:23.249043 20881 raft_consensus.cc:493] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.249652 20881 raft_consensus.cc:515] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.256603 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:23.257536 20900 consensus_queue.cc:1048] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.258587 20781 tablet_bootstrap.cc:654] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.249614 20510 raft_consensus.cc:3060] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.260514 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:23.261897 20550 leader_election.cc:343] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.265076 20807 consensus_queue.cc:1048] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.253001 20834 consensus_queue.cc:1048] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:14:23.271157 20404 catalog_manager.cc:5697] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:23.278149 20548 leader_election.cc:343] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.278677 20548 leader_election.cc:304] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:23.280758 20818 raft_consensus.cc:2749] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.281288 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:23.250989 20880 raft_consensus.cc:515] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.289269 20880 leader_election.cc:290] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:23.290400 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2f2e25de645878298811e12c1eefe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:23.294265 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2f2e25de645878298811e12c1eefe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:23.294934 20585 raft_consensus.cc:2468] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
W20260709 12:14:23.304764 20624 leader_election.cc:343] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.306589 20622 leader_election.cc:304] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:23.303709 20778 consensus_queue.cc:260] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.310124 20778 ts_tablet_manager.cc:1434] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.159s	user 0.008s	sys 0.001s
I20260709 12:14:23.323225 20778 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:23.343290 20914 raft_consensus.cc:493] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.343901 20914 raft_consensus.cc:515] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.346083 20914 leader_election.cc:290] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:23.348191 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c3ec756598438db6b68df006b111ef" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:23.350911 20820 consensus_queue.cc:1048] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:23.356436 20549 consensus_peers.cc:597] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.367527 20835 raft_consensus.cc:493] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.368247 20835 raft_consensus.cc:515] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.371569 20835 leader_election.cc:290] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:23.371742 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:23.371961 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e744c13d5a84d18965663d8e15147b8" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:23.372388 20881 leader_election.cc:290] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.373900 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:23.376428 20778 tablet_bootstrap.cc:654] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.380873 20994 raft_consensus.cc:2804] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.381629 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c3ec756598438db6b68df006b111ef" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:23.384109 20777 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
W20260709 12:14:23.385076 20623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 117806us
I20260709 12:14:23.388264 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e744c13d5a84d18965663d8e15147b8" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:23.389137 20779 tablet_bootstrap.cc:492] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:23.421286 20584 raft_consensus.cc:2393] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
W20260709 12:14:23.426789 20622 leader_election.cc:343] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.427148 20994 raft_consensus.cc:493] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.422456 20407 catalog_manager.cc:5697] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.435322 20994 raft_consensus.cc:3060] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.425843 20781 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:23.438339 20781 ts_tablet_manager.cc:1403] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.255s	user 0.049s	sys 0.066s
I20260709 12:14:23.428176 20777 ts_tablet_manager.cc:1403] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.367s	user 0.020s	sys 0.007s
I20260709 12:14:23.431567 20779 ts_tablet_manager.cc:1403] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.333s	user 0.006s	sys 0.017s
W20260709 12:14:23.442435 20473 consensus_peers.cc:597] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.446707 20777 raft_consensus.cc:359] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.447480 20777 raft_consensus.cc:385] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.447798 20777 raft_consensus.cc:740] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.448800 20778 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:23.449405 20778 ts_tablet_manager.cc:1403] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.012s
I20260709 12:14:23.448493 20777 consensus_queue.cc:260] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:23.450767 20623 leader_election.cc:343] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.449936 20994 raft_consensus.cc:515] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.433332 20880 consensus_queue.cc:1048] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.449841 20781 raft_consensus.cc:359] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.455024 20781 raft_consensus.cc:385] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.455375 20781 raft_consensus.cc:740] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.455962 20895 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.456174 20781 consensus_queue.cc:260] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.456411 20895 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.459396 20781 ts_tablet_manager.cc:1434] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:14:23.453976 20475 leader_election.cc:304] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:23.454107 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2f2e25de645878298811e12c1eefe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:23.459367 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:23.461647 20807 raft_consensus.cc:2749] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:23.461896 20508 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:23.461071 20475 leader_election.cc:304] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:23.463310 20697 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:23.464195 20900 raft_consensus.cc:2804] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.464818 20900 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.459741 20779 raft_consensus.cc:359] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.464294 20584 raft_consensus.cc:3060] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.465230 20900 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.466172 20994 leader_election.cc:290] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:23.465368 20779 raft_consensus.cc:385] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.464073 20807 raft_consensus.cc:3060] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.468957 20779 raft_consensus.cc:740] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.469740 20779 consensus_queue.cc:260] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.470698 20895 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.473294 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd2f2e25de645878298811e12c1eefe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:23.468912 20781 tablet_bootstrap.cc:492] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:23.474020 20732 raft_consensus.cc:3060] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.474036 20779 ts_tablet_manager.cc:1434] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:14:23.480250 20779 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:23.453157 20777 ts_tablet_manager.cc:1434] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:14:23.484756 20777 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:23.485188 20584 raft_consensus.cc:2468] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:23.481488 20781 tablet_bootstrap.cc:654] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.487960 20622 leader_election.cc:304] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:23.481985 20807 raft_consensus.cc:2749] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.488945 20994 raft_consensus.cc:2804] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.489521 20994 raft_consensus.cc:697] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:23.490453 20895 raft_consensus.cc:493] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.490546 20994 consensus_queue.cc:237] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.491124 20895 raft_consensus.cc:515] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.493582 20732 raft_consensus.cc:2468] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:23.494144 20895 leader_election.cc:290] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:23.494455 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:23.454241 20623 leader_election.cc:304] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:23.498216 20623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 66004.1us
I20260709 12:14:23.498528 20880 raft_consensus.cc:2749] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.500038 20895 consensus_queue.cc:1048] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.514014 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:23.518244 20781 tablet_bootstrap.cc:492] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:23.518968 20781 ts_tablet_manager.cc:1403] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.004s
I20260709 12:14:23.484045 20900 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.527848 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:23.528086 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:23.528963 20507 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.488675 20778 raft_consensus.cc:359] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.529546 20778 raft_consensus.cc:385] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.529850 20778 raft_consensus.cc:740] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
W20260709 12:14:23.531075 20696 leader_election.cc:343] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.531668 20778 consensus_queue.cc:260] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:23.539206 20696 leader_election.cc:343] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.543162 20510 raft_consensus.cc:2468] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:23.547166 20779 tablet_bootstrap.cc:654] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.544085 20778 ts_tablet_manager.cc:1434] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
I20260709 12:14:23.550287 20778 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:23.550925 20408 catalog_manager.cc:5697] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.554061 20895 consensus_queue.cc:1048] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.554106 20697 leader_election.cc:304] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:23.556344 20962 raft_consensus.cc:2804] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.557600 20962 raft_consensus.cc:493] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.558555 20962 raft_consensus.cc:3060] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.556890 20507 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:23.566843 20900 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.568674 20697 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:23.569463 20781 raft_consensus.cc:359] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.570430 20781 raft_consensus.cc:385] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.570782 20781 raft_consensus.cc:740] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.571743 20781 consensus_queue.cc:260] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.568702 20777 tablet_bootstrap.cc:654] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.580567 20781 ts_tablet_manager.cc:1434] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.003s
I20260709 12:14:23.599712 20779 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:23.600483 20779 ts_tablet_manager.cc:1403] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.010s
I20260709 12:14:23.602696 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:23.607483 20781 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
W20260709 12:14:23.609694 20696 leader_election.cc:343] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.611490 20659 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.620239 20779 raft_consensus.cc:359] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.621318 20779 raft_consensus.cc:385] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.612228 20900 raft_consensus.cc:2804] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.621622 20779 raft_consensus.cc:740] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.623687 20779 consensus_queue.cc:260] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.643327 20779 ts_tablet_manager.cc:1434] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.043s	user 0.016s	sys 0.004s
I20260709 12:14:23.653914 20778 tablet_bootstrap.cc:654] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.659797 20781 tablet_bootstrap.cc:654] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.624962 20835 consensus_queue.cc:1048] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:14:23.660851 20900 raft_consensus.cc:697] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:23.675171 20978 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.675736 20978 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.677922 20962 raft_consensus.cc:515] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.678471 20978 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:23.681209 20779 tablet_bootstrap.cc:492] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:23.686710 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:23.688410 20550 leader_election.cc:343] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.688957 20994 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.690709 20994 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.691311 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:23.699440 20549 leader_election.cc:343] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.699936 20549 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:23.700973 20978 raft_consensus.cc:2749] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.702414 20978 consensus_queue.cc:1048] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.761591 20777 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:23.763319 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:23.768698 20777 ts_tablet_manager.cc:1403] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.282s	user 0.014s	sys 0.011s
I20260709 12:14:23.706776 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:23.773020 20781 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:23.775485 20781 ts_tablet_manager.cc:1403] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.168s	user 0.037s	sys 0.046s
I20260709 12:14:23.773348 20777 raft_consensus.cc:359] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.776293 20777 raft_consensus.cc:385] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.706976 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:23.780498 20696 leader_election.cc:343] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.786932 20962 leader_election.cc:290] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:23.789870 20778 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:23.790417 20778 ts_tablet_manager.cc:1403] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.240s	user 0.009s	sys 0.011s
I20260709 12:14:23.781217 20781 raft_consensus.cc:359] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.776680 20777 raft_consensus.cc:740] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.792088 20781 raft_consensus.cc:385] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.792531 20781 raft_consensus.cc:740] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.705423 20994 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.784271 20508 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
W20260709 12:14:23.762223 20549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 63886.4us
I20260709 12:14:23.803198 20778 raft_consensus.cc:359] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.810324 20778 raft_consensus.cc:385] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.810357 20978 consensus_queue.cc:1048] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.792613 20777 consensus_queue.cc:260] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.796214 20623 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:23.798466 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:23.812925 20881 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:23.813235 20509 raft_consensus.cc:3060] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.813406 20881 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election (detected failure of leader d45ade27487a47c990a6f9d0fa4a86c7)
I20260709 12:14:23.813880 20777 ts_tablet_manager.cc:1434] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:14:23.813939 20881 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.814810 20781 consensus_queue.cc:260] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.817663 20781 ts_tablet_manager.cc:1434] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 12:14:23.791900 20779 tablet_bootstrap.cc:654] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.810788 20778 raft_consensus.cc:740] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.818934 20781 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:23.819653 20778 consensus_queue.cc:260] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.822065 20778 ts_tablet_manager.cc:1434] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:14:23.778344 20900 consensus_queue.cc:237] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.827391 20777 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:23.826970 20659 raft_consensus.cc:3060] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.833389 20881 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.824373 20778 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:23.834767 20777 tablet_bootstrap.cc:654] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.838081 20781 tablet_bootstrap.cc:654] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.840130 20509 raft_consensus.cc:2468] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:23.843786 20697 leader_election.cc:304] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:23.845167 21014 raft_consensus.cc:2804] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.845811 21014 raft_consensus.cc:697] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:23.846987 21014 consensus_queue.cc:237] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.872704 21014 raft_consensus.cc:493] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.873520 21014 raft_consensus.cc:515] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.877930 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c20742313b4aeeb03cc3df575852e1" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:23.880131 20697 leader_election.cc:343] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.883119 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c20742313b4aeeb03cc3df575852e1" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:23.884034 20584 raft_consensus.cc:2468] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:23.885866 20696 leader_election.cc:304] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:23.887084 20895 raft_consensus.cc:2804] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.887531 20895 raft_consensus.cc:493] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.887948 20895 raft_consensus.cc:3060] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.898641 21014 leader_election.cc:290] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.900007 20658 raft_consensus.cc:1240] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Rejecting Update request from peer d45ade27487a47c990a6f9d0fa4a86c7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:23.900822 20895 raft_consensus.cc:515] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.904858 20978 consensus_queue.cc:1059] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.905872 20778 tablet_bootstrap.cc:654] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.907790 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:23.909893 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:23.915524 20781 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:23.917855 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c20742313b4aeeb03cc3df575852e1" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:23.928949 20781 ts_tablet_manager.cc:1403] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.110s	user 0.026s	sys 0.023s
I20260709 12:14:23.928999 20583 raft_consensus.cc:3060] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.930179 20622 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:23.931561 20994 raft_consensus.cc:2749] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:23.932547 20781 raft_consensus.cc:359] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.933385 20781 raft_consensus.cc:385] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.933688 20781 raft_consensus.cc:740] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.934520 20781 consensus_queue.cc:260] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.936643 20779 tablet_bootstrap.cc:492] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:23.936857 20781 ts_tablet_manager.cc:1434] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:23.937314 20779 ts_tablet_manager.cc:1403] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.277s	user 0.009s	sys 0.024s
I20260709 12:14:23.938012 20781 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:23.915881 20777 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:23.918354 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c20742313b4aeeb03cc3df575852e1" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:23.940757 20779 raft_consensus.cc:359] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.941604 20779 raft_consensus.cc:385] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.941862 20779 raft_consensus.cc:740] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
W20260709 12:14:23.942447 20697 leader_election.cc:343] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.942478 20779 consensus_queue.cc:260] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:23.944820 20781 tablet_bootstrap.cc:654] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.945094 20777 ts_tablet_manager.cc:1403] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.030s
I20260709 12:14:23.912205 20978 raft_consensus.cc:3055] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:23.946092 20978 raft_consensus.cc:740] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:23.911267 20881 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.923435 21010 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.947293 21010 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.917948 20895 leader_election.cc:290] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.949537 21010 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:23.951081 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:23.953611 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:23.954751 20475 leader_election.cc:343] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.955024 20779 ts_tablet_manager.cc:1434] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:14:23.956583 20978 consensus_queue.cc:260] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:23.923724 20405 catalog_manager.cc:5697] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.960068 20779 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:23.960902 20978 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.958021 20584 raft_consensus.cc:2468] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:23.965965 20473 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:23.968295 20807 raft_consensus.cc:2804] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.968714 20807 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.969106 20807 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.969317 20583 raft_consensus.cc:2468] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:23.970024 20779 tablet_bootstrap.cc:654] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.971580 20696 leader_election.cc:304] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:23.953105 20777 raft_consensus.cc:359] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.973320 20777 raft_consensus.cc:385] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.973759 20777 raft_consensus.cc:740] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.974789 20777 consensus_queue.cc:260] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:23.977877 20777 ts_tablet_manager.cc:1434] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.002s
I20260709 12:14:23.978451 20895 raft_consensus.cc:2804] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.987504 20777 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:23.987747 20895 raft_consensus.cc:697] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:24.001245 20895 consensus_queue.cc:237] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:23.998049 20978 raft_consensus.cc:493] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.007025 20978 raft_consensus.cc:515] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.009814 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292e7809bb4a42639e34ae1cf67f2541" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:24.011384 20548 leader_election.cc:343] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.012156 20777 tablet_bootstrap.cc:654] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.012310 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292e7809bb4a42639e34ae1cf67f2541" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.013265 20729 raft_consensus.cc:2468] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:24.015784 20550 leader_election.cc:304] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:24.017313 20814 raft_consensus.cc:2804] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.017714 20814 raft_consensus.cc:493] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.018131 20814 raft_consensus.cc:3060] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.026461 20778 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:24.026995 20778 ts_tablet_manager.cc:1403] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.203s	user 0.017s	sys 0.014s
I20260709 12:14:24.029799 20778 raft_consensus.cc:359] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.030421 20778 raft_consensus.cc:385] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.030715 20778 raft_consensus.cc:740] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.031540 20778 consensus_queue.cc:260] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.023204 20978 leader_election.cc:290] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:24.036276 20814 raft_consensus.cc:515] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.042068 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292e7809bb4a42639e34ae1cf67f2541" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:24.043919 20881 consensus_queue.cc:1048] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:24.044627 20994 consensus_queue.cc:1048] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:24.046828 20548 leader_election.cc:343] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.052222 20778 ts_tablet_manager.cc:1434] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:14:24.061291 20807 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.063671 20778 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:24.067463 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:24.072755 20807 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:24.074342 20475 leader_election.cc:343] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.077181 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:24.077909 20585 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.079546 20778 tablet_bootstrap.cc:654] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.086786 20814 leader_election.cc:290] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:24.089696 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292e7809bb4a42639e34ae1cf67f2541" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:24.103099 20779 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:24.103945 20779 ts_tablet_manager.cc:1403] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.145s	user 0.027s	sys 0.003s
I20260709 12:14:24.094846 20728 raft_consensus.cc:3060] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.107770 20814 raft_consensus.cc:493] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.108520 20814 raft_consensus.cc:515] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.109068 20585 raft_consensus.cc:2468] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:24.110777 20814 leader_election.cc:290] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:24.112460 20473 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:24.114225 21010 raft_consensus.cc:2804] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:24.114902 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:24.116545 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.117295 20781 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:24.117825 20781 ts_tablet_manager.cc:1403] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.180s	user 0.050s	sys 0.091s
I20260709 12:14:24.119539 20548 leader_election.cc:304] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:24.121910 20781 raft_consensus.cc:359] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.123862 20781 raft_consensus.cc:385] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.124233 20781 raft_consensus.cc:740] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.125192 20781 consensus_queue.cc:260] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.126652 20779 raft_consensus.cc:359] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.127363 20779 raft_consensus.cc:385] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.127614 20779 raft_consensus.cc:740] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.117743 21010 raft_consensus.cc:697] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:24.128316 20779 consensus_queue.cc:260] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.129216 21010 consensus_queue.cc:237] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.130808 20779 ts_tablet_manager.cc:1434] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:14:24.132195 20978 raft_consensus.cc:2749] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:24.137409 20781 ts_tablet_manager.cc:1434] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 12:14:24.141062 20779 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:24.148329 20777 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:24.148929 20777 ts_tablet_manager.cc:1403] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.162s	user 0.041s	sys 0.032s
I20260709 12:14:24.158780 20779 tablet_bootstrap.cc:654] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.159081 20728 raft_consensus.cc:2468] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:24.160244 20781 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:24.162415 20550 leader_election.cc:304] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:24.162302 20777 raft_consensus.cc:359] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.163046 20777 raft_consensus.cc:385] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.163321 20777 raft_consensus.cc:740] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.164034 20814 raft_consensus.cc:2804] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:24.164126 20777 consensus_queue.cc:260] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.164659 20814 raft_consensus.cc:697] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:24.167373 20814 consensus_queue.cc:237] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.197433 20408 catalog_manager.cc:5697] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.204723 20781 tablet_bootstrap.cc:654] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.208253 20777 ts_tablet_manager.cc:1434] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:14:24.210807 20405 catalog_manager.cc:5697] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.214561 20777 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:24.217285 20781 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:24.217841 20781 ts_tablet_manager.cc:1403] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.006s
I20260709 12:14:24.220883 20778 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:24.221387 20781 raft_consensus.cc:359] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.222523 20781 raft_consensus.cc:385] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.222779 20777 tablet_bootstrap.cc:654] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.222839 20781 raft_consensus.cc:740] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.221517 20778 ts_tablet_manager.cc:1403] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.014s
I20260709 12:14:24.224050 20781 consensus_queue.cc:260] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.226840 20781 ts_tablet_manager.cc:1434] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:14:24.214612 20405 catalog_manager.cc:5697] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.227789 20778 raft_consensus.cc:359] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.228609 20778 raft_consensus.cc:385] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.228905 20778 raft_consensus.cc:740] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.229303 20781 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:24.229797 20778 consensus_queue.cc:260] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.229807 20779 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:24.231077 20779 ts_tablet_manager.cc:1403] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.007s
I20260709 12:14:24.232475 20778 ts_tablet_manager.cc:1434] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:24.239190 20778 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:24.245500 20781 tablet_bootstrap.cc:654] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.245764 20778 tablet_bootstrap.cc:654] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.247305 20404 catalog_manager.cc:5697] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.258986 20777 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:24.260028 20777 ts_tablet_manager.cc:1403] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.047s	user 0.002s	sys 0.012s
I20260709 12:14:24.234360 20779 raft_consensus.cc:359] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.261307 20779 raft_consensus.cc:385] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.261646 20779 raft_consensus.cc:740] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.262390 20779 consensus_queue.cc:260] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.269204 20814 raft_consensus.cc:493] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.271477 20814 raft_consensus.cc:515] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.273725 20814 leader_election.cc:290] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:24.275892 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91424c9e0aab4fc6a3b15c6359edbf9e" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:24.266302 20777 raft_consensus.cc:359] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.277837 20777 raft_consensus.cc:385] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.278213 20777 raft_consensus.cc:740] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.270795 20779 ts_tablet_manager.cc:1434] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:14:24.278627 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91424c9e0aab4fc6a3b15c6359edbf9e" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:24.279636 20548 leader_election.cc:343] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:24.280253 20549 leader_election.cc:343] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.280912 20549 leader_election.cc:304] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:24.282579 20781 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:24.282749 20778 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:24.283164 20778 ts_tablet_manager.cc:1403] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.013s
I20260709 12:14:24.283133 20781 ts_tablet_manager.cc:1403] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.013s
I20260709 12:14:24.283591 20814 raft_consensus.cc:2749] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:24.286069 20781 raft_consensus.cc:359] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.286100 20584 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.286957 20781 raft_consensus.cc:385] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.286278 20778 raft_consensus.cc:359] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.287326 20781 raft_consensus.cc:740] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.287406 20778 raft_consensus.cc:385] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.287783 20778 raft_consensus.cc:740] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.288153 20781 consensus_queue.cc:260] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.288473 20778 consensus_queue.cc:260] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.290787 20778 ts_tablet_manager.cc:1434] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:14:24.292138 20778 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:24.293426 20781 ts_tablet_manager.cc:1434] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 12:14:24.293807 20696 consensus_peers.cc:597] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.294417 20781 tablet_bootstrap.cc:492] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:24.298079 20778 tablet_bootstrap.cc:654] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.299834 20779 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:24.280187 20777 consensus_queue.cc:260] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.304307 20814 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.304888 20814 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.305795 20585 raft_consensus.cc:3060] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.308667 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.309288 20962 raft_consensus.cc:493] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.309803 20962 raft_consensus.cc:515] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.311302 20814 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.312160 20781 tablet_bootstrap.cc:654] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.313226 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd5ef95d6fb4ce880377ca28d298a81" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.313921 20508 raft_consensus.cc:2468] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:24.315066 20962 leader_election.cc:290] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.317234 20697 leader_election.cc:304] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:24.317970 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd5ef95d6fb4ce880377ca28d298a81" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:24.318657 20659 raft_consensus.cc:2468] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:24.321095 20994 raft_consensus.cc:493] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.321676 20994 raft_consensus.cc:515] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.324538 20895 raft_consensus.cc:2804] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.324992 20895 raft_consensus.cc:493] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.325326 20895 raft_consensus.cc:3060] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.325661 20994 leader_election.cc:290] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.327699 20777 ts_tablet_manager.cc:1434] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.003s
I20260709 12:14:24.330936 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.334335 20508 raft_consensus.cc:2393] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:24.335191 20785 consensus_queue.cc:1048] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:24.336810 20777 tablet_bootstrap.cc:492] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:24.332201 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.342510 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.343312 20508 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:24.344878 20624 leader_election.cc:304] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:24.346256 20994 raft_consensus.cc:3060] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.350471 20549 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9
I20260709 12:14:24.355602 20785 consensus_queue.cc:1048] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:24.363095 20994 raft_consensus.cc:2749] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:24.364684 20779 tablet_bootstrap.cc:654] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.371747 20777 tablet_bootstrap.cc:654] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.376199 20814 raft_consensus.cc:2804] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:24.378326 20814 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 491eb72eef45486bb35575f2936538d9)
I20260709 12:14:24.378973 20814 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:24.395274 20779 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:24.395921 20779 ts_tablet_manager.cc:1403] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.001s
I20260709 12:14:24.375048 20895 raft_consensus.cc:515] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.405624 20814 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.408872 21014 consensus_queue.cc:1048] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:24.409891 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd5ef95d6fb4ce880377ca28d298a81" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:24.410574 20659 raft_consensus.cc:3060] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.415714 20814 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.415733 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:24.417917 20583 raft_consensus.cc:1240] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Rejecting Update request from peer 491eb72eef45486bb35575f2936538d9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:24.423902 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:24.442590 20779 raft_consensus.cc:359] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.445436 20549 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:24.457528 20814 raft_consensus.cc:2749] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:24.458213 20978 raft_consensus.cc:493] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.459198 20978 raft_consensus.cc:515] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.459836 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd5ef95d6fb4ce880377ca28d298a81" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:24.460541 20508 raft_consensus.cc:3060] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.461781 20978 leader_election.cc:290] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:24.446383 20777 tablet_bootstrap.cc:492] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:24.446669 20962 consensus_queue.cc:1059] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:24.463734 20777 ts_tablet_manager.cc:1403] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.003s
I20260709 12:14:24.452404 20659 raft_consensus.cc:2468] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:24.464807 20779 raft_consensus.cc:385] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.466843 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:24.469403 20779 raft_consensus.cc:740] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.471102 20779 consensus_queue.cc:260] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.494078 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.462673 20895 leader_election.cc:290] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.496446 20779 ts_tablet_manager.cc:1434] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 12:14:24.497699 20779 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:24.472215 20658 raft_consensus.cc:2468] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:24.506321 20548 leader_election.cc:304] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:24.507336 20993 raft_consensus.cc:2804] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.507714 20993 raft_consensus.cc:493] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:24.471616 21046 log.cc:927] Time spent T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:14:24.508047 20993 raft_consensus.cc:3060] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:24.509810 20549 leader_election.cc:343] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.511052 20507 raft_consensus.cc:3060] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.478982 20785 raft_consensus.cc:3055] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:24.516829 20785 raft_consensus.cc:740] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:24.491359 20696 leader_election.cc:304] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:24.520257 20895 raft_consensus.cc:2804] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:24.521051 20895 raft_consensus.cc:697] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:24.521956 20895 consensus_queue.cc:237] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.523779 20962 consensus_queue.cc:1048] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:24.529633 20779 tablet_bootstrap.cc:654] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.531983 20781 tablet_bootstrap.cc:492] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:24.535657 20781 ts_tablet_manager.cc:1403] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.242s	user 0.052s	sys 0.107s
I20260709 12:14:24.526266 20777 raft_consensus.cc:359] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.536460 20777 raft_consensus.cc:385] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.536813 20777 raft_consensus.cc:740] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.518033 20785 consensus_queue.cc:260] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.542654 20777 consensus_queue.cc:260] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.543469 20785 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:24.550189 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:24.541607 20781 raft_consensus.cc:359] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.551509 20781 raft_consensus.cc:385] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.551800 20781 raft_consensus.cc:740] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.556437 20781 consensus_queue.cc:260] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
W20260709 12:14:24.566223 20475 consensus_peers.cc:597] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 -> Peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Couldn't send request to peer 491eb72eef45486bb35575f2936538d9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.568553 20993 raft_consensus.cc:515] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.570231 20777 ts_tablet_manager.cc:1434] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 12:14:24.571642 20777 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:24.573813 20814 consensus_queue.cc:1048] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:24.571797 20781 ts_tablet_manager.cc:1434] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 12:14:24.580328 21014 consensus_queue.cc:1048] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:24.582183 20781 tablet_bootstrap.cc:492] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:24.583389 20777 tablet_bootstrap.cc:654] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.588502 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:24.589215 20658 raft_consensus.cc:3060] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.598407 20778 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:24.599038 20778 ts_tablet_manager.cc:1403] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.307s	user 0.046s	sys 0.049s
I20260709 12:14:24.611433 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:24.595307 20993 leader_election.cc:290] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:24.618727 20778 raft_consensus.cc:359] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.619374 20778 raft_consensus.cc:385] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.617527 20404 catalog_manager.cc:5697] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.619622 20778 raft_consensus.cc:740] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.623165 20994 raft_consensus.cc:493] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.623622 20778 consensus_queue.cc:260] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.623800 20994 raft_consensus.cc:515] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.631834 20779 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:24.632493 20779 ts_tablet_manager.cc:1403] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.014s
I20260709 12:14:24.636281 20658 raft_consensus.cc:2468] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:24.638528 20508 raft_consensus.cc:2468] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
W20260709 12:14:24.639786 20549 leader_election.cc:343] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.642632 20659 raft_consensus.cc:3060] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.642952 20548 leader_election.cc:304] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:24.645402 20814 raft_consensus.cc:2804] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:24.645833 20814 raft_consensus.cc:697] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:24.648171 20778 ts_tablet_manager.cc:1434] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 12:14:24.646595 20814 consensus_queue.cc:237] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.660959 20778 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:24.659904 20998 raft_consensus.cc:493] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.663838 20998 raft_consensus.cc:515] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.666043 20998 leader_election.cc:290] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:24.667335 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292e7809bb4a42639e34ae1cf67f2541" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.674058 21010 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.674578 21010 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.675477 20994 leader_election.cc:290] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.676608 21010 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:24.677378 21053 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.693178 21014 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.693759 21014 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.694516 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.694321 20779 raft_consensus.cc:359] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.695813 21014 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:24.687999 21053 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.695679 20779 raft_consensus.cc:385] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.698968 20779 raft_consensus.cc:740] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.706991 20779 consensus_queue.cc:260] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.711112 20779 ts_tablet_manager.cc:1434] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 12:14:24.713114 20779 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:24.710902 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.714933 20728 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:24.736320 20993 raft_consensus.cc:493] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.736647 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:24.736934 20993 raft_consensus.cc:515] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.737501 20585 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:24.736995 20475 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:24.742708 21010 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.743188 21010 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.743602 21010 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.746356 20781 tablet_bootstrap.cc:654] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.741341 20408 catalog_manager.cc:5697] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:24.758076 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292e7809bb4a42639e34ae1cf67f2541" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:24.760843 20777 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:24.761360 20777 ts_tablet_manager.cc:1403] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.190s	user 0.019s	sys 0.008s
I20260709 12:14:24.765441 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48011569942a40d1aa1ebe657707a381" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.767561 20732 raft_consensus.cc:2468] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:24.771039 20993 leader_election.cc:290] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.772024 20658 raft_consensus.cc:3060] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.773337 20550 leader_election.cc:304] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:24.774943 20814 raft_consensus.cc:2804] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.775339 20814 raft_consensus.cc:493] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.775655 20814 raft_consensus.cc:3060] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.778299 20777 raft_consensus.cc:359] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.752235 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.780243 20777 raft_consensus.cc:385] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.782084 20777 raft_consensus.cc:740] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.783038 20777 consensus_queue.cc:260] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.780670 20778 tablet_bootstrap.cc:654] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.779963 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:24.789355 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.797101 20584 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:24.790251 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.779801 20622 leader_election.cc:304] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:24.791455 21058 log.cc:927] Time spent T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:14:24.814467 20624 leader_election.cc:304] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:24.815629 20779 tablet_bootstrap.cc:654] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.788506 20728 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:24.823594 21055 raft_consensus.cc:493] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.824394 21055 raft_consensus.cc:515] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.828647 20777 ts_tablet_manager.cc:1434] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:14:24.830202 20777 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:24.834035 20550 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:24.835824 20978 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.836357 20978 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.836807 20978 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.838860 20696 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:24.836714 21053 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.840277 21062 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:24.840749 21062 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.841084 21062 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.850899 20994 raft_consensus.cc:2749] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:24.852459 21062 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.856824 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:24.856964 21055 leader_election.cc:290] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:24.858742 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:24.859580 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:24.866643 20509 raft_consensus.cc:3060] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.866760 20506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48011569942a40d1aa1ebe657707a381" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.867391 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:24.860291 21062 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:24.795163 20814 raft_consensus.cc:515] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.875172 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24b9972f873044ed82799e7051a8f79c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:24.885746 20814 leader_election.cc:290] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.888744 20880 raft_consensus.cc:2749] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:24.889350 20914 consensus_queue.cc:1048] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:14:24.888959 20549 leader_election.cc:343] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.894470 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48011569942a40d1aa1ebe657707a381" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:24.895313 20729 raft_consensus.cc:3060] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:24.899375 20473 leader_election.cc:304] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:24.904924 20729 raft_consensus.cc:2468] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:24.906471 20550 leader_election.cc:304] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:24.907624 20781 tablet_bootstrap.cc:492] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:24.908231 20781 ts_tablet_manager.cc:1403] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.329s	user 0.049s	sys 0.048s
I20260709 12:14:24.909402 20506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48011569942a40d1aa1ebe657707a381" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:24.911126 20549 leader_election.cc:343] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.907569 21053 raft_consensus.cc:2804] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:24.913239 20814 consensus_queue.cc:1048] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:14:24.879865 21010 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.919896 21053 raft_consensus.cc:697] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:24.937860 20507 raft_consensus.cc:2393] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491eb72eef45486bb35575f2936538d9 in current term 1: Already voted for candidate 2ca675f8ab8b49e2b275294280376184 in this term.
I20260709 12:14:24.940446 20781 raft_consensus.cc:359] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.941130 20781 raft_consensus.cc:385] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:24.941354 20781 raft_consensus.cc:740] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:24.941926 20781 consensus_queue.cc:260] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.946437 20895 consensus_queue.cc:1048] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:24.951654 21053 consensus_queue.cc:237] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.962127 21010 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:24.963395 21062 raft_consensus.cc:493] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.963331 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:24.964143 21062 raft_consensus.cc:515] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:24.964507 20728 raft_consensus.cc:2393] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:24.964485 20978 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:24.965000 20880 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.965612 20880 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:24.966569 21062 leader_election.cc:290] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:24.967715 20880 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:24.968628 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:24.973835 20623 leader_election.cc:343] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:24.977207 20777 tablet_bootstrap.cc:654] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:24.984388 20993 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.984901 20993 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:24.986109 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:24.987049 20993 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:24.988970 20585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:24.991245 20781 ts_tablet_manager.cc:1434] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.005s
I20260709 12:14:25.006175 20781 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:25.010686 20778 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:25.011422 20778 ts_tablet_manager.cc:1403] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.351s	user 0.009s	sys 0.022s
I20260709 12:14:25.013703 20584 raft_consensus.cc:2393] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 491eb72eef45486bb35575f2936538d9 in current term 1: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:25.016075 20777 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:25.016667 20777 ts_tablet_manager.cc:1403] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.187s	user 0.009s	sys 0.018s
I20260709 12:14:25.017716 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.022979 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:25.023965 20696 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:25.025828 20777 raft_consensus.cc:359] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.026580 20777 raft_consensus.cc:385] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.026868 20777 raft_consensus.cc:740] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.029335 20404 catalog_manager.cc:5697] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.031098 21070 raft_consensus.cc:493] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.031888 20978 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:25.031698 21070 raft_consensus.cc:515] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.034149 20914 raft_consensus.cc:2749] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.034366 21070 leader_election.cc:290] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:25.043248 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:25.037377 20697 leader_election.cc:343] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.043675 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
W20260709 12:14:25.053879 20696 leader_election.cc:343] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:25.055717 20622 leader_election.cc:343] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.055841 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.056337 20622 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:25.057642 20994 raft_consensus.cc:2749] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.059623 20473 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:25.060161 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:25.061003 20508 raft_consensus.cc:2393] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 1: Already voted for candidate 2ca675f8ab8b49e2b275294280376184 in this term.
I20260709 12:14:25.062119 21010 raft_consensus.cc:2749] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.039065 20779 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:25.027803 20895 raft_consensus.cc:2749] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.064908 20779 ts_tablet_manager.cc:1403] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.352s	user 0.028s	sys 0.015s
I20260709 12:14:25.033656 20778 raft_consensus.cc:359] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.044158 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ace43443b44cb8bc3ac3955248269" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:25.065608 20778 raft_consensus.cc:385] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.066004 20778 raft_consensus.cc:740] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.066551 20729 raft_consensus.cc:2393] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:25.066875 20778 consensus_queue.cc:260] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.069164 20778 ts_tablet_manager.cc:1434] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 12:14:25.070142 20778 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:25.074829 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ace43443b44cb8bc3ac3955248269" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:25.074791 20548 leader_election.cc:343] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.081050 20779 raft_consensus.cc:359] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:25.081816 20779 raft_consensus.cc:385] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.082090 20779 raft_consensus.cc:740] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.083141 20696 leader_election.cc:304] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
W20260709 12:14:25.085342 20548 leader_election.cc:343] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.086716 20781 tablet_bootstrap.cc:654] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.085356 20778 tablet_bootstrap.cc:654] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.085772 20777 consensus_queue.cc:260] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.089257 20895 raft_consensus.cc:2749] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.089329 20779 consensus_queue.cc:260] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:25.091197 20779 ts_tablet_manager.cc:1434] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:14:25.093684 20779 tablet_bootstrap.cc:492] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
W20260709 12:14:25.098757 20550 leader_election.cc:343] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.101619 20550 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
W20260709 12:14:25.107642 20550 leader_election.cc:343] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.108139 20550 leader_election.cc:304] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:25.108960 20978 raft_consensus.cc:2749] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.109683 20978 raft_consensus.cc:2749] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.111994 20550 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:25.114933 20978 raft_consensus.cc:2749] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:14:25.118141 21074 log.cc:927] Time spent T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:14:25.121506 20779 tablet_bootstrap.cc:654] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:25.138428 20549 consensus_peers.cc:597] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.141561 20777 ts_tablet_manager.cc:1434] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.003s
I20260709 12:14:25.143908 20777 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:25.162304 20785 consensus_queue.cc:1048] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:25.165591 20729 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.184228 20778 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:25.184979 20778 ts_tablet_manager.cc:1403] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.115s	user 0.027s	sys 0.013s
I20260709 12:14:25.189703 20781 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:25.190204 20781 ts_tablet_manager.cc:1403] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.037s
I20260709 12:14:25.193703 20778 raft_consensus.cc:359] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.194427 20778 raft_consensus.cc:385] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.194721 20778 raft_consensus.cc:740] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.195943 20777 tablet_bootstrap.cc:654] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.197739 20781 raft_consensus.cc:359] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.198508 20781 raft_consensus.cc:385] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.198786 20781 raft_consensus.cc:740] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.199335 20778 consensus_queue.cc:260] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.199496 20781 consensus_queue.cc:260] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.203956 20778 ts_tablet_manager.cc:1434] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:14:25.203960 20781 ts_tablet_manager.cc:1434] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:14:25.206012 20781 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:25.211997 20781 tablet_bootstrap.cc:654] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.221683 21070 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.222182 21070 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.224287 21070 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.225093 20779 tablet_bootstrap.cc:492] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:25.225577 20779 ts_tablet_manager.cc:1403] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.000s
I20260709 12:14:25.231093 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:25.235046 20548 leader_election.cc:343] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.235569 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:25.236779 20778 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:25.237061 20549 leader_election.cc:343] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.241405 20549 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:25.243142 21070 raft_consensus.cc:2749] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.250182 21055 raft_consensus.cc:493] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.250795 21055 raft_consensus.cc:515] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.253611 20779 raft_consensus.cc:359] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.254590 21055 leader_election.cc:290] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.255286 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.256379 20659 raft_consensus.cc:2393] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:25.254365 20779 raft_consensus.cc:385] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.258855 20779 raft_consensus.cc:740] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.259450 21070 consensus_queue.cc:1048] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:25.263406 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1aa42341cf4cefb9820116cc711eaf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.264921 20779 consensus_queue.cc:260] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.266162 20473 leader_election.cc:304] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:25.267387 21055 raft_consensus.cc:3060] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.270861 20779 ts_tablet_manager.cc:1434] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:14:25.271962 20779 tablet_bootstrap.cc:492] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:25.275094 21055 raft_consensus.cc:2749] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.278847 20779 tablet_bootstrap.cc:654] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.280146 20781 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:25.280917 20781 ts_tablet_manager.cc:1403] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.024s
I20260709 12:14:25.284732 20781 raft_consensus.cc:359] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.285670 20781 raft_consensus.cc:385] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.286015 20781 raft_consensus.cc:740] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.286927 20781 consensus_queue.cc:260] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.304189 20781 ts_tablet_manager.cc:1434] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:14:25.319444 20781 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:25.333268 20781 tablet_bootstrap.cc:654] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.355461 20777 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:25.355576 20778 tablet_bootstrap.cc:654] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.356088 20777 ts_tablet_manager.cc:1403] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.212s	user 0.063s	sys 0.077s
W20260709 12:14:25.359588 20549 consensus_peers.cc:597] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.359400 20777 raft_consensus.cc:359] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.363740 20777 raft_consensus.cc:385] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.364081 20777 raft_consensus.cc:740] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.365634 20777 consensus_queue.cc:260] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.367983 20777 ts_tablet_manager.cc:1434] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:14:25.368851 20779 tablet_bootstrap.cc:492] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:25.368960 20781 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:25.369791 20779 ts_tablet_manager.cc:1403] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.098s	user 0.032s	sys 0.046s
I20260709 12:14:25.371522 20778 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:25.372064 20778 ts_tablet_manager.cc:1403] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.003s
I20260709 12:14:25.373263 20779 raft_consensus.cc:359] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.374073 20779 raft_consensus.cc:385] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.374395 20779 raft_consensus.cc:740] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.374927 20778 raft_consensus.cc:359] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.375625 20778 raft_consensus.cc:385] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.375187 20779 consensus_queue.cc:260] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.369061 20777 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:25.377538 21070 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.378129 21070 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.381436 21070 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.369803 20781 ts_tablet_manager.cc:1403] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.015s
I20260709 12:14:25.375924 20778 raft_consensus.cc:740] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.383718 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:25.384593 20777 tablet_bootstrap.cc:654] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.385450 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.385215 20781 raft_consensus.cc:359] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:25.386849 20549 leader_election.cc:343] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.386996 20781 raft_consensus.cc:385] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:25.387745 20548 leader_election.cc:343] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.388310 20781 raft_consensus.cc:740] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.387738 20778 consensus_queue.cc:260] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.388463 20548 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:25.389297 20781 consensus_queue.cc:260] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.390410 20993 raft_consensus.cc:2749] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.390892 20778 ts_tablet_manager.cc:1434] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:14:25.392073 20778 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:25.393240 20781 ts_tablet_manager.cc:1434] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 12:14:25.397233 20781 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:25.397884 20779 ts_tablet_manager.cc:1434] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:14:25.399216 20779 tablet_bootstrap.cc:492] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:25.400063 20777 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:25.400607 20777 ts_tablet_manager.cc:1403] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:14:25.403560 20777 raft_consensus.cc:359] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.404277 20777 raft_consensus.cc:385] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.404587 20777 raft_consensus.cc:740] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.403926 20781 tablet_bootstrap.cc:654] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.405318 20777 consensus_queue.cc:260] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.407347 20778 tablet_bootstrap.cc:654] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.415990 20777 ts_tablet_manager.cc:1434] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:14:25.417392 20777 tablet_bootstrap.cc:492] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:25.435240 20781 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:25.435853 20781 ts_tablet_manager.cc:1403] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 12:14:25.436602 20994 raft_consensus.cc:493] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.437413 20779 tablet_bootstrap.cc:654] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.437263 20994 raft_consensus.cc:515] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.439107 20781 raft_consensus.cc:359] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:25.439816 20781 raft_consensus.cc:385] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.440124 20781 raft_consensus.cc:740] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.440825 20778 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:25.441383 20778 ts_tablet_manager.cc:1403] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.004s
I20260709 12:14:25.441574 20914 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d45ade27487a47c990a6f9d0fa4a86c7)
I20260709 12:14:25.442134 20914 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.442853 20781 consensus_queue.cc:260] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:25.444228 20914 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.444571 20778 raft_consensus.cc:359] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.445297 20778 raft_consensus.cc:385] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.445137 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91424c9e0aab4fc6a3b15c6359edbf9e" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:25.445602 20778 raft_consensus.cc:740] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.445850 20508 raft_consensus.cc:2468] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:25.448335 20623 leader_election.cc:304] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.449134 20777 tablet_bootstrap.cc:654] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.449355 20998 raft_consensus.cc:2804] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:25.449717 20998 raft_consensus.cc:493] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.450109 20998 raft_consensus.cc:3060] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.448136 20778 consensus_queue.cc:260] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.453991 20778 ts_tablet_manager.cc:1434] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:14:25.454970 20895 raft_consensus.cc:493] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.455166 20778 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:25.435732 21062 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.457105 21062 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.459403 21062 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.459916 20781 ts_tablet_manager.cc:1434] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:14:25.462234 20778 tablet_bootstrap.cc:654] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.464241 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.465673 20656 raft_consensus.cc:2393] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 2: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:25.469165 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.470113 20583 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:25.472675 20781 tablet_bootstrap.cc:492] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:25.483894 20781 tablet_bootstrap.cc:654] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.485769 20473 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:25.506115 21010 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:25.506619 21010 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d45ade27487a47c990a6f9d0fa4a86c7)
I20260709 12:14:25.507067 21010 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.507184 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91424c9e0aab4fc6a3b15c6359edbf9e" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.508339 20583 raft_consensus.cc:2468] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:25.489820 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.495074 20895 raft_consensus.cc:515] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.503254 20994 leader_election.cc:290] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:25.528473 20895 leader_election.cc:290] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.534514 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.535557 20583 raft_consensus.cc:2468] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:25.536087 20993 consensus_queue.cc:1048] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:25.538174 20696 leader_election.cc:304] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:25.540005 20584 raft_consensus.cc:2468] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:25.542642 20696 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:25.543394 20895 raft_consensus.cc:2804] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:25.544130 20895 raft_consensus.cc:493] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.544628 20895 raft_consensus.cc:3060] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.546919 21062 raft_consensus.cc:2804] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:25.547464 20781 tablet_bootstrap.cc:492] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:25.548462 20781 ts_tablet_manager.cc:1403] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.013s
I20260709 12:14:25.547434 21062 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.553860 21062 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.562846 20993 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.563666 20993 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:25.572005 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:25.574636 20993 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:25.575888 20550 leader_election.cc:343] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.583613 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:25.585896 20549 leader_election.cc:343] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.586563 20549 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:25.588505 20993 raft_consensus.cc:2749] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.609547 20781 raft_consensus.cc:359] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.611393 20781 raft_consensus.cc:385] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.612385 20781 raft_consensus.cc:740] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.630584 20781 consensus_queue.cc:260] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.673080 20781 ts_tablet_manager.cc:1434] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.124s	user 0.011s	sys 0.001s
I20260709 12:14:25.638950 20978 raft_consensus.cc:493] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:25.635638 20623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 159569us
I20260709 12:14:25.638358 21010 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.686053 20880 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.697283 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.697883 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.698521 21055 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.698988 21055 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.701030 21055 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.702598 20781 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:25.706941 21096 raft_consensus.cc:493] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.707777 21096 raft_consensus.cc:515] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.710233 20777 tablet_bootstrap.cc:492] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:25.710759 20777 ts_tablet_manager.cc:1403] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.294s	user 0.039s	sys 0.062s
I20260709 12:14:25.710971 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.711186 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.711642 20659 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:25.712307 20583 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:25.712980 20473 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.713698 20777 raft_consensus.cc:359] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.715700 21010 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.716292 21010 raft_consensus.cc:2804] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:25.716626 21010 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.716681 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:25.717047 21010 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.717476 20659 raft_consensus.cc:2393] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 2: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:25.681386 20978 raft_consensus.cc:515] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.714380 20777 raft_consensus.cc:385] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:25.705444 20696 leader_election.cc:343] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:25.722450 20696 leader_election.cc:343] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.720536 20777 raft_consensus.cc:740] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.726081 20777 consensus_queue.cc:260] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.705828 20880 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.753173 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:25.767290 20807 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.767889 20807 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.769690 20807 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.768703 21096 leader_election.cc:290] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:25.763787 20880 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:25.777200 20978 leader_election.cc:290] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:25.784569 20778 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:25.785074 20778 ts_tablet_manager.cc:1403] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.330s	user 0.042s	sys 0.093s
I20260709 12:14:25.787518 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:25.787791 20778 raft_consensus.cc:359] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.788192 20729 raft_consensus.cc:2468] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:25.788455 20778 raft_consensus.cc:385] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.788477 20779 tablet_bootstrap.cc:492] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:25.789191 20779 ts_tablet_manager.cc:1403] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.390s	user 0.094s	sys 0.117s
I20260709 12:14:25.784157 20998 raft_consensus.cc:515] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.793447 20998 leader_election.cc:290] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:25.790653 20777 ts_tablet_manager.cc:1434] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 12:14:25.791085 20778 raft_consensus.cc:740] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.795324 20781 tablet_bootstrap.cc:654] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.795063 20778 consensus_queue.cc:260] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.808660 20778 ts_tablet_manager.cc:1434] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:14:25.808297 20624 leader_election.cc:304] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.809810 20778 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:25.813385 21097 raft_consensus.cc:2804] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:25.813895 21097 raft_consensus.cc:493] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.814216 21097 raft_consensus.cc:3060] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.815346 20777 tablet_bootstrap.cc:492] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:25.823074 20895 raft_consensus.cc:515] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.820188 21062 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.829075 20895 leader_election.cc:290] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.830291 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.832291 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:25.832615 20778 tablet_bootstrap.cc:654] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.832976 20659 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:25.835000 20473 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.835935 21104 raft_consensus.cc:2804] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:25.836321 21104 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.836628 21104 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.838919 21062 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.841053 20777 tablet_bootstrap.cc:654] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:25.846101 21104 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:25.849213 20548 leader_election.cc:343] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:25.852301 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:25.852937 20659 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.855046 21010 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.852533 21097 raft_consensus.cc:515] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.859905 21096 raft_consensus.cc:493] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.861181 21097 leader_election.cc:290] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:25.860946 21096 raft_consensus.cc:515] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.863850 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:25.864492 20656 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.864734 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91424c9e0aab4fc6a3b15c6359edbf9e" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:25.865469 20581 raft_consensus.cc:3060] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.866098 21096 leader_election.cc:290] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:25.867233 21010 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.870296 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:25.863433 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.870949 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:25.867326 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:25.871780 20583 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:25.871948 20729 raft_consensus.cc:2393] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:25.873071 20656 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:25.874708 20732 raft_consensus.cc:3060] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.874349 20473 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.876222 21010 raft_consensus.cc:2804] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:25.877104 21010 raft_consensus.cc:697] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:25.874212 20779 raft_consensus.cc:359] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.878232 21010 consensus_queue.cc:237] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.879427 20581 raft_consensus.cc:2468] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:25.861083 21104 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:25.893385 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:25.895061 20583 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.891551 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:25.899341 20581 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.915020 20622 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.879413 20779 raft_consensus.cc:385] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:25.918140 20779 raft_consensus.cc:740] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:25.919209 20779 consensus_queue.cc:260] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:25.860167 20659 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:25.922123 20994 raft_consensus.cc:2764] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:14:25.933099 20779 ts_tablet_manager.cc:1434] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.144s	user 0.006s	sys 0.003s
I20260709 12:14:25.917554 20584 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:25.934537 20998 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.963116 20732 raft_consensus.cc:2468] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:25.965389 20779 tablet_bootstrap.cc:492] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:25.960533 20998 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.975044 20998 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:25.976262 20624 leader_election.cc:304] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.976852 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:25.960659 20622 leader_election.cc:304] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.976284 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:25.979085 20509 raft_consensus.cc:3060] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.979657 20994 raft_consensus.cc:2804] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:25.980367 20994 raft_consensus.cc:697] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:25.982740 20880 raft_consensus.cc:2804] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:25.983490 20880 raft_consensus.cc:697] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:25.984560 20880 consensus_queue.cc:237] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:25.987337 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91424c9e0aab4fc6a3b15c6359edbf9e" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:25.988245 20504 raft_consensus.cc:3060] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.001610 20509 raft_consensus.cc:2468] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:25.981652 20994 consensus_queue.cc:237] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:25.951573 20473 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:25.968559 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.007390 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.020102 20507 raft_consensus.cc:2376] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1. Re-sending same reply.
I20260709 12:14:26.028604 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.029296 20507 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:26.036557 20581 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:26.037385 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.038141 20584 raft_consensus.cc:3060] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.038373 20408 catalog_manager.cc:5697] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:26.041857 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:26.042634 20656 raft_consensus.cc:3060] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.042954 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
W20260709 12:14:26.017982 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 70826.3us
I20260709 12:14:26.043942 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.042375 20580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.044792 20582 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:26.041838 20781 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:26.046936 20781 ts_tablet_manager.cc:1403] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.355s	user 0.018s	sys 0.013s
I20260709 12:14:26.045637 20580 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:26.065193 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:26.071301 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7816f77dbdd34454829a05b79e59e7f2" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.071709 20508 raft_consensus.cc:2393] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 2ca675f8ab8b49e2b275294280376184 in this term.
I20260709 12:14:26.071869 20623 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:26.073016 20998 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:26.073498 20998 raft_consensus.cc:493] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.073908 20998 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.081524 20778 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:26.082063 20778 ts_tablet_manager.cc:1403] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.272s	user 0.022s	sys 0.021s
I20260709 12:14:26.085251 20777 tablet_bootstrap.cc:492] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:26.085192 20778 raft_consensus.cc:359] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:26.086350 20778 raft_consensus.cc:385] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.086830 20778 raft_consensus.cc:740] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.086956 20777 ts_tablet_manager.cc:1403] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.272s	user 0.020s	sys 0.021s
I20260709 12:14:26.088109 20778 consensus_queue.cc:260] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:26.078670 21055 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491eb72eef45486bb35575f2936538d9)
I20260709 12:14:26.070209 20504 raft_consensus.cc:2468] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:26.078691 21104 raft_consensus.cc:2804] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:26.096359 20781 raft_consensus.cc:359] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.104876 20781 raft_consensus.cc:385] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.105152 20778 ts_tablet_manager.cc:1434] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:14:26.105183 20781 raft_consensus.cc:740] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
W20260709 12:14:26.108230 20696 leader_election.cc:343] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.106389 20781 consensus_queue.cc:260] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.109247 21104 raft_consensus.cc:697] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:26.116859 21104 consensus_queue.cc:237] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.095178 21055 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.125974 21055 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:26.127743 20778 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:26.107288 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 61761.5us
I20260709 12:14:26.132682 20781 ts_tablet_manager.cc:1434] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.004s
I20260709 12:14:26.115208 21106 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.134778 21106 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.134987 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:26.135862 20732 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:26.136569 20584 raft_consensus.cc:2468] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:26.136832 21106 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:26.139959 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.140738 20508 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:26.142059 20779 tablet_bootstrap.cc:654] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.142536 20697 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:26.147130 21106 raft_consensus.cc:2804] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:14:26.148192 20550 leader_election.cc:343] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.150170 20583 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:26.113771 20656 raft_consensus.cc:2468] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:26.155443 20696 leader_election.cc:304] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:26.166324 20785 raft_consensus.cc:2804] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:26.167044 20785 raft_consensus.cc:697] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:26.168162 20785 consensus_queue.cc:237] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.170135 20622 leader_election.cc:304] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:26.171857 20781 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:26.151042 21106 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.175895 20994 raft_consensus.cc:2749] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.174057 20475 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:26.150844 20550 leader_election.cc:304] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.182812 21106 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.205288 20914 raft_consensus.cc:2804] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:26.211246 20781 tablet_bootstrap.cc:654] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.214986 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.216045 20582 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:26.215512 21053 raft_consensus.cc:2749] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:26.219446 20550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 71281.2us
I20260709 12:14:26.210461 20914 raft_consensus.cc:493] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 491eb72eef45486bb35575f2936538d9)
I20260709 12:14:26.223819 20914 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:26.197902 20473 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.231056 21119 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:26.231654 21119 raft_consensus.cc:697] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:26.232239 20778 tablet_bootstrap.cc:654] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.232708 21119 consensus_queue.cc:237] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.199055 20998 raft_consensus.cc:515] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.239101 21106 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.244203 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:26.248476 21106 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:26.276057 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.281095 20582 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:26.254858 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 72181.2us
I20260709 12:14:26.279174 20580 raft_consensus.cc:2468] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:26.294080 20777 raft_consensus.cc:359] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.282891 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:26.302960 20777 raft_consensus.cc:385] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.303499 20777 raft_consensus.cc:740] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.296556 20998 leader_election.cc:290] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:26.312397 20696 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.311393 20777 consensus_queue.cc:260] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.336951 20779 tablet_bootstrap.cc:492] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:26.338310 20779 ts_tablet_manager.cc:1403] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.385s	user 0.036s	sys 0.024s
I20260709 12:14:26.337864 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.343302 20779 raft_consensus.cc:359] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.344034 20779 raft_consensus.cc:385] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.343953 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5066470d3b4a1bad58285cfaad4b11" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.344473 20779 raft_consensus.cc:740] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.344729 20584 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.345225 20779 consensus_queue.cc:260] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.348176 20779 ts_tablet_manager.cc:1434] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:26.330183 21106 raft_consensus.cc:2804] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:26.350559 20777 ts_tablet_manager.cc:1434] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.263s	user 0.004s	sys 0.006s
I20260709 12:14:26.359026 21055 consensus_queue.cc:1048] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.360014 20914 raft_consensus.cc:515] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.361351 20508 raft_consensus.cc:3060] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:26.361577 21106 raft_consensus.cc:697] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:26.362738 21106 consensus_queue.cc:237] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.370522 20779 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:26.372263 20777 tablet_bootstrap.cc:492] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:26.348502 20582 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:26.378989 20914 leader_election.cc:290] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:26.379254 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:26.380302 20729 raft_consensus.cc:2368] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3.
I20260709 12:14:26.381960 20778 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:26.383298 20475 leader_election.cc:400] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Vote denied by peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653) with higher term. Message: Invalid argument: T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3.
I20260709 12:14:26.383136 20696 leader_election.cc:304] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:26.384087 20475 leader_election.cc:403] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:14:26.384716 20895 raft_consensus.cc:2804] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.385398 20895 raft_consensus.cc:697] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:26.385747 20778 ts_tablet_manager.cc:1403] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.258s	user 0.013s	sys 0.033s
I20260709 12:14:26.386477 20895 consensus_queue.cc:237] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.395291 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c315ff4fd74be5a73f34e66c452920" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.395830 20508 raft_consensus.cc:2468] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:26.396057 20583 raft_consensus.cc:2368] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3.
I20260709 12:14:26.396239 20781 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:26.396823 20781 ts_tablet_manager.cc:1403] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.004s
I20260709 12:14:26.397828 20406 catalog_manager.cc:5697] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:26.402268 20407 catalog_manager.cc:5697] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:26.402915 20406 catalog_manager.cc:5697] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:26.403641 20778 raft_consensus.cc:359] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.404559 20778 raft_consensus.cc:385] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.404866 20778 raft_consensus.cc:740] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.412966 20778 consensus_queue.cc:260] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.418646 21103 raft_consensus.cc:493] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.419373 21103 raft_consensus.cc:515] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.405809 20914 raft_consensus.cc:2749] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653) with higher term. Message: Invalid argument: T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3.
I20260709 12:14:26.415917 20781 raft_consensus.cc:359] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.423542 20781 raft_consensus.cc:385] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.423827 20781 raft_consensus.cc:740] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.424867 20473 leader_election.cc:400] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Vote denied by peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285) with higher term. Message: Invalid argument: T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3.
I20260709 12:14:26.424419 20781 consensus_queue.cc:260] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.426270 20778 ts_tablet_manager.cc:1434] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.001s
I20260709 12:14:26.429595 20778 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:26.434191 20807 consensus_queue.cc:1048] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.437014 21103 leader_election.cc:290] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:26.439651 20584 raft_consensus.cc:2468] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 3.
I20260709 12:14:26.439841 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ace43443b44cb8bc3ac3955248269" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:26.441108 20622 leader_election.cc:304] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:26.438138 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ace43443b44cb8bc3ac3955248269" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.442898 20781 ts_tablet_manager.cc:1434] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.001s
W20260709 12:14:26.443718 20696 leader_election.cc:343] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.442582 21108 raft_consensus.cc:2804] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:26.444968 20582 raft_consensus.cc:2468] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:26.446118 21108 raft_consensus.cc:697] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 3 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:26.446520 20696 leader_election.cc:304] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.447412 21108 consensus_queue.cc:237] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.448510 21106 raft_consensus.cc:2804] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:26.449086 21106 raft_consensus.cc:493] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.449503 21106 raft_consensus.cc:3060] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.464861 21055 raft_consensus.cc:493] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.466151 21055 raft_consensus.cc:515] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:26.468669 21055 leader_election.cc:290] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:26.470476 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:26.471086 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:26.477571 20779 tablet_bootstrap.cc:654] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:26.479116 20473 leader_election.cc:343] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.473579 20781 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:26.483186 20777 tablet_bootstrap.cc:654] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:26.487466 20475 leader_election.cc:343] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.488004 20475 leader_election.cc:304] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.488885 21055 raft_consensus.cc:2749] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.500792 20781 tablet_bootstrap.cc:654] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.516546 20994 consensus_queue.cc:1048] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.527243 20509 raft_consensus.cc:3060] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.533375 21106 raft_consensus.cc:515] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.536566 20580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ace43443b44cb8bc3ac3955248269" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.545956 20580 raft_consensus.cc:3060] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.548254 20779 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:26.549464 20779 ts_tablet_manager.cc:1403] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.195s	user 0.010s	sys 0.013s
I20260709 12:14:26.554520 20778 tablet_bootstrap.cc:654] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.553938 20779 raft_consensus.cc:359] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:26.560472 20779 raft_consensus.cc:385] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.557578 21053 raft_consensus.cc:493] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.562124 21053 raft_consensus.cc:515] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.557710 20994 consensus_queue.cc:1048] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:14:26.572196 21053 leader_election.cc:290] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:26.560986 20779 raft_consensus.cc:740] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.571815 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.577275 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:26.581431 20549 leader_election.cc:343] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:26.582618 20548 leader_election.cc:343] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.583468 20895 consensus_queue.cc:1048] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:26.583979 20777 tablet_bootstrap.cc:492] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:26.584729 20777 ts_tablet_manager.cc:1403] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.213s	user 0.022s	sys 0.003s
I20260709 12:14:26.586678 20548 leader_election.cc:304] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.587956 21117 raft_consensus.cc:2749] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.590772 21108 consensus_queue.cc:1048] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.594640 20779 consensus_queue.cc:260] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:26.605530 20779 ts_tablet_manager.cc:1434] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:14:26.610052 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c05ace43443b44cb8bc3ac3955248269" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
W20260709 12:14:26.614161 20696 leader_election.cc:343] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.617050 20777 raft_consensus.cc:359] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.619295 21119 consensus_queue.cc:1048] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.619746 20777 raft_consensus.cc:385] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.621361 20777 raft_consensus.cc:740] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.622134 20777 consensus_queue.cc:260] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.607081 21106 leader_election.cc:290] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:26.626691 21117 raft_consensus.cc:493] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.644443 20777 ts_tablet_manager.cc:1434] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.003s
I20260709 12:14:26.644135 21117 raft_consensus.cc:515] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.647172 20994 raft_consensus.cc:493] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.660100 20994 raft_consensus.cc:515] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.663384 20994 leader_election.cc:290] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:26.663371 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.666326 20583 raft_consensus.cc:2468] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:26.668025 21055 consensus_queue.cc:1048] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.670109 21117 leader_election.cc:290] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:26.672319 20622 leader_election.cc:304] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:26.674350 21108 consensus_queue.cc:1048] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:26.676570 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a303f022ac4e27aed72a4e2a4067d5" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.676940 21106 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.677019 21108 raft_consensus.cc:2804] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:26.677469 21106 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:26.678947 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:26.680009 20732 raft_consensus.cc:2468] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:26.680639 21106 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:26.681717 20998 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.682422 20998 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.683810 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:26.685927 20998 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:26.688508 20505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:26.678864 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a303f022ac4e27aed72a4e2a4067d5" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:26.691206 20550 leader_election.cc:343] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.677714 21108 raft_consensus.cc:493] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.694629 21108 raft_consensus.cc:3060] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.694727 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.695854 20583 raft_consensus.cc:2393] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:26.700116 20777 tablet_bootstrap.cc:492] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
W20260709 12:14:26.708307 20549 leader_election.cc:343] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:26.693295 20696 leader_election.cc:343] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.708868 20549 leader_election.cc:304] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:26.719774 20781 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:26.720363 20781 ts_tablet_manager.cc:1403] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.247s	user 0.021s	sys 0.026s
W20260709 12:14:26.725880 21138 log.cc:927] Time spent T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:14:26.733865 20778 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:26.734361 20778 ts_tablet_manager.cc:1403] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.305s	user 0.033s	sys 0.038s
I20260709 12:14:26.734972 20657 raft_consensus.cc:1240] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 3 LEADER]: Rejecting Update request from peer 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:26.736828 21010 consensus_queue.cc:1059] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:26.737219 20778 raft_consensus.cc:359] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.737558 21010 consensus_queue.cc:1243] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Peer ea25df1d72fa4708887246c33c9efcda log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:14:26.737914 20778 raft_consensus.cc:385] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.739643 20778 raft_consensus.cc:740] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.740751 20778 consensus_queue.cc:260] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.741215 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:26.743849 20778 ts_tablet_manager.cc:1434] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:26.745234 20778 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:26.745457 20697 leader_election.cc:343] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.730206 21053 raft_consensus.cc:2749] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.747527 20583 raft_consensus.cc:1240] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Rejecting Update request from peer 2ca675f8ab8b49e2b275294280376184 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:26.754822 21010 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.753945 20781 raft_consensus.cc:359] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.760883 20781 raft_consensus.cc:385] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.761307 20781 raft_consensus.cc:740] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.762207 20781 consensus_queue.cc:260] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.765524 21010 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.775643 21010 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:26.777215 20659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:26.778211 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:26.778656 20473 leader_election.cc:343] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:26.778931 20583 raft_consensus.cc:2468] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:26.784076 21010 consensus_queue.cc:1059] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:26.785895 20779 tablet_bootstrap.cc:492] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:26.786052 20777 tablet_bootstrap.cc:654] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.788575 20473 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.746358 20697 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.792492 20781 ts_tablet_manager.cc:1434] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.003s
I20260709 12:14:26.793233 21010 raft_consensus.cc:2804] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:26.793884 21010 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.778825 21103 consensus_queue.cc:1048] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:14:26.805954 20914 raft_consensus.cc:3055] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:14:26.810037 21141 log.cc:927] Time spent T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: Append to log took a long time: real 0.159s	user 0.000s	sys 0.002s
I20260709 12:14:26.811151 20580 raft_consensus.cc:2468] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:26.816085 20696 leader_election.cc:304] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:26.794306 21010 raft_consensus.cc:3060] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.821859 20914 raft_consensus.cc:740] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:26.834326 21106 raft_consensus.cc:2749] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:26.827143 20623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 72469.9us
I20260709 12:14:26.836261 21103 raft_consensus.cc:2804] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:26.851435 20914 consensus_queue.cc:260] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.844298 20895 consensus_queue.cc:1048] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:14:26.857384 20914 raft_consensus.cc:3060] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:26.839939 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 94541.4us
I20260709 12:14:26.844515 21108 raft_consensus.cc:515] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.865144 20781 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:26.868427 20779 tablet_bootstrap.cc:654] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.870282 21103 raft_consensus.cc:697] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:26.875415 20781 tablet_bootstrap.cc:654] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.875226 21103 consensus_queue.cc:237] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.871528 20624 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:26.880409 20994 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.892457 20994 raft_consensus.cc:2749] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:26.896683 20406 catalog_manager.cc:5697] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } }
I20260709 12:14:26.907434 20406 catalog_manager.cc:5697] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 3, leader changed from d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130) to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 3 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:26.903128 21108 leader_election.cc:290] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:26.915537 21117 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.960952 20779 tablet_bootstrap.cc:492] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:26.953075 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.962323 20779 ts_tablet_manager.cc:1403] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.005s
I20260709 12:14:26.962664 20582 raft_consensus.cc:3060] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.969144 20779 raft_consensus.cc:359] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.969899 20779 raft_consensus.cc:385] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.970180 20779 raft_consensus.cc:740] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.970851 20779 consensus_queue.cc:260] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:26.976336 20509 raft_consensus.cc:1275] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:26.976996 20781 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:26.977620 20781 ts_tablet_manager.cc:1403] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.023s
I20260709 12:14:26.979387 20580 raft_consensus.cc:1275] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:26.980072 20914 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.980897 20914 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
W20260709 12:14:26.982398 21153 log.cc:927] Time spent T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:14:26.986181 20778 tablet_bootstrap.cc:654] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:26.987260 21010 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.987342 20781 raft_consensus.cc:359] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.988296 20781 raft_consensus.cc:385] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:26.988613 20781 raft_consensus.cc:740] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:26.989496 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:26.989684 20914 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:26.990216 20581 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:26.991453 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:26.992019 20581 raft_consensus.cc:3060] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:26.948643 21117 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:26.992962 20781 consensus_queue.cc:260] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:26.996031 21117 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:26.996907 20473 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:27.003336 21055 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:27.003808 21055 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.004141 21055 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.009558 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:27.012108 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
W20260709 12:14:27.013868 20473 leader_election.cc:343] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:27.014030 20549 leader_election.cc:343] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.014422 21010 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:27.017098 20781 ts_tablet_manager.cc:1434] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.006s
I20260709 12:14:27.024253 20582 raft_consensus.cc:2468] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:27.010135 20581 raft_consensus.cc:2468] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:27.033272 20777 tablet_bootstrap.cc:492] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:27.036541 20777 ts_tablet_manager.cc:1403] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.337s	user 0.021s	sys 0.049s
I20260709 12:14:27.040398 20781 tablet_bootstrap.cc:492] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:27.046630 20404 catalog_manager.cc:5697] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.048434 20779 ts_tablet_manager.cc:1434] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 12:14:27.049412 20404 catalog_manager.cc:5697] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.051860 20473 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:27.059863 20622 leader_election.cc:304] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:27.061956 20998 raft_consensus.cc:2804] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.062507 20998 raft_consensus.cc:697] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:27.063212 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:27.063354 20998 consensus_queue.cc:237] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.069257 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
W20260709 12:14:27.071974 20548 leader_election.cc:343] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.072470 20548 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:27.035893 20785 consensus_queue.cc:1048] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:14:27.055881 21119 raft_consensus.cc:2804] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.078891 20779 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:27.067227 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:27.073110 20728 raft_consensus.cc:3060] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.081939 21117 raft_consensus.cc:2749] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.082193 21119 raft_consensus.cc:697] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:27.089028 20508 raft_consensus.cc:1275] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:14:27.089499 20508 pending_rounds.cc:85] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Aborting all ops after (but not including) 1
I20260709 12:14:27.089753 20508 pending_rounds.cc:107] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:14:27.090075 20508 raft_consensus.cc:2889] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.089178 21119 consensus_queue.cc:237] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.084633 21055 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.092571 21055 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:27.093820 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:27.099591 20733 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:27.100250 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:27.100899 20581 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.101692 20584 raft_consensus.cc:1275] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:27.102557 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:27.113327 21158 consensus_queue.cc:1048] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:27.125608 20781 tablet_bootstrap.cc:654] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.127110 20728 raft_consensus.cc:2468] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:27.148680 21107 consensus_queue.cc:1048] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:14:27.157984 20581 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:27.160959 20473 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9
W20260709 12:14:27.140834 20550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 81401.8us
I20260709 12:14:27.163590 21010 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:27.166417 20777 raft_consensus.cc:359] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.183902 20777 raft_consensus.cc:385] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.184198 20777 raft_consensus.cc:740] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.174460 21107 consensus_queue.cc:1048] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:27.184823 21010 raft_consensus.cc:697] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:27.186699 21010 consensus_queue.cc:237] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.188158 20998 consensus_queue.cc:1048] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:27.192297 20777 consensus_queue.cc:260] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.196532 20777 ts_tablet_manager.cc:1434] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.160s	user 0.005s	sys 0.002s
I20260709 12:14:27.224186 20779 tablet_bootstrap.cc:654] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.226612 20777 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
W20260709 12:14:27.237186 21159 log.cc:927] Time spent T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:14:27.247691 20778 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:27.248247 20778 ts_tablet_manager.cc:1403] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.503s	user 0.029s	sys 0.038s
I20260709 12:14:27.252702 20778 raft_consensus.cc:359] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.253366 20778 raft_consensus.cc:385] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.253669 20778 raft_consensus.cc:740] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.254307 20778 consensus_queue.cc:260] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.260914 20777 tablet_bootstrap.cc:654] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.269630 20778 ts_tablet_manager.cc:1434] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:14:27.271036 20778 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:27.273612 20404 catalog_manager.cc:5697] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.278985 20778 tablet_bootstrap.cc:654] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.289750 20781 tablet_bootstrap.cc:492] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:27.290302 20781 ts_tablet_manager.cc:1403] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.250s	user 0.010s	sys 0.008s
I20260709 12:14:27.291711 20779 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:27.292275 20779 ts_tablet_manager.cc:1403] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.000s
I20260709 12:14:27.292641 20781 raft_consensus.cc:359] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.293254 20781 raft_consensus.cc:385] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.293471 20781 raft_consensus.cc:740] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.294001 20781 consensus_queue.cc:260] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.297850 20405 catalog_manager.cc:5697] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.324632 20655 raft_consensus.cc:3060] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.336575 20779 raft_consensus.cc:359] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.337383 20779 raft_consensus.cc:385] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.337661 20779 raft_consensus.cc:740] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.338305 20779 consensus_queue.cc:260] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.343297 20779 ts_tablet_manager.cc:1434] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:14:27.344357 20779 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:27.349959 20779 tablet_bootstrap.cc:654] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.356349 20781 ts_tablet_manager.cc:1434] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.066s	user 0.001s	sys 0.003s
I20260709 12:14:27.357861 21107 consensus_queue.cc:1048] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.358750 20781 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:27.365342 20779 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:27.365875 20779 ts_tablet_manager.cc:1403] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:14:27.369634 20779 raft_consensus.cc:359] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.355288 20407 catalog_manager.cc:5697] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.370312 20779 raft_consensus.cc:385] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.377166 20779 raft_consensus.cc:740] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.377574 20407 catalog_manager.cc:5697] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:27.378265 20779 consensus_queue.cc:260] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.380865 20779 ts_tablet_manager.cc:1434] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:14:27.381982 20779 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:27.383361 20777 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:27.383968 20777 ts_tablet_manager.cc:1403] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.023s
I20260709 12:14:27.387161 20777 raft_consensus.cc:359] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.387970 20777 raft_consensus.cc:385] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.388279 20779 tablet_bootstrap.cc:654] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.388417 20777 raft_consensus.cc:740] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.390179 20781 tablet_bootstrap.cc:654] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.389777 20777 consensus_queue.cc:260] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.394565 20777 ts_tablet_manager.cc:1434] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:27.395620 20777 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:27.399408 20778 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:27.400285 21162 consensus_queue.cc:1048] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.406287 20777 tablet_bootstrap.cc:654] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.406792 21107 raft_consensus.cc:493] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.407354 21107 raft_consensus.cc:515] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.409554 21107 leader_election.cc:290] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:27.412196 20655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752dcdc33454bf381a9c8a0e91910e0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:27.412509 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752dcdc33454bf381a9c8a0e91910e0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:27.415051 20581 raft_consensus.cc:2468] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
W20260709 12:14:27.416594 20696 leader_election.cc:343] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.418350 20696 leader_election.cc:304] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:27.419946 21162 raft_consensus.cc:2804] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.420426 21162 raft_consensus.cc:493] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.420825 21162 raft_consensus.cc:3060] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.423635 20778 ts_tablet_manager.cc:1403] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.036s
I20260709 12:14:27.434322 20778 raft_consensus.cc:359] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.435170 20778 raft_consensus.cc:385] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.434445 21162 raft_consensus.cc:515] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.441494 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752dcdc33454bf381a9c8a0e91910e0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:27.442224 20581 raft_consensus.cc:3060] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.446053 20655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752dcdc33454bf381a9c8a0e91910e0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:27.446507 21162 leader_election.cc:290] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
W20260709 12:14:27.448194 20696 leader_election.cc:343] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.451246 20777 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:27.451802 20777 ts_tablet_manager.cc:1403] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.001s
I20260709 12:14:27.456053 21164 raft_consensus.cc:493] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.456709 21164 raft_consensus.cc:515] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.463457 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:27.467025 20777 raft_consensus.cc:359] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.467775 20777 raft_consensus.cc:385] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.468039 20777 raft_consensus.cc:740] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
W20260709 12:14:27.471338 20550 leader_election.cc:343] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.475301 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:27.475960 21164 leader_election.cc:290] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:27.476918 20549 leader_election.cc:343] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.477469 20549 leader_election.cc:304] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:27.478988 20998 consensus_queue.cc:1048] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.479885 21164 raft_consensus.cc:2749] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.481074 20777 consensus_queue.cc:260] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.435465 20778 raft_consensus.cc:740] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.491063 20581 raft_consensus.cc:2468] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:27.499107 20696 leader_election.cc:304] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:27.499998 20777 ts_tablet_manager.cc:1434] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:14:27.499874 20778 consensus_queue.cc:260] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.501204 21107 raft_consensus.cc:2804] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.501785 21107 raft_consensus.cc:697] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:27.502803 20778 ts_tablet_manager.cc:1434] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 12:14:27.502661 21107 consensus_queue.cc:237] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.504005 20778 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:27.504151 20998 raft_consensus.cc:493] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.504719 20998 raft_consensus.cc:515] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.507911 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:27.509656 20895 raft_consensus.cc:493] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:27.510277 20623 leader_election.cc:343] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.510236 20895 raft_consensus.cc:515] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.512358 21104 consensus_queue.cc:1048] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.513268 20895 leader_election.cc:290] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:27.514572 20998 leader_election.cc:290] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:27.516472 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:27.517140 20508 raft_consensus.cc:2468] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:27.520025 20697 leader_election.cc:304] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:27.520191 20998 consensus_queue.cc:1048] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.521976 21150 raft_consensus.cc:2804] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.522548 21150 raft_consensus.cc:493] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.523242 21150 raft_consensus.cc:3060] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.526409 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:27.527113 20581 raft_consensus.cc:2468] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:27.528154 20655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:27.528234 20622 leader_election.cc:304] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
W20260709 12:14:27.531644 20696 leader_election.cc:343] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.532294 20994 raft_consensus.cc:2804] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.532945 20994 raft_consensus.cc:493] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.533388 20994 raft_consensus.cc:3060] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.536055 20779 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:27.536607 20779 ts_tablet_manager.cc:1403] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.155s	user 0.041s	sys 0.015s
I20260709 12:14:27.540019 20781 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:27.540593 20781 ts_tablet_manager.cc:1403] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.023s
I20260709 12:14:27.543506 20781 raft_consensus.cc:359] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.546445 20655 raft_consensus.cc:3060] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.549089 21164 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.554932 21010 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.559998 20778 tablet_bootstrap.cc:654] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.560214 20779 raft_consensus.cc:359] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.568986 20781 raft_consensus.cc:385] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.571262 20779 raft_consensus.cc:385] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.571316 20781 raft_consensus.cc:740] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.571672 20779 raft_consensus.cc:740] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.572301 20781 consensus_queue.cc:260] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.519987 20777 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:27.569262 20404 catalog_manager.cc:5697] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:27.574745 20779 consensus_queue.cc:260] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.575577 21164 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.578917 21010 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.588004 20779 ts_tablet_manager.cc:1434] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:14:27.589147 20779 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:27.590569 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:27.591614 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:27.592301 20730 raft_consensus.cc:2468] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:27.594693 21010 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:27.595465 20550 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:27.596437 21167 raft_consensus.cc:2804] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.596818 21167 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.596968 20580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:27.597895 20509 raft_consensus.cc:2468] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:27.600178 21167 raft_consensus.cc:3060] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.582976 21164 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:27.614662 20781 ts_tablet_manager.cc:1434] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 12:14:27.582474 20994 raft_consensus.cc:515] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.618861 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:27.639885 20781 tablet_bootstrap.cc:492] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:27.638890 21165 raft_consensus.cc:493] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.641263 21165 raft_consensus.cc:515] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.639048 20730 raft_consensus.cc:2468] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:27.643591 21165 leader_election.cc:290] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:27.650096 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df74870926dd4e4a98d23dcda857942a" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:27.650799 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df74870926dd4e4a98d23dcda857942a" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:27.652244 20696 leader_election.cc:343] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:27.652817 20697 leader_election.cc:343] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.653268 20697 leader_election.cc:304] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:27.652858 21150 raft_consensus.cc:515] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.655184 21162 raft_consensus.cc:2749] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:27.657087 20475 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:27.657917 21151 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.658536 21151 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.668048 21010 consensus_queue.cc:1048] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:14:27.659078 21119 raft_consensus.cc:2804] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:27.678671 21119 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.679173 21119 raft_consensus.cc:3060] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.680929 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:27.683569 20623 leader_election.cc:343] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:27.689103 20733 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:27.661181 21167 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.695590 20580 raft_consensus.cc:2393] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:27.702309 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:27.705030 21167 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:27.718829 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:27.719942 20731 raft_consensus.cc:3060] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.721452 20781 tablet_bootstrap.cc:654] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.736879 20994 leader_election.cc:290] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:27.739848 20580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:27.740367 20579 raft_consensus.cc:1275] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:27.740701 20580 raft_consensus.cc:3060] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.743345 21010 consensus_queue.cc:1048] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:27.753942 20779 tablet_bootstrap.cc:654] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.773305 20777 tablet_bootstrap.cc:654] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.780728 21150 leader_election.cc:290] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:27.759193 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 120065us
I20260709 12:14:27.787478 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:27.788371 20509 raft_consensus.cc:3060] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:27.812291 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:27.813078 20509 raft_consensus.cc:2468] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:27.812079 21151 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:27.830672 20778 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:27.833698 20778 ts_tablet_manager.cc:1403] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.328s	user 0.014s	sys 0.006s
I20260709 12:14:27.839238 20777 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:27.843479 20777 ts_tablet_manager.cc:1403] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.324s	user 0.032s	sys 0.002s
I20260709 12:14:27.839303 20733 raft_consensus.cc:1275] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:27.858768 21119 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.864135 20731 raft_consensus.cc:2468] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:27.868192 21119 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:27.869891 20778 raft_consensus.cc:359] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.873112 20778 raft_consensus.cc:385] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.873466 20778 raft_consensus.cc:740] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.873952 20777 raft_consensus.cc:359] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.875892 20777 raft_consensus.cc:385] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.876157 20777 raft_consensus.cc:740] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.876959 20777 consensus_queue.cc:260] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.877743 20781 tablet_bootstrap.cc:492] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:27.878515 21154 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.879227 20777 ts_tablet_manager.cc:1434] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:14:27.879614 20779 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:27.879432 21154 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:27.880273 20779 ts_tablet_manager.cc:1403] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.291s	user 0.012s	sys 0.029s
I20260709 12:14:27.880450 20777 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:27.880924 20550 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:27.882071 21154 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:27.883266 20781 ts_tablet_manager.cc:1403] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.257s	user 0.019s	sys 0.005s
I20260709 12:14:27.884248 20779 raft_consensus.cc:359] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.885200 20779 raft_consensus.cc:385] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.885495 20779 raft_consensus.cc:740] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.886459 20779 consensus_queue.cc:260] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.889089 20779 ts_tablet_manager.cc:1434] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:14:27.889915 20777 tablet_bootstrap.cc:654] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.890255 20779 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:27.892148 21107 raft_consensus.cc:493] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.892704 21107 raft_consensus.cc:515] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:27.893262 21167 raft_consensus.cc:2804] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:27.893909 21167 raft_consensus.cc:697] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:27.894810 21167 consensus_queue.cc:237] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.897445 20781 raft_consensus.cc:359] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.898066 20779 tablet_bootstrap.cc:654] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.898473 20781 raft_consensus.cc:385] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.898962 20781 raft_consensus.cc:740] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.900012 20781 consensus_queue.cc:260] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:27.902376 20781 ts_tablet_manager.cc:1434] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:14:27.902531 21107 leader_election.cc:290] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:27.903677 20781 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: Bootstrap starting.
I20260709 12:14:27.911908 20781 tablet_bootstrap.cc:654] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:27.914058 20580 raft_consensus.cc:2468] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:27.929631 20779 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:27.930578 20779 ts_tablet_manager.cc:1403] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.009s
I20260709 12:14:27.932901 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:27.933797 20733 raft_consensus.cc:2393] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:27.937686 21010 consensus_queue.cc:1048] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:27.941087 20779 raft_consensus.cc:359] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.942332 20779 raft_consensus.cc:385] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:27.942664 20779 raft_consensus.cc:740] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:27.943542 20779 consensus_queue.cc:260] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:27.946439 20779 ts_tablet_manager.cc:1434] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:14:27.947671 20779 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:27.950318 20508 raft_consensus.cc:2393] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 1: Already voted for candidate 2ca675f8ab8b49e2b275294280376184 in this term.
I20260709 12:14:27.954705 20779 tablet_bootstrap.cc:654] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.029768 21107 raft_consensus.cc:493] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.030714 21107 raft_consensus.cc:515] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.033526 21107 leader_election.cc:290] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:28.174568 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:28.192576 20581 raft_consensus.cc:2468] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
W20260709 12:14:28.126729 20475 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 194320us
W20260709 12:14:28.275239 21197 log.cc:927] Time spent T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:14:28.292183 21201 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.300396 21201 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:28.410897 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 143773us
I20260709 12:14:28.418548 21201 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
W20260709 12:14:28.427523 21191 log.cc:927] Time spent T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: Append to log took a long time: real 0.665s	user 0.000s	sys 0.005s
W20260709 12:14:28.519976 20781 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.074s	sys 0.143s
W20260709 12:14:28.520457 20781 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.074s	sys 0.143s
I20260709 12:14:28.522529 20781 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: No bootstrap required, opened a new log
I20260709 12:14:28.523066 20781 ts_tablet_manager.cc:1403] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent bootstrapping tablet: real 0.620s	user 0.083s	sys 0.144s
W20260709 12:14:28.523175 20777 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.070s	sys 0.160s
W20260709 12:14:28.523676 20777 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.070s	sys 0.160s
I20260709 12:14:28.526029 20777 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:28.526574 20777 ts_tablet_manager.cc:1403] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.646s	user 0.082s	sys 0.160s
I20260709 12:14:28.526387 20781 raft_consensus.cc:359] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.527289 20781 raft_consensus.cc:385] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.527621 20781 raft_consensus.cc:740] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.528417 20781 consensus_queue.cc:260] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.529362 20777 raft_consensus.cc:359] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.530125 20777 raft_consensus.cc:385] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.530402 20777 raft_consensus.cc:740] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.531121 20781 ts_tablet_manager.cc:1434] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:14:28.531014 20777 consensus_queue.cc:260] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.533018 20777 ts_tablet_manager.cc:1434] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:28.533841 20777 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:28.541294 20777 tablet_bootstrap.cc:654] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.546800 20777 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:28.547991 20777 ts_tablet_manager.cc:1403] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:14:28.551052 20777 raft_consensus.cc:359] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.552027 20777 raft_consensus.cc:385] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.552350 20777 raft_consensus.cc:740] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.553293 20777 consensus_queue.cc:260] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.556258 20777 ts_tablet_manager.cc:1434] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:28.557379 20777 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:28.564745 20777 tablet_bootstrap.cc:654] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.567871 21154 raft_consensus.cc:493] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.568504 21154 raft_consensus.cc:515] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:28.571513 21154 leader_election.cc:290] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:28.573132 20777 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:28.573719 20777 ts_tablet_manager.cc:1403] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:14:28.576876 20777 raft_consensus.cc:359] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.577557 20777 raft_consensus.cc:385] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.577816 20777 raft_consensus.cc:740] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.578398 20777 consensus_queue.cc:260] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.581030 20777 ts_tablet_manager.cc:1434] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:28.582180 20777 tablet_bootstrap.cc:492] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:28.582396 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:28.588790 20777 tablet_bootstrap.cc:654] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.593396 20655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16336d75934db78f1ee7b4aaf2d760" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:28.609061 20579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
W20260709 12:14:28.609714 20548 leader_election.cc:343] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:28.616629 20548 leader_election.cc:343] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.619483 20778 consensus_queue.cc:260] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.623620 20622 leader_election.cc:304] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:28.625680 21216 raft_consensus.cc:2804] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:28.626168 21216 raft_consensus.cc:697] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:28.627154 21216 consensus_queue.cc:237] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.645558 21217 raft_consensus.cc:493] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.646200 21217 raft_consensus.cc:515] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.648515 21217 leader_election.cc:290] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:28.641134 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:28.651291 20657 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:28.651875 20778 ts_tablet_manager.cc:1434] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.818s	user 0.017s	sys 0.000s
W20260709 12:14:28.652273 20778 ts_tablet_manager.cc:1467] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Tablet startup took 818ms
W20260709 12:14:28.652633 20778 ts_tablet_manager.cc:1469] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Trace:
0709 12:14:19.485398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.490599 (+  5201us) service_pool.cc:224] Handling call
0709 12:14:19.690849 (+200250us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:14:19.690975 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:14:19.826412 (+135437us) tablet_metadata.cc:665] Metadata flushed
0709 12:14:19.935125 (+108713us) tablet_replica.cc:206] Creating consensus instance
0709 12:14:20.001697 (+ 66572us) inbound_call.cc:177] Queueing success response
0709 12:14:27.503585 (+7501888us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:14:27.833977 (+330392us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:14:27.866444 (+ 32467us) tablet_replica.cc:261] Starting instrumentation
0709 12:14:27.867564 (+  1120us) tablet_replica.cc:280] Starting consensus
0709 12:14:28.619043 (+751479us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b4c005535c0. stack: 00007f982d9bc343 00007f982d9bc240 00007f982d34b1d4 00007f9837089304 00007f9837089299 00007f982eda7a20 00007f982edb8a29 00007f982ed7e644 00007f982eda5f2d 00007f982eda5b93 00007f9830ad618b 00007f9830ad6cb5 00007f9830ad1f30 00007f9830ad0c40 00007f98344cdb2e 00007f9835aefd8a
Metrics: {"spinlock_wait_cycles":1590457344,"tablet-open.queue_time_us":7530619}
I20260709 12:14:28.656113 20778 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:28.655887 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:28.656766 20728 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:28.659433 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16336d75934db78f1ee7b4aaf2d760" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:28.662042 20777 tablet_bootstrap.cc:492] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:28.662647 20777 ts_tablet_manager.cc:1403] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.002s
I20260709 12:14:28.665773 20777 raft_consensus.cc:359] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:28.666481 20777 raft_consensus.cc:385] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.666781 20777 raft_consensus.cc:740] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.667524 20777 consensus_queue.cc:260] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:28.669880 20777 ts_tablet_manager.cc:1434] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:28.671162 20777 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:28.673118 20697 leader_election.cc:304] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:28.673981 21150 raft_consensus.cc:2804] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:28.674688 21150 raft_consensus.cc:697] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:28.674890 20406 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41904 (request call id 77) took 1033 ms. Trace:
I20260709 12:14:28.675154 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:28.675546 21150 consensus_queue.cc:237] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.675335 20406 rpcz_store.cc:276] 0709 12:14:27.641683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.646004 (+  4321us) service_pool.cc:224] Handling call
0709 12:14:28.674833 (+1028829us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":579884,"reported_tablets":2}
W20260709 12:14:28.679227 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:28.681592 20778 tablet_bootstrap.cc:654] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:28.683259 20779 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.038s	sys 0.073s
W20260709 12:14:28.683632 20779 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.038s	sys 0.073s
I20260709 12:14:28.684664 20777 tablet_bootstrap.cc:654] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.693398 21215 raft_consensus.cc:493] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.694052 21215 raft_consensus.cc:515] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.696519 20778 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:28.697109 20778 ts_tablet_manager.cc:1403] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.005s
I20260709 12:14:28.697028 21215 leader_election.cc:290] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:28.701275 20778 raft_consensus.cc:359] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.701599 21217 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 491eb72eef45486bb35575f2936538d9)
I20260709 12:14:28.702020 20778 raft_consensus.cc:385] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.702368 20778 raft_consensus.cc:740] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.702234 21217 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:28.704879 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:28.706650 21217 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:28.710383 20654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3947f06087460cbf1b9149f8e20daf" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:28.711395 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 50592.2us
I20260709 12:14:28.711799 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:28.712178 20473 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:28.712471 20656 raft_consensus.cc:3060] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.713166 21207 raft_consensus.cc:2749] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:28.705281 20777 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:28.705730 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:28.714872 20777 ts_tablet_manager.cc:1403] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.005s
I20260709 12:14:28.705734 20778 consensus_queue.cc:260] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.721251 20473 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:28.722242 20914 raft_consensus.cc:2804] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:28.722921 20914 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.723376 20914 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.726035 20510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3947f06087460cbf1b9149f8e20daf" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:28.724315 20778 ts_tablet_manager.cc:1434] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:14:28.724989 20507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a0ecf5d0874c90adf810893870a790" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:28.727802 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:28.729043 20779 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:28.729609 20779 ts_tablet_manager.cc:1403] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.782s	user 0.048s	sys 0.075s
I20260709 12:14:28.732290 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:28.732921 20778 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:28.745329 20505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:28.746414 20505 raft_consensus.cc:2393] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea25df1d72fa4708887246c33c9efcda in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:28.747031 20777 raft_consensus.cc:359] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.748101 20777 raft_consensus.cc:385] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.748375 20777 raft_consensus.cc:740] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.749121 20777 consensus_queue.cc:260] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:28.752872 20549 leader_election.cc:343] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.753494 20549 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:28.754285 21215 raft_consensus.cc:2749] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:28.756702 20656 raft_consensus.cc:2468] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
W20260709 12:14:28.756873 20697 leader_election.cc:343] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.760236 20914 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.761125 21215 consensus_queue.cc:1048] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:28.767059 20779 raft_consensus.cc:359] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.767941 20779 raft_consensus.cc:385] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.768261 20779 raft_consensus.cc:740] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.769050 20779 consensus_queue.cc:260] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.770244 20914 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
W20260709 12:14:28.771957 20549 leader_election.cc:343] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.766168 20778 tablet_bootstrap.cc:654] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.763567 20406 catalog_manager.cc:5697] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:28.793968 20623 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:28.795935 20777 ts_tablet_manager.cc:1434] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 12:14:28.798477 20778 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:28.802178 20778 ts_tablet_manager.cc:1403] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 12:14:28.806128 20777 tablet_bootstrap.cc:492] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:28.807137 20778 raft_consensus.cc:359] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.808090 20778 raft_consensus.cc:385] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.808184 21154 raft_consensus.cc:493] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.808511 20778 raft_consensus.cc:740] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.808797 21154 raft_consensus.cc:515] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.809533 20778 consensus_queue.cc:260] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:28.811911 21154 leader_election.cc:290] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:28.812479 21216 raft_consensus.cc:2749] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:28.813616 20697 leader_election.cc:343] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.815510 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a303f022ac4e27aed72a4e2a4067d5" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:28.817075 20549 leader_election.cc:343] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.815550 20778 ts_tablet_manager.cc:1434] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:14:28.819380 20778 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:28.820228 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 45455.5us
I20260709 12:14:28.823964 21150 consensus_queue.cc:1048] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:28.825390 21119 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.826115 20778 tablet_bootstrap.cc:654] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.825881 21119 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:28.827255 20622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 145679us
I20260709 12:14:28.828006 21119 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:28.829896 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:28.830267 20580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:28.830605 20582 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:28.832718 20473 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:28.834623 20779 ts_tablet_manager.cc:1434] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 12:14:28.835714 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:28.836413 20622 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:28.837971 21214 raft_consensus.cc:2749] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:28.838213 20654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:28.838933 20654 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:28.842767 20914 raft_consensus.cc:2804] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:28.843891 20623 leader_election.cc:304] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:28.843343 20914 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.845443 20914 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.836356 20657 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.845607 21216 raft_consensus.cc:2749] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:28.851157 20777 tablet_bootstrap.cc:654] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.858388 20657 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:28.835989 20779 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:28.859130 20696 leader_election.cc:304] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:28.859980 21165 raft_consensus.cc:2804] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:28.860097 20473 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:28.860467 21165 raft_consensus.cc:493] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.860813 21165 raft_consensus.cc:3060] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.861428 21119 raft_consensus.cc:2804] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:28.862002 21119 raft_consensus.cc:697] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:28.862917 21119 consensus_queue.cc:237] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:28.866226 20550 leader_election.cc:343] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.867046 20550 leader_election.cc:304] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:28.868561 21154 raft_consensus.cc:2749] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:28.869978 20779 tablet_bootstrap.cc:654] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.871035 21165 raft_consensus.cc:515] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.882984 21165 leader_election.cc:290] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:28.873509 21207 raft_consensus.cc:493] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.886404 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:28.886961 21207 raft_consensus.cc:515] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.877439 21154 consensus_queue.cc:1048] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:28.892292 20778 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:28.893787 20778 ts_tablet_manager.cc:1403] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.075s	user 0.033s	sys 0.000s
W20260709 12:14:28.900007 20697 leader_election.cc:343] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.902264 20778 raft_consensus.cc:359] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.902930 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:28.903402 20778 raft_consensus.cc:385] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:28.905224 20696 consensus_peers.cc:597] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:28.906080 20696 leader_election.cc:343] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:28.905403 20778 raft_consensus.cc:740] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.903883 20582 raft_consensus.cc:2393] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:28.906155 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:28.907549 20778 consensus_queue.cc:260] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.908294 20473 leader_election.cc:304] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:28.911569 21119 raft_consensus.cc:3060] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.908787 20777 tablet_bootstrap.cc:492] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:28.914884 20777 ts_tablet_manager.cc:1403] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.001s
I20260709 12:14:28.916816 20778 ts_tablet_manager.cc:1434] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:14:28.879182 20914 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.921195 20914 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:28.922933 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:28.929764 20778 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:28.930192 20657 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.924108 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:28.935081 20582 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.891994 21207 leader_election.cc:290] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:28.941090 21119 raft_consensus.cc:2749] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:28.944985 20778 tablet_bootstrap.cc:654] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:28.945762 20582 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:28.906587 20696 leader_election.cc:304] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:28.951807 21165 raft_consensus.cc:2749] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:28.951850 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 45818.9us
I20260709 12:14:28.959663 20657 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:28.961138 20473 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:28.962358 20914 raft_consensus.cc:2804] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:28.962889 20914 raft_consensus.cc:697] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:28.963881 20914 consensus_queue.cc:237] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:28.968180 20779 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:28.968663 20779 ts_tablet_manager.cc:1403] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.006s
I20260709 12:14:28.971354 20779 raft_consensus.cc:359] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.971939 20779 raft_consensus.cc:385] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.972184 20779 raft_consensus.cc:740] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.972787 20779 consensus_queue.cc:260] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:28.978405 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:28.977988 20405 catalog_manager.cc:5697] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:28.979143 20728 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:28.986792 20728 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:28.987653 20777 raft_consensus.cc:359] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:28.988363 20777 raft_consensus.cc:385] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:28.988624 20777 raft_consensus.cc:740] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:28.989518 20777 consensus_queue.cc:260] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:28.992501 20777 ts_tablet_manager.cc:1434] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:14:28.993817 21227 raft_consensus.cc:493] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.994452 21227 raft_consensus.cc:515] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.000948 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a0ecf5d0874c90adf810893870a790" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.001783 20730 raft_consensus.cc:2468] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:29.002007 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df74870926dd4e4a98d23dcda857942a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:29.002861 20509 raft_consensus.cc:2468] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:29.004076 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df74870926dd4e4a98d23dcda857942a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.004849 20733 raft_consensus.cc:2468] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:29.006450 20624 leader_election.cc:304] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:29.006595 20730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a303f022ac4e27aed72a4e2a4067d5" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.007441 20730 raft_consensus.cc:2468] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 0.
I20260709 12:14:29.007622 21216 raft_consensus.cc:2804] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:29.008198 21216 raft_consensus.cc:493] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.008566 21216 raft_consensus.cc:3060] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.014925 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:29.015712 20582 raft_consensus.cc:3060] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.023088 20777 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:29.026415 20779 ts_tablet_manager.cc:1434] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:14:29.026623 21227 leader_election.cc:290] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.027467 20779 tablet_bootstrap.cc:492] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:29.029112 20550 leader_election.cc:304] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:29.030511 21206 raft_consensus.cc:2804] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:29.030936 21206 raft_consensus.cc:493] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.031245 21206 raft_consensus.cc:3060] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.039803 20779 tablet_bootstrap.cc:654] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.040020 20407 catalog_manager.cc:5697] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:29.044142 20778 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:29.044529 20777 tablet_bootstrap.cc:654] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.044807 20778 ts_tablet_manager.cc:1403] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.118s	user 0.026s	sys 0.005s
I20260709 12:14:29.044045 20582 raft_consensus.cc:2468] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:29.051544 20998 raft_consensus.cc:493] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.052124 20998 raft_consensus.cc:515] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.054811 20998 leader_election.cc:290] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.057169 20550 leader_election.cc:304] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:29.058380 21154 raft_consensus.cc:2804] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:29.058838 21154 raft_consensus.cc:493] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.059190 21154 raft_consensus.cc:3060] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.058578 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3947f06087460cbf1b9149f8e20daf" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:29.061614 20623 leader_election.cc:343] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:29.063984 20998 raft_consensus.cc:493] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.064524 20998 raft_consensus.cc:515] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:29.067379 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16336d75934db78f1ee7b4aaf2d760" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:29.068095 20581 raft_consensus.cc:2468] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:29.071872 20622 leader_election.cc:304] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:29.073488 21214 raft_consensus.cc:2804] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:29.073939 21214 raft_consensus.cc:493] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.074321 21214 raft_consensus.cc:3060] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.046736 21206 raft_consensus.cc:515] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:29.089597 20696 leader_election.cc:304] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:29.091326 21154 raft_consensus.cc:515] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:29.095731 20408 catalog_manager.cc:5697] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:29.097229 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a0ecf5d0874c90adf810893870a790" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:29.098052 20408 catalog_manager.cc:5697] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:29.098840 20549 leader_election.cc:343] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:29.099833 21237 raft_consensus.cc:2804] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.100838 21237 raft_consensus.cc:697] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:29.102682 21151 consensus_queue.cc:1048] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:29.059136 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3947f06087460cbf1b9149f8e20daf" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.102231 21237 consensus_queue.cc:237] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:29.108469 20733 raft_consensus.cc:2468] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:29.110169 20624 leader_election.cc:304] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:29.111115 21217 raft_consensus.cc:2804] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:29.111649 21217 raft_consensus.cc:493] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.112068 21217 raft_consensus.cc:3060] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.130100 21227 consensus_queue.cc:1048] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:29.140677 21206 leader_election.cc:290] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.144220 21154 leader_election.cc:290] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.145227 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a303f022ac4e27aed72a4e2a4067d5" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:29.145836 20509 raft_consensus.cc:3060] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.146572 20657 raft_consensus.cc:3060] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.152179 20998 leader_election.cc:290] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:29.155761 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16336d75934db78f1ee7b4aaf2d760" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.158432 20509 raft_consensus.cc:2468] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:29.159673 20549 leader_election.cc:304] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:29.163211 21215 raft_consensus.cc:2804] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.163723 21215 raft_consensus.cc:697] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:29.164616 21215 consensus_queue.cc:237] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
W20260709 12:14:29.159690 20624 leader_election.cc:343] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:29.207928 20777 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:29.208513 20777 ts_tablet_manager.cc:1403] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.186s	user 0.023s	sys 0.026s
I20260709 12:14:29.210973 20778 raft_consensus.cc:359] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:29.215512 20778 raft_consensus.cc:385] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.217533 20778 raft_consensus.cc:740] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.219403 20778 consensus_queue.cc:260] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
W20260709 12:14:29.228091 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 68461.7us
I20260709 12:14:29.235145 20777 raft_consensus.cc:359] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:29.236265 20777 raft_consensus.cc:385] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.236629 20777 raft_consensus.cc:740] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.237501 20777 consensus_queue.cc:260] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:29.241549 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 44575.6us
I20260709 12:14:29.265163 20778 ts_tablet_manager.cc:1434] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.220s	user 0.011s	sys 0.000s
I20260709 12:14:29.273157 20777 ts_tablet_manager.cc:1434] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:14:29.232605 21216 raft_consensus.cc:515] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:29.242769 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4f00 after lost signal to thread 9941
I20260709 12:14:29.293977 20777 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda: Bootstrap starting.
I20260709 12:14:29.291464 20778 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:29.315438 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08002e65e0 after lost signal to thread 20442
I20260709 12:14:29.315910 20895 consensus_queue.cc:1048] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:29.316519 21217 raft_consensus.cc:515] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.318051 21214 raft_consensus.cc:515] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:29.320529 21214 leader_election.cc:290] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:29.329854 20778 tablet_bootstrap.cc:654] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.334978 20779 tablet_bootstrap.cc:492] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:29.335536 20779 ts_tablet_manager.cc:1403] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.308s	user 0.039s	sys 0.053s
I20260709 12:14:29.337581 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a303f022ac4e27aed72a4e2a4067d5" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:29.338338 20732 raft_consensus.cc:3060] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.338711 20779 raft_consensus.cc:359] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:29.339509 20779 raft_consensus.cc:385] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.339771 20779 raft_consensus.cc:740] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.340067 20407 catalog_manager.cc:5697] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:29.340515 20779 consensus_queue.cc:260] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:29.342270 20779 ts_tablet_manager.cc:1434] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:29.349332 20727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a0ecf5d0874c90adf810893870a790" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:29.350028 20727 raft_consensus.cc:3060] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.350201 20779 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: Bootstrap starting.
I20260709 12:14:29.354806 20584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16336d75934db78f1ee7b4aaf2d760" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:29.355234 21216 leader_election.cc:290] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.355751 20584 raft_consensus.cc:3060] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:29.317242 20606 debug-util.cc:398] Leaking SignalData structure 0x7b080035d8e0 after lost signal to thread 20534
W20260709 12:14:29.355901 21249 log.cc:927] Time spent T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:14:29.380422 21010 raft_consensus.cc:493] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.381122 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 84295.4us
I20260709 12:14:29.381093 21010 raft_consensus.cc:515] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:29.390816 20728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16336d75934db78f1ee7b4aaf2d760" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:29.391501 20728 raft_consensus.cc:3060] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.394237 20777 tablet_bootstrap.cc:654] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.394934 20732 raft_consensus.cc:2468] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:29.410159 21010 leader_election.cc:290] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:29.411893 20729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df74870926dd4e4a98d23dcda857942a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:29.412644 20729 raft_consensus.cc:3060] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:29.398051 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08003288c0 after lost signal to thread 20609
I20260709 12:14:29.414378 20779 tablet_bootstrap.cc:654] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.441258 20584 raft_consensus.cc:2468] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
W20260709 12:14:29.442726 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 191021us
I20260709 12:14:29.442807 20622 leader_election.cc:304] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:29.443943 20895 consensus_queue.cc:1048] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:29.415213 20606 debug-util.cc:398] Leaking SignalData structure 0x7b0800136aa0 after lost signal to thread 20683
I20260709 12:14:29.414229 20728 raft_consensus.cc:2468] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:29.446209 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:29.416378 21217 leader_election.cc:290] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.451970 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3947f06087460cbf1b9149f8e20daf" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:29.447662 21151 raft_consensus.cc:2804] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.517480 20778 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:29.518253 20778 ts_tablet_manager.cc:1403] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.231s	user 0.023s	sys 0.008s
I20260709 12:14:29.509045 20731 raft_consensus.cc:3060] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.529748 21151 raft_consensus.cc:697] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
W20260709 12:14:29.530349 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3320 after lost signal to thread 20757
W20260709 12:14:29.531213 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08001b17c0 after lost signal to thread 21128
I20260709 12:14:29.530862 21151 consensus_queue.cc:237] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:29.530637 20408 catalog_manager.cc:5697] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:29.531421 20727 raft_consensus.cc:2468] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
W20260709 12:14:29.531642 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08003407c0 after lost signal to thread 21145
I20260709 12:14:29.555208 20777 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda: No bootstrap required, opened a new log
I20260709 12:14:29.555809 20777 ts_tablet_manager.cc:1403] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda: Time spent bootstrapping tablet: real 0.271s	user 0.005s	sys 0.009s
I20260709 12:14:29.558949 20777 raft_consensus.cc:359] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.559823 20777 raft_consensus.cc:385] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.560124 20777 raft_consensus.cc:740] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.561067 20777 consensus_queue.cc:260] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.547310 20581 raft_consensus.cc:2393] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:29.568130 21227 raft_consensus.cc:493] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.568773 20778 raft_consensus.cc:359] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.569604 20778 raft_consensus.cc:385] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.568797 21227 raft_consensus.cc:515] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.571846 20725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.569947 20778 raft_consensus.cc:740] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.546911 21201 consensus_queue.cc:1048] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:14:29.573194 20778 consensus_queue.cc:260] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.576828 20778 ts_tablet_manager.cc:1434] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
I20260709 12:14:29.578081 21227 leader_election.cc:290] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:29.577662 20725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:29.545135 20508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b3947f06087460cbf1b9149f8e20daf" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:29.581317 20624 leader_election.cc:343] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:29.581693 20508 raft_consensus.cc:3060] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.582432 20550 leader_election.cc:304] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
W20260709 12:14:29.548995 20606 debug-util.cc:398] Leaking SignalData structure 0x7b0800168000 after lost signal to thread 21149
W20260709 12:14:29.588809 20549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 97695.3us
W20260709 12:14:29.593489 20606 debug-util.cc:398] Leaking SignalData structure 0x7b08001681a0 after lost signal to thread 21152
I20260709 12:14:29.586045 20505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df74870926dd4e4a98d23dcda857942a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
W20260709 12:14:29.604911 20606 debug-util.cc:398] Leaking SignalData structure 0x7b0800168020 after lost signal to thread 21153
I20260709 12:14:29.613519 21221 raft_consensus.cc:2804] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:29.616446 20473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 65346.4us
I20260709 12:14:29.611399 20505 raft_consensus.cc:3060] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.622229 20473 leader_election.cc:304] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:29.625664 20623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 72230us
I20260709 12:14:29.617867 20729 raft_consensus.cc:2468] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:29.638619 20778 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:29.644583 20895 consensus_queue.cc:1048] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:29.629360 21104 raft_consensus.cc:3060] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.662388 20779 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: No bootstrap required, opened a new log
I20260709 12:14:29.663240 20779 ts_tablet_manager.cc:1403] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: Time spent bootstrapping tablet: real 0.313s	user 0.011s	sys 0.018s
I20260709 12:14:29.626149 21221 raft_consensus.cc:697] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:29.704061 20509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:29.707757 20777 ts_tablet_manager.cc:1434] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda: Time spent starting tablet: real 0.152s	user 0.017s	sys 0.029s
I20260709 12:14:29.716306 21221 consensus_queue.cc:237] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:29.717482 21275 consensus_queue.cc:1048] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:29.748584 20505 raft_consensus.cc:2468] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:29.740911 20731 raft_consensus.cc:2468] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:29.755955 20779 raft_consensus.cc:359] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.756779 20779 raft_consensus.cc:385] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.757062 20779 raft_consensus.cc:740] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.701756 20624 leader_election.cc:304] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:29.762643 20508 raft_consensus.cc:2468] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:29.757725 20779 consensus_queue.cc:260] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.768536 21010 consensus_queue.cc:1048] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:29.771098 21119 consensus_queue.cc:1048] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:29.772291 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 105907us
I20260709 12:14:29.773201 21158 raft_consensus.cc:2804] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.773801 21158 raft_consensus.cc:697] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:29.774828 21158 consensus_queue.cc:237] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:29.775163 21225 consensus_queue.cc:1048] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:29.774034 20624 leader_election.cc:304] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
W20260709 12:14:29.779731 20550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 112768us
W20260709 12:14:29.802088 20623 leader_election.cc:343] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:29.802736 20623 leader_election.cc:304] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:29.811662 20779 ts_tablet_manager.cc:1434] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: Time spent starting tablet: real 0.148s	user 0.006s	sys 0.001s
I20260709 12:14:29.821218 20778 tablet_bootstrap.cc:654] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:29.808188 21227 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.861110 21214 raft_consensus.cc:2749] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:29.858032 21227 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:29.867303 21259 raft_consensus.cc:2804] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:29.879685 21259 raft_consensus.cc:697] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:29.880919 21259 consensus_queue.cc:237] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:29.883090 21283 log.cc:927] Time spent T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:14:29.887339 21227 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:29.904105 21104 raft_consensus.cc:2749] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:29.935045 21282 log.cc:927] Time spent T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.003s
W20260709 12:14:29.939865 21281 log.cc:927] Time spent T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:14:29.948239 20622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 142880us
I20260709 12:14:29.955718 20579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:29.956544 20579 raft_consensus.cc:2468] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:29.965287 20895 consensus_queue.cc:1048] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:29.984056 20778 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:29.984562 20778 ts_tablet_manager.cc:1403] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.346s	user 0.018s	sys 0.004s
I20260709 12:14:29.987722 20778 raft_consensus.cc:359] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:29.988355 20778 raft_consensus.cc:385] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.988648 20778 raft_consensus.cc:740] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.989217 20778 consensus_queue.cc:260] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:29.994856 20623 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 190975us
I20260709 12:14:29.999452 21221 consensus_queue.cc:1048] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:30.021261 20778 ts_tablet_manager.cc:1434] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:14:30.023053 20778 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:30.017958 20622 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
W20260709 12:14:30.074138 20622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 56315.1us
I20260709 12:14:30.116494 20504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:30.080483 21287 raft_consensus.cc:2804] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:30.120636 20778 tablet_bootstrap.cc:654] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.120740 21287 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.084307 21162 raft_consensus.cc:493] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.087448 20914 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.132405 20914 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:30.133574 20504 raft_consensus.cc:2468] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 0.
I20260709 12:14:30.146822 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:30.147716 20576 raft_consensus.cc:2468] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 0.
I20260709 12:14:30.149696 20473 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:30.122907 21287 raft_consensus.cc:3060] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.155332 21055 raft_consensus.cc:2804] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:30.155769 21055 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.156131 21055 raft_consensus.cc:3060] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.159116 20914 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:30.159513 21290 consensus_queue.cc:1048] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:14:30.128000 21162 raft_consensus.cc:515] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:30.165700 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
W20260709 12:14:30.246474 20622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 72108.2us
I20260709 12:14:30.260658 20405 catalog_manager.cc:5697] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.279876 21162 leader_election.cc:290] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:30.282374 20456 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:30.287973 21287 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:30.289605 20657 raft_consensus.cc:2393] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:30.292560 20506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
W20260709 12:14:30.294623 20697 leader_election.cc:343] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:30.296201 21279 consensus_queue.cc:1048] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:30.284644 21055 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:30.339603 21055 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:30.342000 20655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:30.343137 20655 raft_consensus.cc:2393] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 1: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
I20260709 12:14:30.343911 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:30.344777 20581 raft_consensus.cc:3060] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.368402 21287 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:30.372965 20581 raft_consensus.cc:2468] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 1.
I20260709 12:14:30.375387 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:30.380103 20473 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:30.380046 21259 consensus_queue.cc:1048] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:30.389257 20549 consensus_peers.cc:597] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:30.390910 21215 consensus_queue.cc:1048] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:30.393455 21297 raft_consensus.cc:2804] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:30.396013 21297 raft_consensus.cc:697] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:30.397173 21297 consensus_queue.cc:237] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:30.426225 20778 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:30.426913 20778 ts_tablet_manager.cc:1403] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.405s	user 0.016s	sys 0.001s
I20260709 12:14:30.429901 20778 raft_consensus.cc:359] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:30.432821 20778 raft_consensus.cc:385] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.433122 20778 raft_consensus.cc:740] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.416347 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:30.441102 20778 consensus_queue.cc:260] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:30.445766 20778 ts_tablet_manager.cc:1434] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:14:30.466109 21279 consensus_queue.cc:1048] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:30.467517 20653 raft_consensus.cc:2468] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 0.
I20260709 12:14:30.494798 20503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:30.498646 20778 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:30.519742 20778 tablet_bootstrap.cc:654] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:30.525337 20623 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:30.526278 21287 raft_consensus.cc:2749] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:30.527345 21287 consensus_queue.cc:1048] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:30.568324 21201 raft_consensus.cc:493] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.569255 21201 raft_consensus.cc:515] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:30.580673 20579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a0ecf5d0874c90adf810893870a790" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:30.592283 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 173022us
I20260709 12:14:30.593797 20696 leader_election.cc:304] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:30.599134 21305 raft_consensus.cc:2804] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:30.599757 21305 raft_consensus.cc:493] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.600150 21305 raft_consensus.cc:3060] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.608950 21201 leader_election.cc:290] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:30.612871 21158 consensus_queue.cc:1048] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:30.659179 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a0ecf5d0874c90adf810893870a790" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:30.662237 21235 log.cc:927] Time spent T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11: Append to log took a long time: real 0.071s	user 0.000s	sys 0.014s
W20260709 12:14:30.663403 21307 log.cc:927] Time spent T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:14:30.670954 20778 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: No bootstrap required, opened a new log
I20260709 12:14:30.673074 20778 ts_tablet_manager.cc:1403] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.014s
W20260709 12:14:30.666898 21306 log.cc:927] Time spent T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: Append to log took a long time: real 0.063s	user 0.011s	sys 0.000s
I20260709 12:14:30.684597 20778 raft_consensus.cc:359] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:30.685380 20778 raft_consensus.cc:385] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:30.686532 21305 raft_consensus.cc:515] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:30.691468 20503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:30.685655 20778 raft_consensus.cc:740] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:30.700448 20778 consensus_queue.cc:260] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:30.701455 21305 leader_election.cc:290] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:30.702055 20503 raft_consensus.cc:3060] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.705595 20475 leader_election.cc:304] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:30.707621 21119 raft_consensus.cc:2749] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:30.708590 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:30.709280 20651 raft_consensus.cc:3060] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.711620 20778 ts_tablet_manager.cc:1434] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
I20260709 12:14:30.736400 20651 raft_consensus.cc:2468] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:30.750168 20696 leader_election.cc:304] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:30.753744 21162 raft_consensus.cc:2804] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:30.754299 21162 raft_consensus.cc:697] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:30.755138 21162 consensus_queue.cc:237] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:30.756932 20408 catalog_manager.cc:5697] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } }
I20260709 12:14:30.769066 20503 raft_consensus.cc:2468] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:30.789938 20502 raft_consensus.cc:3060] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:30.796162 20407 catalog_manager.cc:5697] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.799222 20407 catalog_manager.cc:5697] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 0 to 1, leader changed from <none> to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 1 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.836814 20408 catalog_manager.cc:5697] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 1 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:30.929440 21055 consensus_queue.cc:1048] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:31.020917 20550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 68849.8us
I20260709 12:14:30.921465 20407 catalog_manager.cc:5697] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.072593 21055 consensus_queue.cc:1048] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:31.198101 20895 consensus_queue.cc:1048] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:31.210415 20895 consensus_queue.cc:1048] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:32.770360  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
W20260709 12:14:32.778568 20697 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:32.784711 20697 consensus_peers.cc:597] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.813192 20697 consensus_peers.cc:597] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.847034  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:32.848287  9938 tablet_replica.cc:333] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.849486  9938 raft_consensus.cc:2243] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.850438  9938 raft_consensus.cc:2272] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.854835  9938 tablet_replica.cc:333] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.855798  9938 raft_consensus.cc:2243] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.856855  9938 raft_consensus.cc:2272] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.859612  9938 tablet_replica.cc:333] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.860394  9938 raft_consensus.cc:2243] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.860908  9938 raft_consensus.cc:2272] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.863456  9938 tablet_replica.cc:333] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.864104  9938 raft_consensus.cc:2243] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.864591  9938 raft_consensus.cc:2272] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.867245  9938 tablet_replica.cc:333] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.867839  9938 raft_consensus.cc:2243] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.868305  9938 raft_consensus.cc:2272] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.870993  9938 tablet_replica.cc:333] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.871726  9938 raft_consensus.cc:2243] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.872485  9938 raft_consensus.cc:2272] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.876080  9938 tablet_replica.cc:333] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.877063  9938 raft_consensus.cc:2243] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.877673  9938 raft_consensus.cc:2272] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.881325  9938 tablet_replica.cc:333] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.882678  9938 raft_consensus.cc:2243] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.884104  9938 raft_consensus.cc:2272] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.887797  9938 tablet_replica.cc:333] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.888872  9938 raft_consensus.cc:2243] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.889771  9938 raft_consensus.cc:2272] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.893602  9938 tablet_replica.cc:333] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.894569  9938 raft_consensus.cc:2243] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.895285  9938 raft_consensus.cc:2272] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.898066 20697 consensus_peers.cc:597] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.898880  9938 tablet_replica.cc:333] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.901072  9938 raft_consensus.cc:2243] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.902673  9938 raft_consensus.cc:2272] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.906167 20549 consensus_peers.cc:597] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.909457 20549 consensus_peers.cc:597] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.920020  9938 tablet_replica.cc:333] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.921165  9938 raft_consensus.cc:2243] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.921938  9938 raft_consensus.cc:2272] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.925361  9938 tablet_replica.cc:333] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
W20260709 12:14:32.925904 20697 consensus_peers.cc:597] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.926383  9938 raft_consensus.cc:2243] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:14:32.929152 20623 consensus_peers.cc:597] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.929515  9938 raft_consensus.cc:2272] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.931346 20623 consensus_peers.cc:597] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.933944  9938 tablet_replica.cc:333] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.935989  9938 raft_consensus.cc:2243] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.938143  9938 raft_consensus.cc:2272] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.942942  9938 tablet_replica.cc:333] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.943653  9938 raft_consensus.cc:2243] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.944219  9938 raft_consensus.cc:2272] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.947233  9938 tablet_replica.cc:333] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.947890  9938 raft_consensus.cc:2243] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.948647  9938 raft_consensus.cc:2272] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.951841  9938 tablet_replica.cc:333] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.952843  9938 raft_consensus.cc:2243] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.954784  9938 raft_consensus.cc:2272] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.958278  9938 tablet_replica.cc:333] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.959110  9938 raft_consensus.cc:2243] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:32.959308 20549 consensus_peers.cc:597] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.959769  9938 raft_consensus.cc:2272] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.963677  9938 tablet_replica.cc:333] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.964607  9938 raft_consensus.cc:2243] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.965181  9938 raft_consensus.cc:2272] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.967864 20697 consensus_peers.cc:597] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.968642  9938 tablet_replica.cc:333] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.969441  9938 raft_consensus.cc:2243] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.970577  9938 raft_consensus.cc:2272] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.974246  9938 tablet_replica.cc:333] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.975236  9938 raft_consensus.cc:2243] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.975912  9938 raft_consensus.cc:2272] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.977725 20697 consensus_peers.cc:597] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.979399  9938 tablet_replica.cc:333] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.980365  9938 raft_consensus.cc:2243] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.981016  9938 raft_consensus.cc:2272] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.984931  9938 tablet_replica.cc:333] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.985694  9938 raft_consensus.cc:2243] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.986652  9938 raft_consensus.cc:2272] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.989128  9938 tablet_replica.cc:333] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.989711  9938 raft_consensus.cc:2243] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.990597  9938 raft_consensus.cc:2272] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.993219  9938 tablet_replica.cc:333] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:32.994279  9938 raft_consensus.cc:2243] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.996544  9938 raft_consensus.cc:2272] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.000032  9938 tablet_replica.cc:333] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.001839  9938 raft_consensus.cc:2243] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.002542  9938 raft_consensus.cc:2272] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.006832  9938 tablet_replica.cc:333] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.007674  9938 raft_consensus.cc:2243] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.008394  9938 raft_consensus.cc:2272] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.011878  9938 tablet_replica.cc:333] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.012778  9938 raft_consensus.cc:2243] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:14:33.013629 20549 consensus_peers.cc:597] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.013908  9938 raft_consensus.cc:2272] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:33.014962 20549 consensus_peers.cc:597] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.017530  9938 tablet_replica.cc:333] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.018173  9938 raft_consensus.cc:2243] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.019317  9938 raft_consensus.cc:2272] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.023036  9938 tablet_replica.cc:333] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.024631  9938 raft_consensus.cc:2243] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.025785  9938 raft_consensus.cc:2272] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.029023  9938 tablet_replica.cc:333] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.029909  9938 raft_consensus.cc:2243] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.030689  9938 raft_consensus.cc:2272] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:33.032792 20623 consensus_peers.cc:597] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.033742  9938 tablet_replica.cc:333] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.034672  9938 raft_consensus.cc:2243] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.035913  9938 raft_consensus.cc:2272] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.038973  9938 tablet_replica.cc:333] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.039774  9938 raft_consensus.cc:2243] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.040995  9938 raft_consensus.cc:2272] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.043984  9938 tablet_replica.cc:333] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.044667  9938 raft_consensus.cc:2243] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.045171  9938 raft_consensus.cc:2272] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.048388  9938 tablet_replica.cc:333] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.049218  9938 raft_consensus.cc:2243] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.050479  9938 raft_consensus.cc:2272] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.053755  9938 tablet_replica.cc:333] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.054610  9938 raft_consensus.cc:2243] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.055610  9938 raft_consensus.cc:2272] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.058310  9938 tablet_replica.cc:333] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.059150  9938 raft_consensus.cc:2243] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.060138  9938 raft_consensus.cc:2272] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.063357  9938 tablet_replica.cc:333] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.064165  9938 raft_consensus.cc:2243] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.064793  9938 raft_consensus.cc:2272] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.067857  9938 tablet_replica.cc:333] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.103432  9938 raft_consensus.cc:2243] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.104281  9938 raft_consensus.cc:2272] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.107749  9938 tablet_replica.cc:333] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.108461  9938 raft_consensus.cc:2243] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.109800  9938 raft_consensus.cc:2272] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.113781  9938 tablet_replica.cc:333] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.114630  9938 raft_consensus.cc:2243] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.115258  9938 raft_consensus.cc:2272] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.118607  9938 tablet_replica.cc:333] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.119383  9938 raft_consensus.cc:2243] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.120016  9938 raft_consensus.cc:2272] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.123373  9938 tablet_replica.cc:333] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.124152  9938 raft_consensus.cc:2243] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.124694  9938 raft_consensus.cc:2272] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:33.126747 20697 consensus_peers.cc:597] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.127923  9938 tablet_replica.cc:333] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.128703  9938 raft_consensus.cc:2243] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.129453  9938 raft_consensus.cc:2272] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:33.130278 20623 consensus_peers.cc:597] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.131000 20623 consensus_peers.cc:597] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.131628 20623 consensus_peers.cc:597] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.132830  9938 tablet_replica.cc:333] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: stopping tablet replica
I20260709 12:14:33.133589  9938 raft_consensus.cc:2243] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.134207  9938 raft_consensus.cc:2272] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:33.143599 20623 consensus_peers.cc:597] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.144842 20549 consensus_peers.cc:597] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.147624 20549 consensus_peers.cc:597] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.160008 20549 consensus_peers.cc:597] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.182802 20697 consensus_peers.cc:597] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.183386 20623 consensus_peers.cc:597] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.185132 20623 consensus_peers.cc:597] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.191625 20697 consensus_peers.cc:597] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.205073 20623 consensus_peers.cc:597] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:33.249503 20697 consensus_peers.cc:597] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.252894  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
W20260709 12:14:33.291173 20697 consensus_peers.cc:597] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.395634  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:33.435532 21340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.436898 21343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.460001 21347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:33.468529  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:33.473580  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:33.473857  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:33.474081  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599273474063 us; error 0 us; skew 500 ppm
I20260709 12:14:33.474882  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:33.517205  9938 webserver.cc:533] Webserver started at http://127.9.180.129:36255/ using document root <none> and password file <none>
I20260709 12:14:33.517952  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:33.518203  9938 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:33.529795  9938 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.002s	sys 0.008s
I20260709 12:14:33.552363 21351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.553362  9938 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.001s	sys 0.007s
I20260709 12:14:33.553735  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "2ca675f8ab8b49e2b275294280376184"
format_stamp: "Formatted at 2026-07-09 12:14:17 on dist-test-slave-lg8f"
I20260709 12:14:33.554860  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:33.670403  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:33.671974  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:33.674274  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:33.681967 21358 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:14:33.970726 21345 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:33.971560 21345 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:33.976177 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:33.979395 21345 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:33.986948 20623 leader_election.cc:336] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:33.987573 20623 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:33.989280 21287 raft_consensus.cc:2749] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.009447 21345 raft_consensus.cc:493] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.010113 21345 raft_consensus.cc:515] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.017431 21324 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.021193 21324 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.023488 21287 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.024207 21287 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.044039 21333 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.044612 21324 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.044608 21333 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.049155 21333 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.050508 21345 leader_election.cc:290] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.047137 21287 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.053149 21326 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.053694 21326 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.051846 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.058091 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
W20260709 12:14:34.055451 20623 leader_election.cc:336] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.052551 21339 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.060415 21339 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.063124 21339 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.064814 20725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:34.065694 20622 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:34.065953 20623 leader_election.cc:336] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.068087 21345 raft_consensus.cc:2749] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.068892 21326 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.070752 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.076638 20725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:34.077126 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:34.078118 20623 leader_election.cc:336] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.078531 20624 leader_election.cc:304] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:34.080111 20624 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:34.081332 21287 raft_consensus.cc:2749] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.081369 21345 raft_consensus.cc:2749] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.082208 21333 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.082902 21333 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.085529 21333 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.088009 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.094146 21345 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.094854 21345 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.096282  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:14:34.096683  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.417s	user 0.009s	sys 0.001s
I20260709 12:14:34.096997  9938 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:14:34.098444 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.099328 20576 raft_consensus.cc:2468] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:34.100628 20622 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.102949 21287 raft_consensus.cc:2804] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.103361 21287 raft_consensus.cc:493] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.103765 21287 raft_consensus.cc:3060] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:34.105317 20549 leader_election.cc:336] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.105824 20549 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:34.108034 21324 raft_consensus.cc:2749] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:34.110688 21339 raft_consensus.cc:493] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.111001 21358 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:34.111356 21339 raft_consensus.cc:515] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.113544 21339 leader_election.cc:290] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.115597 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.119352 21333 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.119875 21333 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.122996 21333 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.124188 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:34.122236 21345 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:34.128393 20549 leader_election.cc:336] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.132654 20549 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
W20260709 12:14:34.135470 20549 leader_election.cc:336] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.137415 21333 raft_consensus.cc:2749] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.150139 21324 raft_consensus.cc:493] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.152117 20549 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:34.152652 21324 raft_consensus.cc:515] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.130005 21287 raft_consensus.cc:515] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.156836 21333 raft_consensus.cc:2749] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.157904 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d300af02eb347b3a365e6c636b8e9ed" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:34.158150 21324 leader_election.cc:290] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.158627 20576 raft_consensus.cc:3060] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.159848 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.160624 20656 raft_consensus.cc:2468] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.162206 20548 leader_election.cc:304] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.163071 21324 raft_consensus.cc:2804] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.163486 21324 raft_consensus.cc:493] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.163905 21324 raft_consensus.cc:3060] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.168345 20576 raft_consensus.cc:2468] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:34.169453 21262 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.170018 21262 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.172588 21324 raft_consensus.cc:515] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.175690 21262 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:34.179587 20697 leader_election.cc:336] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.180903 21324 leader_election.cc:290] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.181896 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16e210fa30f4a9d971b30b7e5439515" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
W20260709 12:14:34.182188 20623 leader_election.cc:336] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.182642 20656 raft_consensus.cc:3060] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.183457 21287 leader_election.cc:290] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.185122 20622 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
W20260709 12:14:34.183121 20623 leader_election.cc:336] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.186802 21287 raft_consensus.cc:2804] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.187681 20623 leader_election.cc:304] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:34.189162 21342 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
W20260709 12:14:34.189397 20549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 53954.9us
I20260709 12:14:34.189788 21342 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.192952 21342 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.195902 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.199528 20576 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:34.189226 21287 raft_consensus.cc:697] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:34.204022 21287 consensus_queue.cc:237] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.196511 20656 raft_consensus.cc:2468] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:34.207798 20548 leader_election.cc:304] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.208756 21324 raft_consensus.cc:2804] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.209303 21324 raft_consensus.cc:697] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:34.210371 21262 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.210233 21324 consensus_queue.cc:237] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.211025 21262 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.213624 21262 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.217159 21345 raft_consensus.cc:2749] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.240060 20406 catalog_manager.cc:5697] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:34.261222 20697 leader_election.cc:336] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.273257 20622 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.275281 21345 raft_consensus.cc:2804] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.275911 21345 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.276453 21345 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.282352 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.283260 20582 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:34.285192 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.286263 20582 raft_consensus.cc:2468] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:34.296519 21262 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.297235 21262 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.299775 21262 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:34.307296 20549 leader_election.cc:336] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.317559 21339 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.349056 20549 leader_election.cc:304] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:34.349777 21358 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:34.351140 21358 tablet_bootstrap.cc:492] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:34.351990 21358 ts_tablet_manager.cc:1403] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.241s	user 0.057s	sys 0.084s
I20260709 12:14:34.344794 21339 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.355655 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.356196 21339 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.358112 21333 raft_consensus.cc:2749] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.359398 21358 raft_consensus.cc:359] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.360551 21358 raft_consensus.cc:740] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
W20260709 12:14:34.358291 20549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 51035.8us
W20260709 12:14:34.362568 20623 leader_election.cc:336] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.363453 20623 leader_election.cc:336] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.368639 21358 consensus_queue.cc:260] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.370558 20696 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.373978 21326 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.376250 21326 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.376608 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.374697 20408 catalog_manager.cc:5697] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.378577 21326 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.381690 20696 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.382026 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.382711 20651 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.383757 21321 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:34.384166 21321 raft_consensus.cc:493] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.384506 21321 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.387709 20548 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.388985 21333 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.389526 21333 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.392079 21333 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.392413 21339 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.392910 21339 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.393505 21333 raft_consensus.cc:2804] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.393960 21333 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.397516 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.394315 21333 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:34.402366 20697 leader_election.cc:336] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.396133 21339 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.401048 21262 raft_consensus.cc:2804] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.407928 21324 raft_consensus.cc:493] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.413331 21324 raft_consensus.cc:515] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.411095 21262 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.421700 21262 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.415599 21324 leader_election.cc:290] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.425210 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.419909 21339 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
W20260709 12:14:34.431406 20549 leader_election.cc:336] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.433652 20549 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
W20260709 12:14:34.435122 20549 leader_election.cc:336] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.437712 20549 leader_election.cc:336] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.439622 21342 raft_consensus.cc:493] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.440245 21342 raft_consensus.cc:515] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.443027 21342 leader_election.cc:290] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.443725 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.444545 20582 raft_consensus.cc:2468] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:34.446636 20622 leader_election.cc:304] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.436053 21324 raft_consensus.cc:2749] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:34.450331 20623 leader_election.cc:336] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.451021 20623 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:34.435600 21339 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.457067 21326 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.457690 21326 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.459851 21326 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.460820 21372 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.462800 21372 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.465205 21372 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.461022 21370 raft_consensus.cc:2804] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.462311 21358 ts_tablet_manager.cc:1434] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.107s	user 0.016s	sys 0.002s
I20260709 12:14:34.466539 21370 raft_consensus.cc:493] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.467049 21370 raft_consensus.cc:3060] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:34.465764 20549 leader_election.cc:336] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.461305 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.467542 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.467806 20651 raft_consensus.cc:2468] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.468220 20582 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:34.469281 20622 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.469408 20548 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
W20260709 12:14:34.470755 20549 leader_election.cc:336] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.471439 20549 leader_election.cc:336] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.470011 21358 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:34.447175 21345 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.471962 20549 leader_election.cc:304] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:34.468950 21339 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.477190 21339 raft_consensus.cc:2804] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.477421 21369 raft_consensus.cc:2749] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.477638 21339 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.478112 21339 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.480157 21345 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.480669 21369 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.481437 21369 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.484987 21369 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.456694 21342 raft_consensus.cc:2749] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.471946 21324 raft_consensus.cc:2804] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.486964 21324 raft_consensus.cc:493] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.487360 21324 raft_consensus.cc:3060] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.488037 21371 raft_consensus.cc:493] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.488740 21371 raft_consensus.cc:515] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.484428 21262 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.498844 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:34.499617 20582 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:34.506760 20549 leader_election.cc:336] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.507659 20549 leader_election.cc:336] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.507997 21374 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.508602 21374 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.519505 20582 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:34.521387 20622 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
W20260709 12:14:34.532465 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 60712.9us
I20260709 12:14:34.524446 21326 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.529350 21372 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.536388 21287 raft_consensus.cc:2804] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.531687 21342 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.540468 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:34.547241 21321 raft_consensus.cc:515] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.549584 21321 leader_election.cc:290] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.525249 21333 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.538393 21374 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:34.588075 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 57961.6us
I20260709 12:14:34.599452 21358 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:34.563019 21287 raft_consensus.cc:697] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:34.543097 21326 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.620651 21287 consensus_queue.cc:237] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.622036 21262 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.624375 21333 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.625298 21324 raft_consensus.cc:515] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.626031 20725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:34.627197 20725 raft_consensus.cc:2468] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.628139 21324 leader_election.cc:290] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.562806 21372 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.632299 21339 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.587189 21342 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.636022 21372 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.636713 20732 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.636917 21342 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.640970 21326 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:34.642269 21371 leader_election.cc:290] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:34.646468 20697 leader_election.cc:336] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.648886 21358 tablet_bootstrap.cc:492] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:34.661809 20725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:34.649780 20549 leader_election.cc:336] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.667035 20549 leader_election.cc:336] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.667639 20549 leader_election.cc:336] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.667757 21358 ts_tablet_manager.cc:1403] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.004s
W20260709 12:14:34.662855 20697 leader_election.cc:336] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.671006 20697 leader_election.cc:336] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.685521 21358 raft_consensus.cc:359] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.686779 21358 raft_consensus.cc:740] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.679090  9938 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:14:34.666771 21339 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:34.689708 20623 leader_election.cc:336] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.688902 21358 consensus_queue.cc:260] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.690415 20623 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:34.691619 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74b64599c6f4b7a8b7e745cd3cf8bf3" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:34.692836 20656 raft_consensus.cc:3060] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:34.693447 20623 leader_election.cc:336] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.689462  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.592s	user 0.321s	sys 0.006s
I20260709 12:14:34.666935 20725 raft_consensus.cc:2468] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 1.
I20260709 12:14:34.665849 21370 raft_consensus.cc:515] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.699218 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
W20260709 12:14:34.702167 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 93184.8us
I20260709 12:14:34.702311 20582 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.704530 21358 ts_tablet_manager.cc:1434] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:14:34.737177 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.737339 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:34.776275 21358 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:34.734606 21386 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.735397 21390 raft_consensus.cc:2749] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:34.839286 20697 leader_election.cc:336] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.840147 20697 leader_election.cc:336] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.840919 20697 leader_election.cc:336] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.842270 20656 raft_consensus.cc:2468] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:34.840373 21386 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.846978 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b49c22a2f045d083b793ec9a932dd0" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:34.847187 20653 raft_consensus.cc:2468] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.847698 20581 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:34.849123 21370 leader_election.cc:290] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:34.850063 20658 raft_consensus.cc:1275] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:34.839010 20651 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.866086 20582 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:34.866241 21389 consensus_queue.cc:1048] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:34.876379 20548 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.878357 20624 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.880760 21379 raft_consensus.cc:2804] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.881197 21379 raft_consensus.cc:493] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.881433 21393 raft_consensus.cc:2804] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.881587 21379 raft_consensus.cc:3060] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.882218 21393 raft_consensus.cc:493] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.883119 21393 raft_consensus.cc:3060] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.886159 20550 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.888132 21388 raft_consensus.cc:2804] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.888510 21388 raft_consensus.cc:493] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
W20260709 12:14:34.888829 20549 consensus_peers.cc:597] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.888845 21388 raft_consensus.cc:3060] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.893137 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:34.893800 20576 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.897194 20583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:34.898073 20583 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:34.899243 20548 leader_election.cc:304] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.900527 21380 raft_consensus.cc:2804] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.901031 21380 raft_consensus.cc:697] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:34.901503 20579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e74df625baa4137a2f384e41c185f8a" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:34.902248 20579 raft_consensus.cc:3060] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.901957 21380 consensus_queue.cc:237] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.906289 20550 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.907028 20581 raft_consensus.cc:2468] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:34.910300 20582 raft_consensus.cc:1275] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:34.910852 20696 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:34.912469 20549 leader_election.cc:336] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.915802 21391 raft_consensus.cc:2749] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:34.921308 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.921458 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.921955 20656 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:34.923246 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.917896 20651 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:34.924021 20653 raft_consensus.cc:2468] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 1.
I20260709 12:14:34.924865 21381 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.925333 21381 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.925753 21381 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.928472 21386 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
W20260709 12:14:34.930265 20623 leader_election.cc:336] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:34.932222 20623 leader_election.cc:336] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:34.933940 20548 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.934345 20656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:34.939967 20656 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 1.
I20260709 12:14:34.933504 20408 catalog_manager.cc:5697] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.948997 20548 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.947469 20622 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:34.953902 20696 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.962052 20696 leader_election.cc:304] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:34.964944 21377 consensus_queue.cc:1048] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:14:34.952737 21287 raft_consensus.cc:2804] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.966674 21384 raft_consensus.cc:2804] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:34.967229 21384 raft_consensus.cc:697] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:34.967815 21287 raft_consensus.cc:697] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:34.968176 21384 consensus_queue.cc:237] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.968811 21287 consensus_queue.cc:237] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:34.960690 21386 raft_consensus.cc:2804] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:34.993240 21386 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:34.993731 21386 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:34.976025 21321 raft_consensus.cc:2804] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:34.988648 21388 raft_consensus.cc:515] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:34.974236 20576 raft_consensus.cc:2468] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:34.996373 21321 raft_consensus.cc:697] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:34.997349 21321 consensus_queue.cc:237] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:34.999996 21388 leader_election.cc:290] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:34.984463 20579 raft_consensus.cc:2468] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:34.964103 21372 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:35.007542 20696 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.009462 21372 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:35.010700 21372 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.011463 21393 raft_consensus.cc:515] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:35.015792 20406 catalog_manager.cc:5697] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.022184 21394 raft_consensus.cc:2804] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:35.024127 20696 leader_election.cc:304] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.024845 21394 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:35.029158 21394 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.032361 21393 leader_election.cc:290] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:35.037487 20696 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.042809 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48d7ba791884a2daf277f9c261b1405" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:35.043517 20733 raft_consensus.cc:3060] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.043802 21368 raft_consensus.cc:2804] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:35.044271 21368 raft_consensus.cc:493] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:35.044675 21368 raft_consensus.cc:3060] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.046777 21375 raft_consensus.cc:2804] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.047374 21375 raft_consensus.cc:697] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:35.024238 21379 raft_consensus.cc:515] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:35.053967 20623 leader_election.cc:336] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.055426 20658 raft_consensus.cc:2393] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 491eb72eef45486bb35575f2936538d9 in current term 2: Already voted for candidate ea25df1d72fa4708887246c33c9efcda in this term.
W20260709 12:14:35.057344 20623 leader_election.cc:336] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:35.058279 20623 leader_election.cc:336] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.049796 21375 consensus_queue.cc:237] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
W20260709 12:14:35.062232 20549 leader_election.cc:336] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.064023 21379 leader_election.cc:290] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:35.065312 20622 leader_election.cc:304] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.067193 21377 raft_consensus.cc:2804] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.067773 21377 raft_consensus.cc:697] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
W20260709 12:14:35.066262 20549 leader_election.cc:336] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.068703 21377 consensus_queue.cc:237] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:35.070981 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e142dcf7243c48a5a62d1a8b2cae011c" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:35.071290 20733 raft_consensus.cc:2468] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:35.071681 20657 raft_consensus.cc:3060] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.072178 21381 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:35.084614 20550 leader_election.cc:304] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.084762 21381 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:35.085526 21381 raft_consensus.cc:2804] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.086069 21381 raft_consensus.cc:697] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:35.087081 21381 consensus_queue.cc:237] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:35.094276 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 68582.8us
I20260709 12:14:35.101734 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a1a775a88343de81c5bc5f5bdb1b85" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:35.102252 21358 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:35.102416 20726 raft_consensus.cc:3060] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.103394 21358 tablet_bootstrap.cc:492] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:35.104226 21358 ts_tablet_manager.cc:1403] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.398s	user 0.027s	sys 0.022s
I20260709 12:14:35.105248 21372 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:35.108903 21394 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:35.121568 21358 raft_consensus.cc:359] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:35.124153 21358 raft_consensus.cc:740] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.136927 21394 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:35.137360 21372 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:35.141423 20549 leader_election.cc:336] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.144441 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:35.145490 20576 raft_consensus.cc:2393] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 491eb72eef45486bb35575f2936538d9 in current term 2: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:35.129994 21358 consensus_queue.cc:260] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:35.140405 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:35.171690 20733 raft_consensus.cc:2393] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d45ade27487a47c990a6f9d0fa4a86c7 in current term 2: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:35.165305 20407 catalog_manager.cc:5697] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 2 to 3, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 3 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:35.175276 20623 consensus_peers.cc:597] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.177565 21358 ts_tablet_manager.cc:1434] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.001s
I20260709 12:14:35.178946 21358 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:35.177678 20696 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:35.131639 20657 raft_consensus.cc:2468] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:35.205381 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:35.208593 20653 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.173862 20726 raft_consensus.cc:2468] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea25df1d72fa4708887246c33c9efcda in term 2.
I20260709 12:14:35.227663 20548 leader_election.cc:304] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
W20260709 12:14:35.233705 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 52378.4us
I20260709 12:14:35.183012 21386 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:35.222963 21391 raft_consensus.cc:2749] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:35.262842 20624 leader_election.cc:304] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:35.238709 21326 raft_consensus.cc:2804] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.271265 21376 raft_consensus.cc:2804] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:35.291257 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 50781.4us
I20260709 12:14:35.290300 20576 raft_consensus.cc:1275] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:35.303885 20697 leader_election.cc:336] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:35.305096 20697 leader_election.cc:336] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.305451 20697 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
W20260709 12:14:35.310693 20623 leader_election.cc:336] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:35.312008 20623 consensus_peers.cc:597] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.312561 20623 consensus_peers.cc:597] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.319204 20623 consensus_peers.cc:597] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.305344 21376 raft_consensus.cc:697] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Leader. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:35.321557 21376 consensus_queue.cc:237] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:35.326226 20623 consensus_peers.cc:597] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.346853 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 46785.5us
I20260709 12:14:35.348018 20550 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:35.352082 21262 raft_consensus.cc:2749] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:14:35.352283 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 47208.1us
I20260709 12:14:35.359261 21386 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:35.352069 21388 raft_consensus.cc:2749] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:35.376199 21368 raft_consensus.cc:515] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:35.377540 20653 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
W20260709 12:14:35.380852 21405 log.cc:927] Time spent T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: Append to log took a long time: real 0.116s	user 0.003s	sys 0.000s
W20260709 12:14:35.386930 20697 consensus_peers.cc:597] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.396898 21342 consensus_queue.cc:1048] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:35.363999 21326 raft_consensus.cc:697] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
W20260709 12:14:35.410202 21408 log.cc:927] Time spent T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
I20260709 12:14:35.414193 20651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
W20260709 12:14:35.414894 20549 leader_election.cc:336] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:35.425786 20408 catalog_manager.cc:5697] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.428709 20407 catalog_manager.cc:5697] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 2 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.433640 20408 catalog_manager.cc:5697] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.429296 20653 raft_consensus.cc:1275] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.443460 20651 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.432536 21368 leader_election.cc:290] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:35.451032 20697 leader_election.cc:336] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:35.451715 20697 consensus_peers.cc:597] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.451910 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b60bfb738d7452f8eed2ef5de1209f5" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:35.459884 20658 raft_consensus.cc:3060] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:35.462402 20697 consensus_peers.cc:597] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.467700 21326 consensus_queue.cc:237] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:35.473315 20696 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.468936 20406 catalog_manager.cc:5697] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to ea25df1d72fa4708887246c33c9efcda (127.9.180.131). New cstate: current_term: 2 leader_uuid: "ea25df1d72fa4708887246c33c9efcda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.490898 21409 raft_consensus.cc:2804] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.489543 20651 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:35.491545 21409 raft_consensus.cc:697] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:35.495326 21409 consensus_queue.cc:237] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:35.504185 20549 consensus_peers.cc:597] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.507728 20549 consensus_peers.cc:597] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.509217 20653 raft_consensus.cc:1275] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.517223 20548 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.531159 20581 raft_consensus.cc:1275] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:35.534713 21321 consensus_queue.cc:1048] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:35.535215 21386 consensus_queue.cc:1048] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:35.543852 20549 consensus_peers.cc:597] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.531678 20697 consensus_peers.cc:597] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.563501 21384 consensus_queue.cc:1048] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:35.565744 21386 raft_consensus.cc:2804] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.582321 20580 raft_consensus.cc:1275] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.583437 21386 raft_consensus.cc:697] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
W20260709 12:14:35.584843 20623 consensus_peers.cc:597] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.584335 21386 consensus_queue.cc:237] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:35.586555 20549 consensus_peers.cc:597] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.588778 20658 raft_consensus.cc:2468] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:35.595029 21345 consensus_queue.cc:1048] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.593585 20696 leader_election.cc:304] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:35.601787 21368 raft_consensus.cc:2804] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.602309 21368 raft_consensus.cc:697] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:35.603196 21368 consensus_queue.cc:237] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:35.621820 21358 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:35.641501 21358 tablet_bootstrap.cc:492] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:35.642385 21358 ts_tablet_manager.cc:1403] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.464s	user 0.019s	sys 0.020s
I20260709 12:14:35.657188 21358 raft_consensus.cc:359] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:35.657975 21358 raft_consensus.cc:740] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.659416 20579 raft_consensus.cc:1275] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:35.661120 20623 consensus_peers.cc:597] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.662631 21358 consensus_queue.cc:260] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:35.669040 21376 consensus_queue.cc:1048] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.678323 20579 raft_consensus.cc:1275] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:35.682377 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 112068us
W20260709 12:14:35.683038 20697 consensus_peers.cc:597] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.684356 20549 consensus_peers.cc:597] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.684883 20549 consensus_peers.cc:597] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.712440 20623 consensus_peers.cc:597] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.711026 21358 ts_tablet_manager.cc:1434] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.012s
I20260709 12:14:35.714933 21358 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:35.726323 20733 raft_consensus.cc:1275] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.709154 21391 consensus_queue.cc:1048] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:14:35.730589 20406 catalog_manager.cc:5697] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 2 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:35.734251 20549 consensus_peers.cc:597] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.743880 21381 consensus_queue.cc:1048] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:35.748147 20623 consensus_peers.cc:597] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.753496 20697 consensus_peers.cc:597] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.754135 20697 consensus_peers.cc:597] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.797454 20731 raft_consensus.cc:1275] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer ea25df1d72fa4708887246c33c9efcda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.803079 21390 consensus_queue.cc:1048] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:35.810879 20623 consensus_peers.cc:597] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.789878 20407 catalog_manager.cc:5697] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } }
I20260709 12:14:35.828718 20406 catalog_manager.cc:5697] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 2 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.838300 21358 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:35.841476 21358 tablet_bootstrap.cc:492] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:35.842308 21358 ts_tablet_manager.cc:1403] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.005s
I20260709 12:14:35.847383 20406 catalog_manager.cc:5697] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } }
I20260709 12:14:35.885200 21358 raft_consensus.cc:359] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:35.886926 21358 raft_consensus.cc:740] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
W20260709 12:14:35.895524 20549 consensus_peers.cc:597] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.897631 20623 consensus_peers.cc:597] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:35.906103 20653 raft_consensus.cc:1275] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:35.910611 20697 consensus_peers.cc:597] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.915618 20697 consensus_peers.cc:597] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.902446 20408 catalog_manager.cc:5697] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:35.918569 20623 consensus_peers.cc:597] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.918802 21368 consensus_queue.cc:1048] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:35.920843 20549 consensus_peers.cc:597] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.929113 20549 consensus_peers.cc:597] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.933216 20623 consensus_peers.cc:597] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.935916 20549 consensus_peers.cc:597] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:35.936219 20697 consensus_peers.cc:597] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.887979 21358 consensus_queue.cc:260] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:35.938593 21358 ts_tablet_manager.cc:1434] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.096s	user 0.005s	sys 0.002s
I20260709 12:14:35.939494 21358 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:35.953867 21433 raft_consensus.cc:493] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.954564 21433 raft_consensus.cc:515] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:35.965090 21433 leader_election.cc:290] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
W20260709 12:14:35.972761 20697 consensus_peers.cc:597] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:35.981994 20623 consensus_peers.cc:597] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:35.977437 20407 catalog_manager.cc:5697] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 1 to 2, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:36.008597 20697 consensus_peers.cc:597] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:36.004822 20549 consensus_peers.cc:597] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:36.023414 20731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:36.032109 20697 consensus_peers.cc:597] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:36.037678 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63b44fdabd6441ea3397fea5da63694" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:36.040591 21352 leader_election.cc:304] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:36.041682 21433 raft_consensus.cc:2749] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:36.042443 20623 consensus_peers.cc:597] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:36.064414 21358 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:14:36.064682 20697 consensus_peers.cc:597] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:36.075392 21358 tablet_bootstrap.cc:492] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.076303 21358 ts_tablet_manager.cc:1403] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.000s
I20260709 12:14:36.080528 21358 raft_consensus.cc:359] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:36.081336 21358 raft_consensus.cc:740] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.082283 21358 consensus_queue.cc:260] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:36.088320 20697 consensus_peers.cc:597] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:36.088505 21358 ts_tablet_manager.cc:1434] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:36.089625 21358 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.094545 20653 raft_consensus.cc:1275] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.096315 21381 consensus_queue.cc:1048] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:36.147358 20549 consensus_peers.cc:597] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:36.153146 21358 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.154335 21358 tablet_bootstrap.cc:492] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.157471 20658 raft_consensus.cc:1275] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.159718 21358 ts_tablet_manager.cc:1403] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.008s
I20260709 12:14:36.161438 21389 consensus_queue.cc:1048] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:36.162843 21358 raft_consensus.cc:359] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.163687 21358 raft_consensus.cc:740] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.165263 21358 consensus_queue.cc:260] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.170743 21358 ts_tablet_manager.cc:1434] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:36.173410 21358 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.200222 20653 raft_consensus.cc:1275] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.204008 21372 consensus_queue.cc:1048] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.234530 21433 raft_consensus.cc:493] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.235194 21433 raft_consensus.cc:515] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.237648 21433 leader_election.cc:290] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:36.239148 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea25df1d72fa4708887246c33c9efcda" is_pre_election: true
I20260709 12:14:36.241657 21358 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.243016 21358 tablet_bootstrap.cc:492] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.243768 21358 ts_tablet_manager.cc:1403] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.007s
I20260709 12:14:36.246629 21358 raft_consensus.cc:359] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.247336 21358 raft_consensus.cc:740] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.248024 21358 consensus_queue.cc:260] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.254032 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47835231a92d4f15accf212d579f7d6e" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:36.256291 21358 ts_tablet_manager.cc:1434] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:14:36.257328 21358 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.281795 21354 leader_election.cc:304] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:36.286099 21433 raft_consensus.cc:2749] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:36.345960 21358 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.352582 21358 tablet_bootstrap.cc:492] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.353336 21358 ts_tablet_manager.cc:1403] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.009s
I20260709 12:14:36.361042 21358 raft_consensus.cc:359] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.365819 21358 raft_consensus.cc:740] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.366986 21358 consensus_queue.cc:260] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.374184 21358 ts_tablet_manager.cc:1434] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:14:36.375417 21358 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.418872 21358 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.431532 21358 tablet_bootstrap.cc:492] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.432466 21358 ts_tablet_manager.cc:1403] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.004s
I20260709 12:14:36.435591 21358 raft_consensus.cc:359] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.436445 21358 raft_consensus.cc:740] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.437391 21358 consensus_queue.cc:260] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.441470 21358 ts_tablet_manager.cc:1434] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:14:36.442477 21358 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.466394 21358 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.467725 21358 tablet_bootstrap.cc:492] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.468524 21358 ts_tablet_manager.cc:1403] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 12:14:36.471632 21358 raft_consensus.cc:359] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.472440 21358 raft_consensus.cc:740] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.473415 21358 consensus_queue.cc:260] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.476028 21358 ts_tablet_manager.cc:1434] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:36.477087 21358 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.503371 21358 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.504563 21358 tablet_bootstrap.cc:492] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.505306 21358 ts_tablet_manager.cc:1403] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 12:14:36.509439 21358 raft_consensus.cc:359] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:36.511505 21358 raft_consensus.cc:740] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.513357 21358 consensus_queue.cc:260] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:36.518296 21358 ts_tablet_manager.cc:1434] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:14:36.519300 21358 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.556003 21358 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.558445 21358 tablet_bootstrap.cc:492] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.559303 21358 ts_tablet_manager.cc:1403] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.004s
I20260709 12:14:36.564827 21358 raft_consensus.cc:359] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.565703 21358 raft_consensus.cc:740] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.566655 21358 consensus_queue.cc:260] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.569252 21358 ts_tablet_manager.cc:1434] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:14:36.571450 21358 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.603824 21358 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.605114 21358 tablet_bootstrap.cc:492] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.605894 21358 ts_tablet_manager.cc:1403] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.015s
I20260709 12:14:36.608847 21358 raft_consensus.cc:359] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.609679 21358 raft_consensus.cc:740] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.610842 21358 consensus_queue.cc:260] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.613431 21358 ts_tablet_manager.cc:1434] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:36.614456 21358 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.772208 21433 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.773018 21433 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.797272 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
I20260709 12:14:36.798560 20733 raft_consensus.cc:2393] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 2: Already voted for candidate 491eb72eef45486bb35575f2936538d9 in this term.
I20260709 12:14:36.787746 21433 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:36.847857 21358 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.850186 21358 tablet_bootstrap.cc:492] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.850993 21358 ts_tablet_manager.cc:1403] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.237s	user 0.061s	sys 0.073s
I20260709 12:14:36.856482 21358 raft_consensus.cc:359] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:36.857651 21358 raft_consensus.cc:740] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.861647 21358 consensus_queue.cc:260] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
W20260709 12:14:36.869915 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 61350.7us
I20260709 12:14:36.872426 21358 ts_tablet_manager.cc:1434] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:14:36.874014 21358 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.877902  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:34503
I20260709 12:14:36.878049 21514 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:34503 every 8 connection(s)
I20260709 12:14:36.889671 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:36.891956 20581 raft_consensus.cc:2393] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ca675f8ab8b49e2b275294280376184 in current term 2: Already voted for candidate d45ade27487a47c990a6f9d0fa4a86c7 in this term.
I20260709 12:14:36.893290 21352 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184; no voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:36.894755 21433 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:36.914713 21433 raft_consensus.cc:2749] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:36.928274 21358 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.929356 21358 tablet_bootstrap.cc:492] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.930024 21358 ts_tablet_manager.cc:1403] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.009s
I20260709 12:14:36.932665 21358 raft_consensus.cc:359] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.933414 21358 raft_consensus.cc:740] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.934100 21358 consensus_queue.cc:260] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:36.936376 21358 ts_tablet_manager.cc:1434] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:14:36.937201 21358 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.946308 21516 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38005
I20260709 12:14:36.946980 21516 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:36.948177 21516 heartbeater.cc:507] Master 127.9.180.190:38005 requested a full tablet report, sending...
I20260709 12:14:36.968551 20407 ts_manager.cc:194] Re-registered known tserver with Master: 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:36.979040 21358 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:36.980301 21358 tablet_bootstrap.cc:492] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:36.981551 21358 ts_tablet_manager.cc:1403] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.009s
I20260709 12:14:36.984576 21358 raft_consensus.cc:359] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.985396 21358 raft_consensus.cc:740] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:36.986753 21358 consensus_queue.cc:260] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:36.996788 21358 ts_tablet_manager.cc:1434] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:14:36.997859 21358 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:36.998207 21391 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.998874 21391 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:37.001595 21391 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:37.002730 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" is_pre_election: true
I20260709 12:14:37.003485 20581 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:37.004004 21476 raft_consensus.cc:3060] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.004722 20696 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:37.005677 21391 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:37.006071 21391 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.006390 21391 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.026983 21468 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.031432 21472 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.037854 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184" is_pre_election: true
I20260709 12:14:37.038779 21465 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:37.069608 21391 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:37.072137 21391 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Requested vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:37.078683 21358 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:37.080178 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:37.080828 20581 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.081832 21465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ca675f8ab8b49e2b275294280376184"
I20260709 12:14:37.082441 21465 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.087174 21358 tablet_bootstrap.cc:492] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:37.088850 21358 ts_tablet_manager.cc:1403] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.000s
I20260709 12:14:37.093116 21358 raft_consensus.cc:359] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:37.098680 21358 raft_consensus.cc:740] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:37.099454 21358 consensus_queue.cc:260] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:37.105588 21358 ts_tablet_manager.cc:1434] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:14:37.106395 21358 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:37.104499 21468 raft_consensus.cc:3060] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:37.106878 20581 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:37.108605 20696 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:37.110844 21391 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:37.111464 21465 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:37.112596 20407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47662
I20260709 12:14:37.111456 21391 raft_consensus.cc:697] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:37.120615 21391 consensus_queue.cc:237] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:37.142819 21516 heartbeater.cc:499] Master 127.9.180.190:38005 was elected leader, sending a full tablet report...
W20260709 12:14:37.154616 20623 consensus_peers.cc:597] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:37.155622 21476 raft_consensus.cc:3060] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.336825 21476 raft_consensus.cc:3060] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.339785 21468 raft_consensus.cc:3060] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:37.340574 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 159349us
I20260709 12:14:37.397856 20407 catalog_manager.cc:5697] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 3, leader changed from 2ca675f8ab8b49e2b275294280376184 (127.9.180.129) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 3 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:37.460114 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 57142.1us
W20260709 12:14:37.525197 20696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:32887, user_credentials={real_user=slave}} blocked reactor thread for 45139.1us
W20260709 12:14:37.540629 20550 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 81559.4us
W20260709 12:14:37.538086 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 82170.3us
I20260709 12:14:37.648259 21465 raft_consensus.cc:3060] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.718467 21469 raft_consensus.cc:1275] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:37.718827 20549 consensus_peers.cc:597] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:37.719398 20549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:34503, user_credentials={real_user=slave}} blocked reactor thread for 45036.3us
I20260709 12:14:37.732748 21358 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:37.733872 21358 tablet_bootstrap.cc:492] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:37.734555 21358 ts_tablet_manager.cc:1403] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.628s	user 0.034s	sys 0.035s
I20260709 12:14:37.739638 21358 raft_consensus.cc:359] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:37.740322 21358 raft_consensus.cc:740] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:37.746702 21358 consensus_queue.cc:260] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:37.754848 21358 ts_tablet_manager.cc:1434] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:14:37.755719 21358 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:37.769963 20576 raft_consensus.cc:1275] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:37.783957 21371 consensus_queue.cc:1048] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:37.788621 21509 consensus_queue.cc:1048] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:37.801460 20623 consensus_peers.cc:597] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:37.823395 20549 consensus_peers.cc:597] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:37.847004 21358 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:37.848546 21358 tablet_bootstrap.cc:492] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:37.877627 21358 ts_tablet_manager.cc:1403] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.002s
W20260709 12:14:37.879801 20549 consensus_peers.cc:597] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:37.880589 20623 consensus_peers.cc:597] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:37.892462 21358 raft_consensus.cc:359] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:37.893436 21358 raft_consensus.cc:740] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:37.894395 21358 consensus_queue.cc:260] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:37.897181 21358 ts_tablet_manager.cc:1434] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:14:37.898183 21358 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:37.900374 20623 consensus_peers.cc:597] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.052430 21358 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.053478 21358 tablet_bootstrap.cc:492] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.054351 21358 ts_tablet_manager.cc:1403] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.156s	user 0.073s	sys 0.072s
W20260709 12:14:38.057130 20549 consensus_peers.cc:597] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.057835 21358 raft_consensus.cc:359] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.058728 21358 raft_consensus.cc:740] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.059525 21358 consensus_queue.cc:260] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.062171 21358 ts_tablet_manager.cc:1434] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:14:38.063228 21358 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.083546 21358 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.084702 21358 tablet_bootstrap.cc:492] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.085533 21358 ts_tablet_manager.cc:1403] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.001s
I20260709 12:14:38.088253 21358 raft_consensus.cc:359] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.088986 21358 raft_consensus.cc:740] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.089702 21358 consensus_queue.cc:260] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.092028 21358 ts_tablet_manager.cc:1434] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:38.092880 21358 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.109503 21358 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.110499 21358 tablet_bootstrap.cc:492] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.111222 21358 ts_tablet_manager.cc:1403] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:14:38.112535 21476 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:38.114087 21358 raft_consensus.cc:359] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.114971 21358 raft_consensus.cc:740] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.115761 21358 consensus_queue.cc:260] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.118005 21358 ts_tablet_manager.cc:1434] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:38.118991 21358 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.147806 21358 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.148921 21358 tablet_bootstrap.cc:492] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.149747 21358 ts_tablet_manager.cc:1403] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.011s
I20260709 12:14:38.152689 21358 raft_consensus.cc:359] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.153542 21358 raft_consensus.cc:740] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.154251 21358 consensus_queue.cc:260] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.156407 21358 ts_tablet_manager.cc:1434] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:14:38.157212 21358 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:38.168597 20549 consensus_peers.cc:597] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:38.180591 21358 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.181746 21358 tablet_bootstrap.cc:492] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.182613 21358 ts_tablet_manager.cc:1403] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.003s
I20260709 12:14:38.185878 21358 raft_consensus.cc:359] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.186669 21358 raft_consensus.cc:740] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.187475 21358 consensus_queue.cc:260] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.189973 21358 ts_tablet_manager.cc:1434] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:14:38.193560 21358 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.215521 21358 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.216524 21358 tablet_bootstrap.cc:492] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.217206 21358 ts_tablet_manager.cc:1403] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 12:14:38.219898 21358 raft_consensus.cc:359] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.220709 21358 raft_consensus.cc:740] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.221608 21358 consensus_queue.cc:260] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.223820 21358 ts_tablet_manager.cc:1434] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:14:38.224838 21358 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.242913 21358 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.243883 21358 tablet_bootstrap.cc:492] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.244966 21358 ts_tablet_manager.cc:1403] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 12:14:38.247535 21358 raft_consensus.cc:359] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.248216 21358 raft_consensus.cc:740] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.249019 21358 consensus_queue.cc:260] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.251194 21358 ts_tablet_manager.cc:1434] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:38.252657 21358 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:38.304875 20697 consensus_peers.cc:597] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.309381 21358 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.310736 21358 tablet_bootstrap.cc:492] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.311430 21358 ts_tablet_manager.cc:1403] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.018s
I20260709 12:14:38.314289 21358 raft_consensus.cc:359] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:38.315073 21358 raft_consensus.cc:740] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.315819 21358 consensus_queue.cc:260] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
W20260709 12:14:38.317689 20623 consensus_peers.cc:597] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.320547 21358 ts_tablet_manager.cc:1434] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:14:38.325526 21358 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:38.343070 20549 consensus_peers.cc:597] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.352892 21358 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.354135 21358 tablet_bootstrap.cc:492] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.354964 21358 ts_tablet_manager.cc:1403] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.003s
I20260709 12:14:38.357813 21358 raft_consensus.cc:359] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.358470 21358 raft_consensus.cc:740] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.359263 21358 consensus_queue.cc:260] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.362185 21358 ts_tablet_manager.cc:1434] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:14:38.362439 20623 consensus_peers.cc:597] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.363222 21358 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:38.364876 20549 consensus_peers.cc:597] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.377210 21476 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:38.402347 21358 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.403687 21358 tablet_bootstrap.cc:492] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.404528 21358 ts_tablet_manager.cc:1403] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.016s
I20260709 12:14:38.407346 21358 raft_consensus.cc:359] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:38.408097 21358 raft_consensus.cc:740] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.409035 21358 consensus_queue.cc:260] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:38.416028 21358 ts_tablet_manager.cc:1434] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:14:38.417109 21358 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:38.460870 20623 consensus_peers.cc:597] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.482163 21358 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.483511 21358 tablet_bootstrap.cc:492] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.484724 21358 ts_tablet_manager.cc:1403] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.068s	user 0.035s	sys 0.015s
I20260709 12:14:38.487627 21358 raft_consensus.cc:359] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.488389 21358 raft_consensus.cc:740] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.489120 21358 consensus_queue.cc:260] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.491490 21358 ts_tablet_manager.cc:1434] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:38.492386 21358 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
W20260709 12:14:38.529044 20623 consensus_peers.cc:597] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.553433 21476 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:38.645234 20623 consensus_peers.cc:597] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:38.691706 21468 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:38.707326 20622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:35285, user_credentials={real_user=slave}} blocked reactor thread for 176720us
I20260709 12:14:38.776811 21358 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.780213 21358 tablet_bootstrap.cc:492] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.781024 21358 ts_tablet_manager.cc:1403] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.289s	user 0.088s	sys 0.084s
I20260709 12:14:38.784011 21358 raft_consensus.cc:359] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.787416 21358 raft_consensus.cc:740] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.788748 21358 consensus_queue.cc:260] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.792471 21358 ts_tablet_manager.cc:1434] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:14:38.807565 21358 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.891237 21358 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.892313 21358 tablet_bootstrap.cc:492] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.893033 21358 ts_tablet_manager.cc:1403] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.098s	user 0.038s	sys 0.031s
I20260709 12:14:38.895674 21358 raft_consensus.cc:359] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:38.896389 21358 raft_consensus.cc:740] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.897229 21358 consensus_queue.cc:260] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:38.900002 21358 ts_tablet_manager.cc:1434] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:38.900923 21358 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.924041 21358 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.925066 21358 tablet_bootstrap.cc:492] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.925684 21358 ts_tablet_manager.cc:1403] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.001s
I20260709 12:14:38.927810 21358 raft_consensus.cc:359] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.928519 21358 raft_consensus.cc:740] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.929199 21358 consensus_queue.cc:260] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.930936 21358 ts_tablet_manager.cc:1434] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:38.932240 21358 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.950403 21358 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.951665 21358 tablet_bootstrap.cc:492] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.958273 21358 ts_tablet_manager.cc:1403] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 12:14:38.961081 21358 raft_consensus.cc:359] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.961798 21358 raft_consensus.cc:740] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.962584 21358 consensus_queue.cc:260] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:38.965067 21358 ts_tablet_manager.cc:1434] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:38.965927 21358 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:38.981683 21358 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:38.982709 21358 tablet_bootstrap.cc:492] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:38.983506 21358 ts_tablet_manager.cc:1403] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.002s
I20260709 12:14:38.985970 21358 raft_consensus.cc:359] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:38.986739 21358 raft_consensus.cc:740] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.987418 21358 consensus_queue.cc:260] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:38.989701 21358 ts_tablet_manager.cc:1434] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:38.990546 21358 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.005281 21358 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.006445 21358 tablet_bootstrap.cc:492] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.007345 21358 ts_tablet_manager.cc:1403] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:14:39.010368 21358 raft_consensus.cc:359] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.011209 21358 raft_consensus.cc:740] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.011960 21358 consensus_queue.cc:260] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.014360 21358 ts_tablet_manager.cc:1434] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:14:39.017416 21358 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.068169 21358 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.071398 21358 tablet_bootstrap.cc:492] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.072319 21358 ts_tablet_manager.cc:1403] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
I20260709 12:14:39.075405 21358 raft_consensus.cc:359] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.076138 21358 raft_consensus.cc:740] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.077109 21358 consensus_queue.cc:260] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.079573 21358 ts_tablet_manager.cc:1434] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:39.081674 21358 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.089305 21477 raft_consensus.cc:3060] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.138528 21358 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.140084 21358 tablet_bootstrap.cc:492] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.140875 21358 ts_tablet_manager.cc:1403] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.013s
I20260709 12:14:39.143738 21358 raft_consensus.cc:359] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:39.144502 21358 raft_consensus.cc:740] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.145368 21358 consensus_queue.cc:260] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:39.148942 21358 ts_tablet_manager.cc:1434] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:14:39.149852 21358 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.171908 21358 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.181107 21358 tablet_bootstrap.cc:492] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.182474 21358 ts_tablet_manager.cc:1403] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.003s
I20260709 12:14:39.192879 21358 raft_consensus.cc:359] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:39.193646 21358 raft_consensus.cc:740] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.194451 21358 consensus_queue.cc:260] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:39.196753 21358 ts_tablet_manager.cc:1434] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:14:39.197633 21358 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.215286 21358 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.216223 21358 tablet_bootstrap.cc:492] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.216913 21358 ts_tablet_manager.cc:1403] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 12:14:39.219475 21358 raft_consensus.cc:359] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.220075 21358 raft_consensus.cc:740] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.220837 21358 consensus_queue.cc:260] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.223083 21358 ts_tablet_manager.cc:1434] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:39.223901 21358 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.248003 21358 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.249079 21358 tablet_bootstrap.cc:492] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.249864 21358 ts_tablet_manager.cc:1403] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.003s
I20260709 12:14:39.252640 21358 raft_consensus.cc:359] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:39.253371 21358 raft_consensus.cc:740] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.254102 21358 consensus_queue.cc:260] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:39.256632 21358 ts_tablet_manager.cc:1434] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:39.257726 21358 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.281057 21358 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.282091 21358 tablet_bootstrap.cc:492] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.283061 21358 ts_tablet_manager.cc:1403] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 12:14:39.285962 21358 raft_consensus.cc:359] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:39.286697 21358 raft_consensus.cc:740] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.287422 21358 consensus_queue.cc:260] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:39.289674 21358 ts_tablet_manager.cc:1434] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:14:39.291098 21358 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.386044 21358 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.387037 21358 tablet_bootstrap.cc:492] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.387693 21358 ts_tablet_manager.cc:1403] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.064s
I20260709 12:14:39.390225 21358 raft_consensus.cc:359] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.392535 21358 raft_consensus.cc:740] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.393275 21358 consensus_queue.cc:260] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:39.395291 21358 ts_tablet_manager.cc:1434] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:14:39.396505 21358 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Bootstrap starting.
I20260709 12:14:39.411329 21358 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:39.412418 21358 tablet_bootstrap.cc:492] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Bootstrap complete.
I20260709 12:14:39.413188 21358 ts_tablet_manager.cc:1403] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:14:39.416357 21358 raft_consensus.cc:359] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:39.417147 21358 raft_consensus.cc:740] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.417919 21358 consensus_queue.cc:260] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:39.420835 21358 ts_tablet_manager.cc:1434] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:39.441056 21476 raft_consensus.cc:3060] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.689324 21476 raft_consensus.cc:3060] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:42.209165 20624 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.132:40653, user_credentials={real_user=slave}} blocked reactor thread for 73611.5us
I20260709 12:14:46.898406  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:46.962320 20726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:46.963522 20726 raft_consensus.cc:606] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:46.966445 20726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:46.966930 20726 raft_consensus.cc:606] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:46.968993 20726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:46.969378 20726 raft_consensus.cc:606] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:46.971477 20726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:46.971853 20726 raft_consensus.cc:606] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:46.985461 20576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a"
dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:52982
I20260709 12:14:46.986086 20576 raft_consensus.cc:606] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:47.000218 20657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7"
dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:14:47.000710 20657 raft_consensus.cc:606] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:47.003595 20726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:47.004074 20726 raft_consensus.cc:606] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Received request to transfer leadership to TS d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:47.005163  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:14:47.006382  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:47.007339  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:47.034440 21513 raft_consensus.cc:993] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.035208 21603 raft_consensus.cc:1081] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.036878 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47184
I20260709 12:14:47.037509 21465 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.037930 21465 raft_consensus.cc:3060] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.047226 21465 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.049551 21465 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:47.051689 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:47.052281 20576 raft_consensus.cc:3055] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:47.052557 20576 raft_consensus.cc:740] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:47.053411 20576 consensus_queue.cc:260] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.050781 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86b5f8a698448b3acb2cbe9320acf4a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:47.054826 20576 raft_consensus.cc:3060] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.055331 20726 raft_consensus.cc:3060] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.065814 20576 raft_consensus.cc:2468] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:47.067656 21352 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:47.069516 20726 raft_consensus.cc:2468] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:47.070344 21629 raft_consensus.cc:2804] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:47.071878 21629 raft_consensus.cc:697] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:47.072854 21629 consensus_queue.cc:237] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.089325 20408 catalog_manager.cc:5697] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.227639 21636 raft_consensus.cc:993] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.228231 21624 raft_consensus.cc:1081] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.229773 21476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:47.230278 21476 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.230607 21476 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:47.236981 21476 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:47.239379 21476 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:47.240433 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:47.241024 20653 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:47.241083 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f124d084cc54b6ab38cbb14dd6b3919" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:47.241784 20726 raft_consensus.cc:3055] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:47.242110 20726 raft_consensus.cc:740] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:47.242925 20726 consensus_queue.cc:260] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:47.244190 20726 raft_consensus.cc:3060] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:47.248209 20653 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:47.249538 21352 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:47.250394 21629 raft_consensus.cc:2804] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:47.250968 20726 raft_consensus.cc:2468] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:47.250982 21629 raft_consensus.cc:697] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:47.252353 21629 consensus_queue.cc:237] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:47.264921 20408 catalog_manager.cc:5697] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 2 to 3, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.281872 21636 raft_consensus.cc:993] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.282371 21624 raft_consensus.cc:1081] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.284288 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:47.284811 21465 raft_consensus.cc:493] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.285102 21465 raft_consensus.cc:3060] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.290380 21465 raft_consensus.cc:515] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.292161 21465 leader_election.cc:290] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:47.292820 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:47.293421 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1f44e30cbb4f23bf23cbbe1ea47f74" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:47.293792 20726 raft_consensus.cc:3055] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:47.294062 20582 raft_consensus.cc:3060] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.294210 20726 raft_consensus.cc:740] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:47.295156 20726 consensus_queue.cc:260] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.296145 20726 raft_consensus.cc:3060] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.299682 20582 raft_consensus.cc:2468] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:47.301177 21352 leader_election.cc:304] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:47.301522 20726 raft_consensus.cc:2468] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:47.302186 21629 raft_consensus.cc:2804] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:47.302738 21629 raft_consensus.cc:697] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:47.303731 21629 consensus_queue.cc:237] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.315234 20408 catalog_manager.cc:5697] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.368330 21636 raft_consensus.cc:993] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.368858 21636 raft_consensus.cc:1081] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.370772 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:47.372364 21465 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.372844 21465 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.374069 21636 raft_consensus.cc:993] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.374733 21636 raft_consensus.cc:1081] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.378896 21476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:47.379544 21476 raft_consensus.cc:493] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.379899 21476 raft_consensus.cc:3060] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.385700 21465 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.387648 21465 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 4 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:47.388325 21476 raft_consensus.cc:515] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:47.388562 20726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:47.388629 20582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd837fa16b64d78b8142773b317ff3f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:47.389508 20726 raft_consensus.cc:3055] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:47.389681 20582 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.389995 20726 raft_consensus.cc:740] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:47.391326 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:47.390986 20726 consensus_queue.cc:260] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.391950 20653 raft_consensus.cc:3060] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.392650 20726 raft_consensus.cc:3060] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:47.394945 21476 leader_election.cc:290] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:47.396708 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372644e1ccf4558882a325df32b0a84" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:47.395418 20582 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 4.
I20260709 12:14:47.397334 20732 raft_consensus.cc:3055] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:47.397655 20732 raft_consensus.cc:740] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:47.397918 21352 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:47.398454 20732 consensus_queue.cc:260] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:47.399933 20732 raft_consensus.cc:3060] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.401553 20726 raft_consensus.cc:2468] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 4.
I20260709 12:14:47.402733 21629 raft_consensus.cc:2804] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:47.403308 21629 raft_consensus.cc:697] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 4 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:47.404279 21629 consensus_queue.cc:237] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:47.408234 20732 raft_consensus.cc:2468] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:47.410646 21354 leader_election.cc:304] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:47.411857 21630 raft_consensus.cc:2804] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:47.413625 21630 raft_consensus.cc:697] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:47.414528 21630 consensus_queue.cc:237] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:47.417887 20653 raft_consensus.cc:2468] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:47.430332 20408 catalog_manager.cc:5697] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 3 to 4, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 4 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.451188 20408 catalog_manager.cc:5697] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.524430 21621 raft_consensus.cc:993] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.525046 21616 raft_consensus.cc:1081] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:47.526448 21476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47174
I20260709 12:14:47.527040 21476 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.527308 21476 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:47.533067 21476 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:47.534921 21476 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:47.535526 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:47.536171 20576 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:47.537748 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15c10d8005c4037b36a80fec3ac32d7" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:47.538373 20653 raft_consensus.cc:3055] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:47.538725 20653 raft_consensus.cc:740] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:47.539428 20653 consensus_queue.cc:260] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:47.541644 20653 raft_consensus.cc:3060] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:47.548985 20653 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:47.549854 20576 raft_consensus.cc:2468] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:47.550153 21352 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:47.551628 21630 raft_consensus.cc:2804] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:47.552101 21630 raft_consensus.cc:697] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:47.553036 21630 consensus_queue.cc:237] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:47.565378 20408 catalog_manager.cc:5697] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 2 to 3, leader changed from ea25df1d72fa4708887246c33c9efcda (127.9.180.131) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.606465 21624 raft_consensus.cc:993] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: : Instructing follower d45ade27487a47c990a6f9d0fa4a86c7 to start an election
I20260709 12:14:47.607169 21639 raft_consensus.cc:1081] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Signalling peer d45ade27487a47c990a6f9d0fa4a86c7 to start an election
I20260709 12:14:47.608831 20576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe"
dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
 from {username='slave'} at 127.0.0.1:55570
I20260709 12:14:47.609287 20576 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:47.609555 20576 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.613884 20576 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:47.615303 20576 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:47.616197 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:47.616374 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:47.616863 20653 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.616968 20732 raft_consensus.cc:3055] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:47.617369 20732 raft_consensus.cc:740] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:47.618072 20732 consensus_queue.cc:260] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:47.619048 20732 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.622768 20653 raft_consensus.cc:2468] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:47.623790 20732 raft_consensus.cc:2468] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:47.623996 20548 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:47.624963 21603 raft_consensus.cc:2804] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:47.626439 21603 raft_consensus.cc:697] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:47.627290 21603 consensus_queue.cc:237] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:47.636986 20408 catalog_manager.cc:5697] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 1 to 2, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.649094 20732 raft_consensus.cc:1275] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:47.650279 21630 consensus_queue.cc:1048] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.665174 20653 raft_consensus.cc:1275] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:47.667057 21641 consensus_queue.cc:1048] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:47.671445 20576 raft_consensus.cc:1275] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.672952 21641 consensus_queue.cc:1048] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.687654 20732 raft_consensus.cc:1275] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.689240 21629 consensus_queue.cc:1048] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.864780 20582 raft_consensus.cc:1275] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 4 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:47.867494 21629 consensus_queue.cc:1048] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.885008 20732 raft_consensus.cc:1275] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:47.888401 21629 consensus_queue.cc:1048] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.890563 20582 raft_consensus.cc:1275] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.892416 21629 consensus_queue.cc:1048] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.913275 20732 raft_consensus.cc:1275] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.916733 21630 consensus_queue.cc:1048] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.946085 20653 raft_consensus.cc:1275] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:47.948230 21629 consensus_queue.cc:1048] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.948849 20653 raft_consensus.cc:1275] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.950384 21629 consensus_queue.cc:1048] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.959898 20581 raft_consensus.cc:1275] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:47.961304 21641 consensus_queue.cc:1048] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:47.969825 20732 raft_consensus.cc:1275] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:47.972070 21630 consensus_queue.cc:1048] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:48.048908 20657 raft_consensus.cc:1275] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:48.050256 21645 consensus_queue.cc:1048] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:48.053215  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:48.069213 20732 raft_consensus.cc:1275] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:48.077076 21603 consensus_queue.cc:1048] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:48.119167 20653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8"
dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:14:48.119735 20653 raft_consensus.cc:606] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:48.122140 20732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:48.122699 20732 raft_consensus.cc:606] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:48.125471 20576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74e746c068884fe09a59543355686d5f"
dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:52982
I20260709 12:14:48.126068 20576 raft_consensus.cc:606] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:48.130097 20653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98538592057b4546a7267066f54c5732"
dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:14:48.130674 20653 raft_consensus.cc:606] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:48.133416 20576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe"
dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
mode: GRACEFUL
new_leader_uuid: "491eb72eef45486bb35575f2936538d9"
 from {username='slave'} at 127.0.0.1:52982
I20260709 12:14:48.133927 20576 raft_consensus.cc:606] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Received request to transfer leadership to TS 491eb72eef45486bb35575f2936538d9
I20260709 12:14:48.136684  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:48.138836  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:48.139657  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:48.248864 21616 raft_consensus.cc:993] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.249405 21621 raft_consensus.cc:1081] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.250830 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98538592057b4546a7267066f54c5732"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47174
I20260709 12:14:48.251281 21465 raft_consensus.cc:493] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.251515 21465 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.259477 21465 raft_consensus.cc:515] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:48.262203 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:48.262852 20576 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.266971 21465 leader_election.cc:290] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:48.268234 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98538592057b4546a7267066f54c5732" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:48.268779 20653 raft_consensus.cc:3055] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:48.269022 20653 raft_consensus.cc:740] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:48.269784 20653 consensus_queue.cc:260] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:48.270234 20576 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:48.270884 20653 raft_consensus.cc:3060] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.271384 21352 leader_election.cc:304] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:48.272300 21641 raft_consensus.cc:2804] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:48.272794 21641 raft_consensus.cc:697] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:48.273743 21641 consensus_queue.cc:237] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:48.277654 20653 raft_consensus.cc:2468] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:48.285087 21513 raft_consensus.cc:993] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.285506 21603 raft_consensus.cc:1081] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.287842 21476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74e746c068884fe09a59543355686d5f"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47184
I20260709 12:14:48.288573 21476 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.287802 20408 catalog_manager.cc:5697] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 2 to 3, leader changed from ea25df1d72fa4708887246c33c9efcda (127.9.180.131) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.288801 21476 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.300980 21476 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:48.303689 21476 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:48.305054 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:48.305711 20576 raft_consensus.cc:3055] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:48.305999 20576 raft_consensus.cc:740] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:48.306156 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e746c068884fe09a59543355686d5f" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:48.306744 20653 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.306954 20576 consensus_queue.cc:260] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:48.308318 20576 raft_consensus.cc:3060] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.314821 20653 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:48.316134 21352 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:48.316934 21641 raft_consensus.cc:2804] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:48.317423 21641 raft_consensus.cc:697] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:48.318435 20576 raft_consensus.cc:2468] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:48.318336 21641 consensus_queue.cc:237] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:48.329288 20408 catalog_manager.cc:5697] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 2 to 3, leader changed from d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.440582 21639 raft_consensus.cc:993] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.441128 21636 raft_consensus.cc:1081] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.442943 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:48.443454 21465 raft_consensus.cc:493] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.443738 21465 raft_consensus.cc:3060] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.449663 21465 raft_consensus.cc:515] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:48.451792 21465 leader_election.cc:290] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:48.452373 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:48.452776 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d424a0defe14912990a5576d69fb1bb" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:48.453078 20653 raft_consensus.cc:3060] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.453356 20732 raft_consensus.cc:3055] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.453650 20732 raft_consensus.cc:740] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:48.454423 20732 consensus_queue.cc:260] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:48.455649 20732 raft_consensus.cc:3060] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.460083 20653 raft_consensus.cc:2468] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:48.461377 21352 leader_election.cc:304] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:48.462370 21629 raft_consensus.cc:2804] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.462323 20732 raft_consensus.cc:2468] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:48.463125 21629 raft_consensus.cc:697] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:48.464082 21629 consensus_queue.cc:237] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:48.474602 20408 catalog_manager.cc:5697] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.500123 21513 raft_consensus.cc:993] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: : Instructing follower 491eb72eef45486bb35575f2936538d9 to start an election
I20260709 12:14:48.500560 21513 raft_consensus.cc:1081] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Signalling peer 491eb72eef45486bb35575f2936538d9 to start an election
I20260709 12:14:48.502287 20726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
 from {username='slave'} at 127.0.0.1:51894
I20260709 12:14:48.503002 20726 raft_consensus.cc:493] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.503396 20726 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.510025 20726 raft_consensus.cc:515] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:48.511785 20726 leader_election.cc:290] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:48.512825 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:48.513487 20576 raft_consensus.cc:3055] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:48.513770 20576 raft_consensus.cc:740] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:48.514573 20576 consensus_queue.cc:260] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:48.515044 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68b8d772da049a19db34b2f00090efe" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:48.515914 20653 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.515997 20576 raft_consensus.cc:3060] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.526011 20576 raft_consensus.cc:2468] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:48.528987 20653 raft_consensus.cc:2468] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 3.
I20260709 12:14:48.531854 20696 leader_election.cc:304] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:48.533078 21636 raft_consensus.cc:2804] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:48.533593 21636 raft_consensus.cc:697] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:48.534569 21636 consensus_queue.cc:237] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:48.544951 20406 catalog_manager.cc:5697] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 2 to 3, leader changed from d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 3 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.615274 21621 raft_consensus.cc:993] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.615864 21616 raft_consensus.cc:1081] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:48.617622 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47174
I20260709 12:14:48.618206 21465 raft_consensus.cc:493] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.618608 21465 raft_consensus.cc:3060] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.626199 21465 raft_consensus.cc:515] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:48.627842 21465 leader_election.cc:290] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:48.628703 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:48.628871 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59de2302cbac41d593cde64fe0aad5d8" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:48.629562 20653 raft_consensus.cc:3055] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.629622 20732 raft_consensus.cc:3060] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.629936 20653 raft_consensus.cc:740] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:48.630937 20653 consensus_queue.cc:260] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:48.631898 20653 raft_consensus.cc:3060] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.636761 20732 raft_consensus.cc:2468] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:48.638368 21354 leader_election.cc:304] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9; no voters: 
I20260709 12:14:48.638505 20653 raft_consensus.cc:2468] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:48.639276 21629 raft_consensus.cc:2804] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.639741 21629 raft_consensus.cc:697] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:48.640762 21629 consensus_queue.cc:237] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:48.654183 20406 catalog_manager.cc:5697] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from ea25df1d72fa4708887246c33c9efcda (127.9.180.131) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.686074 20653 raft_consensus.cc:1275] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:48.687398 21629 consensus_queue.cc:1048] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.700078 20576 raft_consensus.cc:1275] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:48.702054 21641 consensus_queue.cc:1048] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.744159 20581 raft_consensus.cc:1275] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:48.745374 21641 consensus_queue.cc:1048] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.756440 20653 raft_consensus.cc:1275] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:48.757830 21670 consensus_queue.cc:1048] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.933841 20581 raft_consensus.cc:1275] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:48.935127 21639 consensus_queue.cc:1048] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.948870 20653 raft_consensus.cc:1275] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:48.951998 21636 consensus_queue.cc:1048] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:48.954768 20653 raft_consensus.cc:1275] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:48.957427 21641 consensus_queue.cc:1048] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:48.978453 20726 raft_consensus.cc:1275] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:48.980410 21641 consensus_queue.cc:1048] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.025543 20657 raft_consensus.cc:1275] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.027274 21629 consensus_queue.cc:1048] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.037197 20726 raft_consensus.cc:1275] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.038676 21670 consensus_queue.cc:1048] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.176563  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:49.225394 20653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a"
dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:14:49.226326 20653 raft_consensus.cc:606] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:49.229700 20732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74580946c1b34dca8f017310b582f20c"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:49.230314 20732 raft_consensus.cc:606] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:49.233319 20653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab"
dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
mode: GRACEFUL
new_leader_uuid: "491eb72eef45486bb35575f2936538d9"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:14:49.233891 20653 raft_consensus.cc:606] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Received request to transfer leadership to TS 491eb72eef45486bb35575f2936538d9
I20260709 12:14:49.236423 20653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1"
dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
mode: GRACEFUL
new_leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:14:49.236975 20653 raft_consensus.cc:606] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Received request to transfer leadership to TS d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:49.238894  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:14:49.241204  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:49.242076  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:49.262625 21616 raft_consensus.cc:993] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:49.263154 21616 raft_consensus.cc:1081] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:49.264736 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47174
I20260709 12:14:49.265362 21465 raft_consensus.cc:493] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:49.265748 21465 raft_consensus.cc:3060] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.273108 21465 raft_consensus.cc:515] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:49.275256 21465 leader_election.cc:290] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:49.275840 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:49.276532 20581 raft_consensus.cc:3060] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.277513 20653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4477cac83a7e48809a693422fbd5b28a" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:49.278105 20653 raft_consensus.cc:3055] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:49.278419 20653 raft_consensus.cc:740] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:49.279214 20653 consensus_queue.cc:260] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:49.280450 20653 raft_consensus.cc:3060] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.284545 20581 raft_consensus.cc:2468] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:49.285936 21352 leader_election.cc:304] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:49.286847 21629 raft_consensus.cc:2804] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.287297 21629 raft_consensus.cc:697] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:49.288170 21629 consensus_queue.cc:237] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:49.288813 20653 raft_consensus.cc:2468] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:49.304761 20408 catalog_manager.cc:5697] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from ea25df1d72fa4708887246c33c9efcda (127.9.180.131) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.348783 21639 raft_consensus.cc:993] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:49.349391 21636 raft_consensus.cc:1081] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:49.351233 21476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74580946c1b34dca8f017310b582f20c"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:49.351827 21476 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:49.352186 21476 raft_consensus.cc:3060] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.359390 21476 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:49.361414 21476 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:49.362242 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:49.362473 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:49.363021 20657 raft_consensus.cc:3060] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.363093 20732 raft_consensus.cc:3055] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:49.363497 20732 raft_consensus.cc:740] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:49.366170 20732 consensus_queue.cc:260] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:49.369755 20732 raft_consensus.cc:3060] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.372503 20657 raft_consensus.cc:2468] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:49.373716 21352 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:49.374758 21629 raft_consensus.cc:2804] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.375453 21629 raft_consensus.cc:697] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:49.376368 21629 consensus_queue.cc:237] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:49.378705 20732 raft_consensus.cc:2468] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 2.
I20260709 12:14:49.387670 20408 catalog_manager.cc:5697] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 1 to 2, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:49.527617 21621 raft_consensus.cc:993] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: : Instructing follower 491eb72eef45486bb35575f2936538d9 to start an election
I20260709 12:14:49.528293 21616 raft_consensus.cc:1081] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Signalling peer 491eb72eef45486bb35575f2936538d9 to start an election
I20260709 12:14:49.529865 20732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
 from {username='slave'} at 127.0.0.1:51904
I20260709 12:14:49.530423 20732 raft_consensus.cc:493] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:49.530754 20732 raft_consensus.cc:3060] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.538318 20732 raft_consensus.cc:515] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:49.540763 20732 leader_election.cc:290] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:49.541529 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:49.542243 20576 raft_consensus.cc:3060] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.543639 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327ac80d17949f8aa3f002cf22986ab" candidate_uuid: "491eb72eef45486bb35575f2936538d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:49.544291 20657 raft_consensus.cc:3055] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:49.544498 20657 raft_consensus.cc:740] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:49.545347 20657 consensus_queue.cc:260] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:49.546691 20657 raft_consensus.cc:3060] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.548411 20576 raft_consensus.cc:2468] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:49.549713 20696 leader_election.cc:304] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 491eb72eef45486bb35575f2936538d9, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:49.550477 21639 raft_consensus.cc:2804] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.551074 21639 raft_consensus.cc:697] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Becoming Leader. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:49.552188 21639 consensus_queue.cc:237] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:49.555311 20657 raft_consensus.cc:2468] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 491eb72eef45486bb35575f2936538d9 in term 2.
I20260709 12:14:49.562837 20407 catalog_manager.cc:5697] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 reported cstate change: term changed from 1 to 2, leader changed from ea25df1d72fa4708887246c33c9efcda (127.9.180.131) to 491eb72eef45486bb35575f2936538d9 (127.9.180.132). New cstate: current_term: 2 leader_uuid: "491eb72eef45486bb35575f2936538d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:49.635208 21621 raft_consensus.cc:993] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: : Instructing follower d45ade27487a47c990a6f9d0fa4a86c7 to start an election
I20260709 12:14:49.635897 21621 raft_consensus.cc:1081] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Signalling peer d45ade27487a47c990a6f9d0fa4a86c7 to start an election
I20260709 12:14:49.637645 20581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1"
dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
 from {username='slave'} at 127.0.0.1:55578
I20260709 12:14:49.638263 20581 raft_consensus.cc:493] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:49.638641 20581 raft_consensus.cc:3060] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.646780 20581 raft_consensus.cc:515] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:49.649420 20581 leader_election.cc:290] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Requested vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653)
I20260709 12:14:49.649976 20657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:49.650695 20657 raft_consensus.cc:3055] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:49.651959 20657 raft_consensus.cc:740] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea25df1d72fa4708887246c33c9efcda, State: Running, Role: LEADER
I20260709 12:14:49.650542 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25019682b2f4f4598912e1bee5d76e1" candidate_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:49.652545 20732 raft_consensus.cc:3060] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.652828 20657 consensus_queue.cc:260] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:49.654137 20657 raft_consensus.cc:3060] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.659893 20657 raft_consensus.cc:2468] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:49.659957 20732 raft_consensus.cc:2468] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45ade27487a47c990a6f9d0fa4a86c7 in term 2.
I20260709 12:14:49.660992 20548 leader_election.cc:304] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d45ade27487a47c990a6f9d0fa4a86c7, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:49.661793 21513 raft_consensus.cc:2804] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.662206 21513 raft_consensus.cc:697] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Leader. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:49.663014 21513 consensus_queue.cc:237] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } }
I20260709 12:14:49.682890 20407 catalog_manager.cc:5697] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 reported cstate change: term changed from 1 to 2, leader changed from ea25df1d72fa4708887246c33c9efcda (127.9.180.131) to d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.765542 20657 raft_consensus.cc:1275] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.766991 21629 consensus_queue.cc:1048] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.786119 20576 raft_consensus.cc:1275] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.788127 21683 consensus_queue.cc:1048] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.841032 20657 raft_consensus.cc:1275] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.841408 20732 raft_consensus.cc:1275] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.842736 21683 consensus_queue.cc:1048] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:49.844099 21629 consensus_queue.cc:1048] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:50.004319 20657 raft_consensus.cc:1275] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:50.005697 21639 consensus_queue.cc:1048] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:50.027796 20581 raft_consensus.cc:1275] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Refusing update from remote peer 491eb72eef45486bb35575f2936538d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:50.034600 21636 consensus_queue.cc:1048] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:50.047500 20733 raft_consensus.cc:1275] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:50.049011 21513 consensus_queue.cc:1048] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:50.063403 20658 raft_consensus.cc:1275] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Refusing update from remote peer d45ade27487a47c990a6f9d0fa4a86c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:50.064893 21513 consensus_queue.cc:1048] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:50.293223  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:50.332371 20576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68"
dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:52982
I20260709 12:14:50.333022 20576 raft_consensus.cc:606] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:50.335495 20732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf"
dest_uuid: "491eb72eef45486bb35575f2936538d9"
mode: GRACEFUL
new_leader_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:53990
I20260709 12:14:50.335978 20732 raft_consensus.cc:606] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Received request to transfer leadership to TS 2ca675f8ab8b49e2b275294280376184
I20260709 12:14:50.337232  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:50.338784  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:50.339419  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:50.492286 21709 raft_consensus.cc:993] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:50.492889 21513 raft_consensus.cc:1081] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:50.494248 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47184
I20260709 12:14:50.494678 21465 raft_consensus.cc:493] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:50.494905 21465 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:50.499712 21465 raft_consensus.cc:515] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:50.502718 20576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:50.503427 20658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c9fc057a5146cc8d2ea60658b76b68" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea25df1d72fa4708887246c33c9efcda"
I20260709 12:14:50.503441 20576 raft_consensus.cc:3055] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:50.504014 20658 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:50.502727 21465 leader_election.cc:290] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Requested vote from peers d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285), ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887)
I20260709 12:14:50.504344 20576 raft_consensus.cc:740] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d45ade27487a47c990a6f9d0fa4a86c7, State: Running, Role: LEADER
I20260709 12:14:50.505311 20576 consensus_queue.cc:260] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:50.506834 20576 raft_consensus.cc:3060] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:50.510458 20658 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:50.511826 21352 leader_election.cc:304] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda; no voters: 
I20260709 12:14:50.512737 21683 raft_consensus.cc:2804] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:50.513187 21683 raft_consensus.cc:697] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:50.514061 21683 consensus_queue.cc:237] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:50.529070 20407 catalog_manager.cc:5697] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 2 to 3, leader changed from d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.530750 20576 raft_consensus.cc:2468] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:50.860327 21716 raft_consensus.cc:993] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: : Instructing follower 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:50.860908 21692 raft_consensus.cc:1081] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Signalling peer 2ca675f8ab8b49e2b275294280376184 to start an election
I20260709 12:14:50.862471 21465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf"
dest_uuid: "2ca675f8ab8b49e2b275294280376184"
 from {username='slave'} at 127.0.0.1:47200
I20260709 12:14:50.863127 21465 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:50.863620 21465 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:50.869843 21465 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:50.871346 21465 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Requested vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:50.872170 20732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "491eb72eef45486bb35575f2936538d9"
I20260709 12:14:50.872397 20581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d9fef03cd64257b9d1812dbdec74cf" candidate_uuid: "2ca675f8ab8b49e2b275294280376184" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d45ade27487a47c990a6f9d0fa4a86c7"
I20260709 12:14:50.872934 20732 raft_consensus.cc:3055] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:50.873157 20581 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:50.873286 20732 raft_consensus.cc:740] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 491eb72eef45486bb35575f2936538d9, State: Running, Role: LEADER
I20260709 12:14:50.874364 20732 consensus_queue.cc:260] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:50.875622 20732 raft_consensus.cc:3060] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:50.879926 20581 raft_consensus.cc:2468] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:50.881209 21352 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7; no voters: 
I20260709 12:14:50.882340 21683 raft_consensus.cc:2804] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:50.882659 20732 raft_consensus.cc:2468] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ca675f8ab8b49e2b275294280376184 in term 3.
I20260709 12:14:50.883138 21683 raft_consensus.cc:697] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Becoming Leader. State: Replica: 2ca675f8ab8b49e2b275294280376184, State: Running, Role: LEADER
I20260709 12:14:50.884141 21683 consensus_queue.cc:237] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:50.899299 20407 catalog_manager.cc:5697] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 reported cstate change: term changed from 2 to 3, leader changed from 491eb72eef45486bb35575f2936538d9 (127.9.180.132) to 2ca675f8ab8b49e2b275294280376184 (127.9.180.129). New cstate: current_term: 3 leader_uuid: "2ca675f8ab8b49e2b275294280376184" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.933703 20581 raft_consensus.cc:1275] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:50.935245 21670 consensus_queue.cc:1048] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:50.962790 20658 raft_consensus.cc:1275] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:50.965030 21683 consensus_queue.cc:1048] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:51.318178 20576 raft_consensus.cc:1275] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:51.319943 21683 consensus_queue.cc:1048] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:51.336938 20732 raft_consensus.cc:1275] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Refusing update from remote peer 2ca675f8ab8b49e2b275294280376184: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:51.340914 21717 consensus_queue.cc:1048] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [LEADER]: Connected to new peer: Peer: permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:51.380713  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:51.424775  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:51.425870  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:51.426323  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:51.461761  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:51.498186  9938 tablet_server.cc:179] TabletServer@127.9.180.129:34503 shutting down...
W20260709 12:14:51.507916 20549 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 321 similar messages]
W20260709 12:14:51.519616 20549 consensus_peers.cc:597] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.545053  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:51.546599  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.547544  9938 raft_consensus.cc:2243] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.548125  9938 raft_consensus.cc:2272] T 1d300af02eb347b3a365e6c636b8e9ed P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.552156  9938 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:51.552796 20623 consensus_peers.cc:597] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.553293  9938 raft_consensus.cc:2243] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.554033  9938 raft_consensus.cc:2272] T 09a0ecf5d0874c90adf810893870a790 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.555998 20549 consensus_peers.cc:597] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.557845  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.558750  9938 raft_consensus.cc:2243] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.559245  9938 raft_consensus.cc:2272] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.562417  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.563120  9938 raft_consensus.cc:2243] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.564208  9938 raft_consensus.cc:2272] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.567692  9938 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:51.567880 20549 consensus_peers.cc:597] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.568315  9938 raft_consensus.cc:2243] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.569265  9938 raft_consensus.cc:2272] T 4477cac83a7e48809a693422fbd5b28a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.572120  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.572965  9938 raft_consensus.cc:2243] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.573585  9938 raft_consensus.cc:2272] T b76fe14c9d9a411b8077b228665e6008 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.577067  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.577925  9938 raft_consensus.cc:2243] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.579219  9938 raft_consensus.cc:2272] T 98538592057b4546a7267066f54c5732 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.582541  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.583650  9938 raft_consensus.cc:2243] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.584826  9938 raft_consensus.cc:2272] T 74580946c1b34dca8f017310b582f20c P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.587843  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.588572  9938 raft_consensus.cc:2243] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:14:51.588881 20623 consensus_peers.cc:597] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.589835  9938 raft_consensus.cc:2272] T 59de2302cbac41d593cde64fe0aad5d8 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.591584 20697 consensus_peers.cc:597] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.592715  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.593547  9938 raft_consensus.cc:2243] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.594005  9938 raft_consensus.cc:2272] T 7be7972679734f9ea94cced565e677c6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.596455  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.597107  9938 raft_consensus.cc:2243] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.597502  9938 raft_consensus.cc:2272] T 0c1aa42341cf4cefb9820116cc711eaf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.599908  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.600824  9938 raft_consensus.cc:2243] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.601925  9938 raft_consensus.cc:2272] T a86b5f8a698448b3acb2cbe9320acf4a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.605410 20697 consensus_peers.cc:597] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.605558  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.606772  9938 raft_consensus.cc:2243] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.607270  9938 raft_consensus.cc:2272] T 91424c9e0aab4fc6a3b15c6359edbf9e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.609712  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.610561  9938 raft_consensus.cc:2243] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.611408  9938 raft_consensus.cc:2272] T 6d424a0defe14912990a5576d69fb1bb P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.613971  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.614856  9938 raft_consensus.cc:2243] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.615896  9938 raft_consensus.cc:2272] T 74e746c068884fe09a59543355686d5f P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.617708 20549 consensus_peers.cc:597] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.618958  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.619931  9938 raft_consensus.cc:2243] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.620909  9938 raft_consensus.cc:2272] T c15c10d8005c4037b36a80fec3ac32d7 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.624795  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.625413  9938 raft_consensus.cc:2243] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.625880  9938 raft_consensus.cc:2272] T b7a1a775a88343de81c5bc5f5bdb1b85 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.628539  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.629312  9938 raft_consensus.cc:2243] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.630263  9938 raft_consensus.cc:2272] T 1372644e1ccf4558882a325df32b0a84 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.633638  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.634476  9938 raft_consensus.cc:2243] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.635020  9938 raft_consensus.cc:2272] T 7bd5ef95d6fb4ce880377ca28d298a81 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.637588  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.638195  9938 raft_consensus.cc:2243] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.638648  9938 raft_consensus.cc:2272] T df74870926dd4e4a98d23dcda857942a P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.641148  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.641881  9938 raft_consensus.cc:2243] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.642365  9938 raft_consensus.cc:2272] T 9b3947f06087460cbf1b9149f8e20daf P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.644758  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.645318  9938 raft_consensus.cc:2243] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.645767  9938 raft_consensus.cc:2272] T 0b60bfb738d7452f8eed2ef5de1209f5 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.648085  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.648666  9938 raft_consensus.cc:2243] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.649078  9938 raft_consensus.cc:2272] T 46c3ec756598438db6b68df006b111ef P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.651234  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.651782  9938 raft_consensus.cc:2243] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.652237  9938 raft_consensus.cc:2272] T f48d7ba791884a2daf277f9c261b1405 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.654534  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.655092  9938 raft_consensus.cc:2243] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.655560  9938 raft_consensus.cc:2272] T 97b49c22a2f045d083b793ec9a932dd0 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.657629  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.658191  9938 raft_consensus.cc:2243] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.658697  9938 raft_consensus.cc:2272] T 47835231a92d4f15accf212d579f7d6e P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.660810  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.661401  9938 raft_consensus.cc:2243] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.662195  9938 raft_consensus.cc:2272] T 18c9fc057a5146cc8d2ea60658b76b68 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.664870  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.665475  9938 raft_consensus.cc:2243] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.665899  9938 raft_consensus.cc:2272] T e142dcf7243c48a5a62d1a8b2cae011c P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.668104  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.668686  9938 raft_consensus.cc:2243] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.669183  9938 raft_consensus.cc:2272] T 44a303f022ac4e27aed72a4e2a4067d5 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.671669  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.672227  9938 raft_consensus.cc:2243] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.672616  9938 raft_consensus.cc:2272] T 7403d046fdc74d9aa962b9cd7c64f41b P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.674698  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.675249  9938 raft_consensus.cc:2243] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.675688  9938 raft_consensus.cc:2272] T d16e210fa30f4a9d971b30b7e5439515 P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.677704  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.678287  9938 raft_consensus.cc:2243] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.678777  9938 raft_consensus.cc:2272] T 48011569942a40d1aa1ebe657707a381 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.681201  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.681950  9938 raft_consensus.cc:2243] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.682458  9938 raft_consensus.cc:2272] T a8c315ff4fd74be5a73f34e66c452920 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.685576  9938 tablet_replica.cc:333] stopping tablet replica
W20260709 12:14:51.685823 20549 consensus_peers.cc:597] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.686352 20697 consensus_peers.cc:597] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.686349  9938 raft_consensus.cc:2243] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.688105  9938 raft_consensus.cc:2272] T 52d9fef03cd64257b9d1812dbdec74cf P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.690821  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.691654  9938 raft_consensus.cc:2243] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:51.691664 20623 consensus_peers.cc:597] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.692226  9938 raft_consensus.cc:2272] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.694530  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.695094  9938 raft_consensus.cc:2243] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.695487  9938 raft_consensus.cc:2272] T 8e744c13d5a84d18965663d8e15147b8 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.697592  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.698139  9938 raft_consensus.cc:2243] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.698586  9938 raft_consensus.cc:2272] T 11c20742313b4aeeb03cc3df575852e1 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.701689  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.702517  9938 raft_consensus.cc:2243] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.702920  9938 raft_consensus.cc:2272] T da27acfc34b4452b95b09724ccd054ac P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.705062  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.705597  9938 raft_consensus.cc:2243] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.706029  9938 raft_consensus.cc:2272] T 684797a7958648ebb2abe2ea5d62a4ab P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.708313  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.708894  9938 raft_consensus.cc:2243] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:51.709714  9938 raft_consensus.cc:2272] T 9f124d084cc54b6ab38cbb14dd6b3919 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.711876  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.712410  9938 raft_consensus.cc:2243] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.712842  9938 raft_consensus.cc:2272] T e63b44fdabd6441ea3397fea5da63694 P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.715441  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.715981  9938 raft_consensus.cc:2243] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.716378  9938 raft_consensus.cc:2272] T 9c5066470d3b4a1bad58285cfaad4b11 P 2ca675f8ab8b49e2b275294280376184 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.718604  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.719103  9938 raft_consensus.cc:2243] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.719585  9938 raft_consensus.cc:2272] T 24b9972f873044ed82799e7051a8f79c P 2ca675f8ab8b49e2b275294280376184 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.722496  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.723224  9938 raft_consensus.cc:2243] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:14:51.723875 20623 consensus_peers.cc:597] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.724294  9938 raft_consensus.cc:2272] T 5fd837fa16b64d78b8142773b317ff3f P 2ca675f8ab8b49e2b275294280376184 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:51.726780  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:51.727296  9938 raft_consensus.cc:2243] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:51.727743  9938 raft_consensus.cc:2272] T 3e74df625baa4137a2f384e41c185f8a P 2ca675f8ab8b49e2b275294280376184 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:51.774729 20549 consensus_peers.cc:597] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.807312  9938 tablet_server.cc:196] TabletServer@127.9.180.129:34503 shutdown complete.
W20260709 12:14:51.808760 20697 consensus_peers.cc:597] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.831396 20623 consensus_peers.cc:597] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.833331 20697 consensus_peers.cc:597] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.869896 20549 consensus_peers.cc:597] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.875226 20549 consensus_peers.cc:597] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.883699 20549 consensus_peers.cc:597] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.887394 20549 consensus_peers.cc:597] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.905334 20697 consensus_peers.cc:597] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.924397  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
W20260709 12:14:51.925143 20623 consensus_peers.cc:597] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.931303 20623 consensus_peers.cc:597] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.936566 20697 consensus_peers.cc:597] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.938920 20623 consensus_peers.cc:597] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.958133 20549 consensus_peers.cc:597] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.961490 20622 consensus_peers.cc:597] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.973847 20623 consensus_peers.cc:597] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.983624 20623 consensus_peers.cc:597] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.996243  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:51.999704  9938 tablet_replica.cc:333] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.000643  9938 raft_consensus.cc:2243] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.001206  9938 raft_consensus.cc:2272] T 1d300af02eb347b3a365e6c636b8e9ed P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.004436  9938 tablet_replica.cc:333] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.005242  9938 raft_consensus.cc:2243] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.005818  9938 raft_consensus.cc:2272] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.007664 20697 consensus_peers.cc:597] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.008735  9938 tablet_replica.cc:333] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
W20260709 12:14:52.008651 20696 consensus_peers.cc:597] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.009644  9938 raft_consensus.cc:2243] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.010583  9938 raft_consensus.cc:2272] T 44a303f022ac4e27aed72a4e2a4067d5 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.012961  9938 tablet_replica.cc:333] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.013809  9938 raft_consensus.cc:2243] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.014376  9938 raft_consensus.cc:2272] T 4477cac83a7e48809a693422fbd5b28a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.016073 20622 consensus_peers.cc:597] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.017007  9938 tablet_replica.cc:333] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.017738  9938 raft_consensus.cc:2243] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.018648  9938 raft_consensus.cc:2272] T d25019682b2f4f4598912e1bee5d76e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.021194  9938 tablet_replica.cc:333] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.021986  9938 raft_consensus.cc:2243] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.022617  9938 raft_consensus.cc:2272] T 98538592057b4546a7267066f54c5732 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.025624  9938 tablet_replica.cc:333] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.026521  9938 raft_consensus.cc:2243] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.027616  9938 raft_consensus.cc:2272] T e142dcf7243c48a5a62d1a8b2cae011c P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.028898 20696 consensus_peers.cc:597] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.030150 20623 consensus_peers.cc:597] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.030614  9938 tablet_replica.cc:333] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.031461  9938 raft_consensus.cc:2243] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.031911  9938 raft_consensus.cc:2272] T 18c9fc057a5146cc8d2ea60658b76b68 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.034217  9938 tablet_replica.cc:333] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.034878  9938 raft_consensus.cc:2243] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.035308  9938 raft_consensus.cc:2272] T c05ace43443b44cb8bc3ac3955248269 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.037176  9938 tablet_replica.cc:333] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.037750  9938 raft_consensus.cc:2243] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.038157  9938 raft_consensus.cc:2272] T a86b5f8a698448b3acb2cbe9320acf4a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.040273  9938 tablet_replica.cc:333] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.041152  9938 raft_consensus.cc:2243] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.041712  9938 raft_consensus.cc:2272] T 91424c9e0aab4fc6a3b15c6359edbf9e P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.044763  9938 tablet_replica.cc:333] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.045413  9938 raft_consensus.cc:2243] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.046409  9938 raft_consensus.cc:2272] T 292e7809bb4a42639e34ae1cf67f2541 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.048583  9938 tablet_replica.cc:333] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.049352  9938 raft_consensus.cc:2243] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.049846  9938 raft_consensus.cc:2272] T 7816f77dbdd34454829a05b79e59e7f2 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.051651 20622 consensus_peers.cc:597] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.052712  9938 tablet_replica.cc:333] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.053426  9938 raft_consensus.cc:2243] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.054035  9938 raft_consensus.cc:2272] T 52d9fef03cd64257b9d1812dbdec74cf P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.074512 20696 consensus_peers.cc:597] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.072567 20697 consensus_peers.cc:597] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 -> Peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Couldn't send request to peer 2ca675f8ab8b49e2b275294280376184. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.113155  9938 tablet_replica.cc:333] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.116616  9938 raft_consensus.cc:2243] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.118347  9938 raft_consensus.cc:2272] T 4dd2f2e25de645878298811e12c1eefe P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.123291 20622 consensus_peers.cc:597] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.126952  9938 tablet_replica.cc:333] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.129022  9938 raft_consensus.cc:2243] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:14:52.131651 20696 consensus_peers.cc:597] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.132781 20696 consensus_peers.cc:597] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.134800  9938 raft_consensus.cc:2272] T 2a44462e219640a88b4641e632a284c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.141005  9938 tablet_replica.cc:333] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.145720  9938 raft_consensus.cc:2243] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.147320  9938 raft_consensus.cc:2272] T 97b49c22a2f045d083b793ec9a932dd0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.155520  9938 tablet_replica.cc:333] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.156915  9938 raft_consensus.cc:2243] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.158136  9938 raft_consensus.cc:2272] T 9752dcdc33454bf381a9c8a0e91910e0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.163882  9938 tablet_replica.cc:333] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.166393  9938 raft_consensus.cc:2243] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.169000  9938 raft_consensus.cc:2272] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.171561 20696 consensus_peers.cc:597] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.174273  9938 tablet_replica.cc:333] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.176373  9938 raft_consensus.cc:2243] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.177512  9938 raft_consensus.cc:2272] T 8e744c13d5a84d18965663d8e15147b8 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.182751  9938 tablet_replica.cc:333] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.184175  9938 raft_consensus.cc:2243] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.185374  9938 raft_consensus.cc:2272] T 11c20742313b4aeeb03cc3df575852e1 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.188611 20622 consensus_peers.cc:597] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.190348  9938 tablet_replica.cc:333] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.191715  9938 raft_consensus.cc:2243] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.194416  9938 raft_consensus.cc:2272] T 24b9972f873044ed82799e7051a8f79c P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.199103  9938 tablet_replica.cc:333] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.200249  9938 raft_consensus.cc:2243] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.201453  9938 raft_consensus.cc:2272] T 9c5066470d3b4a1bad58285cfaad4b11 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.206382  9938 tablet_replica.cc:333] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.207620  9938 raft_consensus.cc:2243] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:52.207660 20622 consensus_peers.cc:597] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.208679  9938 raft_consensus.cc:2272] T 7403d046fdc74d9aa962b9cd7c64f41b P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.212311  9938 tablet_replica.cc:333] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.213271  9938 raft_consensus.cc:2243] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.214071  9938 raft_consensus.cc:2272] T 5fd837fa16b64d78b8142773b317ff3f P d45ade27487a47c990a6f9d0fa4a86c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.217389  9938 tablet_replica.cc:333] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.218065  9938 raft_consensus.cc:2243] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.219416  9938 raft_consensus.cc:2272] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.223488  9938 tablet_replica.cc:333] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.224232  9938 raft_consensus.cc:2243] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.225169  9938 raft_consensus.cc:2272] T 1d16336d75934db78f1ee7b4aaf2d760 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.229439  9938 tablet_replica.cc:333] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.230602  9938 raft_consensus.cc:2243] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.231662  9938 raft_consensus.cc:2272] T a8c315ff4fd74be5a73f34e66c452920 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.235659  9938 tablet_replica.cc:333] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.236256  9938 raft_consensus.cc:2243] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.237408  9938 raft_consensus.cc:2272] T 51b188093e7f4e49b475a039b4dc0022 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.238103 20622 consensus_peers.cc:597] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.241024  9938 tablet_replica.cc:333] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.242084  9938 raft_consensus.cc:2243] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.244340  9938 raft_consensus.cc:2272] T f48d7ba791884a2daf277f9c261b1405 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.248346  9938 tablet_replica.cc:333] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.249006  9938 raft_consensus.cc:2243] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.249634  9938 raft_consensus.cc:2272] T a7ec97c769014205af4764e131c2ba36 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.252861  9938 tablet_replica.cc:333] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.253528  9938 raft_consensus.cc:2243] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.254225  9938 raft_consensus.cc:2272] T c15c10d8005c4037b36a80fec3ac32d7 P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.256754  9938 tablet_replica.cc:333] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.257349  9938 raft_consensus.cc:2243] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.257890  9938 raft_consensus.cc:2272] T 74e746c068884fe09a59543355686d5f P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.260258  9938 tablet_replica.cc:333] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.260919  9938 raft_consensus.cc:2243] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.261536  9938 raft_consensus.cc:2272] T c68b8d772da049a19db34b2f00090efe P d45ade27487a47c990a6f9d0fa4a86c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.263784  9938 tablet_replica.cc:333] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.264326  9938 raft_consensus.cc:2243] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.265496  9938 raft_consensus.cc:2272] T 48011569942a40d1aa1ebe657707a381 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.267745  9938 tablet_replica.cc:333] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.268267  9938 raft_consensus.cc:2243] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.269268  9938 raft_consensus.cc:2272] T d16e210fa30f4a9d971b30b7e5439515 P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.271739  9938 tablet_replica.cc:333] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.272264  9938 raft_consensus.cc:2243] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.272774  9938 raft_consensus.cc:2272] T 91e700eae1d14008b9b5f277207b7f47 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.275113  9938 tablet_replica.cc:333] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.275671  9938 raft_consensus.cc:2243] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.277583  9938 raft_consensus.cc:2272] T 0c1aa42341cf4cefb9820116cc711eaf P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.281867  9938 tablet_replica.cc:333] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.282722  9938 raft_consensus.cc:2243] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.283552  9938 raft_consensus.cc:2272] T 7be7972679734f9ea94cced565e677c6 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.282815 20696 consensus_peers.cc:597] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.287700  9938 tablet_replica.cc:333] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.288535  9938 raft_consensus.cc:2243] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.289928  9938 raft_consensus.cc:2272] T 09a0ecf5d0874c90adf810893870a790 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.291517 20696 consensus_peers.cc:597] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.295238  9938 tablet_replica.cc:333] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.296218  9938 raft_consensus.cc:2243] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.297053  9938 raft_consensus.cc:2272] T b327ac80d17949f8aa3f002cf22986ab P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.300952  9938 tablet_replica.cc:333] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.301652  9938 raft_consensus.cc:2243] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.303105  9938 raft_consensus.cc:2272] T b76fe14c9d9a411b8077b228665e6008 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.306033  9938 tablet_replica.cc:333] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.306797  9938 raft_consensus.cc:2243] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.307396  9938 raft_consensus.cc:2272] T 3e74df625baa4137a2f384e41c185f8a P d45ade27487a47c990a6f9d0fa4a86c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.309916  9938 tablet_replica.cc:333] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7: stopping tablet replica
I20260709 12:14:52.310644  9938 raft_consensus.cc:2243] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.311462  9938 raft_consensus.cc:2272] T e708e6dd44c04400839f898100989df0 P d45ade27487a47c990a6f9d0fa4a86c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.343971 20622 consensus_peers.cc:597] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.369535 20696 consensus_peers.cc:597] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.375161 20696 consensus_peers.cc:597] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.390908 20696 consensus_peers.cc:597] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.474831  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
W20260709 12:14:52.536762 20622 consensus_peers.cc:597] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda -> Peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Couldn't send request to peer d45ade27487a47c990a6f9d0fa4a86c7. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.545542 21727 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.546653 21727 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:52.549635 21727 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 491eb72eef45486bb35575f2936538d9 (127.9.180.132:40653), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:52.553119 20733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74580946c1b34dca8f017310b582f20c" candidate_uuid: "ea25df1d72fa4708887246c33c9efcda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "491eb72eef45486bb35575f2936538d9" is_pre_election: true
W20260709 12:14:52.559933 20623 leader_election.cc:336] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.560595 20623 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, 491eb72eef45486bb35575f2936538d9
I20260709 12:14:52.561630 21727 raft_consensus.cc:2749] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:52.651131  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
I20260709 12:14:52.689927 21727 raft_consensus.cc:493] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.690793 21727 raft_consensus.cc:515] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:52.694357 21739 raft_consensus.cc:493] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.695092 21739 raft_consensus.cc:515] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:52.697866 21739 leader_election.cc:290] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:52.699136 20622 leader_election.cc:336] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.700596 21727 leader_election.cc:290] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
W20260709 12:14:52.704879 20623 leader_election.cc:336] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:52.703029 20622 leader_election.cc:336] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.705483 20623 leader_election.cc:304] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.708127 21727 raft_consensus.cc:2749] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:52.709120 20623 leader_election.cc:336] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.709697 20623 leader_election.cc:304] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.710613 21727 raft_consensus.cc:2749] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:52.716619  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:52.717715  9938 tablet_replica.cc:333] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.718945  9938 raft_consensus.cc:2243] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.719969  9938 raft_consensus.cc:2272] T 1d300af02eb347b3a365e6c636b8e9ed P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.722316  9938 tablet_replica.cc:333] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.723044  9938 raft_consensus.cc:2243] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.723594  9938 raft_consensus.cc:2272] T 9752dcdc33454bf381a9c8a0e91910e0 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.726050  9938 tablet_replica.cc:333] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.726676  9938 raft_consensus.cc:2243] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.727047 21727 raft_consensus.cc:493] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.727267  9938 raft_consensus.cc:2272] T 6d424a0defe14912990a5576d69fb1bb P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.727774 21727 raft_consensus.cc:515] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } } peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } }
I20260709 12:14:52.730296  9938 tablet_replica.cc:333] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.730886 21727 leader_election.cc:290] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:52.731304  9938 raft_consensus.cc:2243] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.732066  9938 raft_consensus.cc:2272] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.735499  9938 tablet_replica.cc:333] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.736435  9938 raft_consensus.cc:2243] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.737066  9938 raft_consensus.cc:2272] T c05ace43443b44cb8bc3ac3955248269 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.737468 20622 leader_election.cc:336] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.740569  9938 tablet_replica.cc:333] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.741557  9938 raft_consensus.cc:2243] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.742471  9938 raft_consensus.cc:2272] T d25019682b2f4f4598912e1bee5d76e1 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.745879  9938 tablet_replica.cc:333] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
W20260709 12:14:52.745879 20623 leader_election.cc:336] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.746816 20623 leader_election.cc:304] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea25df1d72fa4708887246c33c9efcda; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.747149  9938 raft_consensus.cc:2243] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:52.747488 20623 raft_consensus.cc:2686] T 4477cac83a7e48809a693422fbd5b28a P ea25df1d72fa4708887246c33c9efcda: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:52.747998  9938 raft_consensus.cc:2272] T 7816f77dbdd34454829a05b79e59e7f2 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.751516  9938 tablet_replica.cc:333] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.752200  9938 raft_consensus.cc:2243] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.752815  9938 raft_consensus.cc:2272] T 98538592057b4546a7267066f54c5732 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.755402  9938 tablet_replica.cc:333] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.756028  9938 raft_consensus.cc:2243] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.757025  9938 raft_consensus.cc:2272] T 91424c9e0aab4fc6a3b15c6359edbf9e P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.760113  9938 tablet_replica.cc:333] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.760934  9938 raft_consensus.cc:2243] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.761719  9938 raft_consensus.cc:2272] T 292e7809bb4a42639e34ae1cf67f2541 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.765441  9938 tablet_replica.cc:333] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.766294  9938 raft_consensus.cc:2243] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.767705  9938 raft_consensus.cc:2272] T 9c5066470d3b4a1bad58285cfaad4b11 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.770637  9938 tablet_replica.cc:333] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.771355  9938 raft_consensus.cc:2243] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.771932  9938 raft_consensus.cc:2272] T 59de2302cbac41d593cde64fe0aad5d8 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.774780  9938 tablet_replica.cc:333] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.775398  9938 raft_consensus.cc:2243] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.776530  9938 raft_consensus.cc:2272] T 4dd2f2e25de645878298811e12c1eefe P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.778929 20696 consensus_peers.cc:597] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.779804  9938 tablet_replica.cc:333] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.780702  9938 raft_consensus.cc:2243] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.781845  9938 raft_consensus.cc:2272] T 7be7972679734f9ea94cced565e677c6 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.784857  9938 tablet_replica.cc:333] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.785627  9938 raft_consensus.cc:2243] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.786192  9938 raft_consensus.cc:2272] T 0c1aa42341cf4cefb9820116cc711eaf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.788865  9938 tablet_replica.cc:333] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.789592  9938 raft_consensus.cc:2243] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.790073 21736 raft_consensus.cc:493] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.790868  9938 raft_consensus.cc:2272] T 46c3ec756598438db6b68df006b111ef P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.790925 21736 raft_consensus.cc:515] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:52.793646 21736 leader_election.cc:290] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:52.794209  9938 tablet_replica.cc:333] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.795576  9938 raft_consensus.cc:2243] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.796240  9938 raft_consensus.cc:2272] T 7bd5ef95d6fb4ce880377ca28d298a81 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.799214  9938 tablet_replica.cc:333] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.800103  9938 raft_consensus.cc:2243] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:14:52.800525 20696 leader_election.cc:336] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
W20260709 12:14:52.801280 20697 leader_election.cc:336] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.801311  9938 raft_consensus.cc:2272] T 1d16336d75934db78f1ee7b4aaf2d760 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.801927 20697 leader_election.cc:304] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.803339 21736 raft_consensus.cc:2749] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:52.803776 20696 consensus_peers.cc:597] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.804972  9938 tablet_replica.cc:333] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.805797  9938 raft_consensus.cc:2243] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.806383  9938 raft_consensus.cc:2272] T 51b188093e7f4e49b475a039b4dc0022 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.809458  9938 tablet_replica.cc:333] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.810195  9938 raft_consensus.cc:2243] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.811301  9938 raft_consensus.cc:2272] T 9b3947f06087460cbf1b9149f8e20daf P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.814368  9938 tablet_replica.cc:333] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.815292  9938 raft_consensus.cc:2243] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.816412  9938 raft_consensus.cc:2272] T df74870926dd4e4a98d23dcda857942a P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.819399  9938 tablet_replica.cc:333] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.820119  9938 raft_consensus.cc:2243] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.820652  9938 raft_consensus.cc:2272] T 0b60bfb738d7452f8eed2ef5de1209f5 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.823127  9938 tablet_replica.cc:333] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.823848  9938 raft_consensus.cc:2243] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.824355  9938 raft_consensus.cc:2272] T 74580946c1b34dca8f017310b582f20c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.827052  9938 tablet_replica.cc:333] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.827816  9938 raft_consensus.cc:2243] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.828411  9938 raft_consensus.cc:2272] T c68b8d772da049a19db34b2f00090efe P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.831159  9938 tablet_replica.cc:333] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.831853  9938 raft_consensus.cc:2243] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.832964  9938 raft_consensus.cc:2272] T 91e700eae1d14008b9b5f277207b7f47 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.835978  9938 tablet_replica.cc:333] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.836745  9938 raft_consensus.cc:2243] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.837404  9938 raft_consensus.cc:2272] T d16e210fa30f4a9d971b30b7e5439515 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.840283  9938 tablet_replica.cc:333] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.841018  9938 raft_consensus.cc:2243] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.841583  9938 raft_consensus.cc:2272] T e708e6dd44c04400839f898100989df0 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.844527  9938 tablet_replica.cc:333] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.845213  9938 raft_consensus.cc:2243] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.845839  9938 raft_consensus.cc:2272] T e142dcf7243c48a5a62d1a8b2cae011c P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.846585 21736 raft_consensus.cc:493] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.847539 21736 raft_consensus.cc:515] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:52.848816  9938 tablet_replica.cc:333] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.850869  9938 raft_consensus.cc:2243] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.851583  9938 raft_consensus.cc:2272] T 18c9fc057a5146cc8d2ea60658b76b68 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.852212 21736 leader_election.cc:290] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:52.854918  9938 tablet_replica.cc:333] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.855926  9938 raft_consensus.cc:2243] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.856542  9938 raft_consensus.cc:2272] T 47835231a92d4f15accf212d579f7d6e P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.859027 20696 leader_election.cc:336] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.859586  9938 tablet_replica.cc:333] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
W20260709 12:14:52.859608 20697 leader_election.cc:336] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.860350 20697 leader_election.cc:304] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.860512  9938 raft_consensus.cc:2243] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.861696  9938 raft_consensus.cc:2272] T 3e74df625baa4137a2f384e41c185f8a P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.862273 21736 raft_consensus.cc:2749] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:52.864543  9938 tablet_replica.cc:333] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.865368  9938 raft_consensus.cc:2243] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.865932  9938 raft_consensus.cc:2272] T 9f124d084cc54b6ab38cbb14dd6b3919 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.867959  9938 tablet_replica.cc:333] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.868745  9938 raft_consensus.cc:2243] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.869225  9938 raft_consensus.cc:2272] T e63b44fdabd6441ea3397fea5da63694 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.871464  9938 tablet_replica.cc:333] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.872007  9938 raft_consensus.cc:2243] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.872895  9938 raft_consensus.cc:2272] T da27acfc34b4452b95b09724ccd054ac P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.875032  9938 tablet_replica.cc:333] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.875653  9938 raft_consensus.cc:2243] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.876845  9938 raft_consensus.cc:2272] T 684797a7958648ebb2abe2ea5d62a4ab P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.879802  9938 tablet_replica.cc:333] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
W20260709 12:14:52.879701 20696 consensus_peers.cc:597] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.880836  9938 raft_consensus.cc:2243] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.881474  9938 raft_consensus.cc:2272] T f74b64599c6f4b7a8b7e745cd3cf8bf3 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.884600  9938 tablet_replica.cc:333] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.885456  9938 raft_consensus.cc:2243] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.885982  9938 raft_consensus.cc:2272] T 2a44462e219640a88b4641e632a284c6 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.888386  9938 tablet_replica.cc:333] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.888465 21740 raft_consensus.cc:493] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.889200  9938 raft_consensus.cc:2243] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.889194 21740 raft_consensus.cc:515] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:52.889912  9938 raft_consensus.cc:2272] T b76fe14c9d9a411b8077b228665e6008 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.891393 21740 leader_election.cc:290] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:52.892926  9938 tablet_replica.cc:333] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.893769  9938 raft_consensus.cc:2243] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.894374  9938 raft_consensus.cc:2272] T b327ac80d17949f8aa3f002cf22986ab P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.894681 20696 leader_election.cc:336] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:52.896173 20697 leader_election.cc:336] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.896591 20697 leader_election.cc:304] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:52.896888  9938 tablet_replica.cc:333] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.897266 21740 raft_consensus.cc:2749] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:52.897656  9938 raft_consensus.cc:2243] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.898268  9938 raft_consensus.cc:2272] T 1372644e1ccf4558882a325df32b0a84 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.900266  9938 tablet_replica.cc:333] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.900723  9938 raft_consensus.cc:2243] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.901089  9938 raft_consensus.cc:2272] T c15c10d8005c4037b36a80fec3ac32d7 P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.903182  9938 tablet_replica.cc:333] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.903780  9938 raft_consensus.cc:2243] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:52.904261  9938 raft_consensus.cc:2272] T 74e746c068884fe09a59543355686d5f P ea25df1d72fa4708887246c33c9efcda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.907253  9938 tablet_replica.cc:333] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.907981  9938 raft_consensus.cc:2243] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.907910 21740 raft_consensus.cc:493] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.909576  9938 raft_consensus.cc:2272] T b7a1a775a88343de81c5bc5f5bdb1b85 P ea25df1d72fa4708887246c33c9efcda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:52.909580 21740 raft_consensus.cc:515] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:52.911316 21716 raft_consensus.cc:493] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.911923 21716 raft_consensus.cc:515] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:52.912793 21740 leader_election.cc:290] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:52.912916  9938 tablet_replica.cc:333] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda: stopping tablet replica
I20260709 12:14:52.914201  9938 raft_consensus.cc:2243] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:52.914198 21716 leader_election.cc:290] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:52.915529  9938 raft_consensus.cc:2272] T a7ec97c769014205af4764e131c2ba36 P ea25df1d72fa4708887246c33c9efcda [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:52.920799 20697 leader_election.cc:336] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:52.922180 21716 raft_consensus.cc:493] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d45ade27487a47c990a6f9d0fa4a86c7)
I20260709 12:14:52.922847 21716 raft_consensus.cc:515] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
W20260709 12:14:52.924132 20696 leader_election.cc:336] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.924716 20696 leader_election.cc:304] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.925427 21716 leader_election.cc:290] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:52.925578 21740 raft_consensus.cc:2749] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:52.926146 20696 consensus_peers.cc:597] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:52.921530 20697 leader_election.cc:336] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:52.926887 20696 leader_election.cc:336] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:52.927323 20696 leader_election.cc:304] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:52.929004 21740 raft_consensus.cc:2749] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:52.933022 20697 leader_election.cc:336] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:52.934952 20696 leader_election.cc:336] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.935452 20696 leader_election.cc:304] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.936369 21740 raft_consensus.cc:2749] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:52.969043 20696 consensus_peers.cc:597] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.984719 21740 raft_consensus.cc:493] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.987826 21740 raft_consensus.cc:515] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } } peers { permanent_uuid: "d45ade27487a47c990a6f9d0fa4a86c7" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 35285 } }
I20260709 12:14:52.988097 21716 raft_consensus.cc:493] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.988808 21716 raft_consensus.cc:515] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:52.989892 21740 leader_election.cc:290] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503), d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285)
I20260709 12:14:52.990799 21716 leader_election.cc:290] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:52.994431 20697 leader_election.cc:336] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:52.995121 20697 leader_election.cc:336] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
W20260709 12:14:52.996707 20696 leader_election.cc:336] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d45ade27487a47c990a6f9d0fa4a86c7 (127.9.180.130:35285): Network error: Client connection negotiation failed: client connection to 127.9.180.130:35285: connect: Connection refused (error 111)
I20260709 12:14:52.996694 21716 raft_consensus.cc:493] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:52.997334 20696 leader_election.cc:304] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, d45ade27487a47c990a6f9d0fa4a86c7
I20260709 12:14:52.997478 21716 raft_consensus.cc:515] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:52.998119 21736 raft_consensus.cc:2749] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:52.999361 20696 leader_election.cc:336] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111)
I20260709 12:14:52.999716 20696 leader_election.cc:304] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:53.000000 21716 leader_election.cc:290] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
I20260709 12:14:53.000216  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:14:53.000314 21740 raft_consensus.cc:2749] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:53.005796 20696 leader_election.cc:336] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111)
W20260709 12:14:53.011590 20697 leader_election.cc:336] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:53.012167 20697 leader_election.cc:304] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
W20260709 12:14:53.012450 20696 consensus_peers.cc:597] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.013082 21716 raft_consensus.cc:2749] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:53.076207  9938 tablet_server.cc:179] TabletServer@127.9.180.132:0 shutting down...
W20260709 12:14:53.108521 20696 consensus_peers.cc:597] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.108472 21716 raft_consensus.cc:493] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ca675f8ab8b49e2b275294280376184)
I20260709 12:14:53.109596 21716 raft_consensus.cc:515] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea25df1d72fa4708887246c33c9efcda" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 32887 } } peers { permanent_uuid: "491eb72eef45486bb35575f2936538d9" member_type: VOTER last_known_addr { host: "127.9.180.132" port: 40653 } } peers { permanent_uuid: "2ca675f8ab8b49e2b275294280376184" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 34503 } }
I20260709 12:14:53.111820 21716 leader_election.cc:290] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887), 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503)
W20260709 12:14:53.112095 20696 consensus_peers.cc:597] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:53.115190 20696 leader_election.cc:336] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111)
W20260709 12:14:53.116319 20697 leader_election.cc:336] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ca675f8ab8b49e2b275294280376184 (127.9.180.129:34503): Network error: Client connection negotiation failed: client connection to 127.9.180.129:34503: connect: Connection refused (error 111)
I20260709 12:14:53.116783 20697 leader_election.cc:304] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 491eb72eef45486bb35575f2936538d9; no voters: 2ca675f8ab8b49e2b275294280376184, ea25df1d72fa4708887246c33c9efcda
I20260709 12:14:53.117599 21716 raft_consensus.cc:2749] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:53.126369  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:53.127342  9938 tablet_replica.cc:333] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.128206  9938 raft_consensus.cc:2243] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.128713  9938 raft_consensus.cc:2272] T 44a303f022ac4e27aed72a4e2a4067d5 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.131012  9938 tablet_replica.cc:333] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.131573  9938 raft_consensus.cc:2243] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.131999  9938 raft_consensus.cc:2272] T 6a1f44e30cbb4f23bf23cbbe1ea47f74 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.134007  9938 tablet_replica.cc:333] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.134577  9938 raft_consensus.cc:2243] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.134992  9938 raft_consensus.cc:2272] T 6d424a0defe14912990a5576d69fb1bb P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.136907  9938 tablet_replica.cc:333] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.137470  9938 raft_consensus.cc:2243] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.137904  9938 raft_consensus.cc:2272] T d25019682b2f4f4598912e1bee5d76e1 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.140174  9938 tablet_replica.cc:333] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.140704  9938 raft_consensus.cc:2243] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.141480  9938 raft_consensus.cc:2272] T c05ace43443b44cb8bc3ac3955248269 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.143399  9938 tablet_replica.cc:333] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.143927  9938 raft_consensus.cc:2243] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.144646  9938 raft_consensus.cc:2272] T 7816f77dbdd34454829a05b79e59e7f2 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.146430  9938 tablet_replica.cc:333] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.147056  9938 raft_consensus.cc:2243] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.147629  9938 raft_consensus.cc:2272] T 52d9fef03cd64257b9d1812dbdec74cf P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.150264  9938 tablet_replica.cc:333] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.151064  9938 raft_consensus.cc:2243] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.151971  9938 raft_consensus.cc:2272] T 7bd5ef95d6fb4ce880377ca28d298a81 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.152714 20696 consensus_peers.cc:597] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.154974  9938 tablet_replica.cc:333] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.155889  9938 raft_consensus.cc:2243] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.156299  9938 raft_consensus.cc:2272] T a86b5f8a698448b3acb2cbe9320acf4a P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.158209  9938 tablet_replica.cc:333] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.158780  9938 raft_consensus.cc:2243] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.159178  9938 raft_consensus.cc:2272] T 292e7809bb4a42639e34ae1cf67f2541 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.161007  9938 tablet_replica.cc:333] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.161489  9938 raft_consensus.cc:2243] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.161886  9938 raft_consensus.cc:2272] T 59de2302cbac41d593cde64fe0aad5d8 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.163901  9938 tablet_replica.cc:333] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.164685  9938 raft_consensus.cc:2243] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.165212  9938 raft_consensus.cc:2272] T 4dd2f2e25de645878298811e12c1eefe P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.167871  9938 tablet_replica.cc:333] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.168452  9938 raft_consensus.cc:2243] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.169068  9938 raft_consensus.cc:2272] T f48d7ba791884a2daf277f9c261b1405 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.169836 20696 consensus_peers.cc:597] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 -> Peer ea25df1d72fa4708887246c33c9efcda (127.9.180.131:32887): Couldn't send request to peer ea25df1d72fa4708887246c33c9efcda. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.131:32887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.171396  9938 tablet_replica.cc:333] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.172016  9938 raft_consensus.cc:2243] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.172437  9938 raft_consensus.cc:2272] T 46c3ec756598438db6b68df006b111ef P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.174701  9938 tablet_replica.cc:333] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.175310  9938 raft_consensus.cc:2243] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.175868  9938 raft_consensus.cc:2272] T 1d16336d75934db78f1ee7b4aaf2d760 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.178649  9938 tablet_replica.cc:333] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.179386  9938 raft_consensus.cc:2243] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.180210  9938 raft_consensus.cc:2272] T a8c315ff4fd74be5a73f34e66c452920 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.182628  9938 tablet_replica.cc:333] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.183108  9938 raft_consensus.cc:2243] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.183545  9938 raft_consensus.cc:2272] T 51b188093e7f4e49b475a039b4dc0022 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.185312  9938 tablet_replica.cc:333] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.185827  9938 raft_consensus.cc:2243] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.186180  9938 raft_consensus.cc:2272] T a7ec97c769014205af4764e131c2ba36 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.187929  9938 tablet_replica.cc:333] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.188403  9938 raft_consensus.cc:2243] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.188772  9938 raft_consensus.cc:2272] T 9f124d084cc54b6ab38cbb14dd6b3919 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.190573  9938 tablet_replica.cc:333] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.191246  9938 raft_consensus.cc:2243] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.191910  9938 raft_consensus.cc:2272] T 684797a7958648ebb2abe2ea5d62a4ab P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.194865  9938 tablet_replica.cc:333] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.195689  9938 raft_consensus.cc:2243] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.196790  9938 raft_consensus.cc:2272] T e63b44fdabd6441ea3397fea5da63694 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.199246  9938 tablet_replica.cc:333] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.199728  9938 raft_consensus.cc:2243] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.200089  9938 raft_consensus.cc:2272] T da27acfc34b4452b95b09724ccd054ac P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.202302  9938 tablet_replica.cc:333] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.202862  9938 raft_consensus.cc:2243] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.203601  9938 raft_consensus.cc:2272] T 47835231a92d4f15accf212d579f7d6e P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.206274  9938 tablet_replica.cc:333] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.206846  9938 raft_consensus.cc:2243] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.207350  9938 raft_consensus.cc:2272] T 1372644e1ccf4558882a325df32b0a84 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.209900  9938 tablet_replica.cc:333] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.210672  9938 raft_consensus.cc:2243] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.211133  9938 raft_consensus.cc:2272] T b7a1a775a88343de81c5bc5f5bdb1b85 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.213804  9938 tablet_replica.cc:333] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.214602  9938 raft_consensus.cc:2243] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.215420  9938 raft_consensus.cc:2272] T 9752dcdc33454bf381a9c8a0e91910e0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.217348  9938 tablet_replica.cc:333] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.217862  9938 raft_consensus.cc:2243] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.218652  9938 raft_consensus.cc:2272] T 8e744c13d5a84d18965663d8e15147b8 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.220360  9938 tablet_replica.cc:333] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.220891  9938 raft_consensus.cc:2243] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.221314  9938 raft_consensus.cc:2272] T fc0a0b1fae4f4ec18e826e98ecafe0f6 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.223233  9938 tablet_replica.cc:333] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.223675  9938 raft_consensus.cc:2243] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.224359  9938 raft_consensus.cc:2272] T 11c20742313b4aeeb03cc3df575852e1 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.226213  9938 tablet_replica.cc:333] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.226742  9938 raft_consensus.cc:2243] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.227445  9938 raft_consensus.cc:2272] T 97b49c22a2f045d083b793ec9a932dd0 P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.229426  9938 tablet_replica.cc:333] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.229969  9938 raft_consensus.cc:2243] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.230363  9938 raft_consensus.cc:2272] T 2a44462e219640a88b4641e632a284c6 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.232497  9938 tablet_replica.cc:333] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.233134  9938 raft_consensus.cc:2243] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.233949  9938 raft_consensus.cc:2272] T c68b8d772da049a19db34b2f00090efe P 491eb72eef45486bb35575f2936538d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.236120  9938 tablet_replica.cc:333] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.236686  9938 raft_consensus.cc:2243] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.237155  9938 raft_consensus.cc:2272] T 48011569942a40d1aa1ebe657707a381 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.239212  9938 tablet_replica.cc:333] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.239768  9938 raft_consensus.cc:2243] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.240226  9938 raft_consensus.cc:2272] T 91e700eae1d14008b9b5f277207b7f47 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.242161  9938 tablet_replica.cc:333] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.242758  9938 raft_consensus.cc:2243] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.243273  9938 raft_consensus.cc:2272] T 09a0ecf5d0874c90adf810893870a790 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.245239  9938 tablet_replica.cc:333] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.245779  9938 raft_consensus.cc:2243] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.246587  9938 raft_consensus.cc:2272] T b327ac80d17949f8aa3f002cf22986ab P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.248549  9938 tablet_replica.cc:333] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.249097  9938 raft_consensus.cc:2243] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.249866  9938 raft_consensus.cc:2272] T 7403d046fdc74d9aa962b9cd7c64f41b P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.251858  9938 tablet_replica.cc:333] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.252389  9938 raft_consensus.cc:2243] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.253240  9938 raft_consensus.cc:2272] T e708e6dd44c04400839f898100989df0 P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.255172  9938 tablet_replica.cc:333] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.255621  9938 raft_consensus.cc:2243] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.256011  9938 raft_consensus.cc:2272] T 24b9972f873044ed82799e7051a8f79c P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.257810  9938 tablet_replica.cc:333] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.258277  9938 raft_consensus.cc:2243] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.258754  9938 raft_consensus.cc:2272] T 5fd837fa16b64d78b8142773b317ff3f P 491eb72eef45486bb35575f2936538d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.260632  9938 tablet_replica.cc:333] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.261083  9938 raft_consensus.cc:2243] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.261469  9938 raft_consensus.cc:2272] T 9b3947f06087460cbf1b9149f8e20daf P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.263634  9938 tablet_replica.cc:333] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.264228  9938 raft_consensus.cc:2243] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.264761  9938 raft_consensus.cc:2272] T df74870926dd4e4a98d23dcda857942a P 491eb72eef45486bb35575f2936538d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.266700  9938 tablet_replica.cc:333] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.267140  9938 raft_consensus.cc:2243] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.267917  9938 raft_consensus.cc:2272] T 0b60bfb738d7452f8eed2ef5de1209f5 P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.269743  9938 tablet_replica.cc:333] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9: stopping tablet replica
I20260709 12:14:53.270169  9938 raft_consensus.cc:2243] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.270640  9938 raft_consensus.cc:2272] T 74580946c1b34dca8f017310b582f20c P 491eb72eef45486bb35575f2936538d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.338974  9938 tablet_server.cc:196] TabletServer@127.9.180.132:0 shutdown complete.
I20260709 12:14:53.416728  9938 master.cc:562] Master@127.9.180.190:38005 shutting down...
I20260709 12:14:53.448670  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.449316  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.449795  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 06488dc712684224814be76ced523f11: stopping tablet replica
I20260709 12:14:53.473719  9938 master.cc:584] Master@127.9.180.190:38005 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36597 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:14:53.570253  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:44963
I20260709 12:14:53.571451  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:53.577474 21747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:53.578083 21748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:53.578786 21750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:53.579030  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:53.580427  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:53.580646  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:53.580788  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599293580775 us; error 0 us; skew 500 ppm
I20260709 12:14:53.581300  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:53.584059  9938 webserver.cc:533] Webserver started at http://127.9.180.190:39671/ using document root <none> and password file <none>
I20260709 12:14:53.584537  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:53.584707  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:53.584935  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:53.586292  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "87b4cb3f79e64121b59261097b85cfbb"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:14:53.591055  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:14:53.594892 21755 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:53.595834  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:14:53.596172  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "87b4cb3f79e64121b59261097b85cfbb"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:14:53.596531  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:53.621600  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:53.623155  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:53.671597  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:44963
I20260709 12:14:53.671716 21806 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:44963 every 8 connection(s)
I20260709 12:14:53.676057 21807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:53.686362 21807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb: Bootstrap starting.
I20260709 12:14:53.691165 21807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.695773 21807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb: No bootstrap required, opened a new log
I20260709 12:14:53.697947 21807 raft_consensus.cc:359] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4cb3f79e64121b59261097b85cfbb" member_type: VOTER }
I20260709 12:14:53.698427 21807 raft_consensus.cc:385] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.698726 21807 raft_consensus.cc:740] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b4cb3f79e64121b59261097b85cfbb, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.699338 21807 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4cb3f79e64121b59261097b85cfbb" member_type: VOTER }
I20260709 12:14:53.699793 21807 raft_consensus.cc:399] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:53.699994 21807 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:53.700277 21807 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.704741 21807 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4cb3f79e64121b59261097b85cfbb" member_type: VOTER }
I20260709 12:14:53.705235 21807 leader_election.cc:304] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b4cb3f79e64121b59261097b85cfbb; no voters: 
I20260709 12:14:53.706352 21807 leader_election.cc:290] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:53.706931 21810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.708603 21810 raft_consensus.cc:697] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 1 LEADER]: Becoming Leader. State: Replica: 87b4cb3f79e64121b59261097b85cfbb, State: Running, Role: LEADER
I20260709 12:14:53.709431 21807 sys_catalog.cc:565] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:53.709369 21810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4cb3f79e64121b59261097b85cfbb" member_type: VOTER }
I20260709 12:14:53.716742 21811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87b4cb3f79e64121b59261097b85cfbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4cb3f79e64121b59261097b85cfbb" member_type: VOTER } }
I20260709 12:14:53.717242 21811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:53.717926 21812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b4cb3f79e64121b59261097b85cfbb. Latest consensus state: current_term: 1 leader_uuid: "87b4cb3f79e64121b59261097b85cfbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b4cb3f79e64121b59261097b85cfbb" member_type: VOTER } }
I20260709 12:14:53.718894 21812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:53.719020 21819 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:53.725520 21819 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:53.727648  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:53.735457 21819 catalog_manager.cc:1383] Generated new cluster ID: 07053c1d4a66498f823860cca19c18c6
I20260709 12:14:53.735792 21819 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:53.751955 21819 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:53.753432 21819 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:53.768961 21819 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb: Generated new TSK 0
I20260709 12:14:53.769667 21819 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:53.794832  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:53.801746 21828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:53.803210 21829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:53.804761 21831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:53.805087  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:53.806301  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:53.806560  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:53.806702  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599293806688 us; error 0 us; skew 500 ppm
I20260709 12:14:53.807186  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:53.809790  9938 webserver.cc:533] Webserver started at http://127.9.180.129:46071/ using document root <none> and password file <none>
I20260709 12:14:53.810274  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:53.810441  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:53.810834  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:53.812101  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:14:53.816845  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:14:53.820677 21836 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:53.821516  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:53.821942  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:14:53.822221  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:53.837903  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:53.839908  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:53.842257  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:53.846091  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:53.846378  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:53.846719  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:53.846952  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:53.896520  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:39209
I20260709 12:14:53.896644 21898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:39209 every 8 connection(s)
I20260709 12:14:53.902065  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:53.911577 21903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:53.913004 21904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:53.916148 21906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:53.916334  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:53.918023  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:53.918263  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:53.918447  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599293918423 us; error 0 us; skew 500 ppm
I20260709 12:14:53.919080  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:53.921100 21899 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44963
I20260709 12:14:53.921528 21899 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:53.922335  9938 webserver.cc:533] Webserver started at http://127.9.180.130:35887/ using document root <none> and password file <none>
I20260709 12:14:53.922423 21899 heartbeater.cc:507] Master 127.9.180.190:44963 requested a full tablet report, sending...
I20260709 12:14:53.923065  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:53.923313  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:53.923600  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:53.924819 21772 ts_manager.cc:194] Registered new tserver with Master: ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209)
I20260709 12:14:53.925055  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:14:53.926689 21772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60332
I20260709 12:14:53.930476  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:14:53.934808 21911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:53.935631  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:53.935988  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:14:53.936311  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:53.962925  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:53.964344  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:53.966059  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:53.968555  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:53.968781  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:53.969029  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:53.969198  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.016590  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:46153
I20260709 12:14:54.016714 21973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:46153 every 8 connection(s)
I20260709 12:14:54.022059  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:54.031095 21977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.031477 21978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:54.034539 21980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:54.034864  9938 server_base.cc:1061] running on GCE node
I20260709 12:14:54.035562 21974 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44963
I20260709 12:14:54.036013 21974 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:54.036054  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:54.036392  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:54.036576  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599294036555 us; error 0 us; skew 500 ppm
I20260709 12:14:54.036947 21974 heartbeater.cc:507] Master 127.9.180.190:44963 requested a full tablet report, sending...
I20260709 12:14:54.037180  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:54.039585 21772 ts_manager.cc:194] Registered new tserver with Master: ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.040148  9938 webserver.cc:533] Webserver started at http://127.9.180.131:45279/ using document root <none> and password file <none>
I20260709 12:14:54.040695  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:54.040917  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:54.041185  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:54.041241 21772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60338
I20260709 12:14:54.042659  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "2c991c3b7b734fc3aba2d42adc00553e"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-lg8f"
I20260709 12:14:54.047851  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:54.051290 21985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.052076  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:14:54.052394  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "2c991c3b7b734fc3aba2d42adc00553e"
format_stamp: "Formatted at 2026-07-09 12:14:54 on dist-test-slave-lg8f"
I20260709 12:14:54.052675  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:54.082330  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:54.083593  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:54.085121  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:54.087395  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:54.087620  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.087860  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:54.088043  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:54.133136  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:45857
I20260709 12:14:54.133323 22047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:45857 every 8 connection(s)
I20260709 12:14:54.149816 22048 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44963
I20260709 12:14:54.150298 22048 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:54.151181 22048 heartbeater.cc:507] Master 127.9.180.190:44963 requested a full tablet report, sending...
I20260709 12:14:54.153263 21772 ts_manager.cc:194] Registered new tserver with Master: 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:54.153535  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01717023s
I20260709 12:14:54.155468 21772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60346
I20260709 12:14:54.182590 21772 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60362:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:54.185338 21772 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:54.263473 21864 tablet_service.cc:1511] Processing CreateTablet for tablet 94b5a9c37cdf41279a7565a0ad14bf31 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:54.264101 21863 tablet_service.cc:1511] Processing CreateTablet for tablet 083641bfbbc54f52977a079cceb15bd7 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:54.265095 21864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5a9c37cdf41279a7565a0ad14bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.265722 21863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083641bfbbc54f52977a079cceb15bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.267588 21862 tablet_service.cc:1511] Processing CreateTablet for tablet 631f63153e40485bb1f960078a0f47c9 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:54.268983 21862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631f63153e40485bb1f960078a0f47c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.272054 21860 tablet_service.cc:1511] Processing CreateTablet for tablet cf9037afdbe7416e98413b10282d5b8e (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:54.275190 21861 tablet_service.cc:1511] Processing CreateTablet for tablet 27a2cab73be544638de72f21aa592869 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:54.278950 21860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9037afdbe7416e98413b10282d5b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.279865 21861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a2cab73be544638de72f21aa592869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.285305 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 94b5a9c37cdf41279a7565a0ad14bf31 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:54.285115 21938 tablet_service.cc:1511] Processing CreateTablet for tablet 083641bfbbc54f52977a079cceb15bd7 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:54.286954 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5a9c37cdf41279a7565a0ad14bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.287631 21938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083641bfbbc54f52977a079cceb15bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.288772 21859 tablet_service.cc:1511] Processing CreateTablet for tablet 89d8bf7d7c60444e90c8f1a7c4c6a978 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:54.290287 21859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d8bf7d7c60444e90c8f1a7c4c6a978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.300916 21858 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcce7d80a1446e39732a0a60f126eaf (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:54.302687 21858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcce7d80a1446e39732a0a60f126eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.303401 21937 tablet_service.cc:1511] Processing CreateTablet for tablet 631f63153e40485bb1f960078a0f47c9 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:54.304999 21937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631f63153e40485bb1f960078a0f47c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.304960 21934 tablet_service.cc:1511] Processing CreateTablet for tablet 89d8bf7d7c60444e90c8f1a7c4c6a978 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:54.307514 21935 tablet_service.cc:1511] Processing CreateTablet for tablet cf9037afdbe7416e98413b10282d5b8e (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:54.309744 21936 tablet_service.cc:1511] Processing CreateTablet for tablet 27a2cab73be544638de72f21aa592869 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:54.311430 21934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d8bf7d7c60444e90c8f1a7c4c6a978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.315433 21857 tablet_service.cc:1511] Processing CreateTablet for tablet 0e972ee484fc47419b19c2b451b5ff60 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:54.316917 21857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e972ee484fc47419b19c2b451b5ff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.318894 21935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9037afdbe7416e98413b10282d5b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.321327 21936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a2cab73be544638de72f21aa592869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.323822 21855 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0949de112842658e03f9dd1008784e (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:54.325266 21855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0949de112842658e03f9dd1008784e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.327303 21856 tablet_service.cc:1511] Processing CreateTablet for tablet b8fa1b90c3a9410da992ec1ab11a6a68 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:54.328738 21856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fa1b90c3a9410da992ec1ab11a6a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.345575 21933 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcce7d80a1446e39732a0a60f126eaf (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:54.346043 21932 tablet_service.cc:1511] Processing CreateTablet for tablet 0e972ee484fc47419b19c2b451b5ff60 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:54.346890 21931 tablet_service.cc:1511] Processing CreateTablet for tablet b8fa1b90c3a9410da992ec1ab11a6a68 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:54.347499 21933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcce7d80a1446e39732a0a60f126eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.355545 21931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fa1b90c3a9410da992ec1ab11a6a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.363094 21932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e972ee484fc47419b19c2b451b5ff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.375917 22013 tablet_service.cc:1511] Processing CreateTablet for tablet 94b5a9c37cdf41279a7565a0ad14bf31 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:54.377533 22013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5a9c37cdf41279a7565a0ad14bf31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.380285 22012 tablet_service.cc:1511] Processing CreateTablet for tablet 083641bfbbc54f52977a079cceb15bd7 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:54.381762 22012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083641bfbbc54f52977a079cceb15bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.383777 22009 tablet_service.cc:1511] Processing CreateTablet for tablet cf9037afdbe7416e98413b10282d5b8e (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:54.385169 22009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9037afdbe7416e98413b10282d5b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.387694 22010 tablet_service.cc:1511] Processing CreateTablet for tablet 27a2cab73be544638de72f21aa592869 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:54.389063 22010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a2cab73be544638de72f21aa592869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.391779 22011 tablet_service.cc:1511] Processing CreateTablet for tablet 631f63153e40485bb1f960078a0f47c9 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:54.393250 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 631f63153e40485bb1f960078a0f47c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.396322 22008 tablet_service.cc:1511] Processing CreateTablet for tablet 89d8bf7d7c60444e90c8f1a7c4c6a978 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:54.396737 22007 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcce7d80a1446e39732a0a60f126eaf (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:54.397105 22006 tablet_service.cc:1511] Processing CreateTablet for tablet 0e972ee484fc47419b19c2b451b5ff60 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:54.397921 22008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d8bf7d7c60444e90c8f1a7c4c6a978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.398672 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e972ee484fc47419b19c2b451b5ff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.399405 22007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcce7d80a1446e39732a0a60f126eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.401450 22005 tablet_service.cc:1511] Processing CreateTablet for tablet b8fa1b90c3a9410da992ec1ab11a6a68 (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:54.404328 22004 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0949de112842658e03f9dd1008784e (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:54.405722 22004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0949de112842658e03f9dd1008784e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.407001 22005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fa1b90c3a9410da992ec1ab11a6a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.418733 22064 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.433104 22064 tablet_bootstrap.cc:654] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.436837 22063 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.438004 21939 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0949de112842658e03f9dd1008784e (DEFAULT_TABLE table=test-workload [id=1c79679e980144378da3e0b39a6ee25e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:54.442737 21939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0949de112842658e03f9dd1008784e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:54.473238 22065 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.483193 22065 tablet_bootstrap.cc:654] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.502777 22065 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.503300 22065 ts_tablet_manager.cc:1403] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:14:54.507440 22065 raft_consensus.cc:359] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.508224 22065 raft_consensus.cc:385] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.508539 22065 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.510257 22065 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.519590 22063 tablet_bootstrap.cc:654] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.520876 22064 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:54.521461 22064 ts_tablet_manager.cc:1403] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.011s
I20260709 12:14:54.526914 22064 raft_consensus.cc:359] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.528169 22064 raft_consensus.cc:385] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.528614 22064 raft_consensus.cc:740] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.529868 22064 consensus_queue.cc:260] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.535555 22063 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.536052 22063 ts_tablet_manager.cc:1403] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.011s
I20260709 12:14:54.538801 22064 ts_tablet_manager.cc:1434] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 12:14:54.538564 22063 raft_consensus.cc:359] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.539116 21899 heartbeater.cc:499] Master 127.9.180.190:44963 was elected leader, sending a full tablet report...
I20260709 12:14:54.539283 22063 raft_consensus.cc:385] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.539858 22063 raft_consensus.cc:740] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.540372 22064 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.540843 22063 consensus_queue.cc:260] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.543812 21974 heartbeater.cc:499] Master 127.9.180.190:44963 was elected leader, sending a full tablet report...
I20260709 12:14:54.544126 22063 ts_tablet_manager.cc:1434] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:14:54.545351 22063 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.547725 22064 tablet_bootstrap.cc:654] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.552268 22063 tablet_bootstrap.cc:654] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.557339 22064 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:54.558007 22064 ts_tablet_manager.cc:1403] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
I20260709 12:14:54.559448 22065 ts_tablet_manager.cc:1434] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.007s
I20260709 12:14:54.560652 22048 heartbeater.cc:499] Master 127.9.180.190:44963 was elected leader, sending a full tablet report...
I20260709 12:14:54.561609 22064 raft_consensus.cc:359] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.562534 22064 raft_consensus.cc:385] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.562885 22064 raft_consensus.cc:740] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.563932 22064 consensus_queue.cc:260] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.564956 22063 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.566241 22065 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.566406 22064 ts_tablet_manager.cc:1434] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:14:54.567695 22064 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.569712 22063 ts_tablet_manager.cc:1403] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.002s
I20260709 12:14:54.572985 22063 raft_consensus.cc:359] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.573725 22063 raft_consensus.cc:385] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.573984 22065 tablet_bootstrap.cc:654] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.574056 22063 raft_consensus.cc:740] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.575251 22064 tablet_bootstrap.cc:654] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.575259 22063 consensus_queue.cc:260] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.578281 22063 ts_tablet_manager.cc:1434] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:54.579625 22063 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.591120 22063 tablet_bootstrap.cc:654] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.600550 22065 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.601235 22065 ts_tablet_manager.cc:1403] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.011s
I20260709 12:14:54.609791 22065 raft_consensus.cc:359] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.616478 22065 raft_consensus.cc:385] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.616890 22065 raft_consensus.cc:740] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.617889 22065 consensus_queue.cc:260] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.621328 22065 ts_tablet_manager.cc:1434] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:14:54.623091 22065 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.632025 22065 tablet_bootstrap.cc:654] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:54.637382 22049 tablet.cc:2406] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:54.645483 22065 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.645781 22063 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.645843 22064 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:54.646186 22065 ts_tablet_manager.cc:1403] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 12:14:54.646883 22063 ts_tablet_manager.cc:1403] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.068s	user 0.045s	sys 0.015s
I20260709 12:14:54.646935 22064 ts_tablet_manager.cc:1403] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.047s
I20260709 12:14:54.649868 22065 raft_consensus.cc:359] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.650579 22065 raft_consensus.cc:385] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.650527 22063 raft_consensus.cc:359] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.650880 22064 raft_consensus.cc:359] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.651343 22065 raft_consensus.cc:740] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.652631 22063 raft_consensus.cc:385] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.652729 22064 raft_consensus.cc:385] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.653107 22063 raft_consensus.cc:740] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.653156 22064 raft_consensus.cc:740] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.653420 22065 consensus_queue.cc:260] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.654258 22064 consensus_queue.cc:260] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.654349 22063 consensus_queue.cc:260] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.656395 22065 ts_tablet_manager.cc:1434] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:54.656868 22064 ts_tablet_manager.cc:1434] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:54.657428 22065 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.657979 22064 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.660429 22063 ts_tablet_manager.cc:1434] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:14:54.661597 22063 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.664664 22065 tablet_bootstrap.cc:654] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.665719 22064 tablet_bootstrap.cc:654] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.669078 22063 tablet_bootstrap.cc:654] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.676297 22065 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.676834 22065 ts_tablet_manager.cc:1403] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.012s
I20260709 12:14:54.679665 22065 raft_consensus.cc:359] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.680408 22065 raft_consensus.cc:385] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.680697 22065 raft_consensus.cc:740] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.681529 22065 consensus_queue.cc:260] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.684001 22065 ts_tablet_manager.cc:1434] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:14:54.685132 22065 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.691362 22065 tablet_bootstrap.cc:654] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.702745 22065 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.703264 22065 ts_tablet_manager.cc:1403] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 12:14:54.705098 22064 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:54.705802 22064 ts_tablet_manager.cc:1403] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.048s	user 0.035s	sys 0.011s
I20260709 12:14:54.705596 22065 raft_consensus.cc:359] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.706521 22065 raft_consensus.cc:385] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.706835 22065 raft_consensus.cc:740] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.707507 22065 consensus_queue.cc:260] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.708235 22063 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.708775 22063 ts_tablet_manager.cc:1403] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.020s
I20260709 12:14:54.709472 22065 ts_tablet_manager.cc:1434] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:14:54.709340 22064 raft_consensus.cc:359] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.710367 22064 raft_consensus.cc:385] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.710800 22065 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.710762 22064 raft_consensus.cc:740] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.712145 22064 consensus_queue.cc:260] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.712702 22063 raft_consensus.cc:359] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.713435 22063 raft_consensus.cc:385] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.713716 22063 raft_consensus.cc:740] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.714609 22063 consensus_queue.cc:260] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.718221 22065 tablet_bootstrap.cc:654] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.721863 22069 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.722038 22063 ts_tablet_manager.cc:1434] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:14:54.722151 22064 ts_tablet_manager.cc:1434] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:14:54.722572 22069 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
W20260709 12:14:54.723358 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:54.723558 22063 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.731653 22063 tablet_bootstrap.cc:654] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.732371 22070 raft_consensus.cc:493] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.733170 22070 raft_consensus.cc:515] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.740662 22064 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.742652 22070 leader_election.cc:290] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:54.752904 22069 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.769934 22069 raft_consensus.cc:493] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.770445 22069 raft_consensus.cc:515] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.771611 22064 tablet_bootstrap.cc:654] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.774237 22069 leader_election.cc:290] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.778647 22063 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.779469 22063 ts_tablet_manager.cc:1403] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.002s
I20260709 12:14:54.787721 22065 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.788461 22065 ts_tablet_manager.cc:1403] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.027s
I20260709 12:14:54.792239 22065 raft_consensus.cc:359] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.793165 22065 raft_consensus.cc:385] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.792972 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:54.793701 22065 raft_consensus.cc:740] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.794729 22065 consensus_queue.cc:260] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.784240 22063 raft_consensus.cc:359] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.796851 22063 raft_consensus.cc:385] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.797230 22063 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
W20260709 12:14:54.797988 21838 leader_election.cc:343] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.798153 22063 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.800218 22065 ts_tablet_manager.cc:1434] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:14:54.801540 22065 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.801965 22069 raft_consensus.cc:493] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.802896 22063 ts_tablet_manager.cc:1434] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:14:54.802618 22069 raft_consensus.cc:515] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.804124 22063 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.806177 22069 leader_election.cc:290] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.808293 22064 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:54.808997 22064 ts_tablet_manager.cc:1403] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.017s
I20260709 12:14:54.813138 22063 tablet_bootstrap.cc:654] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.813880 22064 raft_consensus.cc:359] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.814906 22064 raft_consensus.cc:385] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.815305 22064 raft_consensus.cc:740] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.816200 22064 consensus_queue.cc:260] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.818955 22071 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.819574 22071 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.820319 22065 tablet_bootstrap.cc:654] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.821333 22064 ts_tablet_manager.cc:1434] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:54.822832 22064 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.825258 22071 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:54.827122 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
W20260709 12:14:54.829998 21987 leader_election.cc:343] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.830169 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
W20260709 12:14:54.831601 21987 leader_election.cc:343] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.831900 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:54.832587 21949 raft_consensus.cc:2468] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:54.834051 21987 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:54.835418 22069 raft_consensus.cc:2804] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.835918 22069 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.836339 22069 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.837776 22063 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.838130 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:54.838755 22063 ts_tablet_manager.cc:1403] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.011s
I20260709 12:14:54.843238 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:54.843538 22063 raft_consensus.cc:359] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.844115 21874 raft_consensus.cc:2468] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:54.844463 22063 raft_consensus.cc:385] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.844913 22063 raft_consensus.cc:740] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.845717 22069 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.843559 22064 tablet_bootstrap.cc:654] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.849808 22069 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.846005 22063 consensus_queue.cc:260] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.846102 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
W20260709 12:14:54.850749 21988 leader_election.cc:343] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.852033 21988 leader_election.cc:304] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:14:54.852620 22063 ts_tablet_manager.cc:1434] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:14:54.853865 22063 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:54.857244 22065 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:54.857913 22065 ts_tablet_manager.cc:1403] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.005s
I20260709 12:14:54.861718 22065 raft_consensus.cc:359] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.862701 22065 raft_consensus.cc:385] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.863042 22065 raft_consensus.cc:740] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.863860 22065 consensus_queue.cc:260] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.865797 22063 tablet_bootstrap.cc:654] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.866586 22069 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.867878 22070 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.868458 22070 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.870874 22070 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.872788 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:54.873602 21949 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 0.
I20260709 12:14:54.875124 21838 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:54.876101 22070 raft_consensus.cc:2804] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.876699 22070 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.877190 22070 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.880043 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:54.882169 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:54.867165 22069 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.882969 21874 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 0.
I20260709 12:14:54.883700 22098 raft_consensus.cc:2804] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.884294 22098 raft_consensus.cc:493] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.884783 22098 raft_consensus.cc:3060] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.884701 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:54.885780 21949 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.886251 21914 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:54.887620 22071 raft_consensus.cc:2804] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.888108 22071 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.888528 22071 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.892220 22069 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.893371 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:54.897856 21949 raft_consensus.cc:2468] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
W20260709 12:14:54.899652 21988 leader_election.cc:343] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.907321 21988 leader_election.cc:304] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e; no voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:54.901321 22097 raft_consensus.cc:493] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.908263 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:54.909065 22097 raft_consensus.cc:515] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.910410 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:54.911530 21874 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:54.911877 21987 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:54.916039 22097 leader_election.cc:290] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.916710 22097 raft_consensus.cc:493] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.917244 22097 raft_consensus.cc:515] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.918557 22100 raft_consensus.cc:2749] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:54.919188 22102 raft_consensus.cc:2804] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:54.902936 22071 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.917824 22064 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:54.905627 22095 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.906131 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:54.920837 22064 ts_tablet_manager.cc:1403] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.024s
I20260709 12:14:54.922986 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:54.920230 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:54.906577 22065 ts_tablet_manager.cc:1434] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.006s
I20260709 12:14:54.920863 21948 raft_consensus.cc:2393] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c991c3b7b734fc3aba2d42adc00553e in current term 1: Already voted for candidate ddf27de0b46c48f8ad3edb85dd24193b in this term.
I20260709 12:14:54.929718 22099 raft_consensus.cc:493] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.919835 22102 raft_consensus.cc:697] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:54.930855 22099 raft_consensus.cc:515] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.931397 22064 raft_consensus.cc:359] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.931468 22102 consensus_queue.cc:237] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.932487 22064 raft_consensus.cc:385] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.932827 22064 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.933605 22064 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.927527 22095 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.928207 21874 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.940812 22064 ts_tablet_manager.cc:1434] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.008s
I20260709 12:14:54.931630 21949 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:54.947177 22022 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 0.
I20260709 12:14:54.950582 21987 leader_election.cc:304] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:54.952147 22070 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:54.952862 22100 raft_consensus.cc:2804] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.954399 22100 raft_consensus.cc:493] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.955343 22100 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.955118 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:54.956233 21949 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:54.959291 22070 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 election: Requested vote from peers 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.960366 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:14:54.960914 22022 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.962944 22063 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:54.963578 22063 ts_tablet_manager.cc:1403] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.110s	user 0.023s	sys 0.006s
I20260709 12:14:54.966977 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:54.966730 22063 raft_consensus.cc:359] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.967607 22063 raft_consensus.cc:385] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.967589 21948 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.957814 22095 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.969233 21987 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:54.968860 22098 raft_consensus.cc:515] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.977136 22103 raft_consensus.cc:493] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:54.978964 21988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:39209, user_credentials={real_user=slave}} blocked reactor thread for 79387.9us
I20260709 12:14:54.980510 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
W20260709 12:14:54.980727 21988 leader_election.cc:343] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.981282 22097 leader_election.cc:290] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:54.982265 21948 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 1.
I20260709 12:14:54.983742 22099 leader_election.cc:290] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:54.984448 21838 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:54.985378 22022 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 1.
I20260709 12:14:54.985911 22095 raft_consensus.cc:2764] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:14:54.986320 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
W20260709 12:14:54.988639 21837 leader_election.cc:343] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.989374 22064 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:54.989847 22099 raft_consensus.cc:2804] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:54.990651 22103 raft_consensus.cc:515] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:54.991845 21949 raft_consensus.cc:2468] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:54.993427 22103 leader_election.cc:290] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:54.994171 21874 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 1.
I20260709 12:14:54.995217 22065 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:54.995798 21987 leader_election.cc:304] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:54.996539 22064 tablet_bootstrap.cc:654] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.997094 22095 raft_consensus.cc:2804] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.997503 22095 raft_consensus.cc:493] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.997854 22095 raft_consensus.cc:3060] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.990690 22099 raft_consensus.cc:697] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 LEADER]: Becoming Leader. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Running, Role: LEADER
I20260709 12:14:54.999426 22071 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:54.999543 22099 consensus_queue.cc:237] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:55.000451 21914 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.003944 22071 raft_consensus.cc:2804] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.004204 22023 raft_consensus.cc:2393] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef14c6a5fb654fc3985d8f8e783b2bfb in current term 1: Already voted for candidate 2c991c3b7b734fc3aba2d42adc00553e in this term.
I20260709 12:14:54.973388 22063 raft_consensus.cc:740] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.005610 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.005944 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:55.006441 21874 raft_consensus.cc:2468] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 0.
I20260709 12:14:55.007213 22100 raft_consensus.cc:515] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
W20260709 12:14:55.008059 21838 leader_election.cc:343] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.982360 21988 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:14:55.008991 22071 raft_consensus.cc:697] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:14:55.005632 22063 consensus_queue.cc:260] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.013901 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.014760 21948 raft_consensus.cc:3060] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.009375 21838 leader_election.cc:304] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:14:55.010007 21837 leader_election.cc:304] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:14:55.016290 22070 raft_consensus.cc:2749] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.017676 22101 raft_consensus.cc:2804] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.012755 22071 consensus_queue.cc:237] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.020450 22063 ts_tablet_manager.cc:1434] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 12:14:55.024362 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.025082 21949 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.025679 22063 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:55.028142 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:14:55.030997 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:55.034269 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:55.044462 21948 raft_consensus.cc:2468] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.045845 21987 leader_election.cc:304] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:55.046917 22102 raft_consensus.cc:2804] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.047472 22070 raft_consensus.cc:3060] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.047621 22102 raft_consensus.cc:697] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:55.048611 22102 consensus_queue.cc:237] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.046013 21769 catalog_manager.cc:5697] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.022761 22101 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.021996 22098 leader_election.cc:290] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.022181 22100 leader_election.cc:290] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
W20260709 12:14:55.060468 21837 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.131:45857, user_credentials={real_user=slave}} blocked reactor thread for 50922.2us
I20260709 12:14:55.062301 21914 leader_election.cc:304] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.063581 22103 raft_consensus.cc:2804] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.064081 22103 raft_consensus.cc:493] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.064491 22103 raft_consensus.cc:3060] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.068502 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.055612 22101 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.084899 22070 raft_consensus.cc:2749] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.058724 22063 tablet_bootstrap.cc:654] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.039003 22095 raft_consensus.cc:515] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.096451 21873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.096911 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.097862 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
W20260709 12:14:55.099018 21988 leader_election.cc:343] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.106866 22022 raft_consensus.cc:2393] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf27de0b46c48f8ad3edb85dd24193b in current term 1: Already voted for candidate 2c991c3b7b734fc3aba2d42adc00553e in this term.
I20260709 12:14:55.099596 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.106352 21874 raft_consensus.cc:2468] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
W20260709 12:14:55.112392 21988 leader_election.cc:343] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:55.112835 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.113468 21874 raft_consensus.cc:3060] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.100450 21949 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.113690 22095 leader_election.cc:290] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.115099 21987 leader_election.cc:304] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:55.116444 22095 raft_consensus.cc:2804] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.116946 22095 raft_consensus.cc:697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:55.117808 22095 consensus_queue.cc:237] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.118878 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.123255 21874 raft_consensus.cc:2468] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.124732 21988 leader_election.cc:304] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.126106 22098 raft_consensus.cc:2804] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.127192 22098 raft_consensus.cc:697] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:55.128547 22098 consensus_queue.cc:237] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.138708 22065 tablet_bootstrap.cc:654] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.150673 22064 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:55.151233 22064 ts_tablet_manager.cc:1403] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.176s	user 0.054s	sys 0.061s
I20260709 12:14:55.154582 22064 raft_consensus.cc:359] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.155496 22064 raft_consensus.cc:385] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.155781 22064 raft_consensus.cc:740] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.156543 22064 consensus_queue.cc:260] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.156993 22063 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:55.157629 22063 ts_tablet_manager.cc:1403] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.004s
I20260709 12:14:55.160763 22063 raft_consensus.cc:359] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.161217 22064 ts_tablet_manager.cc:1434] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:14:55.161516 22063 raft_consensus.cc:385] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.160486 21770 catalog_manager.cc:5697] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb reported cstate change: term changed from 0 to 1, leader changed from <none> to ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129). New cstate: current_term: 1 leader_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.161303 22103 raft_consensus.cc:515] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.167263 21948 raft_consensus.cc:2393] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c991c3b7b734fc3aba2d42adc00553e in current term 1: Already voted for candidate ddf27de0b46c48f8ad3edb85dd24193b in this term.
I20260709 12:14:55.168906 22103 leader_election.cc:290] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:55.169144 21874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.165724 22101 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.170002 21874 raft_consensus.cc:2393] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf27de0b46c48f8ad3edb85dd24193b in current term 1: Already voted for candidate 2c991c3b7b734fc3aba2d42adc00553e in this term.
I20260709 12:14:55.170536 22021 raft_consensus.cc:2393] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf27de0b46c48f8ad3edb85dd24193b in current term 1: Already voted for candidate 2c991c3b7b734fc3aba2d42adc00553e in this term.
I20260709 12:14:55.172035 22101 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.172868 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.174043 21871 raft_consensus.cc:2393] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c991c3b7b734fc3aba2d42adc00553e in current term 1: Already voted for candidate ddf27de0b46c48f8ad3edb85dd24193b in this term.
I20260709 12:14:55.167368 21768 catalog_manager.cc:5697] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 1 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.176834 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:14:55.165548 22064 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:55.177644 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.179028 21912 leader_election.cc:304] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:55.179488 21987 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e; no voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:55.180485 22101 raft_consensus.cc:2749] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.180595 21872 raft_consensus.cc:2468] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.180485 22103 raft_consensus.cc:2749] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.184448 22064 tablet_bootstrap.cc:654] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.161890 22063 raft_consensus.cc:740] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.186323 22065 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:55.187090 22065 ts_tablet_manager.cc:1403] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.006s
I20260709 12:14:55.187232 22063 consensus_queue.cc:260] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.188987 22063 ts_tablet_manager.cc:1434] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.004s
I20260709 12:14:55.189749 22063 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:55.190462 22065 raft_consensus.cc:359] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.191362 22065 raft_consensus.cc:385] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.191658 22065 raft_consensus.cc:740] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.192860 22064 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:55.192598 22065 consensus_queue.cc:260] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.193511 22064 ts_tablet_manager.cc:1403] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.007s
I20260709 12:14:55.195499 22065 ts_tablet_manager.cc:1434] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:55.196615 22064 raft_consensus.cc:359] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.197049 22065 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:55.197510 22064 raft_consensus.cc:385] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.197912 22064 raft_consensus.cc:740] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.198661 22064 consensus_queue.cc:260] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.200717 22064 ts_tablet_manager.cc:1434] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:55.201706 22064 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:55.205848 22065 tablet_bootstrap.cc:654] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.207652 22064 tablet_bootstrap.cc:654] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.215595 21768 catalog_manager.cc:5697] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.218120 22065 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:55.218251 22064 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:55.217761 21768 catalog_manager.cc:5697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.218672 22065 ts_tablet_manager.cc:1403] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:14:55.218930 22064 ts_tablet_manager.cc:1403] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:14:55.221498 22065 raft_consensus.cc:359] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.222146 22065 raft_consensus.cc:385] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.222469 22065 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.222213 22064 raft_consensus.cc:359] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.223455 22064 raft_consensus.cc:385] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.223882 22064 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.223542 22065 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.225685 22064 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.226900 22065 ts_tablet_manager.cc:1434] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:14:55.227275 22063 tablet_bootstrap.cc:654] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.227906 22065 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e: Bootstrap starting.
I20260709 12:14:55.228729 22064 ts_tablet_manager.cc:1434] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:55.229851 22064 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:14:55.236549 22065 tablet_bootstrap.cc:654] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.237433 21768 catalog_manager.cc:5697] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.241305 22064 tablet_bootstrap.cc:654] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.248862 22063 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:55.249292 22063 ts_tablet_manager.cc:1403] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.005s
I20260709 12:14:55.249881 22065 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e: No bootstrap required, opened a new log
I20260709 12:14:55.250366 22065 ts_tablet_manager.cc:1403] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:14:55.252650 22064 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: No bootstrap required, opened a new log
I20260709 12:14:55.252431 22063 raft_consensus.cc:359] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.253293 22064 ts_tablet_manager.cc:1403] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.001s
I20260709 12:14:55.253221 22065 raft_consensus.cc:359] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.253310 22063 raft_consensus.cc:385] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.254783 22065 raft_consensus.cc:385] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.254769 22063 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.255434 22065 raft_consensus.cc:740] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.256227 22063 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.256373 22065 consensus_queue.cc:260] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.257486 22064 raft_consensus.cc:359] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.258301 22064 raft_consensus.cc:385] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.258661 22064 raft_consensus.cc:740] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.259305 22065 ts_tablet_manager.cc:1434] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:14:55.259349 22064 consensus_queue.cc:260] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.261689 22064 ts_tablet_manager.cc:1434] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:55.262197 22063 ts_tablet_manager.cc:1434] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:14:55.263396 22063 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: Bootstrap starting.
I20260709 12:14:55.272349 22063 tablet_bootstrap.cc:654] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.277501 22063 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: No bootstrap required, opened a new log
I20260709 12:14:55.278018 22063 ts_tablet_manager.cc:1403] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:14:55.280146 22063 raft_consensus.cc:359] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.280668 22063 raft_consensus.cc:385] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.280813 22099 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.280916 22063 raft_consensus.cc:740] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.281713 22099 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.282073 22063 consensus_queue.cc:260] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.283692 22099 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:55.284124 22063 ts_tablet_manager.cc:1434] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:14:55.284996 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:55.285688 22021 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 0.
I20260709 12:14:55.286360 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:55.286698 21837 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.287040 21948 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 0.
I20260709 12:14:55.287560 22099 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.287914 22099 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.288245 22099 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.292871 22101 raft_consensus.cc:493] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.293406 22101 raft_consensus.cc:515] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.295344 22099 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.295831 22101 leader_election.cc:290] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.297051 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:55.297638 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.297780 21948 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:55.298233 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.298533 21872 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:55.298919 21949 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.299365 21987 leader_election.cc:304] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:55.300258 22101 raft_consensus.cc:2804] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.300622 22101 raft_consensus.cc:493] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.300974 22101 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.303086 22099 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 election: Requested vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:55.306012 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:14:55.306605 22021 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.307085 21949 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 1.
I20260709 12:14:55.308508 21838 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.308979 22101 raft_consensus.cc:515] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.309513 22099 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.310052 22099 raft_consensus.cc:697] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 LEADER]: Becoming Leader. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Running, Role: LEADER
I20260709 12:14:55.311051 22099 consensus_queue.cc:237] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.312163 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.312808 21872 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.313331 22021 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef14c6a5fb654fc3985d8f8e783b2bfb in term 1.
I20260709 12:14:55.315498 22101 leader_election.cc:290] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.315719 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.316421 21949 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.322364 21949 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.322914 21872 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.323557 21987 leader_election.cc:304] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:55.324532 22101 raft_consensus.cc:2804] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.325013 22101 raft_consensus.cc:697] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:55.325896 22101 consensus_queue.cc:237] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.327124 21769 catalog_manager.cc:5697] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb reported cstate change: term changed from 0 to 1, leader changed from <none> to ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129). New cstate: current_term: 1 leader_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.335359 21770 catalog_manager.cc:5697] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.395306 22101 consensus_queue.cc:1048] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.409387 21872 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.418751 22101 consensus_queue.cc:1048] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.431820 22103 raft_consensus.cc:493] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.432459 22103 raft_consensus.cc:515] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.434418 22103 leader_election.cc:290] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:55.435258 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.435802 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:55.435978 21872 raft_consensus.cc:2468] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 0.
I20260709 12:14:55.436724 22021 raft_consensus.cc:2468] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 0.
I20260709 12:14:55.437291 21914 leader_election.cc:304] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.438134 22103 raft_consensus.cc:2804] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.438428 22103 raft_consensus.cc:493] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.438764 22103 raft_consensus.cc:3060] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.444088 22103 raft_consensus.cc:515] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.445780 22103 leader_election.cc:290] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:55.446732 21872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.447263 21872 raft_consensus.cc:3060] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.447108 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:14:55.448011 22021 raft_consensus.cc:3060] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.449158 22101 raft_consensus.cc:493] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.449702 22101 raft_consensus.cc:515] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.451144 22099 raft_consensus.cc:493] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.451660 22099 raft_consensus.cc:515] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.453047 22101 leader_election.cc:290] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.453397 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:14:55.453506 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:55.454272 21871 raft_consensus.cc:2468] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:55.454916 21949 raft_consensus.cc:2468] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 0.
I20260709 12:14:55.455899 21988 leader_election.cc:304] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.456838 22101 raft_consensus.cc:2804] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.456969 21872 raft_consensus.cc:2468] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 1.
I20260709 12:14:55.457310 22101 raft_consensus.cc:493] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.457836 22101 raft_consensus.cc:3060] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.458180 21914 leader_election.cc:304] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:14:55.459033 22103 raft_consensus.cc:2804] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.459589 22103 raft_consensus.cc:697] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:14:55.458983 22099 leader_election.cc:290] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:55.460867 22021 raft_consensus.cc:2468] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 1.
I20260709 12:14:55.460374 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:55.460474 22103 consensus_queue.cc:237] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.461932 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:55.462749 21949 raft_consensus.cc:2393] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef14c6a5fb654fc3985d8f8e783b2bfb in current term 1: Already voted for candidate 2c991c3b7b734fc3aba2d42adc00553e in this term.
I20260709 12:14:55.463694 21838 leader_election.cc:304] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:14:55.466634 22099 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.467690 22095 consensus_queue.cc:1048] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.469192 22101 raft_consensus.cc:515] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.471446 22101 leader_election.cc:290] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:55.472585 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:55.473230 21948 raft_consensus.cc:3060] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.477806 22099 raft_consensus.cc:2749] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.478724 21871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:14:55.479485 21871 raft_consensus.cc:3060] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.478600 22101 consensus_queue.cc:1048] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:55.486330 21948 raft_consensus.cc:2468] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.487665 21871 raft_consensus.cc:2468] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:55.488653 21987 leader_election.cc:304] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:55.489758 22102 raft_consensus.cc:2804] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.490571 22102 raft_consensus.cc:697] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:55.491739 22102 consensus_queue.cc:237] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:55.494694 21769 catalog_manager.cc:5697] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 1 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.508595 21768 catalog_manager.cc:5697] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 1 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:55.535522 22099 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.547012 22099 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:55.561362 22103 consensus_queue.cc:1048] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.575377 22071 consensus_queue.cc:1048] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.648782 22102 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.660694 22102 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.695895  9938 ts_manager.cc:295] Set tserver state for ef14c6a5fb654fc3985d8f8e783b2bfb to MAINTENANCE_MODE
I20260709 12:14:55.696650  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
I20260709 12:14:55.719157  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:55.720144  9938 tablet_replica.cc:333] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.721042  9938 raft_consensus.cc:2243] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.721483  9938 raft_consensus.cc:2272] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.724082  9938 tablet_replica.cc:333] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
W20260709 12:14:55.724530 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:55.725045  9938 raft_consensus.cc:2243] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.725455  9938 raft_consensus.cc:2272] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.727443  9938 tablet_replica.cc:333] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.727985  9938 raft_consensus.cc:2243] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.728353  9938 raft_consensus.cc:2272] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.730149  9938 tablet_replica.cc:333] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.730746  9938 raft_consensus.cc:2243] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.731122  9938 raft_consensus.cc:2272] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.733803  9938 tablet_replica.cc:333] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.734654  9938 raft_consensus.cc:2243] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.735318  9938 pending_rounds.cc:70] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Trying to abort 1 pending ops.
I20260709 12:14:55.735576  9938 pending_rounds.cc:77] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622713605107712 op_type: NO_OP noop_request { }
I20260709 12:14:55.735950  9938 raft_consensus.cc:2889] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:55.736238  9938 raft_consensus.cc:2272] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:55.737534 21988 consensus_peers.cc:597] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:55.738847  9938 tablet_replica.cc:333] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.739498  9938 raft_consensus.cc:2243] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.739882  9938 raft_consensus.cc:2272] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.741772  9938 tablet_replica.cc:333] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.742326  9938 raft_consensus.cc:2243] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.742853  9938 raft_consensus.cc:2272] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.745362  9938 tablet_replica.cc:333] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.745911  9938 raft_consensus.cc:2243] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:55.747078  9938 raft_consensus.cc:2272] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.749648  9938 tablet_replica.cc:333] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.750149  9938 raft_consensus.cc:2243] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.750578  9938 raft_consensus.cc:2272] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.752965  9938 tablet_replica.cc:333] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: stopping tablet replica
I20260709 12:14:55.753432  9938 raft_consensus.cc:2243] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:55.753882  9938 raft_consensus.cc:2272] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:55.761886 22102 consensus_queue.cc:1048] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.782538  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
W20260709 12:14:55.791986 21988 consensus_peers.cc:597] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:55.956270 22102 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:55.970535 21988 consensus_peers.cc:597] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.024382 21988 consensus_peers.cc:597] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.024933 21988 consensus_peers.cc:597] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.072088 21914 consensus_peers.cc:597] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.083992 22071 consensus_queue.cc:1048] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:56.091367 21988 consensus_peers.cc:597] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:56.109891 22095 consensus_queue.cc:1048] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:56.189706 21914 consensus_peers.cc:597] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:56.627710 21914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111) [suppressed 169 similar messages]
W20260709 12:14:56.725569 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:57.046991 22155 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef14c6a5fb654fc3985d8f8e783b2bfb)
I20260709 12:14:57.047605 22155 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:57.049286 22155 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:57.050448 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:57.051630 22098 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef14c6a5fb654fc3985d8f8e783b2bfb)
I20260709 12:14:57.052107 22098 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
W20260709 12:14:57.053604 21914 leader_election.cc:336] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:14:57.054020 22098 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:57.054258 21914 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:57.055171 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:14:57.055351 22155 raft_consensus.cc:2749] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:57.056147 21949 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 1.
I20260709 12:14:57.057214 21987 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:14:57.057848 22098 raft_consensus.cc:2804] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:57.058128 22098 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef14c6a5fb654fc3985d8f8e783b2bfb)
W20260709 12:14:57.058300 21988 leader_election.cc:336] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:14:57.058446 22098 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:57.064436 22098 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:57.066363 22098 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:14:57.073654 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:14:57.074297 21949 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:57.075723 21988 leader_election.cc:336] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:14:57.079222 21949 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 2.
I20260709 12:14:57.080379 21987 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:57.081090 22102 raft_consensus.cc:2804] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:57.081786 22102 raft_consensus.cc:697] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:14:57.082803 22102 consensus_queue.cc:237] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:14:57.090819 21768 catalog_manager.cc:5697] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 1 to 2, leader changed from ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 2 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:57.151388 22155 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.151888 22155 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:57.153779 22155 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:57.155292 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:14:57.156155 22022 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 1.
I20260709 12:14:57.157678 21912 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
W20260709 12:14:57.158304 21914 leader_election.cc:336] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:14:57.158551 22155 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:57.159060 22155 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.159371 22155 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:57.165197 22155 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:57.166986 22155 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:14:57.168222 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:14:57.168918 22022 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:57.170393 21914 leader_election.cc:336] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:14:57.174335 22022 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:14:57.175647 21912 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:14:57.176349 22155 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:57.176888 22155 raft_consensus.cc:697] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:14:57.177748 22155 consensus_queue.cc:237] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:14:57.186239 21768 catalog_manager.cc:5697] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 1 to 2, leader changed from ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 2 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:57.529279 21949 raft_consensus.cc:1275] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:57.531090 22102 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:57.544891 21988 consensus_peers.cc:597] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:57.726653 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:57.782310 21914 consensus_peers.cc:597] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.805186 22022 raft_consensus.cc:1275] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:57.806691 22155 consensus_queue.cc:1048] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:58.162247 21988 consensus_peers.cc:597] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.218143 21988 consensus_peers.cc:597] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.381429 21988 consensus_peers.cc:597] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.421655 21988 consensus_peers.cc:597] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.495203 21988 consensus_peers.cc:597] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.644232 21914 consensus_peers.cc:597] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.727763 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:58.830204 21914 consensus_peers.cc:597] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:58.944664 21988 consensus_peers.cc:597] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:59.728773 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:00.400463 21988 consensus_peers.cc:597] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:00.495667 21914 consensus_peers.cc:597] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:00.574735 21988 consensus_peers.cc:597] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:00.719205 21988 consensus_peers.cc:597] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:00.729678 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:00.734618 21988 consensus_peers.cc:597] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.802949  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:00.809782 22169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:00.810725 22170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:00.812203 22172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:00.814116  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:00.816892  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:00.817185  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:00.817410  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599300817389 us; error 0 us; skew 500 ppm
I20260709 12:15:00.818142  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:00.821484  9938 webserver.cc:533] Webserver started at http://127.9.180.129:46071/ using document root <none> and password file <none>
I20260709 12:15:00.822000  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:00.822153  9938 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:15:00.825704  9938 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:00.829460 22177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:00.830375  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:15:00.830745  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
format_stamp: "Formatted at 2026-07-09 12:14:53 on dist-test-slave-lg8f"
I20260709 12:15:00.831012  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:00.849074  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:00.850361  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:00.852276  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:15:00.853394 21988 consensus_peers.cc:597] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.856678 22184 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:15:00.907965  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:15:00.908252  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.053s	user 0.001s	sys 0.002s
I20260709 12:15:00.908618  9938 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:15:00.913153 22184 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:00.929010 22184 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:00.930051 22184 tablet_bootstrap.cc:492] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:00.931481 22184 ts_tablet_manager.cc:1403] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
W20260709 12:15:00.934638 21988 consensus_peers.cc:597] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:00.934415 22184 raft_consensus.cc:359] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:00.935268 22184 raft_consensus.cc:740] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:00.936015 22184 consensus_queue.cc:260] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:00.938942 22184 ts_tablet_manager.cc:1434] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:15:00.939757 22184 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:00.955248 22184 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:00.956192 22184 tablet_bootstrap.cc:492] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:00.956815 22184 ts_tablet_manager.cc:1403] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 12:15:00.959301 22184 raft_consensus.cc:359] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:00.959964 22184 raft_consensus.cc:740] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:00.960670 22184 consensus_queue.cc:260] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:00.961469  9938 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:15:00.961861  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.053s	user 0.053s	sys 0.001s
I20260709 12:15:00.962958 22184 ts_tablet_manager.cc:1434] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:15:00.963858 22184 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:00.982358 22184 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:15:00.983600 22184 tablet_bootstrap.cc:492] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:00.984448 22184 ts_tablet_manager.cc:1403] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:15:00.987792 22184 raft_consensus.cc:359] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:00.988828 22184 raft_consensus.cc:740] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:00.989745 22184 consensus_queue.cc:260] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:00.992329 22184 ts_tablet_manager.cc:1434] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:00.993273 22184 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.016782 22184 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.017714 22184 tablet_bootstrap.cc:492] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.018466 22184 ts_tablet_manager.cc:1403] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 12:15:01.021245 22184 raft_consensus.cc:359] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.022033 22184 raft_consensus.cc:740] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.022884 22184 consensus_queue.cc:260] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.025249 22184 ts_tablet_manager.cc:1434] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:01.026005 22184 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.029273  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:39209
I20260709 12:15:01.029435 22246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:39209 every 8 connection(s)
I20260709 12:15:01.034554  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:01.043476 22184 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.044366 22184 tablet_bootstrap.cc:492] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.044967 22184 ts_tablet_manager.cc:1403] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:15:01.047235 22184 raft_consensus.cc:359] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.048002 22184 raft_consensus.cc:740] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.048679 22184 consensus_queue.cc:260] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.050129 22184 ts_tablet_manager.cc:1434] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:01.051012 22184 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.058113 22247 heartbeater.cc:344] Connected to a master server at 127.9.180.190:44963
I20260709 12:15:01.058770 22247 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:01.059885 22247 heartbeater.cc:507] Master 127.9.180.190:44963 requested a full tablet report, sending...
I20260709 12:15:01.065557 22184 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.066401 22184 tablet_bootstrap.cc:492] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.067095 22184 ts_tablet_manager.cc:1403] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 12:15:01.066830 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27a2cab73be544638de72f21aa592869"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:01.067693 22022 raft_consensus.cc:606] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:01.068607 21768 ts_manager.cc:194] Re-registered known tserver with Master: ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209)
I20260709 12:15:01.069622 22184 raft_consensus.cc:359] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.070364 22184 raft_consensus.cc:740] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.071269 22184 consensus_queue.cc:260] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.073035 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:01.073228 22184 ts_tablet_manager.cc:1434] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:15:01.073735 22022 raft_consensus.cc:606] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:01.074213 22184 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.077728 22022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:01.078820 22022 raft_consensus.cc:606] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:01.080303 21768 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51366
I20260709 12:15:01.081048  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:01.081873  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:01.082774  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:01.092813 22247 heartbeater.cc:499] Master 127.9.180.190:44963 was elected leader, sending a full tablet report...
I20260709 12:15:01.093015 22184 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.094038 22184 tablet_bootstrap.cc:492] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.094693 22184 ts_tablet_manager.cc:1403] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:15:01.097012 22184 raft_consensus.cc:359] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.097730 22184 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.098395 22184 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.100064 22184 ts_tablet_manager.cc:1434] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:01.100708 22184 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.104552 22220 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.109442 22184 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.110140 22184 tablet_bootstrap.cc:492] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.110749 22184 ts_tablet_manager.cc:1403] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:15:01.112650 22184 raft_consensus.cc:359] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.113286 22184 raft_consensus.cc:740] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.113912 22184 consensus_queue.cc:260] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.114554 22220 pending_rounds.cc:85] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Aborting all ops after (but not including) 0
I20260709 12:15:01.114969 22220 pending_rounds.cc:107] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:15:01.115208 22220 raft_consensus.cc:2889] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:01.116267 22184 ts_tablet_manager.cc:1434] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:01.117055 22184 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.131260 22184 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.132189 22184 tablet_bootstrap.cc:492] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.132855 22184 ts_tablet_manager.cc:1403] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:15:01.133001 22227 raft_consensus.cc:993] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:01.133461 22227 raft_consensus.cc:1081] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:01.135167 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:01.135739 21949 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:01.135443 22184 raft_consensus.cc:359] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.136083 21949 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.136118 22184 raft_consensus.cc:740] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.136904 22184 consensus_queue.cc:260] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.139036 22184 ts_tablet_manager.cc:1434] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:01.139814 22184 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap starting.
I20260709 12:15:01.142972 21949 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:01.145722 21949 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 3 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:01.146327 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:01.146127 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:01.147087 22022 raft_consensus.cc:3055] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:01.147245 22220 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.147519 22022 raft_consensus.cc:740] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:01.148487 22022 consensus_queue.cc:260] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:01.149943 22022 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.155419 22184 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.156442 22184 tablet_bootstrap.cc:492] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Bootstrap complete.
I20260709 12:15:01.156371 22220 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 3.
I20260709 12:15:01.157588 22184 ts_tablet_manager.cc:1403] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:15:01.158113 21914 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:01.159070 22155 raft_consensus.cc:2804] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:01.160408 22155 raft_consensus.cc:697] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:01.160564 22184 raft_consensus.cc:359] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.161274 22184 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef14c6a5fb654fc3985d8f8e783b2bfb, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.161324 22155 consensus_queue.cc:237] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:01.161949 22022 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 3.
I20260709 12:15:01.162060 22184 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.164255 22184 ts_tablet_manager.cc:1434] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:01.170634 21768 catalog_manager.cc:5697] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 2 to 3, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 3 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.209198 22227 raft_consensus.cc:993] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:01.209785 22098 raft_consensus.cc:1081] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:01.211706 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:01.212333 21949 raft_consensus.cc:493] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:01.212695 21949 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.221087 21949 raft_consensus.cc:515] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.224679 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:01.224907 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:01.225548 22220 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.225762 22022 raft_consensus.cc:3055] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:01.226233 22022 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:01.227137 22022 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.228986 21949 leader_election.cc:290] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:01.228390 22022 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.234527 22220 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:01.235841 21914 leader_election.cc:304] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:01.236694 22155 raft_consensus.cc:2804] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:01.237146 22155 raft_consensus.cc:697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:01.237557 22022 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:01.237972 22155 consensus_queue.cc:237] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.246678 21768 catalog_manager.cc:5697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 1 to 2, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 2 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.266269 22227 raft_consensus.cc:993] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:01.266970 22098 raft_consensus.cc:1081] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:01.268656 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27a2cab73be544638de72f21aa592869"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:01.269133 21949 raft_consensus.cc:493] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:01.269419 21949 raft_consensus.cc:3060] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.273823 21949 raft_consensus.cc:515] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.275334 21949 leader_election.cc:290] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:01.276494 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:01.276605 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27a2cab73be544638de72f21aa592869" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:01.277071 22220 raft_consensus.cc:3060] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.277320 22022 raft_consensus.cc:3055] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:01.277716 22022 raft_consensus.cc:740] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:01.278476 22022 consensus_queue.cc:260] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.279630 22022 raft_consensus.cc:3060] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.282259 22220 raft_consensus.cc:2468] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:01.283576 21914 leader_election.cc:304] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:01.284509 22155 raft_consensus.cc:2804] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:01.284957 22155 raft_consensus.cc:697] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:01.285735 22155 consensus_queue.cc:237] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:01.285995 22022 raft_consensus.cc:2468] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:01.294234 21768 catalog_manager.cc:5697] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 1 to 2, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 2 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.597397 22022 raft_consensus.cc:1275] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:01.599169 22274 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:01.610558 22220 raft_consensus.cc:1275] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:01.612401 22262 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.668859 22022 raft_consensus.cc:1275] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.670320 22274 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.681234 22220 raft_consensus.cc:1275] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.683717 22281 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:01.726042 22022 raft_consensus.cc:1275] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.727499 22281 consensus_queue.cc:1048] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:01.730767 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:01.736825 22220 raft_consensus.cc:1275] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.738899 22274 consensus_queue.cc:1048] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:02.096032  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:02.113570 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
mode: GRACEFUL
new_leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:15:02.114095 21949 raft_consensus.cc:606] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Received request to transfer leadership to TS 2c991c3b7b734fc3aba2d42adc00553e
I20260709 12:15:02.116705 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
mode: GRACEFUL
new_leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:15:02.117156 21949 raft_consensus.cc:606] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Received request to transfer leadership to TS 2c991c3b7b734fc3aba2d42adc00553e
I20260709 12:15:02.118135  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:02.118793  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:02.119418  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:02.198256 22281 raft_consensus.cc:993] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: : Instructing follower 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:02.199893 22281 raft_consensus.cc:1081] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Signalling peer 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:02.202301 22021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:15:02.203096 22021 raft_consensus.cc:493] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:02.203472 22021 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:02.212083 22021 raft_consensus.cc:515] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:02.213904 22021 leader_election.cc:290] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:02.215481 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:02.216156 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:02.216694 22220 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:02.216905 21949 raft_consensus.cc:3055] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:02.217305 21949 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:02.218207 21949 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:02.219892 21949 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:02.225840 22220 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:02.227594 21949 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:02.227761 21988 leader_election.cc:304] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:02.229074 22227 raft_consensus.cc:2804] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:02.229676 22227 raft_consensus.cc:697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:02.231171 22227 consensus_queue.cc:237] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:02.240898 21768 catalog_manager.cc:5697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 2 to 3, leader changed from ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 3 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:02.639811 22281 raft_consensus.cc:993] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: : Instructing follower 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:02.640473 22262 raft_consensus.cc:1081] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Signalling peer 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:02.642220 22021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:15:02.642792 22021 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:02.643126 22021 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.652045 22021 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:02.654278 22021 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:02.654994 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:02.655725 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:02.655850 22220 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.656589 21949 raft_consensus.cc:3055] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:02.656931 21949 raft_consensus.cc:740] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:02.657974 21949 consensus_queue.cc:260] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:02.659220 21949 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.662856 22220 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 2.
I20260709 12:15:02.664304 21988 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:02.664701 21949 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 2.
I20260709 12:15:02.665038 22227 raft_consensus.cc:2804] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:02.665735 22227 raft_consensus.cc:697] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:02.667052 22227 consensus_queue.cc:237] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:02.675351 21769 catalog_manager.cc:5697] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 1 to 2, leader changed from ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 2 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:02.715482 22220 raft_consensus.cc:1275] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:02.717070 22227 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:02.730305 21949 raft_consensus.cc:1275] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:15:02.732472 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:02.732717 22283 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:03.172205 22220 raft_consensus.cc:1275] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:03.174084 22283 consensus_queue.cc:1048] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:03.187189 21949 raft_consensus.cc:1275] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:03.189188 22227 consensus_queue.cc:1048] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:03.198024  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:03.209671 22021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:03.210351 22021 raft_consensus.cc:606] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:03.213218 22021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:03.213766 22021 raft_consensus.cc:606] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:03.216507 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
mode: GRACEFUL
new_leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:15:03.217068 21949 raft_consensus.cc:606] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Received request to transfer leadership to TS 2c991c3b7b734fc3aba2d42adc00553e
I20260709 12:15:03.218585  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:03.219156  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:03.219966  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:03.229104 22283 raft_consensus.cc:993] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:03.229840 22227 raft_consensus.cc:1081] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:03.231668 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:03.232141 21949 raft_consensus.cc:493] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.232443 21949 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:03.237716 21949 raft_consensus.cc:515] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.239631 21949 leader_election.cc:290] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:03.240676 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:03.241282 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d8bf7d7c60444e90c8f1a7c4c6a978" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:03.241535 22220 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:03.241993 22021 raft_consensus.cc:3055] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:03.242389 22021 raft_consensus.cc:740] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:03.243424 22021 consensus_queue.cc:260] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.244927 22021 raft_consensus.cc:3060] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:03.250928 22220 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 4.
I20260709 12:15:03.252583 21914 leader_election.cc:304] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:03.253535 22281 raft_consensus.cc:2804] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:03.253981 22021 raft_consensus.cc:2468] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 4.
I20260709 12:15:03.254105 22281 raft_consensus.cc:697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:03.255334 22281 consensus_queue.cc:237] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.262724 21768 catalog_manager.cc:5697] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 3 to 4, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 4 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.265082 22262 raft_consensus.cc:993] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: : Instructing follower 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:03.265846 22281 raft_consensus.cc:1081] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Signalling peer 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:03.268236 22021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:15:03.269065 22021 raft_consensus.cc:493] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.269403 22021 raft_consensus.cc:3060] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.276669 22021 raft_consensus.cc:515] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.278362 22021 leader_election.cc:290] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:03.279430 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:03.279531 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:03.280191 22220 raft_consensus.cc:3060] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.280244 21949 raft_consensus.cc:3055] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:03.280758 21949 raft_consensus.cc:740] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:03.281601 21949 consensus_queue.cc:260] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.282644 21949 raft_consensus.cc:3060] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.286377 22220 raft_consensus.cc:2468] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 2.
I20260709 12:15:03.286979 21949 raft_consensus.cc:2468] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 2.
I20260709 12:15:03.287647 21988 leader_election.cc:304] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:03.288631 22227 raft_consensus.cc:2804] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:03.289077 22227 raft_consensus.cc:697] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:03.289980 22227 consensus_queue.cc:237] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.298198 21768 catalog_manager.cc:5697] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 1 to 2, leader changed from ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 2 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:03.643425 22219 raft_consensus.cc:1275] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:03.644857 22262 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:03.653486 22021 raft_consensus.cc:1275] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:03.656462 22305 consensus_queue.cc:1048] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:03.712965 22283 raft_consensus.cc:993] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:03.713505 22227 raft_consensus.cc:1081] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:03.715138 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:03.715663 21949 raft_consensus.cc:493] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:03.716004 21949 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.722285 21949 raft_consensus.cc:515] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.724089 21949 leader_election.cc:290] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:03.725404 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:03.725404 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:03.726476 22021 raft_consensus.cc:3055] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:03.726629 22219 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.727048 22021 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:03.728286 22021 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.729439 22021 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:03.733848 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:03.735097 22021 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:03.735433 22219 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:03.736399 21912 leader_election.cc:304] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:15:03.737290 22305 raft_consensus.cc:2804] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:03.737818 22305 raft_consensus.cc:697] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:03.738838 22305 consensus_queue.cc:237] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:03.743240 22219 raft_consensus.cc:1275] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:03.745115 22227 consensus_queue.cc:1048] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:03.747118 21769 catalog_manager.cc:5697] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 1 to 2, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 2 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:03.756373 21949 raft_consensus.cc:1275] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:03.758045 22227 consensus_queue.cc:1048] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:04.227662  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:04.235136 22021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:04.235879 22021 raft_consensus.cc:606] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:04.238646 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b0949de112842658e03f9dd1008784e"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
mode: GRACEFUL
new_leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:15:04.239183 21949 raft_consensus.cc:606] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Received request to transfer leadership to TS 2c991c3b7b734fc3aba2d42adc00553e
I20260709 12:15:04.242203 21949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
mode: GRACEFUL
new_leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:15:04.242761 21949 raft_consensus.cc:606] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Received request to transfer leadership to TS 2c991c3b7b734fc3aba2d42adc00553e
I20260709 12:15:04.244010  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:04.244011 22219 raft_consensus.cc:1275] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.244604  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:04.245437  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:04.245837 22281 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.257258 22021 raft_consensus.cc:1275] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:04.259562 22310 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.269630 22305 raft_consensus.cc:993] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: : Instructing follower 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:04.270222 22310 raft_consensus.cc:1081] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Signalling peer 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:04.272117 22021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:15:04.272939 22021 raft_consensus.cc:493] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.273408 22021 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.279506 22021 raft_consensus.cc:515] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.281183 22021 leader_election.cc:290] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:04.282079 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:04.282359 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:04.282822 22219 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.283110 21949 raft_consensus.cc:3055] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:04.283514 21949 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:04.284269 21949 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.285526 21949 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.290364 22219 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:04.291651 21988 leader_election.cc:304] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:04.292265 21949 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:04.292644 22227 raft_consensus.cc:2804] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:04.293289 22227 raft_consensus.cc:697] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:04.294129 22227 consensus_queue.cc:237] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.301728 21769 catalog_manager.cc:5697] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 2 to 3, leader changed from ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 3 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:04.355607 22314 raft_consensus.cc:993] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:04.356215 22308 raft_consensus.cc:1081] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:04.358014 21949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:04.358839 21949 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.359197 21949 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.365552 21949 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.367542 21949 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 3 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:04.368773 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:04.368989 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:04.369602 22219 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.369627 22021 raft_consensus.cc:3055] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:04.370297 22021 raft_consensus.cc:740] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:04.371351 22021 consensus_queue.cc:260] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.372828 22021 raft_consensus.cc:3060] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.378892 22219 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 3.
I20260709 12:15:04.380594 21914 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:04.381244 22021 raft_consensus.cc:2468] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 3.
I20260709 12:15:04.381593 22310 raft_consensus.cc:2804] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:04.382313 22310 raft_consensus.cc:697] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:04.383265 22310 consensus_queue.cc:237] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.390926 21769 catalog_manager.cc:5697] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 2 to 3, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 3 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.434537 22305 raft_consensus.cc:993] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: : Instructing follower 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:04.435093 22281 raft_consensus.cc:1081] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Signalling peer 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:04.436862 22021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b0949de112842658e03f9dd1008784e"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:15:04.437390 22021 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:04.437705 22021 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.443688 22021 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.445672 22021 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:04.446774 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:04.447067 21949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:04.447417 22219 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.447881 21949 raft_consensus.cc:3055] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:04.448187 21949 raft_consensus.cc:740] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:04.449048 21949 consensus_queue.cc:260] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.450240 21949 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:04.453171 22219 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:04.454355 21988 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:04.455181 22308 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:04.455747 22308 raft_consensus.cc:697] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:04.457206 21949 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:04.456951 22308 consensus_queue.cc:237] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:04.466277 21769 catalog_manager.cc:5697] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 2 to 3, leader changed from ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 3 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:04.735168 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:04.756074 21948 raft_consensus.cc:1275] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.757557 22308 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:04.767663 22219 raft_consensus.cc:1275] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.770031 22308 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:04.920609 22219 raft_consensus.cc:1275] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.921938 22281 consensus_queue.cc:1048] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:04.931595 22021 raft_consensus.cc:1275] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:04.933887 22281 consensus_queue.cc:1048] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:04.961822 21948 raft_consensus.cc:1275] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:04.963264 22227 consensus_queue.cc:1048] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:04.968668 22219 raft_consensus.cc:1275] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:04.970583 22227 consensus_queue.cc:1048] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.538805  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:06.578320 22328 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf27de0b46c48f8ad3edb85dd24193b)
I20260709 12:15:06.586174 22328 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.593578 22330 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf27de0b46c48f8ad3edb85dd24193b)
I20260709 12:15:06.594262 22330 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:06.595054 22328 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:06.596936 22330 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:06.597747 22331 raft_consensus.cc:493] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.598325 22331 raft_consensus.cc:515] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.599887 22333 raft_consensus.cc:493] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf27de0b46c48f8ad3edb85dd24193b)
I20260709 12:15:06.601545 22333 raft_consensus.cc:515] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.602044 22334 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.600835 22331 leader_election.cc:290] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
W20260709 12:15:06.602774 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:06.602777 22334 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.606206 22334 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.607401 22334 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.608314 22334 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.611157 22334 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.612840 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:15:06.613670 22219 raft_consensus.cc:2468] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 1.
I20260709 12:15:06.616144 22333 leader_election.cc:290] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.618098 21914 leader_election.cc:304] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:06.619599 22331 raft_consensus.cc:2804] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:06.620121 22331 raft_consensus.cc:493] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.621179 22331 raft_consensus.cc:3060] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.623934 22337 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.624622 22337 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.627689 22337 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.627823 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:15:06.628516 22219 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 3.
I20260709 12:15:06.629755 21914 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:06.634207 22022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.640233 22331 raft_consensus.cc:515] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.643069 22331 leader_election.cc:290] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.646376 22337 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:06.646838 22337 raft_consensus.cc:493] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.646739 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:06.647328 22337 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:06.647488 22219 raft_consensus.cc:3060] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.657004 22339 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.657790 22339 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.662057 22339 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.663494 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:15:06.664371 22212 raft_consensus.cc:2468] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 1.
I20260709 12:15:06.665194 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:06.667390 21914 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:06.667783 22333 raft_consensus.cc:493] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.668426 22219 raft_consensus.cc:2468] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:06.668602 22333 raft_consensus.cc:515] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.669317 22216 raft_consensus.cc:1240] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Rejecting Update request from peer 2c991c3b7b734fc3aba2d42adc00553e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:06.670562 22331 raft_consensus.cc:2804] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:06.670946 22331 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.671182 22333 leader_election.cc:290] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.671331 22331 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.673297 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.675022 21914 leader_election.cc:304] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:06.676192 22339 raft_consensus.cc:2804] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:06.677054 22339 raft_consensus.cc:697] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:06.679117 22339 consensus_queue.cc:237] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.676892 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:15:06.682449 22333 raft_consensus.cc:493] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c991c3b7b734fc3aba2d42adc00553e)
I20260709 12:15:06.683044 22333 raft_consensus.cc:515] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.684863 21947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.685266 22333 leader_election.cc:290] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.686384 22021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:06.687000 22021 raft_consensus.cc:606] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.677426 22337 raft_consensus.cc:515] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.697078 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:06.697540 22337 leader_election.cc:290] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.701392 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e972ee484fc47419b19c2b451b5ff60" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.701756 21987 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e; no voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:15:06.703975 22227 raft_consensus.cc:2749] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:06.706620 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" is_pre_election: true
I20260709 12:15:06.701623 21949 raft_consensus.cc:1240] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Rejecting Update request from peer 2c991c3b7b734fc3aba2d42adc00553e for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:06.711174 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.712877 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.712987 22331 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.714289 21948 raft_consensus.cc:1240] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Rejecting Update request from peer 2c991c3b7b734fc3aba2d42adc00553e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:06.716912 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.717708 22330 consensus_queue.cc:1059] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.718478 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.718870 22330 raft_consensus.cc:3055] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:06.719305 22330 raft_consensus.cc:740] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:06.720252 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.720219 22330 consensus_queue.cc:260] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.721688 22330 raft_consensus.cc:3060] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.723906 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:06.725625 21945 raft_consensus.cc:1240] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Rejecting Update request from peer 2c991c3b7b734fc3aba2d42adc00553e for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:06.721750 21948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
mode: GRACEFUL
new_leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:15:06.717872 21988 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e; no voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:15:06.726622 21948 raft_consensus.cc:606] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Received request to transfer leadership to TS 2c991c3b7b734fc3aba2d42adc00553e
I20260709 12:15:06.728543 22331 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:06.731527 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.731839 22023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
mode: GRACEFUL
new_leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:37416
I20260709 12:15:06.732491 21945 raft_consensus.cc:2393] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef14c6a5fb654fc3985d8f8e783b2bfb in current term 4: Already voted for candidate ddf27de0b46c48f8ad3edb85dd24193b in this term.
I20260709 12:15:06.732499 22023 raft_consensus.cc:606] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Received request to transfer leadership to TS ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.733273 22328 raft_consensus.cc:2749] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:06.733661 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.734113 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083641bfbbc54f52977a079cceb15bd7" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.734392  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:15:06.734552 21945 raft_consensus.cc:2393] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef14c6a5fb654fc3985d8f8e783b2bfb in current term 2: Already voted for candidate ddf27de0b46c48f8ad3edb85dd24193b in this term.
I20260709 12:15:06.734107 22328 consensus_queue.cc:1059] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:06.735587  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:06.736214 21945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcce7d80a1446e39732a0a60f126eaf" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.736163 22227 raft_consensus.cc:3055] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:06.736362  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:06.737321 22227 raft_consensus.cc:740] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:06.737785 22328 consensus_queue.cc:1059] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.738677 22179 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.738405 22227 consensus_queue.cc:260] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.739300 22332 raft_consensus.cc:3055] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:06.739711 22332 raft_consensus.cc:740] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:06.740052 22333 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:06.740530 22227 raft_consensus.cc:3060] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:06.740944 22332 consensus_queue.cc:260] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.742908 22332 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.748382 22333 raft_consensus.cc:2749] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:06.749742 22179 leader_election.cc:304] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.736487 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf9037afdbe7416e98413b10282d5b8e" candidate_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:06.750875 22019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e" is_pre_election: true
I20260709 12:15:06.751621 22333 raft_consensus.cc:2749] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:06.751184 21770 catalog_manager.cc:5697] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 1 to 2, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 2 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:06.752928 22179 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.754468 22021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:06.755415 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b0949de112842658e03f9dd1008784e" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:06.755646 22179 leader_election.cc:304] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.756289 22333 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.756646 22334 raft_consensus.cc:2749] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:06.757267 22179 leader_election.cc:304] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b
I20260709 12:15:06.758565 22334 raft_consensus.cc:2749] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:06.762425 22019 raft_consensus.cc:2468] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 2.
I20260709 12:15:06.762885 21912 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b; no voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:15:06.763907 22331 raft_consensus.cc:2749] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:06.764366 22023 raft_consensus.cc:2468] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 4.
I20260709 12:15:06.764979 22333 raft_consensus.cc:2749] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:06.765750 21912 leader_election.cc:304] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:15:06.766752 22331 raft_consensus.cc:2804] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:06.767289 22331 raft_consensus.cc:697] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:06.768079 22331 consensus_queue.cc:237] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:06.782778 21770 catalog_manager.cc:5697] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 3 to 4, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 4 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.098255 22330 raft_consensus.cc:993] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: : Instructing follower ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:07.098876 22332 raft_consensus.cc:1081] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Signalling peer ddf27de0b46c48f8ad3edb85dd24193b to start an election
I20260709 12:15:07.100664 21948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68"
dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
 from {username='slave'} at 127.0.0.1:45706
I20260709 12:15:07.101254 21948 raft_consensus.cc:493] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:07.101574 21948 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:07.107343 21948 raft_consensus.cc:515] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:07.109248 21948 leader_election.cc:290] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131:45857)
I20260709 12:15:07.110057 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:07.110826 22339 raft_consensus.cc:993] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: : Instructing follower 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:07.110625 22023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fa1b90c3a9410da992ec1ab11a6a68" candidate_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
I20260709 12:15:07.111022 22217 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:07.111510 22023 raft_consensus.cc:3055] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:07.111584 22341 raft_consensus.cc:1081] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Signalling peer 2c991c3b7b734fc3aba2d42adc00553e to start an election
I20260709 12:15:07.112057 22023 raft_consensus.cc:740] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:07.113538 22019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31"
dest_uuid: "2c991c3b7b734fc3aba2d42adc00553e"
 from {username='slave'} at 127.0.0.1:43544
I20260709 12:15:07.113291 22023 consensus_queue.cc:260] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:07.114089 22019 raft_consensus.cc:493] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:07.114603 22019 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:07.115068 22023 raft_consensus.cc:3060] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:07.120705 22019 raft_consensus.cc:515] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:07.121779 22217 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 4.
I20260709 12:15:07.123168 22019 leader_election.cc:290] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 4 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:07.123390 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb"
I20260709 12:15:07.123381 21914 leader_election.cc:304] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf27de0b46c48f8ad3edb85dd24193b, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:07.124634 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5a9c37cdf41279a7565a0ad14bf31" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:07.124570 22216 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:07.125548 22341 raft_consensus.cc:2804] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:07.125976 21948 raft_consensus.cc:3055] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:07.124580 22023 raft_consensus.cc:2468] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf27de0b46c48f8ad3edb85dd24193b in term 4.
I20260709 12:15:07.126518 21948 raft_consensus.cc:740] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:07.126240 22341 raft_consensus.cc:697] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 LEADER]: Becoming Leader. State: Replica: ddf27de0b46c48f8ad3edb85dd24193b, State: Running, Role: LEADER
I20260709 12:15:07.128090 22341 consensus_queue.cc:237] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:07.128094 21948 consensus_queue.cc:260] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:07.130079 21948 raft_consensus.cc:3060] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:07.135648 22216 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 4.
I20260709 12:15:07.136972 21988 leader_election.cc:304] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ef14c6a5fb654fc3985d8f8e783b2bfb; no voters: 
I20260709 12:15:07.137295 21948 raft_consensus.cc:2468] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 4.
I20260709 12:15:07.137856 22332 raft_consensus.cc:2804] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:07.138408 22332 raft_consensus.cc:697] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:07.139508 22332 consensus_queue.cc:237] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } }
I20260709 12:15:07.140903 21770 catalog_manager.cc:5697] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b reported cstate change: term changed from 3 to 4, leader changed from 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131) to ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130). New cstate: current_term: 4 leader_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.149062 21769 catalog_manager.cc:5697] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 3 to 4, leader changed from ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130) to 2c991c3b7b734fc3aba2d42adc00553e (127.9.180.131). New cstate: current_term: 4 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.171765 22023 raft_consensus.cc:1275] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:07.173318 22341 consensus_queue.cc:1048] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:07.186271 22216 raft_consensus.cc:1275] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:07.187966 22341 consensus_queue.cc:1048] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:07.255066 22023 raft_consensus.cc:1275] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:07.256529 22331 consensus_queue.cc:1048] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:07.269765 22216 raft_consensus.cc:1275] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:07.271791 22341 consensus_queue.cc:1048] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:07.524377 21948 raft_consensus.cc:1275] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:07.525790 22332 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:07.535284 22216 raft_consensus.cc:1275] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:07.537189 22227 consensus_queue.cc:1048] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:07.554287 22023 raft_consensus.cc:1275] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:07.555625 22341 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:07.569598 22216 raft_consensus.cc:1275] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Refusing update from remote peer ddf27de0b46c48f8ad3edb85dd24193b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:07.571131 22341 consensus_queue.cc:1048] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:15:07.604000 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:07.604755 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080005bba0 after lost signal to thread 9941
W20260709 12:15:07.605852 22243 debug-util.cc:398] Leaking SignalData structure 0x7b0800103f80 after lost signal to thread 21806
W20260709 12:15:07.608467 22243 debug-util.cc:398] Leaking SignalData structure 0x7b080025e340 after lost signal to thread 22246
I20260709 12:15:07.757591  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:07.795408  9938 tablet_server.cc:179] TabletServer@127.9.180.129:39209 shutting down...
I20260709 12:15:07.834864  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:07.835949  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.837193  9938 raft_consensus.cc:2243] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.838003  9938 raft_consensus.cc:2272] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.842377  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.843266  9938 raft_consensus.cc:2243] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.843909  9938 raft_consensus.cc:2272] T 6fcce7d80a1446e39732a0a60f126eaf P ef14c6a5fb654fc3985d8f8e783b2bfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.847280  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.848011  9938 raft_consensus.cc:2243] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.848519  9938 raft_consensus.cc:2272] T 0e972ee484fc47419b19c2b451b5ff60 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.852159  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.852977  9938 raft_consensus.cc:2243] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.853605  9938 raft_consensus.cc:2272] T b8fa1b90c3a9410da992ec1ab11a6a68 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.857713  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.858462  9938 raft_consensus.cc:2243] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.859174  9938 raft_consensus.cc:2272] T cf9037afdbe7416e98413b10282d5b8e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.862286  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.863179  9938 raft_consensus.cc:2243] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.863770  9938 raft_consensus.cc:2272] T 27a2cab73be544638de72f21aa592869 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.866937  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.867624  9938 raft_consensus.cc:2243] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.868266  9938 raft_consensus.cc:2272] T 6b0949de112842658e03f9dd1008784e P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.871891  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.872512  9938 raft_consensus.cc:2243] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.872983  9938 raft_consensus.cc:2272] T 631f63153e40485bb1f960078a0f47c9 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.876199  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.876859  9938 raft_consensus.cc:2243] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.877352  9938 raft_consensus.cc:2272] T 083641bfbbc54f52977a079cceb15bd7 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:07.880512  9938 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:07.881132  9938 raft_consensus.cc:2243] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:07.881726  9938 raft_consensus.cc:2272] T 94b5a9c37cdf41279a7565a0ad14bf31 P ef14c6a5fb654fc3985d8f8e783b2bfb [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:07.989845 21914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111) [suppressed 90 similar messages]
W20260709 12:15:07.993732 21914 consensus_peers.cc:597] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.091137 21914 consensus_peers.cc:597] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.164391 21988 consensus_peers.cc:597] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.165131 21988 consensus_peers.cc:597] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.169570 21914 consensus_peers.cc:597] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.221099 21914 consensus_peers.cc:597] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.272097 21914 consensus_peers.cc:597] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.285096 21914 consensus_peers.cc:597] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.341989 21988 consensus_peers.cc:597] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:08.376627 22369 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.377183 22369 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:08.379307 22369 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:08.380546 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" is_pre_election: true
I20260709 12:15:08.381330 21948 raft_consensus.cc:2468] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 2.
I20260709 12:15:08.382709 21987 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: 
I20260709 12:15:08.383477 22369 raft_consensus.cc:2804] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:08.383891 22369 raft_consensus.cc:493] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:08.383819 21988 leader_election.cc:336] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:15:08.384471 22369 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:08.390805 22369 raft_consensus.cc:515] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:08.392592 22369 leader_election.cc:290] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Requested vote from peers ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209), ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153)
I20260709 12:15:08.393990 21948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "631f63153e40485bb1f960078a0f47c9" candidate_uuid: "2c991c3b7b734fc3aba2d42adc00553e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf27de0b46c48f8ad3edb85dd24193b"
I20260709 12:15:08.394675 21948 raft_consensus.cc:3060] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:08.397094 21988 leader_election.cc:336] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111)
I20260709 12:15:08.401089 21948 raft_consensus.cc:2468] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c991c3b7b734fc3aba2d42adc00553e in term 3.
I20260709 12:15:08.402192 21987 leader_election.cc:304] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c991c3b7b734fc3aba2d42adc00553e, ddf27de0b46c48f8ad3edb85dd24193b; no voters: ef14c6a5fb654fc3985d8f8e783b2bfb
I20260709 12:15:08.402909 22369 raft_consensus.cc:2804] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:08.403440 22369 raft_consensus.cc:697] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Becoming Leader. State: Replica: 2c991c3b7b734fc3aba2d42adc00553e, State: Running, Role: LEADER
I20260709 12:15:08.404313 22369 consensus_queue.cc:237] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } }
I20260709 12:15:08.412967 21769 catalog_manager.cc:5697] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2c991c3b7b734fc3aba2d42adc00553e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef14c6a5fb654fc3985d8f8e783b2bfb" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c991c3b7b734fc3aba2d42adc00553e" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 45857 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:08.605151 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:08.807610 21988 consensus_peers.cc:597] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:08.909144  9938 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22243)
I20260709 12:15:09.022759 21948 raft_consensus.cc:1275] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Refusing update from remote peer 2c991c3b7b734fc3aba2d42adc00553e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:09.024307 22369 consensus_queue.cc:1048] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf27de0b46c48f8ad3edb85dd24193b" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:09.606581 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:09.909889  9938 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22243)
W20260709 12:15:10.396768 21988 consensus_peers.cc:597] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.509270 21988 consensus_peers.cc:597] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.545284 21914 consensus_peers.cc:597] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.589967 21914 consensus_peers.cc:597] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.607959 21820 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:10.663542 21914 consensus_peers.cc:597] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.677760 21914 consensus_peers.cc:597] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.778182 21914 consensus_peers.cc:597] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:10.830229 21914 consensus_peers.cc:597] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:10.838922  9938 tablet_server.cc:196] TabletServer@127.9.180.129:39209 shutdown complete.
I20260709 12:15:10.867980  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
I20260709 12:15:10.903649  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:10.904740  9938 tablet_replica.cc:333] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.905755  9938 raft_consensus.cc:2243] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:10.907101  9938 raft_consensus.cc:2272] T b8fa1b90c3a9410da992ec1ab11a6a68 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.910140  9938 tablet_replica.cc:333] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.910926  9938 raft_consensus.cc:2243] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:10.911473  9938 raft_consensus.cc:2272] T cf9037afdbe7416e98413b10282d5b8e P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.914412  9938 tablet_replica.cc:333] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.915333  9938 raft_consensus.cc:2243] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:10.915908  9938 raft_consensus.cc:2272] T 6fcce7d80a1446e39732a0a60f126eaf P ddf27de0b46c48f8ad3edb85dd24193b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:10.917701 21987 consensus_peers.cc:597] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153): Couldn't send request to peer ddf27de0b46c48f8ad3edb85dd24193b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:10.919150  9938 tablet_replica.cc:333] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.919842  9938 raft_consensus.cc:2243] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:10.920710  9938 raft_consensus.cc:2272] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.923588  9938 tablet_replica.cc:333] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.924212  9938 raft_consensus.cc:2243] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:10.925068  9938 raft_consensus.cc:2272] T 083641bfbbc54f52977a079cceb15bd7 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.927735  9938 tablet_replica.cc:333] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.928345  9938 raft_consensus.cc:2243] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:10.928756  9938 raft_consensus.cc:2272] T 94b5a9c37cdf41279a7565a0ad14bf31 P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.931586  9938 tablet_replica.cc:333] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.932331  9938 raft_consensus.cc:2243] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:10.933193  9938 raft_consensus.cc:2272] T 0e972ee484fc47419b19c2b451b5ff60 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.935899  9938 tablet_replica.cc:333] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.936508  9938 raft_consensus.cc:2243] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:10.938146  9938 raft_consensus.cc:2272] T 6b0949de112842658e03f9dd1008784e P ddf27de0b46c48f8ad3edb85dd24193b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.941166  9938 tablet_replica.cc:333] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.941905  9938 raft_consensus.cc:2243] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:10.942950  9938 raft_consensus.cc:2272] T 27a2cab73be544638de72f21aa592869 P ddf27de0b46c48f8ad3edb85dd24193b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:10.945351  9938 tablet_replica.cc:333] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b: stopping tablet replica
I20260709 12:15:10.946156  9938 raft_consensus.cc:2243] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:10.946669  9938 raft_consensus.cc:2272] T 631f63153e40485bb1f960078a0f47c9 P ddf27de0b46c48f8ad3edb85dd24193b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:10.952955 21987 consensus_peers.cc:597] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ddf27de0b46c48f8ad3edb85dd24193b (127.9.180.130:46153): Couldn't send request to peer ddf27de0b46c48f8ad3edb85dd24193b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:10.969112 21988 consensus_peers.cc:597] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e -> Peer ef14c6a5fb654fc3985d8f8e783b2bfb (127.9.180.129:39209): Couldn't send request to peer ef14c6a5fb654fc3985d8f8e783b2bfb. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:39209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:10.990329  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
I20260709 12:15:11.017674  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
I20260709 12:15:11.053988  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:11.054858  9938 tablet_replica.cc:333] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.056006  9938 raft_consensus.cc:2243] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:11.056553  9938 raft_consensus.cc:2272] T 0e972ee484fc47419b19c2b451b5ff60 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.059176  9938 tablet_replica.cc:333] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.059867  9938 raft_consensus.cc:2243] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:11.060375  9938 raft_consensus.cc:2272] T b8fa1b90c3a9410da992ec1ab11a6a68 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.062891  9938 tablet_replica.cc:333] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.063457  9938 raft_consensus.cc:2243] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:11.064318  9938 raft_consensus.cc:2272] T cf9037afdbe7416e98413b10282d5b8e P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.066725  9938 tablet_replica.cc:333] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.067320  9938 raft_consensus.cc:2243] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:11.067756  9938 raft_consensus.cc:2272] T 083641bfbbc54f52977a079cceb15bd7 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.069963  9938 tablet_replica.cc:333] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.070600  9938 raft_consensus.cc:2243] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:11.071488  9938 raft_consensus.cc:2272] T 94b5a9c37cdf41279a7565a0ad14bf31 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.073828  9938 tablet_replica.cc:333] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.074409  9938 raft_consensus.cc:2243] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:11.074896  9938 raft_consensus.cc:2272] T 89d8bf7d7c60444e90c8f1a7c4c6a978 P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.077266  9938 tablet_replica.cc:333] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.077832  9938 raft_consensus.cc:2243] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:11.078904  9938 raft_consensus.cc:2272] T 6fcce7d80a1446e39732a0a60f126eaf P 2c991c3b7b734fc3aba2d42adc00553e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.081817  9938 tablet_replica.cc:333] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.082464  9938 raft_consensus.cc:2243] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:11.083016  9938 raft_consensus.cc:2272] T 6b0949de112842658e03f9dd1008784e P 2c991c3b7b734fc3aba2d42adc00553e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.085323  9938 tablet_replica.cc:333] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.085877  9938 raft_consensus.cc:2243] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:11.086402  9938 raft_consensus.cc:2272] T 27a2cab73be544638de72f21aa592869 P 2c991c3b7b734fc3aba2d42adc00553e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.088708  9938 tablet_replica.cc:333] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e: stopping tablet replica
I20260709 12:15:11.089219  9938 raft_consensus.cc:2243] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:11.090108  9938 raft_consensus.cc:2272] T 631f63153e40485bb1f960078a0f47c9 P 2c991c3b7b734fc3aba2d42adc00553e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.124483  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:15:11.150020  9938 master.cc:562] Master@127.9.180.190:44963 shutting down...
I20260709 12:15:11.175855  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:11.176570  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:11.177016  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 87b4cb3f79e64121b59261097b85cfbb: stopping tablet replica
I20260709 12:15:11.199988  9938 master.cc:584] Master@127.9.180.190:44963 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (17681 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:15:11.252429  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:38551
I20260709 12:15:11.253854  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:11.260829 22388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.260939 22387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.261915 22390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:11.262360  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:11.263403  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:11.263592  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:11.263707  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599311263696 us; error 0 us; skew 500 ppm
I20260709 12:15:11.264187  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:11.266662  9938 webserver.cc:533] Webserver started at http://127.9.180.190:38913/ using document root <none> and password file <none>
I20260709 12:15:11.267122  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:11.267279  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:11.267501  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:11.268571  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "0e566ba6c16a459d8712fba2a68fc723"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.273030  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:15:11.276644 22395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.277539  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:15:11.277902  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "0e566ba6c16a459d8712fba2a68fc723"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.278230  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:11.324193  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:11.325698  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:11.367851  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:38551
I20260709 12:15:11.368013 22446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:38551 every 8 connection(s)
I20260709 12:15:11.372103 22447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.385535 22447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723: Bootstrap starting.
I20260709 12:15:11.391331 22447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:11.396251 22447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723: No bootstrap required, opened a new log
I20260709 12:15:11.398749 22447 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e566ba6c16a459d8712fba2a68fc723" member_type: VOTER }
I20260709 12:15:11.399189 22447 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:11.399422 22447 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e566ba6c16a459d8712fba2a68fc723, State: Initialized, Role: FOLLOWER
I20260709 12:15:11.400174 22447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e566ba6c16a459d8712fba2a68fc723" member_type: VOTER }
I20260709 12:15:11.400704 22447 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:11.400946 22447 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:11.401243 22447 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:11.406888 22447 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e566ba6c16a459d8712fba2a68fc723" member_type: VOTER }
I20260709 12:15:11.407459 22447 leader_election.cc:304] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e566ba6c16a459d8712fba2a68fc723; no voters: 
I20260709 12:15:11.408751 22447 leader_election.cc:290] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:11.409194 22450 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:11.410720 22450 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 1 LEADER]: Becoming Leader. State: Replica: 0e566ba6c16a459d8712fba2a68fc723, State: Running, Role: LEADER
I20260709 12:15:11.411478 22450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e566ba6c16a459d8712fba2a68fc723" member_type: VOTER }
I20260709 12:15:11.412231 22447 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:11.416095 22451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e566ba6c16a459d8712fba2a68fc723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e566ba6c16a459d8712fba2a68fc723" member_type: VOTER } }
I20260709 12:15:11.417032 22451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:11.416788 22452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e566ba6c16a459d8712fba2a68fc723. Latest consensus state: current_term: 1 leader_uuid: "0e566ba6c16a459d8712fba2a68fc723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e566ba6c16a459d8712fba2a68fc723" member_type: VOTER } }
I20260709 12:15:11.417654 22452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:11.422062 22457 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:11.428350 22457 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:11.432684  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:11.438426 22457 catalog_manager.cc:1383] Generated new cluster ID: 13a7f3b7872241a2b386773eb3e7e713
I20260709 12:15:11.438793 22457 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:11.458433 22457 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:11.460011 22457 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:11.477535 22457 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723: Generated new TSK 0
I20260709 12:15:11.478261 22457 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:11.499497  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:11.506023 22468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.507130 22469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.509042 22471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:11.509900  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:11.511066  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:11.511262  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:11.511399  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599311511385 us; error 0 us; skew 500 ppm
I20260709 12:15:11.511935  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:11.514611  9938 webserver.cc:533] Webserver started at http://127.9.180.129:37921/ using document root <none> and password file <none>
I20260709 12:15:11.515089  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:11.515256  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:11.515486  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:11.516659  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "318199f12d154140b942c59a5469c658"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.521435  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:15:11.525159 22476 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.526100  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:15:11.526479  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "318199f12d154140b942c59a5469c658"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.526870  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:11.540426  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:11.541779  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:11.543356  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:11.545897  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:11.546087  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.546409  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:11.546674  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:15:11.593199  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:45925
I20260709 12:15:11.593374 22538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:45925 every 8 connection(s)
I20260709 12:15:11.598181  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:11.606768 22543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.608557 22544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.610787 22547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:11.610963  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:11.612318  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:11.612555  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:11.612783  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599311612765 us; error 0 us; skew 500 ppm
I20260709 12:15:11.613559 22539 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38551
I20260709 12:15:11.613550  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:11.614121 22539 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:11.615242 22539 heartbeater.cc:507] Master 127.9.180.190:38551 requested a full tablet report, sending...
I20260709 12:15:11.616955  9938 webserver.cc:533] Webserver started at http://127.9.180.130:35061/ using document root <none> and password file <none>
I20260709 12:15:11.617669  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:11.617897 22412 ts_manager.cc:194] Registered new tserver with Master: 318199f12d154140b942c59a5469c658 (127.9.180.129:45925)
I20260709 12:15:11.618093  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:11.618733  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:11.619889 22412 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41540
I20260709 12:15:11.620100  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.625960  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:15:11.629873 22551 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.630913  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:11.631258  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.631584  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:11.647467  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:11.648792  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:11.650748  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:11.653175  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:11.653409  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.653661  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:11.653836  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.701525  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:44521
I20260709 12:15:11.701664 22613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:44521 every 8 connection(s)
I20260709 12:15:11.707264  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:11.714242 22617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.716506 22618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:11.719741 22620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:11.720660 22614 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38551
I20260709 12:15:11.721127 22614 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:11.721527  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:11.722201 22614 heartbeater.cc:507] Master 127.9.180.190:38551 requested a full tablet report, sending...
I20260709 12:15:11.722749  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:11.723107  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:11.723325  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599311723300 us; error 0 us; skew 500 ppm
I20260709 12:15:11.724180  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:11.724661 22412 ts_manager.cc:194] Registered new tserver with Master: c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521)
I20260709 12:15:11.726141 22412 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41548
I20260709 12:15:11.727578  9938 webserver.cc:533] Webserver started at http://127.9.180.131:37785/ using document root <none> and password file <none>
I20260709 12:15:11.728222  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:11.728453  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:11.728786  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:11.730157  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.735001  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:15:11.738860 22625 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.739671  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:11.740025  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
format_stamp: "Formatted at 2026-07-09 12:15:11 on dist-test-slave-lg8f"
I20260709 12:15:11.740339  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:11.751273  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:11.752539  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:11.754161  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:11.756565  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:11.756798  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.757045  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:11.757228  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:11.805927  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:46357
I20260709 12:15:11.806057 22687 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:46357 every 8 connection(s)
I20260709 12:15:11.821244 22688 heartbeater.cc:344] Connected to a master server at 127.9.180.190:38551
I20260709 12:15:11.821691 22688 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:11.822569 22688 heartbeater.cc:507] Master 127.9.180.190:38551 requested a full tablet report, sending...
I20260709 12:15:11.824558 22412 ts_manager.cc:194] Registered new tserver with Master: b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:11.824676  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015087689s
I20260709 12:15:11.826378 22412 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41556
I20260709 12:15:11.856876 22412 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41572:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:11.859021 22412 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:11.910065 22504 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd355a052f34c6c9b31a594976f151d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f99b091ab4e94dbc8af196dfccd90484]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:11.911636 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd355a052f34c6c9b31a594976f151d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.911805 22503 tablet_service.cc:1511] Processing CreateTablet for tablet 8c52117b76b040029f08a3b9458e5a69 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f99b091ab4e94dbc8af196dfccd90484]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:11.913373 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c52117b76b040029f08a3b9458e5a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.919921 22653 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd355a052f34c6c9b31a594976f151d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f99b091ab4e94dbc8af196dfccd90484]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:11.920279 22652 tablet_service.cc:1511] Processing CreateTablet for tablet 8c52117b76b040029f08a3b9458e5a69 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f99b091ab4e94dbc8af196dfccd90484]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:11.921502 22653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd355a052f34c6c9b31a594976f151d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.922160 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c52117b76b040029f08a3b9458e5a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.923034 22578 tablet_service.cc:1511] Processing CreateTablet for tablet 8c52117b76b040029f08a3b9458e5a69 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f99b091ab4e94dbc8af196dfccd90484]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:11.923746 22579 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd355a052f34c6c9b31a594976f151d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f99b091ab4e94dbc8af196dfccd90484]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:11.924486 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c52117b76b040029f08a3b9458e5a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.926172 22579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd355a052f34c6c9b31a594976f151d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:11.965749 22703 tablet_bootstrap.cc:492] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658: Bootstrap starting.
I20260709 12:15:11.968294 22705 tablet_bootstrap.cc:492] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885: Bootstrap starting.
I20260709 12:15:11.969245 22704 tablet_bootstrap.cc:492] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Bootstrap starting.
I20260709 12:15:11.974239 22703 tablet_bootstrap.cc:654] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:11.977056 22705 tablet_bootstrap.cc:654] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:11.977267 22704 tablet_bootstrap.cc:654] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:11.979200 22703 tablet_bootstrap.cc:492] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658: No bootstrap required, opened a new log
I20260709 12:15:11.979777 22703 ts_tablet_manager.cc:1403] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:15:11.988909 22705 tablet_bootstrap.cc:492] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885: No bootstrap required, opened a new log
I20260709 12:15:11.989037 22703 raft_consensus.cc:359] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:11.990042 22703 raft_consensus.cc:385] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:11.989729 22705 ts_tablet_manager.cc:1403] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:15:11.990439 22704 tablet_bootstrap.cc:492] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: No bootstrap required, opened a new log
I20260709 12:15:11.990361 22703 raft_consensus.cc:740] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 318199f12d154140b942c59a5469c658, State: Initialized, Role: FOLLOWER
I20260709 12:15:11.991228 22704 ts_tablet_manager.cc:1403] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:15:11.991569 22703 consensus_queue.cc:260] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:11.994014 22539 heartbeater.cc:499] Master 127.9.180.190:38551 was elected leader, sending a full tablet report...
I20260709 12:15:11.993772 22705 raft_consensus.cc:359] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:11.994611 22705 raft_consensus.cc:385] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:11.994302 22704 raft_consensus.cc:359] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:11.994805 22703 ts_tablet_manager.cc:1434] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.003s
I20260709 12:15:11.994993 22705 raft_consensus.cc:740] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Initialized, Role: FOLLOWER
I20260709 12:15:11.995175 22704 raft_consensus.cc:385] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:11.995585 22704 raft_consensus.cc:740] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Initialized, Role: FOLLOWER
I20260709 12:15:11.996021 22703 tablet_bootstrap.cc:492] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658: Bootstrap starting.
I20260709 12:15:11.995914 22705 consensus_queue.cc:260] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:11.996719 22704 consensus_queue.cc:260] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.003317 22704 ts_tablet_manager.cc:1434] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:15:12.004199 22614 heartbeater.cc:499] Master 127.9.180.190:38551 was elected leader, sending a full tablet report...
I20260709 12:15:12.006228 22703 tablet_bootstrap.cc:654] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.007766 22704 tablet_bootstrap.cc:492] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1: Bootstrap starting.
I20260709 12:15:12.015416 22688 heartbeater.cc:499] Master 127.9.180.190:38551 was elected leader, sending a full tablet report...
I20260709 12:15:12.016328 22704 tablet_bootstrap.cc:654] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.016566 22705 ts_tablet_manager.cc:1434] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent starting tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 12:15:12.018249 22705 tablet_bootstrap.cc:492] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: Bootstrap starting.
I20260709 12:15:12.028088 22704 tablet_bootstrap.cc:492] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1: No bootstrap required, opened a new log
I20260709 12:15:12.028558 22705 tablet_bootstrap.cc:654] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.028704 22704 ts_tablet_manager.cc:1403] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.013s
I20260709 12:15:12.032138 22704 raft_consensus.cc:359] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.032877 22704 raft_consensus.cc:385] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.033166 22704 raft_consensus.cc:740] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.034171 22704 consensus_queue.cc:260] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.038889 22704 ts_tablet_manager.cc:1434] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:15:12.043104 22705 tablet_bootstrap.cc:492] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: No bootstrap required, opened a new log
I20260709 12:15:12.043910 22705 ts_tablet_manager.cc:1403] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 12:15:12.048123 22705 raft_consensus.cc:359] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.049139 22705 raft_consensus.cc:385] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.049518 22705 raft_consensus.cc:740] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.050407 22705 consensus_queue.cc:260] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.052284 22705 ts_tablet_manager.cc:1434] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:15:12.054436 22703 tablet_bootstrap.cc:492] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658: No bootstrap required, opened a new log
I20260709 12:15:12.055114 22703 ts_tablet_manager.cc:1403] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.036s
I20260709 12:15:12.058352 22703 raft_consensus.cc:359] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.059056 22703 raft_consensus.cc:385] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.059327 22703 raft_consensus.cc:740] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 318199f12d154140b942c59a5469c658, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.060029 22703 consensus_queue.cc:260] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.062333 22703 ts_tablet_manager.cc:1434] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:15:12.232831 22710 raft_consensus.cc:493] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.235069 22710 raft_consensus.cc:515] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.238097 22710 leader_election.cc:290] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521)
I20260709 12:15:12.254022 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658" is_pre_election: true
I20260709 12:15:12.255401 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" is_pre_election: true
I20260709 12:15:12.255501 22514 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 0.
I20260709 12:15:12.256361 22711 raft_consensus.cc:493] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.257184 22711 raft_consensus.cc:515] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.257445 22626 leader_election.cc:304] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, b2569a5cc80c4c49ad7aace1dc2fd885; no voters: 
I20260709 12:15:12.258167 22589 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 0.
I20260709 12:15:12.258518 22710 raft_consensus.cc:2804] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:12.259116 22710 raft_consensus.cc:493] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.259542 22710 raft_consensus.cc:3060] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.260923 22711 leader_election.cc:290] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:12.273061 22710 raft_consensus.cc:515] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.274312 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658" is_pre_election: true
I20260709 12:15:12.275110 22514 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 0.
I20260709 12:15:12.275825 22710 leader_election.cc:290] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 election: Requested vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521)
I20260709 12:15:12.276607 22552 leader_election.cc:304] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.276829 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
I20260709 12:15:12.277052 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658"
I20260709 12:15:12.277541 22589 raft_consensus.cc:3060] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.277838 22513 raft_consensus.cc:3060] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.281075 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" is_pre_election: true
I20260709 12:15:12.281874 22663 raft_consensus.cc:2393] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in current term 1: Already voted for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in this term.
I20260709 12:15:12.290295 22513 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 1.
I20260709 12:15:12.290295 22589 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 1.
I20260709 12:15:12.291345 22711 raft_consensus.cc:2764] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:15:12.292132 22628 leader_election.cc:304] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2569a5cc80c4c49ad7aace1dc2fd885, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.293201 22710 raft_consensus.cc:2804] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:12.294409 22710 raft_consensus.cc:697] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Becoming Leader. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Running, Role: LEADER
I20260709 12:15:12.295810 22710 consensus_queue.cc:237] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.304718 22410 catalog_manager.cc:5697] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.319202 22711 raft_consensus.cc:493] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.319870 22711 raft_consensus.cc:515] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.322014 22711 leader_election.cc:290] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:12.322786 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658" is_pre_election: true
I20260709 12:15:12.323359 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" is_pre_election: true
I20260709 12:15:12.323663 22513 raft_consensus.cc:2468] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 0.
I20260709 12:15:12.324242 22663 raft_consensus.cc:2468] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 0.
I20260709 12:15:12.324894 22552 leader_election.cc:304] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.325598 22711 raft_consensus.cc:2804] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:12.326012 22711 raft_consensus.cc:493] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.326350 22711 raft_consensus.cc:3060] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.335325 22711 raft_consensus.cc:515] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.337172 22711 leader_election.cc:290] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 election: Requested vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:12.338313 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658"
I20260709 12:15:12.338726 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
I20260709 12:15:12.339020 22513 raft_consensus.cc:3060] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.339447 22663 raft_consensus.cc:3060] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.345504 22513 raft_consensus.cc:2468] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 1.
I20260709 12:15:12.346756 22552 leader_election.cc:304] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.347023 22663 raft_consensus.cc:2468] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 1.
I20260709 12:15:12.348356 22711 raft_consensus.cc:2804] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:12.350028 22711 raft_consensus.cc:697] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Becoming Leader. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Running, Role: LEADER
I20260709 12:15:12.351406 22711 consensus_queue.cc:237] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.359977 22410 catalog_manager.cc:5697] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.434625 22410 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41574:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:12.437083 22410 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:12.464432 22503 tablet_service.cc:1511] Processing CreateTablet for tablet fadaeddd6d7341d3955c263d3931c890 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9f6526ec68c84e47a1b630f1949e0838]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:12.466288 22503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadaeddd6d7341d3955c263d3931c890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:12.466395 22578 tablet_service.cc:1511] Processing CreateTablet for tablet fadaeddd6d7341d3955c263d3931c890 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9f6526ec68c84e47a1b630f1949e0838]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:12.468335 22578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadaeddd6d7341d3955c263d3931c890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:12.468218 22652 tablet_service.cc:1511] Processing CreateTablet for tablet fadaeddd6d7341d3955c263d3931c890 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9f6526ec68c84e47a1b630f1949e0838]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:12.470106 22652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadaeddd6d7341d3955c263d3931c890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:12.472922 22579 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb0828112194a95afe4d273d9fc8270 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9f6526ec68c84e47a1b630f1949e0838]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:12.474284 22579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb0828112194a95afe4d273d9fc8270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:12.477015 22653 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb0828112194a95afe4d273d9fc8270 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9f6526ec68c84e47a1b630f1949e0838]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:12.477295 22504 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb0828112194a95afe4d273d9fc8270 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=9f6526ec68c84e47a1b630f1949e0838]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:12.478742 22653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb0828112194a95afe4d273d9fc8270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:12.478886 22504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb0828112194a95afe4d273d9fc8270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:12.496862 22705 tablet_bootstrap.cc:492] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: Bootstrap starting.
I20260709 12:15:12.506026 22705 tablet_bootstrap.cc:654] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.510313 22704 tablet_bootstrap.cc:492] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Bootstrap starting.
I20260709 12:15:12.514395 22703 tablet_bootstrap.cc:492] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: Bootstrap starting.
I20260709 12:15:12.519125 22704 tablet_bootstrap.cc:654] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.523173 22703 tablet_bootstrap.cc:654] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.531112 22705 tablet_bootstrap.cc:492] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: No bootstrap required, opened a new log
I20260709 12:15:12.531170 22704 tablet_bootstrap.cc:492] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: No bootstrap required, opened a new log
I20260709 12:15:12.531787 22703 tablet_bootstrap.cc:492] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: No bootstrap required, opened a new log
I20260709 12:15:12.531980 22705 ts_tablet_manager.cc:1403] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.007s
I20260709 12:15:12.531996 22704 ts_tablet_manager.cc:1403] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:15:12.532356 22703 ts_tablet_manager.cc:1403] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:15:12.535923 22704 raft_consensus.cc:359] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.536620 22704 raft_consensus.cc:385] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.536409 22705 raft_consensus.cc:359] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.536609 22703 raft_consensus.cc:359] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.537282 22704 raft_consensus.cc:740] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.537438 22705 raft_consensus.cc:385] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.537569 22703 raft_consensus.cc:385] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.537894 22705 raft_consensus.cc:740] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.538089 22703 raft_consensus.cc:740] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 318199f12d154140b942c59a5469c658, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.538339 22704 consensus_queue.cc:260] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.538923 22705 consensus_queue.cc:260] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.539685 22703 consensus_queue.cc:260] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.543558 22703 ts_tablet_manager.cc:1434] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:12.544754 22705 ts_tablet_manager.cc:1434] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:15:12.544806 22703 tablet_bootstrap.cc:492] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: Bootstrap starting.
I20260709 12:15:12.546257 22705 tablet_bootstrap.cc:492] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885: Bootstrap starting.
I20260709 12:15:12.549458 22704 ts_tablet_manager.cc:1434] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:15:12.554248 22705 tablet_bootstrap.cc:654] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.554652 22703 tablet_bootstrap.cc:654] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.560993 22704 tablet_bootstrap.cc:492] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Bootstrap starting.
I20260709 12:15:12.563767 22703 tablet_bootstrap.cc:492] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: No bootstrap required, opened a new log
I20260709 12:15:12.564329 22703 ts_tablet_manager.cc:1403] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 12:15:12.566855 22711 raft_consensus.cc:493] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.567584 22711 raft_consensus.cc:515] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.567629 22703 raft_consensus.cc:359] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.569829 22703 raft_consensus.cc:385] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.569859 22711 leader_election.cc:290] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:12.570385 22703 raft_consensus.cc:740] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 318199f12d154140b942c59a5469c658, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.570701 22705 tablet_bootstrap.cc:492] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885: No bootstrap required, opened a new log
I20260709 12:15:12.571331 22705 ts_tablet_manager.cc:1403] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.015s
I20260709 12:15:12.571508 22703 consensus_queue.cc:260] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.572006 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658" is_pre_election: true
I20260709 12:15:12.572433 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" is_pre_election: true
I20260709 12:15:12.572645 22513 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 0.
I20260709 12:15:12.573983 22552 leader_election.cc:304] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.574383 22703 ts_tablet_manager.cc:1434] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 12:15:12.574525 22705 raft_consensus.cc:359] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.575372 22705 raft_consensus.cc:385] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.575672 22705 raft_consensus.cc:740] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.576025 22721 raft_consensus.cc:2804] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:12.576432 22721 raft_consensus.cc:493] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.576875 22721 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.576484 22705 consensus_queue.cc:260] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.579532 22705 ts_tablet_manager.cc:1434] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 12:15:12.574923 22552 leader_election.cc:343] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:12.586380 22721 raft_consensus.cc:515] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.587680 22704 tablet_bootstrap.cc:654] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:12.589768 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658"
I20260709 12:15:12.590093 22721 leader_election.cc:290] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 election: Requested vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:12.590531 22513 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.591497 22663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
I20260709 12:15:12.592378 22663 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.596837 22704 tablet_bootstrap.cc:492] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1: No bootstrap required, opened a new log
I20260709 12:15:12.597430 22704 ts_tablet_manager.cc:1403] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 12:15:12.597568 22513 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 1.
I20260709 12:15:12.598678 22552 leader_election.cc:304] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.599366 22721 raft_consensus.cc:2804] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:12.599825 22721 raft_consensus.cc:697] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Becoming Leader. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Running, Role: LEADER
I20260709 12:15:12.600566 22721 consensus_queue.cc:237] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.600848 22704 raft_consensus.cc:359] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.601639 22704 raft_consensus.cc:385] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:12.601941 22704 raft_consensus.cc:740] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Initialized, Role: FOLLOWER
I20260709 12:15:12.602777 22704 consensus_queue.cc:260] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.604046 22663 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 1.
I20260709 12:15:12.605204 22704 ts_tablet_manager.cc:1434] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:15:12.608686 22410 catalog_manager.cc:5697] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.666867 22710 raft_consensus.cc:493] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.667536 22710 raft_consensus.cc:515] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.669610 22710 leader_election.cc:290] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521)
I20260709 12:15:12.670332 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658" is_pre_election: true
I20260709 12:15:12.670902 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" is_pre_election: true
I20260709 12:15:12.671079 22513 raft_consensus.cc:2468] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 0.
I20260709 12:15:12.671568 22589 raft_consensus.cc:2468] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 0.
I20260709 12:15:12.672295 22626 leader_election.cc:304] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, b2569a5cc80c4c49ad7aace1dc2fd885; no voters: 
I20260709 12:15:12.673167 22710 raft_consensus.cc:2804] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:12.673568 22710 raft_consensus.cc:493] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.673861 22710 raft_consensus.cc:3060] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.678712 22710 raft_consensus.cc:515] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.680394 22710 leader_election.cc:290] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 election: Requested vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521)
I20260709 12:15:12.681332 22513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "318199f12d154140b942c59a5469c658"
I20260709 12:15:12.681562 22589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
I20260709 12:15:12.682123 22513 raft_consensus.cc:3060] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.682147 22589 raft_consensus.cc:3060] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:12.690196 22589 raft_consensus.cc:2468] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 1.
I20260709 12:15:12.690196 22513 raft_consensus.cc:2468] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 1.
I20260709 12:15:12.691597 22626 leader_election.cc:304] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, b2569a5cc80c4c49ad7aace1dc2fd885; no voters: 
I20260709 12:15:12.692325 22710 raft_consensus.cc:2804] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:12.692814 22710 raft_consensus.cc:697] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Becoming Leader. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Running, Role: LEADER
I20260709 12:15:12.693548 22710 consensus_queue.cc:237] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.701491 22410 catalog_manager.cc:5697] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.763263 22711 consensus_queue.cc:1048] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:12.772102 22663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d"
dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
mode: GRACEFUL
new_leader_uuid: "318199f12d154140b942c59a5469c658"
 from {username='slave'} at 127.0.0.1:47820
I20260709 12:15:12.772977 22663 raft_consensus.cc:606] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Received request to transfer leadership to TS 318199f12d154140b942c59a5469c658
I20260709 12:15:12.784915 22719 consensus_queue.cc:1048] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:12.786352 22719 consensus_queue.cc:1048] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:12.793249 22711 consensus_queue.cc:1048] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:12.803886 22710 raft_consensus.cc:993] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: : Instructing follower 318199f12d154140b942c59a5469c658 to start an election
I20260709 12:15:12.804630 22710 raft_consensus.cc:1081] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Signalling peer 318199f12d154140b942c59a5469c658 to start an election
I20260709 12:15:12.807866 22514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d"
dest_uuid: "318199f12d154140b942c59a5469c658"
 from {username='slave'} at 127.0.0.1:56598
I20260709 12:15:12.808797 22514 raft_consensus.cc:493] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.809181 22514 raft_consensus.cc:3060] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.813669 22588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69"
dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
mode: GRACEFUL
new_leader_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
 from {username='slave'} at 127.0.0.1:50854
I20260709 12:15:12.814544 22588 raft_consensus.cc:606] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Received request to transfer leadership to TS b2569a5cc80c4c49ad7aace1dc2fd885
I20260709 12:15:12.820418 22514 raft_consensus.cc:515] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.821731 22513 raft_consensus.cc:1240] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Rejecting Update request from peer b2569a5cc80c4c49ad7aace1dc2fd885 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:12.824560 22662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890"
dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
mode: GRACEFUL
new_leader_uuid: "318199f12d154140b942c59a5469c658"
 from {username='slave'} at 127.0.0.1:47820
I20260709 12:15:12.825435 22662 raft_consensus.cc:606] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Received request to transfer leadership to TS 318199f12d154140b942c59a5469c658
I20260709 12:15:12.828037 22719 consensus_queue.cc:1059] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:12.829200 22719 raft_consensus.cc:3055] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:12.829569 22719 raft_consensus.cc:740] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Running, Role: LEADER
I20260709 12:15:12.830518 22719 consensus_queue.cc:260] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.831523 22719 raft_consensus.cc:3060] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.836731 22588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270"
dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
mode: GRACEFUL
new_leader_uuid: "318199f12d154140b942c59a5469c658"
 from {username='slave'} at 127.0.0.1:50854
I20260709 12:15:12.837724 22588 raft_consensus.cc:606] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Received request to transfer leadership to TS 318199f12d154140b942c59a5469c658
I20260709 12:15:12.844708 22514 leader_election.cc:290] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [CANDIDATE]: Term 2 election: Requested vote from peers c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:12.856523 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "318199f12d154140b942c59a5469c658" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
I20260709 12:15:12.857510 22588 raft_consensus.cc:3060] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.870560 22662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dd355a052f34c6c9b31a594976f151d" candidate_uuid: "318199f12d154140b942c59a5469c658" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
I20260709 12:15:12.870748 22588 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 318199f12d154140b942c59a5469c658 in term 2.
I20260709 12:15:12.872229 22479 leader_election.cc:304] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:12.873145 22709 raft_consensus.cc:2804] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:12.874671 22709 raft_consensus.cc:697] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Becoming Leader. State: Replica: 318199f12d154140b942c59a5469c658, State: Running, Role: LEADER
I20260709 12:15:12.875815 22709 consensus_queue.cc:237] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:12.878340 22662 raft_consensus.cc:2468] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 318199f12d154140b942c59a5469c658 in term 2.
I20260709 12:15:12.883555 22409 catalog_manager.cc:5697] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 reported cstate change: term changed from 1 to 2, leader changed from b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131) to 318199f12d154140b942c59a5469c658 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "318199f12d154140b942c59a5469c658" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.999476 22721 consensus_queue.cc:1048] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:13.012244 22721 consensus_queue.cc:1048] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:13.022166 22721 raft_consensus.cc:993] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: : Instructing follower 318199f12d154140b942c59a5469c658 to start an election
I20260709 12:15:13.022657 22721 raft_consensus.cc:1081] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Signalling peer 318199f12d154140b942c59a5469c658 to start an election
I20260709 12:15:13.024281 22514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270"
dest_uuid: "318199f12d154140b942c59a5469c658"
 from {username='slave'} at 127.0.0.1:56604
I20260709 12:15:13.024806 22514 raft_consensus.cc:493] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.025175 22514 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.030882 22514 raft_consensus.cc:515] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.033128 22514 leader_election.cc:290] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [CANDIDATE]: Term 2 election: Requested vote from peers c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:13.033528 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "318199f12d154140b942c59a5469c658" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
I20260709 12:15:13.033758 22662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "318199f12d154140b942c59a5469c658" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
I20260709 12:15:13.034323 22588 raft_consensus.cc:3055] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.034418 22662 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.034782 22588 raft_consensus.cc:740] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Running, Role: LEADER
I20260709 12:15:13.035825 22588 consensus_queue.cc:260] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.037351 22588 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.040007 22662 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 318199f12d154140b942c59a5469c658 in term 2.
I20260709 12:15:13.041162 22477 leader_election.cc:304] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, b2569a5cc80c4c49ad7aace1dc2fd885; no voters: 
I20260709 12:15:13.041949 22709 raft_consensus.cc:2804] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.042524 22709 raft_consensus.cc:697] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Becoming Leader. State: Replica: 318199f12d154140b942c59a5469c658, State: Running, Role: LEADER
I20260709 12:15:13.043408 22709 consensus_queue.cc:237] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.044672 22588 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 318199f12d154140b942c59a5469c658 in term 2.
I20260709 12:15:13.050242 22412 catalog_manager.cc:5697] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 reported cstate change: term changed from 1 to 2, leader changed from c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130) to 318199f12d154140b942c59a5469c658 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "318199f12d154140b942c59a5469c658" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.096181 22719 consensus_queue.cc:1048] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:13.107363 22752 consensus_queue.cc:1048] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:13.116074 22710 raft_consensus.cc:993] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: : Instructing follower 318199f12d154140b942c59a5469c658 to start an election
I20260709 12:15:13.116724 22752 raft_consensus.cc:1081] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Signalling peer 318199f12d154140b942c59a5469c658 to start an election
I20260709 12:15:13.118614 22514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890"
dest_uuid: "318199f12d154140b942c59a5469c658"
 from {username='slave'} at 127.0.0.1:56598
I20260709 12:15:13.119163 22514 raft_consensus.cc:493] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.119565 22514 raft_consensus.cc:3060] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.124547 22514 raft_consensus.cc:515] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.126569 22514 leader_election.cc:290] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [CANDIDATE]: Term 2 election: Requested vote from peers c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:13.127305 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890" candidate_uuid: "318199f12d154140b942c59a5469c658" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
I20260709 12:15:13.127569 22662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadaeddd6d7341d3955c263d3931c890" candidate_uuid: "318199f12d154140b942c59a5469c658" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
I20260709 12:15:13.128089 22588 raft_consensus.cc:3060] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.128147 22662 raft_consensus.cc:3055] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.128764 22662 raft_consensus.cc:740] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Running, Role: LEADER
I20260709 12:15:13.129680 22662 consensus_queue.cc:260] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.131094 22662 raft_consensus.cc:3060] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.136440 22588 raft_consensus.cc:2468] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 318199f12d154140b942c59a5469c658 in term 2.
I20260709 12:15:13.137655 22479 leader_election.cc:304] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:13.138228 22662 raft_consensus.cc:2468] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 318199f12d154140b942c59a5469c658 in term 2.
I20260709 12:15:13.138386 22709 raft_consensus.cc:2804] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.139079 22709 raft_consensus.cc:697] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Becoming Leader. State: Replica: 318199f12d154140b942c59a5469c658, State: Running, Role: LEADER
I20260709 12:15:13.139917 22709 consensus_queue.cc:237] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.145888 22412 catalog_manager.cc:5697] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 reported cstate change: term changed from 1 to 2, leader changed from b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131) to 318199f12d154140b942c59a5469c658 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "318199f12d154140b942c59a5469c658" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.199493 22721 raft_consensus.cc:993] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: : Instructing follower b2569a5cc80c4c49ad7aace1dc2fd885 to start an election
I20260709 12:15:13.199993 22711 raft_consensus.cc:1081] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Signalling peer b2569a5cc80c4c49ad7aace1dc2fd885 to start an election
I20260709 12:15:13.201838 22662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69"
dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
 from {username='slave'} at 127.0.0.1:47806
I20260709 12:15:13.202355 22662 raft_consensus.cc:493] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.202663 22662 raft_consensus.cc:3060] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.208444 22662 raft_consensus.cc:515] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.210072 22662 leader_election.cc:290] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 2 election: Requested vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130:44521)
I20260709 12:15:13.211103 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "318199f12d154140b942c59a5469c658"
I20260709 12:15:13.211230 22588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c52117b76b040029f08a3b9458e5a69" candidate_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
I20260709 12:15:13.212044 22514 raft_consensus.cc:3060] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.212078 22588 raft_consensus.cc:3055] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.212627 22588 raft_consensus.cc:740] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Running, Role: LEADER
I20260709 12:15:13.213531 22588 consensus_queue.cc:260] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.214954 22588 raft_consensus.cc:3060] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.220109 22514 raft_consensus.cc:2468] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 2.
I20260709 12:15:13.221714 22626 leader_election.cc:304] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 318199f12d154140b942c59a5469c658, b2569a5cc80c4c49ad7aace1dc2fd885; no voters: 
I20260709 12:15:13.222600 22752 raft_consensus.cc:2804] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.222718 22588 raft_consensus.cc:2468] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2569a5cc80c4c49ad7aace1dc2fd885 in term 2.
I20260709 12:15:13.223179 22752 raft_consensus.cc:697] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 LEADER]: Becoming Leader. State: Replica: b2569a5cc80c4c49ad7aace1dc2fd885, State: Running, Role: LEADER
I20260709 12:15:13.224133 22752 consensus_queue.cc:237] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.231269 22412 catalog_manager.cc:5697] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 reported cstate change: term changed from 1 to 2, leader changed from c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130) to b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:13.318157  9938 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:15:13.319736  9938 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:15:13.320144  9938 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:15:13.333665 22514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270"
dest_uuid: "318199f12d154140b942c59a5469c658"
mode: GRACEFUL
new_leader_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
 from {username='slave'} at 127.0.0.1:56616
I20260709 12:15:13.334333 22514 raft_consensus.cc:606] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Received request to transfer leadership to TS c9d4bf329e4849eb9ec9f4c2d1d033d1
I20260709 12:15:13.335767  9938 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:15:13.420452 22662 raft_consensus.cc:1275] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Refusing update from remote peer 318199f12d154140b942c59a5469c658: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.421902 22709 consensus_queue.cc:1048] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.434075 22588 raft_consensus.cc:1275] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Refusing update from remote peer 318199f12d154140b942c59a5469c658: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.435762 22709 consensus_queue.cc:1048] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.447568 22662 raft_consensus.cc:1275] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Refusing update from remote peer 318199f12d154140b942c59a5469c658: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.449047 22756 consensus_queue.cc:1048] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.456816 22588 raft_consensus.cc:1275] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Refusing update from remote peer 318199f12d154140b942c59a5469c658: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.458444 22709 consensus_queue.cc:1048] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.464640 22756 raft_consensus.cc:993] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: : Instructing follower c9d4bf329e4849eb9ec9f4c2d1d033d1 to start an election
I20260709 12:15:13.465204 22709 raft_consensus.cc:1081] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Signalling peer c9d4bf329e4849eb9ec9f4c2d1d033d1 to start an election
I20260709 12:15:13.466822 22588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270"
dest_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1"
 from {username='slave'} at 127.0.0.1:50862
I20260709 12:15:13.467298 22588 raft_consensus.cc:493] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.467598 22588 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.472935 22588 raft_consensus.cc:515] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.474824 22588 leader_election.cc:290] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 3 election: Requested vote from peers 318199f12d154140b942c59a5469c658 (127.9.180.129:45925), b2569a5cc80c4c49ad7aace1dc2fd885 (127.9.180.131:46357)
I20260709 12:15:13.476069 22514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "318199f12d154140b942c59a5469c658"
I20260709 12:15:13.476684 22514 raft_consensus.cc:3055] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:13.476735 22662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb0828112194a95afe4d273d9fc8270" candidate_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885"
I20260709 12:15:13.477100 22514 raft_consensus.cc:740] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 318199f12d154140b942c59a5469c658, State: Running, Role: LEADER
I20260709 12:15:13.477335 22662 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.477911 22514 consensus_queue.cc:260] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.479259 22514 raft_consensus.cc:3060] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.484633 22662 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 3.
I20260709 12:15:13.485873 22552 leader_election.cc:304] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2569a5cc80c4c49ad7aace1dc2fd885, c9d4bf329e4849eb9ec9f4c2d1d033d1; no voters: 
I20260709 12:15:13.486080 22514 raft_consensus.cc:2468] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9d4bf329e4849eb9ec9f4c2d1d033d1 in term 3.
I20260709 12:15:13.486747 22711 raft_consensus.cc:2804] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:13.487263 22711 raft_consensus.cc:697] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 3 LEADER]: Becoming Leader. State: Replica: c9d4bf329e4849eb9ec9f4c2d1d033d1, State: Running, Role: LEADER
I20260709 12:15:13.487993 22711 consensus_queue.cc:237] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } }
I20260709 12:15:13.494277 22412 catalog_manager.cc:5697] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 reported cstate change: term changed from 2 to 3, leader changed from 318199f12d154140b942c59a5469c658 (127.9.180.129) to c9d4bf329e4849eb9ec9f4c2d1d033d1 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "318199f12d154140b942c59a5469c658" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2569a5cc80c4c49ad7aace1dc2fd885" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 46357 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.558698  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
I20260709 12:15:13.592926  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:13.593680  9938 tablet_replica.cc:333] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658: stopping tablet replica
I20260709 12:15:13.594251  9938 raft_consensus.cc:2243] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.594802  9938 raft_consensus.cc:2272] T 0cb0828112194a95afe4d273d9fc8270 P 318199f12d154140b942c59a5469c658 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.597404  9938 tablet_replica.cc:333] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658: stopping tablet replica
I20260709 12:15:13.598112  9938 raft_consensus.cc:2243] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:13.599047  9938 raft_consensus.cc:2272] T 7dd355a052f34c6c9b31a594976f151d P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.602326  9938 tablet_replica.cc:333] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: stopping tablet replica
I20260709 12:15:13.603086  9938 raft_consensus.cc:2243] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:13.603793  9938 pending_rounds.cc:70] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: Trying to abort 1 pending ops.
I20260709 12:15:13.604010  9938 pending_rounds.cc:77] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622786628845568 op_type: NO_OP noop_request { }
I20260709 12:15:13.604270  9938 raft_consensus.cc:2889] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:13.604517  9938 raft_consensus.cc:2272] T fadaeddd6d7341d3955c263d3931c890 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.607344  9938 tablet_replica.cc:333] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658: stopping tablet replica
I20260709 12:15:13.607977  9938 raft_consensus.cc:2243] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.608407  9938 raft_consensus.cc:2272] T 8c52117b76b040029f08a3b9458e5a69 P 318199f12d154140b942c59a5469c658 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.623512 22588 raft_consensus.cc:1275] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Refusing update from remote peer b2569a5cc80c4c49ad7aace1dc2fd885: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.624877 22752 consensus_queue.cc:1048] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9d4bf329e4849eb9ec9f4c2d1d033d1" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:13.637332 22626 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.180.129:45925: connect: Connection refused (error 111) [suppressed 63 similar messages]
I20260709 12:15:13.640744  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
W20260709 12:15:13.644443 22626 consensus_peers.cc:597] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 -> Peer 318199f12d154140b942c59a5469c658 (127.9.180.129:45925): Couldn't send request to peer 318199f12d154140b942c59a5469c658. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:45925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:13.659776  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
I20260709 12:15:13.689129  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:13.689826  9938 tablet_replica.cc:333] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: stopping tablet replica
I20260709 12:15:13.690346  9938 raft_consensus.cc:2243] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:13.691042  9938 pending_rounds.cc:70] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Trying to abort 1 pending ops.
I20260709 12:15:13.691222  9938 pending_rounds.cc:77] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622788053913600 op_type: NO_OP noop_request { }
I20260709 12:15:13.691453  9938 raft_consensus.cc:2889] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:13.691684  9938 raft_consensus.cc:2272] T 0cb0828112194a95afe4d273d9fc8270 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.694167  9938 tablet_replica.cc:333] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1: stopping tablet replica
I20260709 12:15:13.694766  9938 raft_consensus.cc:2243] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.695137  9938 raft_consensus.cc:2272] T 7dd355a052f34c6c9b31a594976f151d P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.697535  9938 tablet_replica.cc:333] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1: stopping tablet replica
I20260709 12:15:13.698000  9938 raft_consensus.cc:2243] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.698431  9938 raft_consensus.cc:2272] T fadaeddd6d7341d3955c263d3931c890 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.700623  9938 tablet_replica.cc:333] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1: stopping tablet replica
I20260709 12:15:13.701081  9938 raft_consensus.cc:2243] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.701467  9938 raft_consensus.cc:2272] T 8c52117b76b040029f08a3b9458e5a69 P c9d4bf329e4849eb9ec9f4c2d1d033d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.726328  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
I20260709 12:15:13.744167  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
I20260709 12:15:13.771052  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:13.771795  9938 tablet_replica.cc:333] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885: stopping tablet replica
I20260709 12:15:13.772387  9938 raft_consensus.cc:2243] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.772872  9938 raft_consensus.cc:2272] T 0cb0828112194a95afe4d273d9fc8270 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.775534  9938 tablet_replica.cc:333] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885: stopping tablet replica
I20260709 12:15:13.776193  9938 raft_consensus.cc:2243] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.776714  9938 raft_consensus.cc:2272] T 7dd355a052f34c6c9b31a594976f151d P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.779753  9938 tablet_replica.cc:333] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885: stopping tablet replica
I20260709 12:15:13.780376  9938 raft_consensus.cc:2243] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:13.780838  9938 raft_consensus.cc:2272] T fadaeddd6d7341d3955c263d3931c890 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.783155  9938 tablet_replica.cc:333] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885: stopping tablet replica
I20260709 12:15:13.783710  9938 raft_consensus.cc:2243] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:13.784581  9938 raft_consensus.cc:2272] T 8c52117b76b040029f08a3b9458e5a69 P b2569a5cc80c4c49ad7aace1dc2fd885 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.810299  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:15:13.827505  9938 master.cc:562] Master@127.9.180.190:38551 shutting down...
I20260709 12:15:13.859275  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:13.859962  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:13.860349  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0e566ba6c16a459d8712fba2a68fc723: stopping tablet replica
I20260709 12:15:13.880877  9938 master.cc:584] Master@127.9.180.190:38551 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2672 ms)
[----------] 6 tests from LeaderRebalancerTest (418237 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:15:13.925724  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:39865
I20260709 12:15:13.927341  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:13.933970 22760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:13.934870 22761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:13.935871 22763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:13.936126  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:13.937178  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:13.937361  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:13.937565  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599313937551 us; error 0 us; skew 500 ppm
I20260709 12:15:13.938165  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:13.940883  9938 webserver.cc:533] Webserver started at http://127.9.180.190:33133/ using document root <none> and password file <none>
I20260709 12:15:13.941388  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:13.941591  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:13.941896  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:13.943068  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "004e2c69aabd4c9c8689e4ca081d3b55"
format_stamp: "Formatted at 2026-07-09 12:15:13 on dist-test-slave-lg8f"
I20260709 12:15:13.947528  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:15:13.951023 22768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:13.951846  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:15:13.952144  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "004e2c69aabd4c9c8689e4ca081d3b55"
format_stamp: "Formatted at 2026-07-09 12:15:13 on dist-test-slave-lg8f"
I20260709 12:15:13.952435  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:13.973454  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:13.974741  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:14.017640  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:39865
I20260709 12:15:14.017802 22819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:39865 every 8 connection(s)
I20260709 12:15:14.022106 22820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.035526 22820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55: Bootstrap starting.
I20260709 12:15:14.041502 22820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.046701 22820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55: No bootstrap required, opened a new log
I20260709 12:15:14.049314 22820 raft_consensus.cc:359] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" member_type: VOTER }
I20260709 12:15:14.049773 22820 raft_consensus.cc:385] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.050019 22820 raft_consensus.cc:740] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004e2c69aabd4c9c8689e4ca081d3b55, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.050804 22820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" member_type: VOTER }
I20260709 12:15:14.051354 22820 raft_consensus.cc:399] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:14.051581 22820 raft_consensus.cc:493] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:14.051923 22820 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:14.057650 22820 raft_consensus.cc:515] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" member_type: VOTER }
I20260709 12:15:14.058293 22820 leader_election.cc:304] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 004e2c69aabd4c9c8689e4ca081d3b55; no voters: 
I20260709 12:15:14.059655 22820 leader_election.cc:290] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:14.060029 22823 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:14.061564 22823 raft_consensus.cc:697] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 1 LEADER]: Becoming Leader. State: Replica: 004e2c69aabd4c9c8689e4ca081d3b55, State: Running, Role: LEADER
I20260709 12:15:14.062266 22823 consensus_queue.cc:237] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" member_type: VOTER }
I20260709 12:15:14.063328 22820 sys_catalog.cc:565] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:14.065681 22825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 004e2c69aabd4c9c8689e4ca081d3b55. Latest consensus state: current_term: 1 leader_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" member_type: VOTER } }
I20260709 12:15:14.065768 22824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "004e2c69aabd4c9c8689e4ca081d3b55" member_type: VOTER } }
I20260709 12:15:14.066720 22825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:14.066766 22824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:14.070823 22829 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:14.075690 22829 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:14.081622  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:14.084789 22829 catalog_manager.cc:1383] Generated new cluster ID: 6211717984c345d7b834ca8de4bf9d68
I20260709 12:15:14.085081 22829 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:14.109635 22829 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:14.111387 22829 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:14.127285 22829 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55: Generated new TSK 0
I20260709 12:15:14.127940 22829 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:14.148149  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:14.155148 22841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.155819 22842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.157895 22844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:14.158475  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:14.159492  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:14.159714  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:14.159902  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599314159865 us; error 0 us; skew 500 ppm
I20260709 12:15:14.160523  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:14.163031  9938 webserver.cc:533] Webserver started at http://127.9.180.129:36453/ using document root <none> and password file <none>
I20260709 12:15:14.163574  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:14.163748  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:14.164074  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:14.165279  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "17f79b18282f40368cd50fb6e7a8f852"
format_stamp: "Formatted at 2026-07-09 12:15:14 on dist-test-slave-lg8f"
I20260709 12:15:14.170042  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:15:14.173894 22849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.174996  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:14.175328  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "17f79b18282f40368cd50fb6e7a8f852"
format_stamp: "Formatted at 2026-07-09 12:15:14 on dist-test-slave-lg8f"
I20260709 12:15:14.175628  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:14.197476  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:14.198689  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:14.200325  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:14.202778  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:14.203015  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.203259  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:14.203450  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.249188  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:42847
I20260709 12:15:14.249388 22911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:42847 every 8 connection(s)
I20260709 12:15:14.254420  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:14.261906 22916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.264299 22917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.265355 22919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:14.266842  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:14.268697  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:14.268923  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:14.269155  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599314269134 us; error 0 us; skew 500 ppm
I20260709 12:15:14.269474 22912 heartbeater.cc:344] Connected to a master server at 127.9.180.190:39865
I20260709 12:15:14.269906 22912 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:14.269912  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:14.270978 22912 heartbeater.cc:507] Master 127.9.180.190:39865 requested a full tablet report, sending...
I20260709 12:15:14.272902  9938 webserver.cc:533] Webserver started at http://127.9.180.130:46031/ using document root <none> and password file <none>
I20260709 12:15:14.273466  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:14.273680  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:14.273960  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:14.273851 22785 ts_manager.cc:194] Registered new tserver with Master: 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847)
I20260709 12:15:14.275442  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
format_stamp: "Formatted at 2026-07-09 12:15:14 on dist-test-slave-lg8f"
I20260709 12:15:14.276353 22785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38374
I20260709 12:15:14.280658  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:15:14.284313 22924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.285238  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:15:14.285570  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
format_stamp: "Formatted at 2026-07-09 12:15:14 on dist-test-slave-lg8f"
I20260709 12:15:14.285866  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:14.295843  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:14.296943  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:14.298359  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:14.300679  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:14.300896  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.301146  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:14.301321  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.343726  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:40941
I20260709 12:15:14.343951 22986 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:40941 every 8 connection(s)
I20260709 12:15:14.348850  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:14.357028 22990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.358855 22991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.360564 22993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:14.362008  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:14.363013 22987 heartbeater.cc:344] Connected to a master server at 127.9.180.190:39865
I20260709 12:15:14.363010  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:14.363806  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:14.363831 22987 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:14.364055  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599314364036 us; error 0 us; skew 500 ppm
I20260709 12:15:14.364835  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:14.364899 22987 heartbeater.cc:507] Master 127.9.180.190:39865 requested a full tablet report, sending...
I20260709 12:15:14.367606 22785 ts_manager.cc:194] Registered new tserver with Master: aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:14.367764  9938 webserver.cc:533] Webserver started at http://127.9.180.131:39009/ using document root <none> and password file <none>
I20260709 12:15:14.368427  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:14.368664  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:14.368986  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:14.369514 22785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38384
I20260709 12:15:14.370580  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
format_stamp: "Formatted at 2026-07-09 12:15:14 on dist-test-slave-lg8f"
I20260709 12:15:14.375411  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:15:14.378932 22998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.379777  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:15:14.380105  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
format_stamp: "Formatted at 2026-07-09 12:15:14 on dist-test-slave-lg8f"
I20260709 12:15:14.380375  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:14.406216  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:14.407294  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:14.408785  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:14.411267  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:14.411456  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.411746  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:14.411947  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:14.455606  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:43449
I20260709 12:15:14.455837 23060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:43449 every 8 connection(s)
I20260709 12:15:14.471262 23061 heartbeater.cc:344] Connected to a master server at 127.9.180.190:39865
I20260709 12:15:14.471709 23061 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:14.472610 23061 heartbeater.cc:507] Master 127.9.180.190:39865 requested a full tablet report, sending...
I20260709 12:15:14.474920 22785 ts_manager.cc:194] Registered new tserver with Master: 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:14.475052  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016203245s
I20260709 12:15:14.476935 22785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38400
I20260709 12:15:14.505524 22785 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38414:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:14.508502 22785 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:14.596676 23024 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbce0ceb89b427f8cc53a68bb604d90 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:14.597471 23025 tablet_service.cc:1511] Processing CreateTablet for tablet e14f9ba3f9844c14bfd74786b95f80f1 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:14.598331 23024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbce0ceb89b427f8cc53a68bb604d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.599084 23025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14f9ba3f9844c14bfd74786b95f80f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.601269 23023 tablet_service.cc:1511] Processing CreateTablet for tablet 81cc0c4dc01c4835a4bb06c65ae6c698 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:14.602183 23026 tablet_service.cc:1511] Processing CreateTablet for tablet f761ade5f6484b97994c4cb11460dda6 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:14.602912 23023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cc0c4dc01c4835a4bb06c65ae6c698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.603677 23026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f761ade5f6484b97994c4cb11460dda6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.603794 23022 tablet_service.cc:1511] Processing CreateTablet for tablet c67ff9f87b9d4ab5badad9b2791c64fe (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:14.605343 23022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67ff9f87b9d4ab5badad9b2791c64fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.605243 22877 tablet_service.cc:1511] Processing CreateTablet for tablet f761ade5f6484b97994c4cb11460dda6 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:14.605969 22876 tablet_service.cc:1511] Processing CreateTablet for tablet e14f9ba3f9844c14bfd74786b95f80f1 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:14.606848 22877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f761ade5f6484b97994c4cb11460dda6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.608210 22875 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbce0ceb89b427f8cc53a68bb604d90 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:14.609611 22875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbce0ceb89b427f8cc53a68bb604d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.611217 22952 tablet_service.cc:1511] Processing CreateTablet for tablet f761ade5f6484b97994c4cb11460dda6 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:14.611557 22873 tablet_service.cc:1511] Processing CreateTablet for tablet c67ff9f87b9d4ab5badad9b2791c64fe (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:14.613037 22952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f761ade5f6484b97994c4cb11460dda6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.613314 22873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67ff9f87b9d4ab5badad9b2791c64fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.615846 22872 tablet_service.cc:1511] Processing CreateTablet for tablet 0de15374caea4b6a8e49632ca6cd2abe (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:14.615923 23021 tablet_service.cc:1511] Processing CreateTablet for tablet 0de15374caea4b6a8e49632ca6cd2abe (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:14.617657 22872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de15374caea4b6a8e49632ca6cd2abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.617995 23021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de15374caea4b6a8e49632ca6cd2abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.619432 22951 tablet_service.cc:1511] Processing CreateTablet for tablet e14f9ba3f9844c14bfd74786b95f80f1 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:14.619760 22874 tablet_service.cc:1511] Processing CreateTablet for tablet 81cc0c4dc01c4835a4bb06c65ae6c698 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:14.621296 22951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14f9ba3f9844c14bfd74786b95f80f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.621536 22874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cc0c4dc01c4835a4bb06c65ae6c698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.622750 22876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14f9ba3f9844c14bfd74786b95f80f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.625975 22871 tablet_service.cc:1511] Processing CreateTablet for tablet 2e89d36af7054860b93358b62676a76f (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:14.627739 22871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e89d36af7054860b93358b62676a76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.628688 22950 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbce0ceb89b427f8cc53a68bb604d90 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:14.630291 22950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbce0ceb89b427f8cc53a68bb604d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.633466 22947 tablet_service.cc:1511] Processing CreateTablet for tablet 0de15374caea4b6a8e49632ca6cd2abe (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:14.633848 22948 tablet_service.cc:1511] Processing CreateTablet for tablet c67ff9f87b9d4ab5badad9b2791c64fe (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:14.635637 22948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67ff9f87b9d4ab5badad9b2791c64fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.636475 22947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de15374caea4b6a8e49632ca6cd2abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.637113 22949 tablet_service.cc:1511] Processing CreateTablet for tablet 81cc0c4dc01c4835a4bb06c65ae6c698 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:14.638844 22949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cc0c4dc01c4835a4bb06c65ae6c698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.693938 22946 tablet_service.cc:1511] Processing CreateTablet for tablet 2e89d36af7054860b93358b62676a76f (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:14.695621 22946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e89d36af7054860b93358b62676a76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.709941 23077 tablet_bootstrap.cc:492] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:14.707597 23076 tablet_bootstrap.cc:492] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:14.736140 23020 tablet_service.cc:1511] Processing CreateTablet for tablet b95014864b2441b19f8c8e20ed94c3a5 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:14.745744 23020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95014864b2441b19f8c8e20ed94c3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.751792 23078 tablet_bootstrap.cc:492] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:14.722036 22870 tablet_service.cc:1511] Processing CreateTablet for tablet b95014864b2441b19f8c8e20ed94c3a5 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:14.755309 22870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95014864b2441b19f8c8e20ed94c3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.756470 23077 tablet_bootstrap.cc:654] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.742527 22873 tablet_service.cc:1511] Processing CreateTablet for tablet 51f3a23b4dbd40dd95afd94b1a0d6553 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:14.759970 22873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f3a23b4dbd40dd95afd94b1a0d6553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.736140 23022 tablet_service.cc:1511] Processing CreateTablet for tablet 2e89d36af7054860b93358b62676a76f (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:14.769781 23022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e89d36af7054860b93358b62676a76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.735102 22945 tablet_service.cc:1511] Processing CreateTablet for tablet b95014864b2441b19f8c8e20ed94c3a5 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:14.779552 22945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95014864b2441b19f8c8e20ed94c3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.744175 23076 tablet_bootstrap.cc:654] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.793496 23078 tablet_bootstrap.cc:654] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.795277 23077 tablet_bootstrap.cc:492] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:14.795864 23077 ts_tablet_manager.cc:1403] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.003s
I20260709 12:15:14.797988 22949 tablet_service.cc:1511] Processing CreateTablet for tablet 51f3a23b4dbd40dd95afd94b1a0d6553 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:14.799513 22949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f3a23b4dbd40dd95afd94b1a0d6553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.799501 23022 tablet_service.cc:1511] Processing CreateTablet for tablet 51f3a23b4dbd40dd95afd94b1a0d6553 (DEFAULT_TABLE table=test-workload [id=71c304582eef4faba276c804069bb684]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:14.801036 23022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f3a23b4dbd40dd95afd94b1a0d6553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:14.806005 23076 tablet_bootstrap.cc:492] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:14.806845 23076 ts_tablet_manager.cc:1403] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.007s
I20260709 12:15:14.810267 23076 raft_consensus.cc:359] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.811061 23076 raft_consensus.cc:385] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.811367 23076 raft_consensus.cc:740] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.812294 23076 consensus_queue.cc:260] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.814108 23077 raft_consensus.cc:359] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.817445 23077 raft_consensus.cc:385] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.817860 23077 raft_consensus.cc:740] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.818807 23077 consensus_queue.cc:260] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.820740 23061 heartbeater.cc:499] Master 127.9.180.190:39865 was elected leader, sending a full tablet report...
I20260709 12:15:14.821834 23076 ts_tablet_manager.cc:1434] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:15:14.822919 23076 tablet_bootstrap.cc:492] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:14.828824 22912 heartbeater.cc:499] Master 127.9.180.190:39865 was elected leader, sending a full tablet report...
I20260709 12:15:14.829876 23076 tablet_bootstrap.cc:654] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.833617 23078 tablet_bootstrap.cc:492] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:14.834170 23078 ts_tablet_manager.cc:1403] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.004s
I20260709 12:15:14.834502 23077 ts_tablet_manager.cc:1434] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.011s
I20260709 12:15:14.835891 23077 tablet_bootstrap.cc:492] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:14.843338 23077 tablet_bootstrap.cc:654] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.843197 23078 raft_consensus.cc:359] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.844074 23078 raft_consensus.cc:385] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.844448 23078 raft_consensus.cc:740] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.845381 23078 consensus_queue.cc:260] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.851853 23076 tablet_bootstrap.cc:492] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:14.852629 23077 tablet_bootstrap.cc:492] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:14.852792 23076 ts_tablet_manager.cc:1403] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.012s
I20260709 12:15:14.853317 23077 ts_tablet_manager.cc:1403] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 12:15:14.857158 23078 ts_tablet_manager.cc:1434] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 12:15:14.856995 23077 raft_consensus.cc:359] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.857822 23077 raft_consensus.cc:385] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.857350 23076 raft_consensus.cc:359] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.858156 23077 raft_consensus.cc:740] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.858377 23076 raft_consensus.cc:385] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.858361 22987 heartbeater.cc:499] Master 127.9.180.190:39865 was elected leader, sending a full tablet report...
I20260709 12:15:14.859123 23077 consensus_queue.cc:260] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.859797 23078 tablet_bootstrap.cc:492] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:14.861922 23077 ts_tablet_manager.cc:1434] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:15:14.863169 23077 tablet_bootstrap.cc:492] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:14.868206 23086 raft_consensus.cc:493] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.869715 23076 raft_consensus.cc:740] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.873003 23076 consensus_queue.cc:260] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.870656 23077 tablet_bootstrap.cc:654] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.875200 23076 ts_tablet_manager.cc:1434] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:15:14.876286 23076 tablet_bootstrap.cc:492] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:14.871619 23086 raft_consensus.cc:515] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.880528 23086 leader_election.cc:290] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:14.882516 23078 tablet_bootstrap.cc:654] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.887171 23083 raft_consensus.cc:493] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.888284 23083 raft_consensus.cc:515] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.896828 23083 leader_election.cc:290] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:14.903898 23076 tablet_bootstrap.cc:654] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.921871 23077 tablet_bootstrap.cc:492] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:14.922585 23077 ts_tablet_manager.cc:1403] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.060s	user 0.031s	sys 0.012s
I20260709 12:15:14.926400 23077 raft_consensus.cc:359] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.927405 23077 raft_consensus.cc:385] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.927763 23077 raft_consensus.cc:740] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.928642 23077 consensus_queue.cc:260] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.931192 23077 ts_tablet_manager.cc:1434] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:15:14.932346 23077 tablet_bootstrap.cc:492] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:14.934655 23078 tablet_bootstrap.cc:492] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:14.935374 23078 ts_tablet_manager.cc:1403] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.008s
I20260709 12:15:14.937251 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
W20260709 12:15:14.939772 22852 leader_election.cc:343] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:14.942261 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:14.943559 23077 tablet_bootstrap.cc:654] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.943210 23078 raft_consensus.cc:359] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.944031 23078 raft_consensus.cc:385] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.944406 23078 raft_consensus.cc:740] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.944420 23076 tablet_bootstrap.cc:492] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
W20260709 12:15:14.944433 22850 leader_election.cc:343] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:14.945676 23076 ts_tablet_manager.cc:1403] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.002s
I20260709 12:15:14.945247 23078 consensus_queue.cc:260] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.945984 22850 leader_election.cc:304] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852; no voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:14.951165 23083 raft_consensus.cc:2749] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:14.952716 23076 raft_consensus.cc:359] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.955488 23076 raft_consensus.cc:385] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.955897 23076 raft_consensus.cc:740] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.956815 23076 consensus_queue.cc:260] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.957016 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:14.960929 23077 tablet_bootstrap.cc:492] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:14.961658 23077 ts_tablet_manager.cc:1403] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.009s
I20260709 12:15:14.961702 23076 ts_tablet_manager.cc:1434] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:15:14.963198 23076 tablet_bootstrap.cc:492] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:14.965363 23077 raft_consensus.cc:359] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
W20260709 12:15:14.965955 22925 leader_election.cc:343] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:14.966331 23077 raft_consensus.cc:385] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.966732 23077 raft_consensus.cc:740] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.967633 23077 consensus_queue.cc:260] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:14.969571 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:14.970324 23077 ts_tablet_manager.cc:1434] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:14.963122 23078 ts_tablet_manager.cc:1434] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
W20260709 12:15:14.971969 22925 leader_election.cc:343] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:14.972412 22925 leader_election.cc:304] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:14.973124 23086 raft_consensus.cc:2749] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:14.971298 23076 tablet_bootstrap.cc:654] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.974905 23077 tablet_bootstrap.cc:492] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:14.978400 23078 tablet_bootstrap.cc:492] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:14.983752 23077 tablet_bootstrap.cc:654] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.984545 23076 tablet_bootstrap.cc:492] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:14.985270 23076 ts_tablet_manager.cc:1403] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 12:15:14.985678 23078 tablet_bootstrap.cc:654] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:14.989238 23076 raft_consensus.cc:359] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:14.990528 23076 raft_consensus.cc:385] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:14.991036 23076 raft_consensus.cc:740] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:14.992362 23076 consensus_queue.cc:260] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:14.996691 23076 ts_tablet_manager.cc:1434] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:15:14.997895 23077 tablet_bootstrap.cc:492] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:14.998581 23076 tablet_bootstrap.cc:492] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:14.998706 23077 ts_tablet_manager.cc:1403] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 12:15:15.002573 23078 tablet_bootstrap.cc:492] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.003254 23078 ts_tablet_manager.cc:1403] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:15:15.003646 23077 raft_consensus.cc:359] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.004519 23077 raft_consensus.cc:385] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.004851 23077 raft_consensus.cc:740] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.005760 23077 consensus_queue.cc:260] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.006623 23076 tablet_bootstrap.cc:654] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.007032 23078 raft_consensus.cc:359] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.007849 23078 raft_consensus.cc:385] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.008181 23078 raft_consensus.cc:740] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.011611 23077 ts_tablet_manager.cc:1434] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:15:15.013023 23077 tablet_bootstrap.cc:492] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:15.009204 23078 consensus_queue.cc:260] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.019347 23083 raft_consensus.cc:493] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.020184 23083 raft_consensus.cc:515] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.020913 23077 tablet_bootstrap.cc:654] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.026479 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f761ade5f6484b97994c4cb11460dda6" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.027448 23036 raft_consensus.cc:2468] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:15.029217 22850 leader_election.cc:304] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:15.033026 23076 tablet_bootstrap.cc:492] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:15.033758 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f761ade5f6484b97994c4cb11460dda6" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.034065 23076 ts_tablet_manager.cc:1403] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.011s
W20260709 12:15:15.035921 22852 leader_election.cc:343] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.037878 23083 leader_election.cc:290] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.038439 23083 raft_consensus.cc:2804] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.038817 23083 raft_consensus.cc:493] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.039153 23083 raft_consensus.cc:3060] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.039891 23076 raft_consensus.cc:359] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.041321 23076 raft_consensus.cc:385] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.041841 23076 raft_consensus.cc:740] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.043291 23076 consensus_queue.cc:260] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.047309 23076 ts_tablet_manager.cc:1434] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:15:15.048986 23076 tablet_bootstrap.cc:492] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:15.049496 23078 ts_tablet_manager.cc:1434] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:15:15.059859 23076 tablet_bootstrap.cc:654] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.062834 23078 tablet_bootstrap.cc:492] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:15.065049 23083 raft_consensus.cc:515] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.068275 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f761ade5f6484b97994c4cb11460dda6" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:15.068869 23036 raft_consensus.cc:3060] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.070317 23078 tablet_bootstrap.cc:654] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.074693 23076 tablet_bootstrap.cc:492] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
W20260709 12:15:15.075632 22833 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:15.075654 23076 ts_tablet_manager.cc:1403] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 12:15:15.077211 23083 leader_election.cc:290] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.078634 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f761ade5f6484b97994c4cb11460dda6" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
W20260709 12:15:15.080314 22852 leader_election.cc:343] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.081241 23076 raft_consensus.cc:359] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.082180 23076 raft_consensus.cc:385] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.082361 23036 raft_consensus.cc:2468] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:15.082602 23076 raft_consensus.cc:740] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.083782 23076 consensus_queue.cc:260] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.084446 23077 tablet_bootstrap.cc:492] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:15.084247 22850 leader_election.cc:304] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.085157 23077 ts_tablet_manager.cc:1403] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.039s
I20260709 12:15:15.085959 23083 raft_consensus.cc:2804] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.088471 23076 ts_tablet_manager.cc:1434] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:15:15.089035 23077 raft_consensus.cc:359] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.089771 23076 tablet_bootstrap.cc:492] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:15.089838 23077 raft_consensus.cc:385] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.090301 23077 raft_consensus.cc:740] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.091372 23077 consensus_queue.cc:260] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.095032 23078 tablet_bootstrap.cc:492] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.095116 23077 ts_tablet_manager.cc:1434] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:15:15.095901 23078 ts_tablet_manager.cc:1403] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.011s
I20260709 12:15:15.096745 23077 tablet_bootstrap.cc:492] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:15.103392 23076 tablet_bootstrap.cc:654] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.103302 23078 raft_consensus.cc:359] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.104262 23078 raft_consensus.cc:385] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.104610 23078 raft_consensus.cc:740] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.087612 23083 raft_consensus.cc:697] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:15.105641 23078 consensus_queue.cc:260] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.106127 23083 consensus_queue.cc:237] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.107358 23077 tablet_bootstrap.cc:654] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.117539 23076 tablet_bootstrap.cc:492] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:15.117872 23078 ts_tablet_manager.cc:1434] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:15:15.118252 23076 ts_tablet_manager.cc:1403] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.005s
I20260709 12:15:15.120795 23077 tablet_bootstrap.cc:492] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:15.121469 23077 ts_tablet_manager.cc:1403] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.009s
I20260709 12:15:15.122404 23076 raft_consensus.cc:359] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.123325 23076 raft_consensus.cc:385] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.123641 23076 raft_consensus.cc:740] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.124732 23076 consensus_queue.cc:260] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.125211 23077 raft_consensus.cc:359] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.126022 23077 raft_consensus.cc:385] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.126353 23077 raft_consensus.cc:740] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.127501 23077 consensus_queue.cc:260] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.128901 23078 tablet_bootstrap.cc:492] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:15.130194 23076 ts_tablet_manager.cc:1434] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:15:15.130350 23077 ts_tablet_manager.cc:1434] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:15:15.131544 23077 tablet_bootstrap.cc:492] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:15.131546 23076 tablet_bootstrap.cc:492] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:15.137077 23082 raft_consensus.cc:493] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.137823 23082 raft_consensus.cc:515] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.140578 23077 tablet_bootstrap.cc:654] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.145390 23078 tablet_bootstrap.cc:654] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.152027 23082 leader_election.cc:290] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.153189 22785 catalog_manager.cc:5697] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:15.158941 23078 tablet_bootstrap.cc:492] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.159175 23083 raft_consensus.cc:493] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.159634 23078 ts_tablet_manager.cc:1403] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.005s
I20260709 12:15:15.160015 23083 raft_consensus.cc:515] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.160974 23077 tablet_bootstrap.cc:492] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:15.161535 23077 ts_tablet_manager.cc:1403] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.006s
I20260709 12:15:15.163215 23078 raft_consensus.cc:359] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.164027 23078 raft_consensus.cc:385] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.163942 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.164184 23077 raft_consensus.cc:359] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.164958 23078 raft_consensus.cc:740] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.165228 22962 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:15.165541 23076 tablet_bootstrap.cc:654] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.166271 23078 consensus_queue.cc:260] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.167007 22852 leader_election.cc:304] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.168581 23101 raft_consensus.cc:2804] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.169184 23101 raft_consensus.cc:493] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.169674 23101 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.176844 23083 leader_election.cc:290] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.169203 23078 ts_tablet_manager.cc:1434] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:15.165243 23077 raft_consensus.cc:385] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.177976 23077 raft_consensus.cc:740] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.179183 23078 tablet_bootstrap.cc:492] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:15.179982 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.180833 23036 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:15.183182 23082 raft_consensus.cc:493] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.185797 23082 raft_consensus.cc:515] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.193382 23101 raft_consensus.cc:515] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.198330 23101 leader_election.cc:290] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.199425 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.199535 23082 leader_election.cc:290] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.200250 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:15.200083 23077 consensus_queue.cc:260] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.203382 22962 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.203537 23036 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.205009 23077 ts_tablet_manager.cc:1434] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 12:15:15.206048 23077 tablet_bootstrap.cc:492] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:15.207115 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.206278 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.208788 22887 raft_consensus.cc:2468] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.210527 22999 leader_election.cc:304] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:15.207937 22886 raft_consensus.cc:2468] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.212241 23077 tablet_bootstrap.cc:654] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.212970 22999 leader_election.cc:304] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:15.213142 22962 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:15.213332 23036 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:15.213997 23082 raft_consensus.cc:2804] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.215999 23082 raft_consensus.cc:493] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.216301 22852 leader_election.cc:304] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.216411 23082 raft_consensus.cc:3060] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.223354 23101 raft_consensus.cc:2804] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.225073 23101 raft_consensus.cc:697] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:15.227097 23101 consensus_queue.cc:237] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.240664 23076 tablet_bootstrap.cc:492] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:15.241676 23076 ts_tablet_manager.cc:1403] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.021s
I20260709 12:15:15.244107 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.245950 23114 raft_consensus.cc:2804] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.246668 23114 raft_consensus.cc:493] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:15.246696 23001 leader_election.cc:343] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.247319 23114 raft_consensus.cc:3060] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.251173 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
W20260709 12:15:15.253072 23001 leader_election.cc:343] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.253481 23078 tablet_bootstrap.cc:654] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.254762 23076 raft_consensus.cc:359] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.256311 23076 raft_consensus.cc:385] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.256645 23076 raft_consensus.cc:740] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.257624 23116 raft_consensus.cc:493] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.260421 23116 raft_consensus.cc:515] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.257481 23076 consensus_queue.cc:260] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.258179 23077 tablet_bootstrap.cc:492] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:15.263639 23077 ts_tablet_manager.cc:1403] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.016s
I20260709 12:15:15.265035 23116 leader_election.cc:290] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.266767 23086 raft_consensus.cc:493] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.264931 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.268468 22886 raft_consensus.cc:2468] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.268826 23076 ts_tablet_manager.cc:1434] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 12:15:15.266958 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.269685 22961 raft_consensus.cc:2468] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.270076 23076 tablet_bootstrap.cc:492] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:15.267524 23086 raft_consensus.cc:515] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.271804 23077 raft_consensus.cc:359] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.271340 23001 leader_election.cc:304] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.277042 23077 raft_consensus.cc:385] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.277431 23077 raft_consensus.cc:740] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.278226 23077 consensus_queue.cc:260] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.272418 23082 raft_consensus.cc:515] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.273386 23086 leader_election.cc:290] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.275059 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.280447 23077 ts_tablet_manager.cc:1434] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:15:15.280834 22886 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 0.
I20260709 12:15:15.281910 23076 tablet_bootstrap.cc:654] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.275460 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.282896 23036 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 0.
I20260709 12:15:15.283895 22925 leader_election.cc:304] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.284169 23082 leader_election.cc:290] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.284873 23082 raft_consensus.cc:2804] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.285203 23082 raft_consensus.cc:493] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.285645 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.288677 23114 raft_consensus.cc:515] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.289621 23086 raft_consensus.cc:2804] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.290195 23086 raft_consensus.cc:493] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.290652 23086 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.290973 23114 leader_election.cc:290] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.285557 23082 raft_consensus.cc:3060] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.296756 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.300599 23082 raft_consensus.cc:515] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
W20260709 12:15:15.301558 23001 leader_election.cc:343] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:15.302410 23001 leader_election.cc:343] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.306602 23082 leader_election.cc:290] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.307741 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:15.308446 23082 raft_consensus.cc:493] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.308646 22887 raft_consensus.cc:3060] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.309815 22885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:15.310184 23082 raft_consensus.cc:515] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.310899 22885 raft_consensus.cc:3060] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.306674 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:15.314415 23082 leader_election.cc:290] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.314700 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.308849 23086 raft_consensus.cc:515] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.300215 22784 catalog_manager.cc:5697] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:15.315801 22962 raft_consensus.cc:2468] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.319128 23001 leader_election.cc:304] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.309681 23078 tablet_bootstrap.cc:492] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.314853 22886 raft_consensus.cc:3060] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.316923 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.320166 23078 ts_tablet_manager.cc:1403] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.141s	user 0.004s	sys 0.011s
I20260709 12:15:15.320129 22961 raft_consensus.cc:3060] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.324038 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:15.324846 22883 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.317216 22884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.328882 22885 raft_consensus.cc:2468] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:15.320174 23076 tablet_bootstrap.cc:492] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:15.322587 23101 raft_consensus.cc:493] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.330905 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:15.332656 23076 ts_tablet_manager.cc:1403] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.021s
I20260709 12:15:15.332567 23101 raft_consensus.cc:515] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.334069 22884 raft_consensus.cc:2468] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.335075 23101 leader_election.cc:290] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.335888 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.331410 23078 raft_consensus.cc:359] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.336211 23076 raft_consensus.cc:359] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.337024 23076 raft_consensus.cc:385] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.331800 22961 raft_consensus.cc:2468] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:15.337424 23076 raft_consensus.cc:740] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.337471 23035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.336913 23078 raft_consensus.cc:385] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.338544 23076 consensus_queue.cc:260] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.339318 22999 leader_election.cc:304] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:15.340291 23082 raft_consensus.cc:2804] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.340794 23082 raft_consensus.cc:697] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:15.332700 23036 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.341723 23082 consensus_queue.cc:237] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.321787 23086 leader_election.cc:290] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.344647 22886 raft_consensus.cc:2468] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:15.336596 22962 raft_consensus.cc:2468] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:15.348023 22852 leader_election.cc:304] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.348340 22999 leader_election.cc:304] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.348994 23101 raft_consensus.cc:2804] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.349447 23101 raft_consensus.cc:493] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.349807 23101 raft_consensus.cc:3060] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.320779 23114 raft_consensus.cc:2804] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.350417 23114 raft_consensus.cc:493] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.351502 23114 raft_consensus.cc:3060] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.352707 23116 raft_consensus.cc:2804] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.350028 23076 ts_tablet_manager.cc:1434] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:15:15.350941 23086 raft_consensus.cc:493] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.357764 23086 raft_consensus.cc:515] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } }
I20260709 12:15:15.346400 22887 raft_consensus.cc:2468] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:15.358206 23101 raft_consensus.cc:515] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.359679 22999 leader_election.cc:304] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.338549 23078 raft_consensus.cc:740] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.360705 23083 raft_consensus.cc:493] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.360073 22785 catalog_manager.cc:5697] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:15.361251 23083 raft_consensus.cc:515] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.362254 23082 raft_consensus.cc:2804] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.362819 23082 raft_consensus.cc:697] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:15.363663 23082 consensus_queue.cc:237] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.365137 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f761ade5f6484b97994c4cb11460dda6" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.366328 23034 raft_consensus.cc:2393] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aec5293ceaa2446bb92d3815d81e4dd9 in current term 1: Already voted for candidate 17f79b18282f40368cd50fb6e7a8f852 in this term.
I20260709 12:15:15.360184 23086 leader_election.cc:290] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.367992 23083 leader_election.cc:290] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.369089 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.369774 23034 raft_consensus.cc:2468] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:15.370909 22850 leader_election.cc:304] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:15.368151 22883 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 1.
I20260709 12:15:15.373561 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.374152 23083 raft_consensus.cc:2804] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.375897 23083 raft_consensus.cc:493] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.376569 23083 raft_consensus.cc:3060] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:15.376323 22852 leader_election.cc:343] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.380327 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f761ade5f6484b97994c4cb11460dda6" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.380892 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.370954 23036 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 1.
I20260709 12:15:15.381959 22962 raft_consensus.cc:3060] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.383142 22925 leader_election.cc:304] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:15.388319 23116 raft_consensus.cc:697] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:15.388768 23086 raft_consensus.cc:3060] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.389333 23116 consensus_queue.cc:237] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.386555 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:15.361142 23078 consensus_queue.cc:260] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.387183 23101 leader_election.cc:290] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.389542 22925 leader_election.cc:304] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:15.386096 23124 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.392967 23124 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.396142 23124 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.396257 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.397351 23086 raft_consensus.cc:2749] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:15.398880 22852 leader_election.cc:343] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.401209 22962 raft_consensus.cc:2468] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:15.401253 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.403992 23122 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.408407 22852 leader_election.cc:304] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:15.406937 23086 raft_consensus.cc:2804] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.408492 22784 catalog_manager.cc:5697] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:15.409804 23086 raft_consensus.cc:697] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:15.411015 23083 raft_consensus.cc:515] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.410880 23086 consensus_queue.cc:237] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.406628 23114 raft_consensus.cc:515] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.412526 23035 raft_consensus.cc:2393] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17f79b18282f40368cd50fb6e7a8f852 in current term 1: Already voted for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in this term.
I20260709 12:15:15.408490 23122 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.414638 23078 ts_tablet_manager.cc:1434] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.010s
I20260709 12:15:15.416536 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.416817 23078 tablet_bootstrap.cc:492] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:15.417317 22883 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:15.418807 23122 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.419031 23036 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:15.419873 22999 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:15.422070 22850 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.422973 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:15.423583 23101 raft_consensus.cc:2804] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.424049 23101 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.424196 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:15.424484 23101 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.420292 23124 raft_consensus.cc:2804] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.427963 23078 tablet_bootstrap.cc:654] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.430914 23122 raft_consensus.cc:2804] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:15.431377 23122 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.431749 23122 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.432336 22785 catalog_manager.cc:5697] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:15.438637 23083 leader_election.cc:290] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
W20260709 12:15:15.440714 23001 leader_election.cc:343] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.441792 23122 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.443414 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.444195 23122 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.444583 23114 leader_election.cc:290] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:15.445107 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:15.445495 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.446180 23124 raft_consensus.cc:697] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:15.446818 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:15.447544 23036 raft_consensus.cc:3060] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.447428 23124 consensus_queue.cc:237] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.445582 22962 raft_consensus.cc:2393] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6cc69a97033e429b982e8ddd0ee48cb7 in current term 1: Already voted for candidate 17f79b18282f40368cd50fb6e7a8f852 in this term.
I20260709 12:15:15.446112 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
W20260709 12:15:15.452387 22852 leader_election.cc:343] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.453301 23101 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.454643 22886 raft_consensus.cc:2393] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6cc69a97033e429b982e8ddd0ee48cb7 in current term 1: Already voted for candidate 17f79b18282f40368cd50fb6e7a8f852 in this term.
I20260709 12:15:15.455657 23101 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.458967 23035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:15.460062 23035 raft_consensus.cc:2393] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17f79b18282f40368cd50fb6e7a8f852 in current term 1: Already voted for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in this term.
I20260709 12:15:15.458284 22784 catalog_manager.cc:5697] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:15.452422 23001 leader_election.cc:343] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.462445 22999 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.464007 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:15.464274 22999 leader_election.cc:304] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.465233 23122 raft_consensus.cc:2749] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:15.465456 23114 raft_consensus.cc:2749] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:15.466939 23078 tablet_bootstrap.cc:492] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.467522 23078 ts_tablet_manager.cc:1403] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.001s
W20260709 12:15:15.468086 22852 leader_election.cc:343] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:15.468483 22852 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852; no voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.469177 23124 raft_consensus.cc:2749] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:15.470404 23078 raft_consensus.cc:359] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.471212 23078 raft_consensus.cc:385] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.471516 23078 raft_consensus.cc:740] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.472390 22785 catalog_manager.cc:5697] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:15.472913 23078 consensus_queue.cc:260] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.475765 23036 raft_consensus.cc:2468] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:15.477146 22850 leader_election.cc:304] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:15.478458 23124 raft_consensus.cc:2804] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:15.478888 23078 ts_tablet_manager.cc:1434] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:15.479221 23124 raft_consensus.cc:697] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:15.480365 23078 tablet_bootstrap.cc:492] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:15.480296 23124 consensus_queue.cc:237] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.487601 23078 tablet_bootstrap.cc:654] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.493705 23078 tablet_bootstrap.cc:492] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.493157 22785 catalog_manager.cc:5697] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:15.494246 23078 ts_tablet_manager.cc:1403] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 12:15:15.494051 23086 raft_consensus.cc:493] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.494858 23086 raft_consensus.cc:515] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.496961 23086 leader_election.cc:290] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.499125 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.501248 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.502117 22883 raft_consensus.cc:2393] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aec5293ceaa2446bb92d3815d81e4dd9 in current term 1: Already voted for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in this term.
I20260709 12:15:15.502178 23078 raft_consensus.cc:359] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.503098 23078 raft_consensus.cc:385] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.503345 23078 raft_consensus.cc:740] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.503479 22925 leader_election.cc:304] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:15.504195 23078 consensus_queue.cc:260] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.504443 23086 raft_consensus.cc:3060] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.506289 23078 ts_tablet_manager.cc:1434] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:15:15.507332 23078 tablet_bootstrap.cc:492] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:15.510731 23086 raft_consensus.cc:2749] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:15.513075 23078 tablet_bootstrap.cc:654] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:15.518072 23124 consensus_queue.cc:1048] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.521298 23078 tablet_bootstrap.cc:492] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:15.521834 23078 ts_tablet_manager.cc:1403] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:15:15.524654 23078 raft_consensus.cc:359] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.525367 23078 raft_consensus.cc:385] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:15.525663 23078 raft_consensus.cc:740] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:15.526409 23078 consensus_queue.cc:260] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.529066 23078 ts_tablet_manager.cc:1434] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:15:15.531383 23129 consensus_queue.cc:1048] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:15.567729 23086 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.568240 23086 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:15.569988 23086 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:15.570760 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:15.571164 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:15.571657 22883 raft_consensus.cc:2393] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aec5293ceaa2446bb92d3815d81e4dd9 in current term 1: Already voted for candidate 17f79b18282f40368cd50fb6e7a8f852 in this term.
I20260709 12:15:15.571933 23036 raft_consensus.cc:2393] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aec5293ceaa2446bb92d3815d81e4dd9 in current term 1: Already voted for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in this term.
I20260709 12:15:15.572994 22925 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:15.573635 23086 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.579895 23086 raft_consensus.cc:2749] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:15.791791 23124 consensus_queue.cc:1048] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.804579 23083 consensus_queue.cc:1048] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.814878 23114 consensus_queue.cc:1048] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.827816 23122 consensus_queue.cc:1048] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.863900 23083 consensus_queue.cc:1048] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.875327 22962 raft_consensus.cc:3060] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.875502 23101 consensus_queue.cc:1048] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:15.887156 23101 consensus_queue.cc:1048] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:15.902541 23101 consensus_queue.cc:1048] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:15.909495 22962 raft_consensus.cc:3060] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:15.919255 23122 consensus_queue.cc:1048] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.930780 23114 consensus_queue.cc:1048] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.967108 23114 consensus_queue.cc:1048] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.973205 23086 consensus_queue.cc:1048] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:15.983805 23082 consensus_queue.cc:1048] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:15.997011 23154 consensus_queue.cc:1048] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:15:16.083220 22833 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:15:17.089223 22833 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:17.094130 23114 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.094843 23114 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.096833 23114 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:17.097980 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:17.098038 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:17.098799 22883 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:17.098938 22962 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:17.100054 22999 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:17.100878 23114 raft_consensus.cc:2804] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:17.101213 23114 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.101545 23114 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.107101 23114 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.108860 23114 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:17.109805 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:17.110118 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:17.110596 22883 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.110754 22962 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.118391 22962 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 2.
I20260709 12:15:17.118391 22883 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 2.
I20260709 12:15:17.119946 23001 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.120784 23114 raft_consensus.cc:2804] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.121865 23114 raft_consensus.cc:697] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:17.122666 23114 consensus_queue.cc:237] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.131410 22785 catalog_manager.cc:5697] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.244426 23036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:17.245003 23036 raft_consensus.cc:606] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:17.260033 22962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
mode: GRACEFUL
new_leader_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:33590
I20260709 12:15:17.260565 22962 raft_consensus.cc:606] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Received request to transfer leadership to TS 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:17.266670 23036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:17.267195 23036 raft_consensus.cc:606] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:17.273082 23036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:17.273561 23036 raft_consensus.cc:606] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:17.288195 22883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33402
I20260709 12:15:17.288920 22883 raft_consensus.cc:606] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:17.294288 22883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e89d36af7054860b93358b62676a76f"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33402
I20260709 12:15:17.294865 22883 raft_consensus.cc:606] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:17.299816 23036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:17.300315 23036 raft_consensus.cc:606] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:17.305342 22883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:33402
I20260709 12:15:17.306011 22883 raft_consensus.cc:606] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Received request to transfer leadership to TS 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:17.321911 23166 raft_consensus.cc:993] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.322429 23101 raft_consensus.cc:1081] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.324153 22962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:43218
I20260709 12:15:17.324615 22962 raft_consensus.cc:493] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.324867 22962 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.329798 22962 raft_consensus.cc:515] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.331466 22962 leader_election.cc:290] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.332521 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:17.332844 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.333390 22883 raft_consensus.cc:3055] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.333390 23036 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.334013 22883 raft_consensus.cc:740] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:17.334996 22883 consensus_queue.cc:260] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.336395 22883 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.342379 23036 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:17.344026 22925 leader_election.cc:304] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.344238 22883 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:17.344916 23154 raft_consensus.cc:2804] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.346288 23154 raft_consensus.cc:697] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:17.347118 23154 consensus_queue.cc:237] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.354835 22785 catalog_manager.cc:5697] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.372049 23156 raft_consensus.cc:993] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:17.372617 23114 raft_consensus.cc:1081] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:17.374159 22883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:15:17.374759 22883 raft_consensus.cc:493] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.375102 22883 raft_consensus.cc:3060] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.381153 22883 raft_consensus.cc:515] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.382913 22883 leader_election.cc:290] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.384121 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.383987 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14f9ba3f9844c14bfd74786b95f80f1" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:17.384869 23036 raft_consensus.cc:3055] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.384913 22962 raft_consensus.cc:3060] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.385412 23036 raft_consensus.cc:740] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:17.386320 23036 consensus_queue.cc:260] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.387691 23036 raft_consensus.cc:3060] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.392868 22962 raft_consensus.cc:2468] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:17.394685 22852 leader_election.cc:304] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.395556 23036 raft_consensus.cc:2468] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:17.395550 23101 raft_consensus.cc:2804] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.396373 23101 raft_consensus.cc:697] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:17.397300 23101 consensus_queue.cc:237] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.404691 22785 catalog_manager.cc:5697] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.424391 23156 raft_consensus.cc:993] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.424963 23114 raft_consensus.cc:1081] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.426836 22962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33576
I20260709 12:15:17.427366 22962 raft_consensus.cc:493] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.427641 22962 raft_consensus.cc:3060] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.433768 23166 raft_consensus.cc:993] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:17.434708 23101 raft_consensus.cc:1081] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Signalling peer 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:17.435636 23167 raft_consensus.cc:993] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: : Instructing follower 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:17.436156 23167 raft_consensus.cc:1081] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Signalling peer 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:17.436892 23036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:44970
I20260709 12:15:17.436797 22962 raft_consensus.cc:515] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.437669 23036 raft_consensus.cc:493] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.438136 23036 raft_consensus.cc:3060] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.438292 22883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:36314
I20260709 12:15:17.438938 22883 raft_consensus.cc:493] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.439327 22883 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.439628 22962 leader_election.cc:290] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.440768 23035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.441537 23035 raft_consensus.cc:3055] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.441871 23035 raft_consensus.cc:740] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:17.441934 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ff9f87b9d4ab5badad9b2791c64fe" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:17.442680 22886 raft_consensus.cc:3060] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.442854 23035 consensus_queue.cc:260] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.444265 23035 raft_consensus.cc:3060] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.445946 23036 raft_consensus.cc:515] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.447440 22883 raft_consensus.cc:515] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.449294 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:17.449958 22887 raft_consensus.cc:3055] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.450265 22887 raft_consensus.cc:740] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:17.450696 22883 leader_election.cc:290] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.451095 22887 consensus_queue.cc:260] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.451645 22886 raft_consensus.cc:2468] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:17.452220 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:17.452888 22962 raft_consensus.cc:3055] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.452920 22925 leader_election.cc:304] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.453018 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.452351 22887 raft_consensus.cc:3060] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.454087 23154 raft_consensus.cc:2804] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.453560 22962 raft_consensus.cc:740] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:17.454798 23154 raft_consensus.cc:697] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:17.455372 22962 consensus_queue.cc:260] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.455658 23154 consensus_queue.cc:237] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.456081 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f3a23b4dbd40dd95afd94b1a0d6553" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:17.456749 22960 raft_consensus.cc:3060] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.454268 23034 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.461993 22887 raft_consensus.cc:2468] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 2.
I20260709 12:15:17.463384 22999 leader_election.cc:304] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:17.464334 23114 raft_consensus.cc:2804] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.464852 23114 raft_consensus.cc:697] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:17.465754 23114 consensus_queue.cc:237] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.453266 23035 raft_consensus.cc:2468] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:17.465695 23034 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:17.469283 22850 leader_election.cc:304] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:17.471560 23166 raft_consensus.cc:2804] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.472685 23166 raft_consensus.cc:697] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:17.473551 23166 consensus_queue.cc:237] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.456729 22962 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.456837 23036 leader_election.cc:290] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:17.480410 22785 catalog_manager.cc:5697] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.481727 22784 catalog_manager.cc:5697] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 1 to 2, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.483786 22960 raft_consensus.cc:2468] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 2.
I20260709 12:15:17.484090 22782 catalog_manager.cc:5697] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 1 to 2, leader changed from aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130) to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.491221 22962 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:17.548472 23101 raft_consensus.cc:993] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.549048 23166 raft_consensus.cc:1081] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.550868 22962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e89d36af7054860b93358b62676a76f"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:43218
I20260709 12:15:17.551508 22962 raft_consensus.cc:493] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.551867 22962 raft_consensus.cc:3060] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.557462 22962 raft_consensus.cc:515] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.559226 22962 leader_election.cc:290] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.560334 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:17.560586 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e89d36af7054860b93358b62676a76f" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.561233 22887 raft_consensus.cc:3055] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.561287 23036 raft_consensus.cc:3060] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.561805 22887 raft_consensus.cc:740] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:17.562811 22887 consensus_queue.cc:260] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.564175 22887 raft_consensus.cc:3060] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.567381 22886 raft_consensus.cc:1275] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:17.568692 23114 consensus_queue.cc:1048] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:17.570399 23036 raft_consensus.cc:2468] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:17.571902 22925 leader_election.cc:304] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.572273 22887 raft_consensus.cc:2468] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:17.572974 23154 raft_consensus.cc:2804] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.573539 23154 raft_consensus.cc:697] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:17.574506 23154 consensus_queue.cc:237] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.587024 22962 raft_consensus.cc:1275] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:17.587139 22782 catalog_manager.cc:5697] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.589239 23114 consensus_queue.cc:1048] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:17.600438 23156 raft_consensus.cc:993] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.601341 23114 raft_consensus.cc:1081] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:17.602411 23180 raft_consensus.cc:993] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:17.603169 22962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33576
I20260709 12:15:17.603911 22962 raft_consensus.cc:493] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.604300 22962 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.604377 23156 raft_consensus.cc:1081] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:17.606415 22886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:15:17.607410 22886 raft_consensus.cc:493] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.607792 22886 raft_consensus.cc:3060] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.611491 22962 raft_consensus.cc:515] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.613724 22962 leader_election.cc:290] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 3 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.614782 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:17.614840 22886 raft_consensus.cc:515] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.615614 22887 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.615532 23036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95014864b2441b19f8c8e20ed94c3a5" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.616597 23036 raft_consensus.cc:3055] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:17.616950 23036 raft_consensus.cc:740] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:17.617798 22886 leader_election.cc:290] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:17.617798 23036 consensus_queue.cc:260] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.619205 23036 raft_consensus.cc:3060] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:17.619338 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:17.619957 23034 raft_consensus.cc:3055] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:17.620316 23034 raft_consensus.cc:740] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:17.620867 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81cc0c4dc01c4835a4bb06c65ae6c698" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:17.621518 22962 raft_consensus.cc:3060] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.621102 23034 consensus_queue.cc:260] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.622556 23034 raft_consensus.cc:3060] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:17.623996 22887 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 3.
I20260709 12:15:17.625439 22925 leader_election.cc:304] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.626370 23154 raft_consensus.cc:2804] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:17.626895 23154 raft_consensus.cc:697] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:17.627846 22962 raft_consensus.cc:2468] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:17.627951 23154 consensus_queue.cc:237] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.626892 23036 raft_consensus.cc:2468] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 3.
I20260709 12:15:17.629282 22852 leader_election.cc:304] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:17.630183 23166 raft_consensus.cc:2804] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:17.630702 23166 raft_consensus.cc:697] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:17.631371 23034 raft_consensus.cc:2468] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:17.631522 23166 consensus_queue.cc:237] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:17.638150 22782 catalog_manager.cc:5697] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 2 to 3, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 3 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.640502 22784 catalog_manager.cc:5697] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.760466 23034 raft_consensus.cc:1275] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.761950 23154 consensus_queue.cc:1048] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:17.772370 22887 raft_consensus.cc:1275] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.774163 23184 consensus_queue.cc:1048] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:17.793565 23034 raft_consensus.cc:1275] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.794978 23166 consensus_queue.cc:1048] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:17.804953 22962 raft_consensus.cc:1275] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.806980 23101 consensus_queue.cc:1048] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:17.873198 22962 raft_consensus.cc:1275] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.874716 23101 consensus_queue.cc:1048] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:17.884553 23034 raft_consensus.cc:1275] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.887980 22887 raft_consensus.cc:1275] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.890106 23114 consensus_queue.cc:1048] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:17.890543 23166 consensus_queue.cc:1048] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:17.901557 22962 raft_consensus.cc:1275] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:17.903076 23181 consensus_queue.cc:1048] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.009043 22887 raft_consensus.cc:1275] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:18.010645 23184 consensus_queue.cc:1048] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.025504 23036 raft_consensus.cc:1275] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:18.027738 23167 consensus_queue.cc:1048] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.043490 22962 raft_consensus.cc:1275] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:18.045006 23166 consensus_queue.cc:1048] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.049279 23036 raft_consensus.cc:1275] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:18.050949 23166 consensus_queue.cc:1048] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.054371 23034 raft_consensus.cc:1275] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:18.056579 23167 consensus_queue.cc:1048] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.076629 22887 raft_consensus.cc:1275] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:18.078588 23193 consensus_queue.cc:1048] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.154933 23034 raft_consensus.cc:1275] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:18.156291 23193 consensus_queue.cc:1048] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:18.164382 22887 raft_consensus.cc:1275] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:18.166160 23193 consensus_queue.cc:1048] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.334424 22784 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50806:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:20.336704 22784 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:20.388768 22870 tablet_service.cc:1511] Processing CreateTablet for tablet 3a852a80db35499983d3b6e09fe4872f (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:20.389743 22949 tablet_service.cc:1511] Processing CreateTablet for tablet 3a852a80db35499983d3b6e09fe4872f (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:20.390252 22870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a852a80db35499983d3b6e09fe4872f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.391198 22949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a852a80db35499983d3b6e09fe4872f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.394258 23022 tablet_service.cc:1511] Processing CreateTablet for tablet 3a852a80db35499983d3b6e09fe4872f (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:20.394619 22872 tablet_service.cc:1511] Processing CreateTablet for tablet 9381344d09374953a2e8b77f6ab634f3 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:20.395279 22945 tablet_service.cc:1511] Processing CreateTablet for tablet 9381344d09374953a2e8b77f6ab634f3 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:20.395742 23022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a852a80db35499983d3b6e09fe4872f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.396099 22872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9381344d09374953a2e8b77f6ab634f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.396687 22945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9381344d09374953a2e8b77f6ab634f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.399449 22876 tablet_service.cc:1511] Processing CreateTablet for tablet 216902f8c4484419aa2204c8e341d9b9 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:20.400732 22876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216902f8c4484419aa2204c8e341d9b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.401074 23024 tablet_service.cc:1511] Processing CreateTablet for tablet 216902f8c4484419aa2204c8e341d9b9 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:20.402550 23024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216902f8c4484419aa2204c8e341d9b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.399513 23020 tablet_service.cc:1511] Processing CreateTablet for tablet 9381344d09374953a2e8b77f6ab634f3 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:20.404740 23020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9381344d09374953a2e8b77f6ab634f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.404417 22873 tablet_service.cc:1511] Processing CreateTablet for tablet 54f9ca74f47b44e78b825ac57c0e8b08 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:20.405804 22873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f9ca74f47b44e78b825ac57c0e8b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.406477 23021 tablet_service.cc:1511] Processing CreateTablet for tablet 54f9ca74f47b44e78b825ac57c0e8b08 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:20.407868 23021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f9ca74f47b44e78b825ac57c0e8b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.408475 22948 tablet_service.cc:1511] Processing CreateTablet for tablet 54f9ca74f47b44e78b825ac57c0e8b08 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:20.409807 22948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f9ca74f47b44e78b825ac57c0e8b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.409587 22874 tablet_service.cc:1511] Processing CreateTablet for tablet 91c5c8a45bfd45748045d92c8adc1eb9 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:20.410977 22874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c5c8a45bfd45748045d92c8adc1eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.408521 22946 tablet_service.cc:1511] Processing CreateTablet for tablet 216902f8c4484419aa2204c8e341d9b9 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:20.414935 22946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216902f8c4484419aa2204c8e341d9b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.423846 23026 tablet_service.cc:1511] Processing CreateTablet for tablet 91c5c8a45bfd45748045d92c8adc1eb9 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:20.425472 23026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c5c8a45bfd45748045d92c8adc1eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.431689 22877 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfb6742cf47458098a12fb789667176 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:20.433233 22877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfb6742cf47458098a12fb789667176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.435256 22871 tablet_service.cc:1511] Processing CreateTablet for tablet 7edccb175f8140e2acf082dba7c24bb7 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:20.435588 23025 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfb6742cf47458098a12fb789667176 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:20.436697 22871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edccb175f8140e2acf082dba7c24bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.437033 23025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfb6742cf47458098a12fb789667176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.441670 22952 tablet_service.cc:1511] Processing CreateTablet for tablet 91c5c8a45bfd45748045d92c8adc1eb9 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:20.442034 22947 tablet_service.cc:1511] Processing CreateTablet for tablet 2dfb6742cf47458098a12fb789667176 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:20.443228 23023 tablet_service.cc:1511] Processing CreateTablet for tablet 7edccb175f8140e2acf082dba7c24bb7 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:20.444684 23023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edccb175f8140e2acf082dba7c24bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.444766 22950 tablet_service.cc:1511] Processing CreateTablet for tablet 7edccb175f8140e2acf082dba7c24bb7 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:20.445389 22875 tablet_service.cc:1511] Processing CreateTablet for tablet 019ee5547f6b4efcad03cb805fb09424 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:20.443280 22952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c5c8a45bfd45748045d92c8adc1eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.446789 22875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019ee5547f6b4efcad03cb805fb09424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.446954 22950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edccb175f8140e2acf082dba7c24bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.447688 22947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dfb6742cf47458098a12fb789667176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.463387 22951 tablet_service.cc:1511] Processing CreateTablet for tablet 019ee5547f6b4efcad03cb805fb09424 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:20.464394 23019 tablet_service.cc:1511] Processing CreateTablet for tablet 019ee5547f6b4efcad03cb805fb09424 (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:20.465037 22951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019ee5547f6b4efcad03cb805fb09424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.465790 23019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019ee5547f6b4efcad03cb805fb09424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.487628 23212 tablet_bootstrap.cc:492] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:20.495152 22869 tablet_service.cc:1511] Processing CreateTablet for tablet 6daa4f911ce6449eaac9ebfdbf37608f (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:20.496546 22869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa4f911ce6449eaac9ebfdbf37608f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.497177 22948 tablet_service.cc:1511] Processing CreateTablet for tablet 6daa4f911ce6449eaac9ebfdbf37608f (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:20.498394 22948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa4f911ce6449eaac9ebfdbf37608f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.514178 23018 tablet_service.cc:1511] Processing CreateTablet for tablet 6daa4f911ce6449eaac9ebfdbf37608f (DEFAULT_TABLE table=soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:20.515604 23018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6daa4f911ce6449eaac9ebfdbf37608f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:20.526762 23213 tablet_bootstrap.cc:492] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.554953 23212 tablet_bootstrap.cc:654] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.605137 23213 tablet_bootstrap.cc:654] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.613914 23214 tablet_bootstrap.cc:492] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:20.624850 23213 tablet_bootstrap.cc:492] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.625420 23213 ts_tablet_manager.cc:1403] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.014s
I20260709 12:15:20.624179 23212 tablet_bootstrap.cc:492] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:20.627799 23212 ts_tablet_manager.cc:1403] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.011s
I20260709 12:15:20.629063 23213 raft_consensus.cc:359] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.629874 23213 raft_consensus.cc:385] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.630146 23213 raft_consensus.cc:740] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.630859 23213 consensus_queue.cc:260] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.631402 23212 raft_consensus.cc:359] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.632187 23214 tablet_bootstrap.cc:654] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.632333 23212 raft_consensus.cc:385] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.632694 23212 raft_consensus.cc:740] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.632990 23213 ts_tablet_manager.cc:1434] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:20.634003 23213 tablet_bootstrap.cc:492] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.633690 23212 consensus_queue.cc:260] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.641045 23213 tablet_bootstrap.cc:654] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.645376 23212 ts_tablet_manager.cc:1434] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:15:20.646694 23212 tablet_bootstrap.cc:492] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:20.654435 23212 tablet_bootstrap.cc:654] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.656730 23214 tablet_bootstrap.cc:492] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:20.657455 23214 ts_tablet_manager.cc:1403] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.007s
I20260709 12:15:20.660876 23212 tablet_bootstrap.cc:492] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:20.661275 23213 tablet_bootstrap.cc:492] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.661716 23212 ts_tablet_manager.cc:1403] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 12:15:20.660992 23214 raft_consensus.cc:359] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.661873 23213 ts_tablet_manager.cc:1403] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:15:20.662165 23214 raft_consensus.cc:385] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.662551 23214 raft_consensus.cc:740] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.663331 23214 consensus_queue.cc:260] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.664937 23213 raft_consensus.cc:359] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.665268 23212 raft_consensus.cc:359] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.665727 23214 ts_tablet_manager.cc:1434] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.001s
I20260709 12:15:20.665745 23213 raft_consensus.cc:385] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.665993 23212 raft_consensus.cc:385] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.666644 23213 raft_consensus.cc:740] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.666740 23212 raft_consensus.cc:740] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.667315 23214 tablet_bootstrap.cc:492] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:20.667518 23213 consensus_queue.cc:260] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.667716 23212 consensus_queue.cc:260] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.670162 23212 ts_tablet_manager.cc:1434] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:15:20.671231 23212 tablet_bootstrap.cc:492] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:20.673105 23213 ts_tablet_manager.cc:1434] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:20.674129 23213 tablet_bootstrap.cc:492] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.684698 23212 tablet_bootstrap.cc:654] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.685235 23213 tablet_bootstrap.cc:654] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.691134 23214 tablet_bootstrap.cc:654] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.701710 23213 tablet_bootstrap.cc:492] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.702147 23213 ts_tablet_manager.cc:1403] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.007s
I20260709 12:15:20.702181 23212 tablet_bootstrap.cc:492] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:20.702867 23212 ts_tablet_manager.cc:1403] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.003s
I20260709 12:15:20.703114 23214 tablet_bootstrap.cc:492] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:20.703718 23214 ts_tablet_manager.cc:1403] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.001s
I20260709 12:15:20.704782 23213 raft_consensus.cc:359] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.705411 23213 raft_consensus.cc:385] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.705657 23213 raft_consensus.cc:740] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.706244 23213 consensus_queue.cc:260] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.706652 23212 raft_consensus.cc:359] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.707516 23212 raft_consensus.cc:385] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.707113 23214 raft_consensus.cc:359] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.707847 23212 raft_consensus.cc:740] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.708076 23214 raft_consensus.cc:385] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.708647 23213 ts_tablet_manager.cc:1434] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:15:20.708663 23214 raft_consensus.cc:740] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.709793 23213 tablet_bootstrap.cc:492] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.710072 23214 consensus_queue.cc:260] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.712900 23214 ts_tablet_manager.cc:1434] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:20.714008 23214 tablet_bootstrap.cc:492] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:20.708808 23212 consensus_queue.cc:260] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.716949 23213 tablet_bootstrap.cc:654] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.717671 23212 ts_tablet_manager.cc:1434] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 12:15:20.719004 23212 tablet_bootstrap.cc:492] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:20.728407 23212 tablet_bootstrap.cc:654] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.733449 23201 raft_consensus.cc:493] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.734228 23201 raft_consensus.cc:515] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.738276 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:20.740006 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
W20260709 12:15:20.740391 22925 leader_election.cc:343] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.742108 23214 tablet_bootstrap.cc:654] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.742444 23212 tablet_bootstrap.cc:492] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
W20260709 12:15:20.742264 22925 leader_election.cc:343] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.743105 23201 leader_election.cc:290] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.743533 23212 ts_tablet_manager.cc:1403] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 12:15:20.743144 22925 leader_election.cc:304] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:20.747486 23101 raft_consensus.cc:493] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.748173 23101 raft_consensus.cc:515] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.749244 23201 raft_consensus.cc:2749] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:20.750674 23212 raft_consensus.cc:359] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.751569 23212 raft_consensus.cc:385] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.751904 23212 raft_consensus.cc:740] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.752010 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:20.752772 23034 raft_consensus.cc:2468] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:20.752943 23213 tablet_bootstrap.cc:492] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.752923 23200 raft_consensus.cc:493] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.752878 23212 consensus_queue.cc:260] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.753777 23213 ts_tablet_manager.cc:1403] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.026s
I20260709 12:15:20.753767 23200 raft_consensus.cc:515] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.755376 22850 leader_election.cc:304] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:20.756124 23200 leader_election.cc:290] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:20.756601 23212 ts_tablet_manager.cc:1434] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:20.756817 23101 leader_election.cc:290] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.757179 23213 raft_consensus.cc:359] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.757787 23212 tablet_bootstrap.cc:492] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:20.758877 23101 raft_consensus.cc:2804] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.759110 23213 raft_consensus.cc:385] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.759405 23101 raft_consensus.cc:493] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.759618 23213 raft_consensus.cc:740] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.759925 23101 raft_consensus.cc:3060] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.760502 23213 consensus_queue.cc:260] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.761214 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:20.762840 23213 ts_tablet_manager.cc:1434] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:20.763840 23213 tablet_bootstrap.cc:492] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.764845 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:20.765508 22887 raft_consensus.cc:2468] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:20.769506 22999 leader_election.cc:304] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:20.770396 23213 tablet_bootstrap.cc:654] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.771317 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
W20260709 12:15:20.773003 23001 leader_election.cc:343] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.774212 23200 raft_consensus.cc:2804] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.774986 23200 raft_consensus.cc:493] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:20.775027 22852 leader_election.cc:343] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.775574 23200 raft_consensus.cc:3060] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.778240 23101 raft_consensus.cc:515] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.780781 23101 leader_election.cc:290] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.784528 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
W20260709 12:15:20.786628 22852 leader_election.cc:343] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.788602 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:20.789305 23034 raft_consensus.cc:3060] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.791172 23212 tablet_bootstrap.cc:654] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.793584 23200 raft_consensus.cc:515] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.804196 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:20.804713 23214 tablet_bootstrap.cc:492] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:20.805446 23214 ts_tablet_manager.cc:1403] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.004s
W20260709 12:15:20.805912 23001 leader_election.cc:343] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.806593 23213 tablet_bootstrap.cc:492] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.807135 23213 ts_tablet_manager.cc:1403] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.009s
I20260709 12:15:20.807438 23034 raft_consensus.cc:2468] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:20.807961 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:20.808660 22887 raft_consensus.cc:3060] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.809008 22850 leader_election.cc:304] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:20.809259 23214 raft_consensus.cc:359] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.810062 23226 raft_consensus.cc:2804] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:20.810324 23214 raft_consensus.cc:385] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.810712 23226 raft_consensus.cc:697] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:20.811036 23214 raft_consensus.cc:740] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.810369 23213 raft_consensus.cc:359] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.811630 23213 raft_consensus.cc:385] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.811962 23213 raft_consensus.cc:740] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.812048 23214 consensus_queue.cc:260] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.812767 23213 consensus_queue.cc:260] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.812060 23226 consensus_queue.cc:237] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.815111 23214 ts_tablet_manager.cc:1434] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 12:15:20.816331 23214 tablet_bootstrap.cc:492] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:20.824975 23214 tablet_bootstrap.cc:654] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.833009 23214 tablet_bootstrap.cc:492] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:20.833559 23212 tablet_bootstrap.cc:492] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:20.833600 23214 ts_tablet_manager.cc:1403] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 12:15:20.834357 23212 ts_tablet_manager.cc:1403] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.017s
I20260709 12:15:20.837906 22887 raft_consensus.cc:2468] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:20.839004 23200 leader_election.cc:290] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:20.839397 22999 leader_election.cc:304] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:20.841310 23214 raft_consensus.cc:359] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.842232 23214 raft_consensus.cc:385] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.842635 23214 raft_consensus.cc:740] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.842356 23212 raft_consensus.cc:359] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.843484 23212 raft_consensus.cc:385] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.843827 23212 raft_consensus.cc:740] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.843750 23214 consensus_queue.cc:260] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.845223 23229 raft_consensus.cc:2804] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:20.846035 23229 raft_consensus.cc:697] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:20.846642 23214 ts_tablet_manager.cc:1434] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 12:15:20.846863 23229 consensus_queue.cc:237] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.844841 23213 ts_tablet_manager.cc:1434] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.037s	user 0.014s	sys 0.006s
I20260709 12:15:20.849045 23213 tablet_bootstrap.cc:492] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.855244 23230 raft_consensus.cc:493] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.855744 23214 tablet_bootstrap.cc:492] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:20.844949 23212 consensus_queue.cc:260] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.855872 23230 raft_consensus.cc:515] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.859117 23212 ts_tablet_manager.cc:1434] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:15:20.859354 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a852a80db35499983d3b6e09fe4872f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:20.859937 22962 raft_consensus.cc:2468] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:20.860167 23212 tablet_bootstrap.cc:492] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:20.861209 22852 leader_election.cc:304] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:20.862207 23101 raft_consensus.cc:2804] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.862627 23101 raft_consensus.cc:493] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.863039 23101 raft_consensus.cc:3060] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.866044 23214 tablet_bootstrap.cc:654] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.871299 23200 raft_consensus.cc:493] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.871852 23200 raft_consensus.cc:515] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.856495 22785 catalog_manager.cc:5697] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.872222 23101 raft_consensus.cc:515] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.876618 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:20.877269 22962 raft_consensus.cc:2468] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:20.877550 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a852a80db35499983d3b6e09fe4872f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:20.877940 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a852a80db35499983d3b6e09fe4872f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:20.878407 23034 raft_consensus.cc:2468] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:20.878532 23001 leader_election.cc:304] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:20.878681 22960 raft_consensus.cc:3060] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.875432 23230 leader_election.cc:290] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.879948 23200 leader_election.cc:290] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:20.881410 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:20.886145 23101 leader_election.cc:290] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.889091 23200 raft_consensus.cc:2804] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.895368 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a852a80db35499983d3b6e09fe4872f" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:20.893404 23200 raft_consensus.cc:493] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.896193 23034 raft_consensus.cc:3060] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.896483 23213 tablet_bootstrap.cc:654] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.896473 23200 raft_consensus.cc:3060] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.898517 22960 raft_consensus.cc:2468] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:20.900197 22852 leader_election.cc:304] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:20.901506 23226 raft_consensus.cc:2804] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:20.902164 23226 raft_consensus.cc:697] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:20.903357 23226 consensus_queue.cc:237] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
W20260709 12:15:20.905879 22999 leader_election.cc:343] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.908294 23214 tablet_bootstrap.cc:492] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:20.912046 23212 tablet_bootstrap.cc:654] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.904848 23034 raft_consensus.cc:2468] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:20.916244 23214 ts_tablet_manager.cc:1403] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.008s
I20260709 12:15:20.919766 23214 raft_consensus.cc:359] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.921514 23214 raft_consensus.cc:385] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.920526 23200 raft_consensus.cc:515] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.920956 23213 tablet_bootstrap.cc:492] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.922641 23213 ts_tablet_manager.cc:1403] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.012s
I20260709 12:15:20.923753 23200 leader_election.cc:290] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:20.924563 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:20.925725 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
W20260709 12:15:20.926064 22999 leader_election.cc:343] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:20.926465 22960 raft_consensus.cc:3060] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.927075 23213 raft_consensus.cc:359] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.927989 23213 raft_consensus.cc:385] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.928345 23213 raft_consensus.cc:740] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.929193 23213 consensus_queue.cc:260] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.931842 23213 ts_tablet_manager.cc:1434] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:20.933032 23213 tablet_bootstrap.cc:492] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:20.937090 23214 raft_consensus.cc:740] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.937844 22960 raft_consensus.cc:2468] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:20.939390 23213 tablet_bootstrap.cc:654] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.938179 23214 consensus_queue.cc:260] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.939419 23001 leader_election.cc:304] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:20.940623 23229 raft_consensus.cc:2804] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:20.941219 23229 raft_consensus.cc:697] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:20.942155 23214 ts_tablet_manager.cc:1434] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.006s
I20260709 12:15:20.942133 23229 consensus_queue.cc:237] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.943578 23214 tablet_bootstrap.cc:492] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:20.945962 23212 tablet_bootstrap.cc:492] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:20.947502 23212 ts_tablet_manager.cc:1403] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.001s
I20260709 12:15:20.951524 23214 tablet_bootstrap.cc:654] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:20.958724 23226 raft_consensus.cc:493] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.959550 23212 raft_consensus.cc:359] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.959589 23226 raft_consensus.cc:515] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.960543 23212 raft_consensus.cc:385] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.961346 23212 raft_consensus.cc:740] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.962566 23212 consensus_queue.cc:260] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.964205 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:20.964980 22960 raft_consensus.cc:2468] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:20.966315 22852 leader_election.cc:304] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:20.967820 23230 raft_consensus.cc:2804] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:20.968169 23230 raft_consensus.cc:493] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.968480 23230 raft_consensus.cc:3060] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.972034 22785 catalog_manager.cc:5697] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.981199 23226 leader_election.cc:290] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.975183 22784 catalog_manager.cc:5697] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.984401 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:20.985492 23034 raft_consensus.cc:2468] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:20.987331 23230 raft_consensus.cc:515] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.991859 23213 tablet_bootstrap.cc:492] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:20.991923 23230 leader_election.cc:290] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:20.992689 23213 ts_tablet_manager.cc:1403] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.060s	user 0.034s	sys 0.017s
I20260709 12:15:20.992972 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:20.993623 22960 raft_consensus.cc:3060] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:20.996306 23213 raft_consensus.cc:359] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.997114 23214 tablet_bootstrap.cc:492] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:20.997188 23201 raft_consensus.cc:493] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:20.997192 23213 raft_consensus.cc:385] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:20.997737 23214 ts_tablet_manager.cc:1403] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.012s
I20260709 12:15:20.998154 23213 raft_consensus.cc:740] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:20.998170 23201 raft_consensus.cc:515] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:20.999089 23213 consensus_queue.cc:260] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.000622 23201 leader_election.cc:290] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.001766 23213 ts_tablet_manager.cc:1434] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:15:21.001565 23214 raft_consensus.cc:359] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.002331 23214 raft_consensus.cc:385] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.002782 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:21.003023 23213 tablet_bootstrap.cc:492] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:21.003082 23214 raft_consensus.cc:740] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.003638 23035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:21.004110 23214 consensus_queue.cc:260] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.001874 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.005203 23034 raft_consensus.cc:3060] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.007056 23214 ts_tablet_manager.cc:1434] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:15:21.008404 23214 tablet_bootstrap.cc:492] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:21.011596 22887 raft_consensus.cc:2393] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aec5293ceaa2446bb92d3815d81e4dd9 in current term 1: Already voted for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in this term.
I20260709 12:15:21.011641 23213 tablet_bootstrap.cc:654] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.014380 22925 leader_election.cc:304] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:21.019174 23201 raft_consensus.cc:3060] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.021118 22960 raft_consensus.cc:2468] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:21.023191 23214 tablet_bootstrap.cc:654] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.025386 23212 ts_tablet_manager.cc:1434] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 12:15:21.031641 23212 tablet_bootstrap.cc:492] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:21.032388 22852 leader_election.cc:304] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.036101 23101 raft_consensus.cc:2804] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.029635 23034 raft_consensus.cc:2468] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:21.036661 23101 raft_consensus.cc:697] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.037760 23101 consensus_queue.cc:237] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.051270 23229 raft_consensus.cc:493] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.052140 23229 raft_consensus.cc:515] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.055927 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:21.056041 23201 raft_consensus.cc:2749] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:21.057631 22999 leader_election.cc:343] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.058907 23229 leader_election.cc:290] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
W20260709 12:15:21.058908 22925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.9.180.129:42847, user_credentials={real_user=slave}} blocked reactor thread for 44621.5us
I20260709 12:15:21.059964 23213 tablet_bootstrap.cc:492] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:21.060527 23213 ts_tablet_manager.cc:1403] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.025s
I20260709 12:15:21.061091 23214 tablet_bootstrap.cc:492] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:21.061705 23214 ts_tablet_manager.cc:1403] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.009s
I20260709 12:15:21.061143 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:21.062798 22960 raft_consensus.cc:2468] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:21.063575 23213 raft_consensus.cc:359] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.064262 23213 raft_consensus.cc:385] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.064160 23001 leader_election.cc:304] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:21.064798 23213 raft_consensus.cc:740] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.065021 23214 raft_consensus.cc:359] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.065723 23229 raft_consensus.cc:2804] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.065867 23214 raft_consensus.cc:385] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.066172 23229 raft_consensus.cc:493] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.066291 23214 raft_consensus.cc:740] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.065999 23213 consensus_queue.cc:260] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.066795 23229 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.067498 23214 consensus_queue.cc:260] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.068368 23213 ts_tablet_manager.cc:1434] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:21.069906 23214 ts_tablet_manager.cc:1434] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:21.070595 23213 tablet_bootstrap.cc:492] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: Bootstrap starting.
I20260709 12:15:21.071069 23214 tablet_bootstrap.cc:492] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:21.072636 22785 catalog_manager.cc:5697] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.077544 23212 tablet_bootstrap.cc:654] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.078022 23213 tablet_bootstrap.cc:654] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.078172 23214 tablet_bootstrap.cc:654] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.088279 22784 catalog_manager.cc:5697] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.090593 23213 tablet_bootstrap.cc:492] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: No bootstrap required, opened a new log
I20260709 12:15:21.091270 23213 ts_tablet_manager.cc:1403] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:15:21.091995 23229 raft_consensus.cc:515] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.094712 23213 raft_consensus.cc:359] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.095443 23213 raft_consensus.cc:385] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.095724 23213 raft_consensus.cc:740] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.096475 23213 consensus_queue.cc:260] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.097342 23212 tablet_bootstrap.cc:492] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:21.097946 23212 ts_tablet_manager.cc:1403] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.004s
I20260709 12:15:21.098721 23213 ts_tablet_manager.cc:1434] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:21.099900 23101 raft_consensus.cc:493] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.100373 23101 raft_consensus.cc:515] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.103766 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:21.104568 22960 raft_consensus.cc:2393] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17f79b18282f40368cd50fb6e7a8f852 in current term 1: Already voted for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in this term.
I20260709 12:15:21.105901 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:21.107709 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.108330 22887 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.102331 23101 leader_election.cc:290] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.111418 22850 leader_election.cc:304] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852; no voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:21.112732 23101 raft_consensus.cc:3060] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.115749 23230 raft_consensus.cc:493] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.116413 23230 raft_consensus.cc:515] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.118566 23230 leader_election.cc:290] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.119695 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:21.119613 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
W20260709 12:15:21.121434 22850 leader_election.cc:343] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:21.122092 22852 leader_election.cc:343] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:21.125331 22852 leader_election.cc:304] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852; no voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:21.126180 23230 raft_consensus.cc:2749] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:21.130241 23101 raft_consensus.cc:2749] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:21.130897 22833 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:21.132391 23229 leader_election.cc:290] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:21.131177 22887 raft_consensus.cc:2468] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:21.133121 23212 raft_consensus.cc:359] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.133975 22999 leader_election.cc:304] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:21.134527 23212 raft_consensus.cc:385] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.134313 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.134970 23229 raft_consensus.cc:2804] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.135285 22960 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.135573 23229 raft_consensus.cc:697] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.135951 23214 tablet_bootstrap.cc:492] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:21.137763 23214 ts_tablet_manager.cc:1403] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.029s
I20260709 12:15:21.137984 23229 consensus_queue.cc:237] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.140260 23214 raft_consensus.cc:359] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.140904 23214 raft_consensus.cc:385] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.141151 23214 raft_consensus.cc:740] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.141855 23214 consensus_queue.cc:260] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.143797 22960 raft_consensus.cc:2468] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:21.144222 23214 ts_tablet_manager.cc:1434] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:21.144701 23212 raft_consensus.cc:740] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.145411 23214 tablet_bootstrap.cc:492] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: Bootstrap starting.
I20260709 12:15:21.145542 23212 consensus_queue.cc:260] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.147994 23212 ts_tablet_manager.cc:1434] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:15:21.149359 23212 tablet_bootstrap.cc:492] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:21.148967 22782 catalog_manager.cc:5697] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.155226 23214 tablet_bootstrap.cc:654] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.157367 23212 tablet_bootstrap.cc:654] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.159469 23230 raft_consensus.cc:493] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.160418 23230 raft_consensus.cc:515] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.163158 23230 leader_election.cc:290] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.165714 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:21.166652 22960 raft_consensus.cc:2468] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:21.168097 22852 leader_election.cc:304] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.168787 23214 tablet_bootstrap.cc:492] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: No bootstrap required, opened a new log
I20260709 12:15:21.168916 23212 tablet_bootstrap.cc:492] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:21.169042 23230 raft_consensus.cc:2804] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.169476 23214 ts_tablet_manager.cc:1403] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 12:15:21.169412 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:21.169731 23230 raft_consensus.cc:493] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.170325 23230 raft_consensus.cc:3060] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.170369 23034 raft_consensus.cc:2468] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 0.
I20260709 12:15:21.172724 23214 raft_consensus.cc:359] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.173372 23214 raft_consensus.cc:385] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.173635 23214 raft_consensus.cc:740] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.174275 23214 consensus_queue.cc:260] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.175985 23214 ts_tablet_manager.cc:1434] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:21.178807 23212 ts_tablet_manager.cc:1403] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 12:15:21.179543 23230 raft_consensus.cc:515] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.181783 23230 leader_election.cc:290] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.182582 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.183111 22960 raft_consensus.cc:3060] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.182966 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.183835 23034 raft_consensus.cc:3060] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.181262 23212 raft_consensus.cc:359] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.187141 23212 raft_consensus.cc:385] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.187544 23212 raft_consensus.cc:740] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.189412 23212 consensus_queue.cc:260] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.191839 23212 ts_tablet_manager.cc:1434] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:15:21.193298 23212 tablet_bootstrap.cc:492] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: Bootstrap starting.
I20260709 12:15:21.194242 23034 raft_consensus.cc:2468] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:21.195436 22850 leader_election.cc:304] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:21.190528 22960 raft_consensus.cc:2468] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 1.
I20260709 12:15:21.196717 23230 raft_consensus.cc:2804] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.197260 23230 raft_consensus.cc:697] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.198441 23230 consensus_queue.cc:237] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.199121 23212 tablet_bootstrap.cc:654] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.205660 23212 tablet_bootstrap.cc:492] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: No bootstrap required, opened a new log
I20260709 12:15:21.206142 23212 ts_tablet_manager.cc:1403] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:15:21.208662 23212 raft_consensus.cc:359] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.209374 23212 raft_consensus.cc:385] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.209651 23212 raft_consensus.cc:740] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.210295 23212 consensus_queue.cc:260] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.210194 22782 catalog_manager.cc:5697] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 1 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.212792 23212 ts_tablet_manager.cc:1434] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:21.265637 23229 raft_consensus.cc:493] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.266295 23229 raft_consensus.cc:515] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.268692 23229 leader_election.cc:290] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:21.269418 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:21.269766 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" is_pre_election: true
I20260709 12:15:21.270087 22887 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:21.270582 22960 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 0.
I20260709 12:15:21.271209 22999 leader_election.cc:304] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:21.272074 23229 raft_consensus.cc:2804] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.272459 23229 raft_consensus.cc:493] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.272696 23229 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.278836 23229 raft_consensus.cc:515] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.280510 23229 leader_election.cc:290] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:21.281239 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.281674 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.282027 22887 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.282478 22960 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.287493 22887 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:21.288638 22960 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 1.
I20260709 12:15:21.288697 22999 leader_election.cc:304] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:21.289911 23229 raft_consensus.cc:2804] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.290544 23229 raft_consensus.cc:697] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.290912 23230 consensus_queue.cc:1048] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.291426 23229 consensus_queue.cc:237] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.301236 22782 catalog_manager.cc:5697] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 1 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.307279 23230 consensus_queue.cc:1048] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.332608 23245 raft_consensus.cc:493] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.332775 23229 consensus_queue.cc:1048] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.333158 23245 raft_consensus.cc:515] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.335276 23245 leader_election.cc:290] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.336509 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" is_pre_election: true
I20260709 12:15:21.336921 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852" is_pre_election: true
I20260709 12:15:21.337410 23034 raft_consensus.cc:2468] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 0.
I20260709 12:15:21.337654 22886 raft_consensus.cc:2468] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 0.
I20260709 12:15:21.339802 22925 leader_election.cc:304] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.340085 22960 raft_consensus.cc:3060] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.341281 23245 raft_consensus.cc:2804] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:21.341691 23245 raft_consensus.cc:493] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.342018 23245 raft_consensus.cc:3060] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.350201 23245 raft_consensus.cc:515] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.351955 23229 consensus_queue.cc:1048] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.352270 23245 leader_election.cc:290] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.355085 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.355553 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.356274 23034 raft_consensus.cc:3060] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.355731 22886 raft_consensus.cc:3060] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.361393 23101 consensus_queue.cc:1048] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.368534 22886 raft_consensus.cc:2468] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 1.
I20260709 12:15:21.370002 22925 leader_election.cc:304] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.371537 23201 raft_consensus.cc:2804] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.372224 23201 raft_consensus.cc:697] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:21.367300 23034 raft_consensus.cc:2468] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 1.
I20260709 12:15:21.379558 23101 consensus_queue.cc:1048] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.373413 23201 consensus_queue.cc:237] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.401500 22782 catalog_manager.cc:5697] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.480576 23229 consensus_queue.cc:1048] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.494051 23269 consensus_queue.cc:1048] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.505120 23034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:21.505774 23034 raft_consensus.cc:606] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:21.511768 23034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:21.512307 23034 raft_consensus.cc:606] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:21.517926 23034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:21.518313 23034 raft_consensus.cc:606] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:21.523697 22886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33402
I20260709 12:15:21.524137 22886 raft_consensus.cc:606] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:21.527771 23269 consensus_queue.cc:1048] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.532034 23034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dfb6742cf47458098a12fb789667176"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:51240
I20260709 12:15:21.532663 23034 raft_consensus.cc:606] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:21.535760 23235 raft_consensus.cc:993] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.536334 23235 raft_consensus.cc:1081] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.538932 22960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dfb6742cf47458098a12fb789667176"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33576
I20260709 12:15:21.540174 22886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33402
I20260709 12:15:21.541059 22886 raft_consensus.cc:606] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:21.543071 23200 consensus_queue.cc:1048] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.544890 22960 raft_consensus.cc:493] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.545367 22960 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.550462 22886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:33402
I20260709 12:15:21.551234 22886 raft_consensus.cc:606] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Received request to transfer leadership to TS aec5293ceaa2446bb92d3815d81e4dd9
I20260709 12:15:21.553359 22960 raft_consensus.cc:515] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.556466 22886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.559306 22961 raft_consensus.cc:1240] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Rejecting Update request from peer 6cc69a97033e429b982e8ddd0ee48cb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:21.560218 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.560477 22962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
mode: GRACEFUL
new_leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:33590
I20260709 12:15:21.560853 23034 raft_consensus.cc:3055] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.561194 22962 raft_consensus.cc:606] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Received request to transfer leadership to TS 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:21.561201 23034 raft_consensus.cc:740] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.563252 23034 consensus_queue.cc:260] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.564069 23200 consensus_queue.cc:1059] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.565491 23034 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.559150 22960 leader_election.cc:290] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.574417 23034 raft_consensus.cc:2468] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:21.575709 22925 leader_election.cc:304] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 17f79b18282f40368cd50fb6e7a8f852
I20260709 12:15:21.576643 23201 raft_consensus.cc:2804] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.577258 23201 raft_consensus.cc:697] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:21.578158 23201 consensus_queue.cc:237] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.585420 22785 catalog_manager.cc:5697] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.652449 23230 consensus_queue.cc:1048] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.664739 23101 consensus_queue.cc:1048] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:21.672911 23101 raft_consensus.cc:993] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.673374 23101 raft_consensus.cc:1081] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.675012 22960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:43218
I20260709 12:15:21.675570 22960 raft_consensus.cc:493] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.675964 22960 raft_consensus.cc:3060] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.681491 22960 raft_consensus.cc:515] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.683316 22960 leader_election.cc:290] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.684201 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.684824 22887 raft_consensus.cc:3055] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.685156 22887 raft_consensus.cc:740] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.684856 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edccb175f8140e2acf082dba7c24bb7" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.686094 23034 raft_consensus.cc:3060] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.685958 22887 consensus_queue.cc:260] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.687311 22887 raft_consensus.cc:3060] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.692442 23034 raft_consensus.cc:2468] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:21.693069 22887 raft_consensus.cc:2468] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:21.693598 22925 leader_election.cc:304] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.694458 23201 raft_consensus.cc:2804] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.694985 23201 raft_consensus.cc:697] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:21.695766 23201 consensus_queue.cc:237] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.703156 22782 catalog_manager.cc:5697] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.716544 23101 consensus_queue.cc:1048] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.724058 23226 raft_consensus.cc:993] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.724689 23230 raft_consensus.cc:1081] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.726395 22961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:43218
I20260709 12:15:21.727149 22961 raft_consensus.cc:493] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.727537 22961 raft_consensus.cc:3060] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.732797 23230 consensus_queue.cc:1048] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.735440 22961 raft_consensus.cc:515] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.736725 22960 raft_consensus.cc:1240] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Rejecting Update request from peer 17f79b18282f40368cd50fb6e7a8f852 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:21.738468 22961 leader_election.cc:290] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.739650 23035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.740559 23035 raft_consensus.cc:3060] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.741565 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c5c8a45bfd45748045d92c8adc1eb9" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.741756 23230 consensus_queue.cc:1059] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.744529 22887 raft_consensus.cc:3055] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.744903 22887 raft_consensus.cc:740] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.745710 22887 consensus_queue.cc:260] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.747023 22887 raft_consensus.cc:3060] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.748276 23035 raft_consensus.cc:2468] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:21.749727 22925 leader_election.cc:304] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.750592 23201 raft_consensus.cc:2804] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.751264 23201 raft_consensus.cc:697] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:21.752100 23201 consensus_queue.cc:237] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.758635 22887 raft_consensus.cc:2468] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
W20260709 12:15:21.759402 23101 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:15:21.762199 22782 catalog_manager.cc:5697] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.776856 23201 consensus_queue.cc:1048] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.792584 23278 consensus_queue.cc:1048] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:21.801728 23263 raft_consensus.cc:993] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: : Instructing follower 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:21.802284 23278 raft_consensus.cc:1081] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Signalling peer 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:21.803987 23034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:15:21.804550 23034 raft_consensus.cc:493] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.804956 23034 raft_consensus.cc:3060] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.810643 23034 raft_consensus.cc:515] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.812428 23034 leader_election.cc:290] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:21.813253 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.813926 22887 raft_consensus.cc:3060] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.813802 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6daa4f911ce6449eaac9ebfdbf37608f" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.814785 22960 raft_consensus.cc:3055] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.815177 22960 raft_consensus.cc:740] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:21.816025 22960 consensus_queue.cc:260] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.817188 22960 raft_consensus.cc:3060] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.820400 22887 raft_consensus.cc:2468] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 2.
I20260709 12:15:21.821712 22999 leader_election.cc:304] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:21.822453 23200 raft_consensus.cc:2804] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.822969 23200 raft_consensus.cc:697] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.823786 23200 consensus_queue.cc:237] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.824817 22960 raft_consensus.cc:2468] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 2.
I20260709 12:15:21.832123 22785 catalog_manager.cc:5697] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 1 to 2, leader changed from aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130) to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 2 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.834733 23229 raft_consensus.cc:993] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:21.835366 23229 raft_consensus.cc:1081] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:21.837239 22887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:15:21.837893 22887 raft_consensus.cc:493] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.838275 22887 raft_consensus.cc:3060] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.847262 22887 raft_consensus.cc:515] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.850343 22887 leader_election.cc:290] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.850476 22960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.850623 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9381344d09374953a2e8b77f6ab634f3" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.851343 22960 raft_consensus.cc:3060] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.851822 23034 raft_consensus.cc:3055] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.852138 23034 raft_consensus.cc:740] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.853400 23034 consensus_queue.cc:260] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.854331 23034 raft_consensus.cc:3060] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.858070 22960 raft_consensus.cc:2468] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:21.858850 22961 raft_consensus.cc:1240] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Rejecting Update request from peer 6cc69a97033e429b982e8ddd0ee48cb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:21.859465 23034 raft_consensus.cc:2468] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:21.859469 22852 leader_election.cc:304] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.860680 23101 raft_consensus.cc:2804] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.861218 23101 raft_consensus.cc:697] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.862005 23101 consensus_queue.cc:237] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.871147 22785 catalog_manager.cc:5697] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.892074 23229 consensus_queue.cc:1048] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.903537 23200 consensus_queue.cc:1048] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:21.911245 23229 raft_consensus.cc:993] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:21.911779 23200 raft_consensus.cc:1081] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:21.913340 22887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:15:21.913864 22887 raft_consensus.cc:493] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.914216 22887 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.919170 22887 raft_consensus.cc:515] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.921036 22887 leader_election.cc:290] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.921563 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.921440 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.922648 23034 raft_consensus.cc:3055] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.922789 22961 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.923091 23034 raft_consensus.cc:740] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.923990 23034 consensus_queue.cc:260] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.924844 23034 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.929581 23034 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:21.930006 22961 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:21.930559 22850 leader_election.cc:304] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:21.931455 23101 raft_consensus.cc:2804] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.931866 23101 raft_consensus.cc:697] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.932511 23101 consensus_queue.cc:237] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.938935 22785 catalog_manager.cc:5697] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.940445 23226 raft_consensus.cc:993] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.941030 23101 raft_consensus.cc:1081] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Signalling peer aec5293ceaa2446bb92d3815d81e4dd9 to start an election
I20260709 12:15:21.942687 22961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
 from {username='slave'} at 127.0.0.1:43218
I20260709 12:15:21.943183 22961 raft_consensus.cc:493] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.943506 22961 raft_consensus.cc:3060] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.949277 22961 raft_consensus.cc:515] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.950982 22961 leader_election.cc:290] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.951680 22887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:21.952304 22887 raft_consensus.cc:3055] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.952193 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019ee5547f6b4efcad03cb805fb09424" candidate_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.953006 23034 raft_consensus.cc:3060] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.953639 22887 raft_consensus.cc:740] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.954748 22887 consensus_queue.cc:260] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.957084 22887 raft_consensus.cc:3060] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.958931 23034 raft_consensus.cc:2468] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:21.960014 22925 leader_election.cc:304] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.960816 23278 raft_consensus.cc:2804] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.961292 23278 raft_consensus.cc:697] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Leader. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:21.962030 23200 raft_consensus.cc:993] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: : Instructing follower 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:21.962780 23235 raft_consensus.cc:1081] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Signalling peer 17f79b18282f40368cd50fb6e7a8f852 to start an election
I20260709 12:15:21.962121 23278 consensus_queue.cc:237] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.964725 22886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
 from {username='slave'} at 127.0.0.1:33398
I20260709 12:15:21.965317 22886 raft_consensus.cc:493] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:21.965654 22886 raft_consensus.cc:3060] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.969192 22887 raft_consensus.cc:2468] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aec5293ceaa2446bb92d3815d81e4dd9 in term 2.
I20260709 12:15:21.970570 22785 catalog_manager.cc:5697] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 reported cstate change: term changed from 1 to 2, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.971875 22886 raft_consensus.cc:515] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.974663 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:21.975006 23034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f9ca74f47b44e78b825ac57c0e8b08" candidate_uuid: "17f79b18282f40368cd50fb6e7a8f852" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
I20260709 12:15:21.976310 23034 raft_consensus.cc:3055] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:21.975555 22961 raft_consensus.cc:3060] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.975742 23035 raft_consensus.cc:1275] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:21.976636 23034 raft_consensus.cc:740] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:21.975253 22886 leader_election.cc:290] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Requested vote from peers aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941), 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449)
I20260709 12:15:21.978845 23278 consensus_queue.cc:1048] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:21.979875 23034 consensus_queue.cc:260] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:21.981226 23034 raft_consensus.cc:3060] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.988766 22961 raft_consensus.cc:2468] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:21.989300 23034 raft_consensus.cc:2468] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17f79b18282f40368cd50fb6e7a8f852 in term 2.
I20260709 12:15:21.990237 22852 leader_election.cc:304] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:21.991638 23101 raft_consensus.cc:2804] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:21.992074 23101 raft_consensus.cc:697] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Leader. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:21.992193 22886 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:21.992794 23101 consensus_queue.cc:237] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:22.001468 22784 catalog_manager.cc:5697] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 reported cstate change: term changed from 1 to 2, leader changed from 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131) to 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129). New cstate: current_term: 2 leader_uuid: "17f79b18282f40368cd50fb6e7a8f852" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.008898 22886 raft_consensus.cc:1275] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.010668 23201 consensus_queue.cc:1048] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.205950 23034 raft_consensus.cc:1275] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.205951 22961 raft_consensus.cc:1275] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.207651 23201 consensus_queue.cc:1048] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.207569 23235 consensus_queue.cc:1048] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.216763 22886 raft_consensus.cc:1275] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.218479 23201 consensus_queue.cc:1048] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.227567 22886 raft_consensus.cc:1275] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.229722 23235 consensus_queue.cc:1048] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.313001 23036 raft_consensus.cc:1275] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.317442 23226 consensus_queue.cc:1048] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.337260 22961 raft_consensus.cc:1275] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.345407 23036 raft_consensus.cc:1275] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.346206 23283 consensus_queue.cc:1048] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.359858 23201 consensus_queue.cc:1048] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.367360 22887 raft_consensus.cc:1275] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.369747 22887 raft_consensus.cc:1275] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.369808 23245 consensus_queue.cc:1048] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.373293 23201 consensus_queue.cc:1048] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.385730 23034 raft_consensus.cc:1275] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer aec5293ceaa2446bb92d3815d81e4dd9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.389693 23201 consensus_queue.cc:1048] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.397212 23034 raft_consensus.cc:1275] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.398996 23283 consensus_queue.cc:1048] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.417919 22961 raft_consensus.cc:1275] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.422781 23101 consensus_queue.cc:1048] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.430394 23036 raft_consensus.cc:1275] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.432163 23284 consensus_queue.cc:1048] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:22.448958 22961 raft_consensus.cc:1275] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Refusing update from remote peer 17f79b18282f40368cd50fb6e7a8f852: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:22.451716 23101 consensus_queue.cc:1048] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:24.566093 22783 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50806:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:24.595265 22783 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50806:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:24.653599 22782 catalog_manager.cc:5789] TS 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131:43449) does not have the latest schema for tablet 6daa4f911ce6449eaac9ebfdbf37608f (table soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]). Expected version 1 got 0
I20260709 12:15:24.676159  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:24.931092 23334 tablet.cc:1724] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:24.939715 23339 tablet.cc:1724] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:24.947340 23341 tablet.cc:1724] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:24.962949 23342 tablet.cc:1724] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:24.981842 22913 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:91c5c8a45bfd45748045d92c8adc1eb9)
I20260709 12:15:24.988474 23340 tablet.cc:1724] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:24.998636 23328 tablet.cc:1724] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:25.074963 22925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:43449, user_credentials={real_user=slave}} blocked reactor thread for 54920.1us
I20260709 12:15:25.091065 23346 tablet.cc:1724] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.097179 23354 tablet.cc:1724] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.115533 22782 catalog_manager.cc:5789] TS aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941) does not have the latest schema for tablet 019ee5547f6b4efcad03cb805fb09424 (table soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]). Expected version 1 got 0
I20260709 12:15:25.116784 22782 catalog_manager.cc:5789] TS aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941) does not have the latest schema for tablet 2dfb6742cf47458098a12fb789667176 (table soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]). Expected version 1 got 0
I20260709 12:15:25.125021 22782 catalog_manager.cc:5789] TS aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941) does not have the latest schema for tablet 91c5c8a45bfd45748045d92c8adc1eb9 (table soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]). Expected version 1 got 0
I20260709 12:15:25.126101 22782 catalog_manager.cc:5789] TS aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941) does not have the latest schema for tablet 7edccb175f8140e2acf082dba7c24bb7 (table soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]). Expected version 1 got 0
I20260709 12:15:25.134409 23339 tablet.cc:1724] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.153630 22886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:33414
I20260709 12:15:25.154771 22886 raft_consensus.cc:606] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Received request to transfer leadership to TS 6cc69a97033e429b982e8ddd0ee48cb7
W20260709 12:15:25.154287 22913 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:54f9ca74f47b44e78b825ac57c0e8b08)
W20260709 12:15:25.163929 22913 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:54f9ca74f47b44e78b825ac57c0e8b08)
I20260709 12:15:25.167142 23355 tablet.cc:1724] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.171111 23345 raft_consensus.cc:993] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.171895 23337 raft_consensus.cc:1081] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Signalling peer 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.192905 23341 tablet.cc:1724] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:25.197158 23356 log.cc:927] Time spent T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:15:25.197638 23334 tablet.cc:1724] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.221032 23035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:44970
I20260709 12:15:25.221895 23035 raft_consensus.cc:493] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.222323 23035 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.204880 23342 tablet.cc:1724] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:25.252622 23359 log.cc:927] Time spent T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: Append to log took a long time: real 0.063s	user 0.004s	sys 0.000s
I20260709 12:15:25.270605 23358 tablet.cc:1724] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.274555 23328 tablet.cc:1724] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.282018 23346 tablet.cc:1724] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.307803 23035 raft_consensus.cc:515] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.261173 23354 tablet.cc:1724] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.317399 23340 tablet.cc:1724] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.322445 23363 tablet.cc:1724] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.297688 23342 tablet.cc:1724] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.334905 23035 leader_election.cc:290] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:25.335821 23361 tablet.cc:1724] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.339538 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:25.340348 22962 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.305711 23358 tablet.cc:1724] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.325882 23339 tablet.cc:1724] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.327739 23355 tablet.cc:1724] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.334924 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216902f8c4484419aa2204c8e341d9b9" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:25.357558 22883 raft_consensus.cc:3055] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:25.357954 22883 raft_consensus.cc:740] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:25.359027 22883 consensus_queue.cc:260] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.360282 22883 raft_consensus.cc:3060] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.354200 22962 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.365192 22782 catalog_manager.cc:5789] TS 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847) does not have the latest schema for tablet 3a852a80db35499983d3b6e09fe4872f (table soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298]). Expected version 1 got 0
I20260709 12:15:25.377849 23001 leader_election.cc:304] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:25.380391 23357 raft_consensus.cc:2804] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:25.380733 22961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dfb6742cf47458098a12fb789667176"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
mode: GRACEFUL
new_leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:60548
I20260709 12:15:25.381608 22961 raft_consensus.cc:606] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Received request to transfer leadership to TS 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:25.380880 23357 raft_consensus.cc:697] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:25.383610 23357 consensus_queue.cc:237] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.390098  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:15:25.390899  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:25.396771 23354 tablet.cc:1724] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.401259 22784 catalog_manager.cc:5697] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 2 to 3, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.393267 23363 tablet.cc:1724] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.415412 23339 tablet.cc:1724] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:25.423328 22961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe"
dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
mode: GRACEFUL
new_leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:60548
I20260709 12:15:25.424180 22961 raft_consensus.cc:606] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Received request to transfer leadership to TS 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:25.431304 22886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90"
dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
mode: GRACEFUL
new_leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:33414
I20260709 12:15:25.432042 22886 raft_consensus.cc:606] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Received request to transfer leadership to TS 6cc69a97033e429b982e8ddd0ee48cb7
I20260709 12:15:25.435092  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:25.436187  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:25.439807 22883 raft_consensus.cc:2468] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.459437 22785 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55: soft_deleted_table [id=9d79cd0b782f4a56ace90743c90f7298] alter complete (version 1)
I20260709 12:15:25.488273 23309 raft_consensus.cc:993] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: : Instructing follower 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.488898 23330 raft_consensus.cc:1081] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Signalling peer 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.490682 23030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:15:25.491226 23030 raft_consensus.cc:493] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.491556 23030 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.497203 23030 raft_consensus.cc:515] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.499310 23030 leader_election.cc:290] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:25.500543 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:25.500543 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de15374caea4b6a8e49632ca6cd2abe" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:25.501524 22962 raft_consensus.cc:3055] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:25.501613 22883 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.501965 22962 raft_consensus.cc:740] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:25.502976 22962 consensus_queue.cc:260] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.504364 22962 raft_consensus.cc:3060] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.509768 22883 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.511417 22999 leader_election.cc:304] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:25.511687 22962 raft_consensus.cc:2468] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.512446 23357 raft_consensus.cc:2804] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:25.513039 23357 raft_consensus.cc:697] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:25.513968 23357 consensus_queue.cc:237] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.523803 22784 catalog_manager.cc:5697] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 2 to 3, leader changed from aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130) to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.751832 23309 raft_consensus.cc:993] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: : Instructing follower 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.752362 23330 raft_consensus.cc:1081] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Signalling peer 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.753921 23030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dfb6742cf47458098a12fb789667176"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:44980
I20260709 12:15:25.754477 23030 raft_consensus.cc:493] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.754822 23030 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.761533 23030 raft_consensus.cc:515] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.763435 23030 leader_election.cc:290] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:25.764181 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:25.764585 22962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dfb6742cf47458098a12fb789667176" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:25.765023 22883 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.765220 22962 raft_consensus.cc:3055] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:25.765661 22962 raft_consensus.cc:740] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aec5293ceaa2446bb92d3815d81e4dd9, State: Running, Role: LEADER
I20260709 12:15:25.766333 22962 consensus_queue.cc:260] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.767374 22962 raft_consensus.cc:3060] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.770717 22883 raft_consensus.cc:2468] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.771907 22999 leader_election.cc:304] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17f79b18282f40368cd50fb6e7a8f852, 6cc69a97033e429b982e8ddd0ee48cb7; no voters: 
I20260709 12:15:25.772643 23357 raft_consensus.cc:2804] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:25.772923 22962 raft_consensus.cc:2468] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.773247 23357 raft_consensus.cc:697] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:25.774327 23357 consensus_queue.cc:237] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.781556 22784 catalog_manager.cc:5697] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 2 to 3, leader changed from aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130) to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:25.791891 22883 raft_consensus.cc:1275] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:25.793149 23357 consensus_queue.cc:1048] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:25.802459 22962 raft_consensus.cc:1275] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:25.804850 23235 consensus_queue.cc:1048] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:25.809106 23345 raft_consensus.cc:993] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: : Instructing follower 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.809619 23345 raft_consensus.cc:1081] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Signalling peer 6cc69a97033e429b982e8ddd0ee48cb7 to start an election
I20260709 12:15:25.811403 23030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90"
dest_uuid: "6cc69a97033e429b982e8ddd0ee48cb7"
 from {username='slave'} at 127.0.0.1:44970
I20260709 12:15:25.812016 23030 raft_consensus.cc:493] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:25.812580 23030 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.827907 23030 raft_consensus.cc:515] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.829702 23030 leader_election.cc:290] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Requested vote from peers 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847), aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941)
I20260709 12:15:25.830659 22883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17f79b18282f40368cd50fb6e7a8f852"
I20260709 12:15:25.831528 22883 raft_consensus.cc:3055] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:25.832116 22883 raft_consensus.cc:740] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17f79b18282f40368cd50fb6e7a8f852, State: Running, Role: LEADER
I20260709 12:15:25.831434 22961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbce0ceb89b427f8cc53a68bb604d90" candidate_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aec5293ceaa2446bb92d3815d81e4dd9"
I20260709 12:15:25.832760 22961 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.833086 22883 consensus_queue.cc:260] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.834724 22883 raft_consensus.cc:3060] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:25.840080 22961 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.841976 23001 leader_election.cc:304] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc69a97033e429b982e8ddd0ee48cb7, aec5293ceaa2446bb92d3815d81e4dd9; no voters: 
I20260709 12:15:25.843238 23235 raft_consensus.cc:2804] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:25.843766 23235 raft_consensus.cc:697] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Becoming Leader. State: Replica: 6cc69a97033e429b982e8ddd0ee48cb7, State: Running, Role: LEADER
I20260709 12:15:25.844739 22883 raft_consensus.cc:2468] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc69a97033e429b982e8ddd0ee48cb7 in term 3.
I20260709 12:15:25.844817 23235 consensus_queue.cc:237] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } }
I20260709 12:15:25.854832 22784 catalog_manager.cc:5697] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 reported cstate change: term changed from 2 to 3, leader changed from 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129) to 6cc69a97033e429b982e8ddd0ee48cb7 (127.9.180.131). New cstate: current_term: 3 leader_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc69a97033e429b982e8ddd0ee48cb7" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 43449 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:26.050292 22883 raft_consensus.cc:1275] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:26.052042 23235 consensus_queue.cc:1048] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:26.063405 22961 raft_consensus.cc:1275] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:26.067608 23375 consensus_queue.cc:1048] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:26.255920 22883 raft_consensus.cc:1275] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:26.257393 23375 consensus_queue.cc:1048] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:26.265751 22961 raft_consensus.cc:1275] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:26.267325 23375 consensus_queue.cc:1048] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:26.354111 22883 raft_consensus.cc:1275] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:26.355635 23375 consensus_queue.cc:1048] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17f79b18282f40368cd50fb6e7a8f852" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:26.365628 22961 raft_consensus.cc:1275] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Refusing update from remote peer 6cc69a97033e429b982e8ddd0ee48cb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:26.367558 23357 consensus_queue.cc:1048] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aec5293ceaa2446bb92d3815d81e4dd9" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 40941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:26.437320  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:26.442461  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:26.442939  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:26.448181  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:26.448571  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:27.449806  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:27.456743  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:27.457194  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:27.463517  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:27.463997  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:28.465195  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:28.470227  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:28.470679  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.476431  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:28.476824  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:29.478296  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:29.484890  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:29.485419  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:29.491312  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:29.491658  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:30.492638  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:30.497856  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:30.498616  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.504843  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:30.505488  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:31.506794  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:31.512965  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:31.513514  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.519759  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:31.520215  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.521430  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:32.528733  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:32.529238  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:32.534063  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:32.534443  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:33.535650  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:33.541126  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:33.541766  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:33.546851  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:33.547266  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:34.548236  9938 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:34.553586  9938 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:34.554066  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:34.558642  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:34.559024  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:35.637621  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
W20260709 12:15:35.656831 22925 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:35.674013 22925 consensus_peers.cc:597] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:35.677049 22925 consensus_peers.cc:597] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:35.724660 22999 consensus_peers.cc:597] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:35.725883 22925 consensus_peers.cc:597] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.738984  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:35.740063  9938 tablet_replica.cc:333] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.741460  9938 raft_consensus.cc:2243] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.742398  9938 raft_consensus.cc:2272] T 91c5c8a45bfd45748045d92c8adc1eb9 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.745215  9938 tablet_replica.cc:333] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.745957  9938 raft_consensus.cc:2243] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.746587  9938 raft_consensus.cc:2272] T 2dfb6742cf47458098a12fb789667176 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.750099  9938 tablet_replica.cc:333] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.751257  9938 raft_consensus.cc:2243] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.752038  9938 raft_consensus.cc:2272] T 6daa4f911ce6449eaac9ebfdbf37608f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.755345  9938 tablet_replica.cc:333] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.755908  9938 raft_consensus.cc:2243] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.756790  9938 raft_consensus.cc:2272] T 3a852a80db35499983d3b6e09fe4872f P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.759281  9938 tablet_replica.cc:333] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.759763  9938 raft_consensus.cc:2243] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.760695  9938 raft_consensus.cc:2272] T 54f9ca74f47b44e78b825ac57c0e8b08 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.763048  9938 tablet_replica.cc:333] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.763619  9938 raft_consensus.cc:2243] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.764111  9938 raft_consensus.cc:2272] T c67ff9f87b9d4ab5badad9b2791c64fe P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.766695  9938 tablet_replica.cc:333] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.767376  9938 raft_consensus.cc:2243] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.768275  9938 raft_consensus.cc:2272] T e14f9ba3f9844c14bfd74786b95f80f1 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.770741  9938 tablet_replica.cc:333] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.771337  9938 raft_consensus.cc:2243] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.772003  9938 raft_consensus.cc:2272] T 216902f8c4484419aa2204c8e341d9b9 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.774565  9938 tablet_replica.cc:333] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.775246  9938 raft_consensus.cc:2243] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.775805  9938 raft_consensus.cc:2272] T 0de15374caea4b6a8e49632ca6cd2abe P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.778373  9938 tablet_replica.cc:333] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.779074  9938 raft_consensus.cc:2243] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.779560  9938 raft_consensus.cc:2272] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.782656  9938 tablet_replica.cc:333] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.783265  9938 raft_consensus.cc:2243] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.784123  9938 raft_consensus.cc:2272] T 019ee5547f6b4efcad03cb805fb09424 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.786545  9938 tablet_replica.cc:333] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.787101  9938 raft_consensus.cc:2243] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.787586  9938 raft_consensus.cc:2272] T 2e89d36af7054860b93358b62676a76f P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.790053  9938 tablet_replica.cc:333] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.790690  9938 raft_consensus.cc:2243] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.791605  9938 raft_consensus.cc:2272] T 9381344d09374953a2e8b77f6ab634f3 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.794143  9938 tablet_replica.cc:333] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.794797  9938 raft_consensus.cc:2243] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.795743  9938 raft_consensus.cc:2272] T f761ade5f6484b97994c4cb11460dda6 P 17f79b18282f40368cd50fb6e7a8f852 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.798036  9938 tablet_replica.cc:333] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.798650  9938 raft_consensus.cc:2243] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.799536  9938 raft_consensus.cc:2272] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.802803  9938 tablet_replica.cc:333] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.803470  9938 raft_consensus.cc:2243] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.804114  9938 raft_consensus.cc:2272] T b95014864b2441b19f8c8e20ed94c3a5 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:35.805279 22925 consensus_peers.cc:597] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.806924  9938 tablet_replica.cc:333] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.807608  9938 raft_consensus.cc:2243] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.808199  9938 raft_consensus.cc:2272] T 7edccb175f8140e2acf082dba7c24bb7 P 17f79b18282f40368cd50fb6e7a8f852 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.810889  9938 tablet_replica.cc:333] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852: stopping tablet replica
I20260709 12:15:35.811450  9938 raft_consensus.cc:2243] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.811950  9938 raft_consensus.cc:2272] T 4dbce0ceb89b427f8cc53a68bb604d90 P 17f79b18282f40368cd50fb6e7a8f852 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:35.857815 22999 consensus_peers.cc:597] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:42847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.862552  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
I20260709 12:15:35.910768  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
I20260709 12:15:35.951041  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:35.951916  9938 tablet_replica.cc:333] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.953049  9938 raft_consensus.cc:2243] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.953893  9938 raft_consensus.cc:2272] T 6daa4f911ce6449eaac9ebfdbf37608f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.957286  9938 tablet_replica.cc:333] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.958241  9938 raft_consensus.cc:2243] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.958958  9938 raft_consensus.cc:2272] T 216902f8c4484419aa2204c8e341d9b9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.962870  9938 tablet_replica.cc:333] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.963732  9938 raft_consensus.cc:2243] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.965035  9938 raft_consensus.cc:2272] T 019ee5547f6b4efcad03cb805fb09424 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.967986  9938 tablet_replica.cc:333] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.968621  9938 raft_consensus.cc:2243] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.969151  9938 raft_consensus.cc:2272] T 2dfb6742cf47458098a12fb789667176 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.971748  9938 tablet_replica.cc:333] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.972419  9938 raft_consensus.cc:2243] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.972968  9938 raft_consensus.cc:2272] T 3a852a80db35499983d3b6e09fe4872f P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.975831  9938 tablet_replica.cc:333] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.976482  9938 raft_consensus.cc:2243] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.977031  9938 raft_consensus.cc:2272] T 51f3a23b4dbd40dd95afd94b1a0d6553 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.979570  9938 tablet_replica.cc:333] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.980171  9938 raft_consensus.cc:2243] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.980712  9938 raft_consensus.cc:2272] T 81cc0c4dc01c4835a4bb06c65ae6c698 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.983469  9938 tablet_replica.cc:333] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.984159  9938 raft_consensus.cc:2243] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.984716  9938 raft_consensus.cc:2272] T e14f9ba3f9844c14bfd74786b95f80f1 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.987257  9938 tablet_replica.cc:333] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.987951  9938 raft_consensus.cc:2243] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.988456  9938 raft_consensus.cc:2272] T 54f9ca74f47b44e78b825ac57c0e8b08 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.990907  9938 tablet_replica.cc:333] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.991426  9938 raft_consensus.cc:2243] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.992349  9938 raft_consensus.cc:2272] T c67ff9f87b9d4ab5badad9b2791c64fe P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.994740  9938 tablet_replica.cc:333] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.995303  9938 raft_consensus.cc:2243] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:35.996192  9938 raft_consensus.cc:2272] T 2e89d36af7054860b93358b62676a76f P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.998600  9938 tablet_replica.cc:333] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:35.999164  9938 raft_consensus.cc:2243] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.999671  9938 raft_consensus.cc:2272] T 9381344d09374953a2e8b77f6ab634f3 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.002020  9938 tablet_replica.cc:333] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:36.002650  9938 raft_consensus.cc:2243] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.003172  9938 raft_consensus.cc:2272] T f761ade5f6484b97994c4cb11460dda6 P aec5293ceaa2446bb92d3815d81e4dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.005600  9938 tablet_replica.cc:333] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:36.006191  9938 raft_consensus.cc:2243] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.007191  9938 raft_consensus.cc:2272] T 91c5c8a45bfd45748045d92c8adc1eb9 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.009421  9938 tablet_replica.cc:333] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:36.010056  9938 raft_consensus.cc:2243] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.011189  9938 raft_consensus.cc:2272] T b95014864b2441b19f8c8e20ed94c3a5 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.013713  9938 tablet_replica.cc:333] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:36.014284  9938 raft_consensus.cc:2243] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.015262  9938 raft_consensus.cc:2272] T 7edccb175f8140e2acf082dba7c24bb7 P aec5293ceaa2446bb92d3815d81e4dd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.017742  9938 tablet_replica.cc:333] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:36.018601  9938 raft_consensus.cc:2243] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.019294  9938 raft_consensus.cc:2272] T 4dbce0ceb89b427f8cc53a68bb604d90 P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.022152  9938 tablet_replica.cc:333] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9: stopping tablet replica
I20260709 12:15:36.022737  9938 raft_consensus.cc:2243] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.023247  9938 raft_consensus.cc:2272] T 0de15374caea4b6a8e49632ca6cd2abe P aec5293ceaa2446bb92d3815d81e4dd9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:36.062575 22999 consensus_peers.cc:597] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:42847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.071095  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
W20260709 12:15:36.075261 23001 consensus_peers.cc:597] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Couldn't send request to peer aec5293ceaa2446bb92d3815d81e4dd9. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:40941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:36.101977 22999 consensus_peers.cc:597] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:42847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:36.113438 23001 consensus_peers.cc:597] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Couldn't send request to peer aec5293ceaa2446bb92d3815d81e4dd9. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:40941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.123332  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
W20260709 12:15:36.155628 22999 consensus_peers.cc:597] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:42847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:36.158742 22999 consensus_peers.cc:597] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer 17f79b18282f40368cd50fb6e7a8f852 (127.9.180.129:42847): Couldn't send request to peer 17f79b18282f40368cd50fb6e7a8f852. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:42847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.162437  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:36.163231  9938 tablet_replica.cc:333] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.164052  9938 raft_consensus.cc:2243] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.165237  9938 raft_consensus.cc:2272] T 6daa4f911ce6449eaac9ebfdbf37608f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.167634  9938 tablet_replica.cc:333] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.168428  9938 raft_consensus.cc:2243] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.169361  9938 raft_consensus.cc:2272] T 216902f8c4484419aa2204c8e341d9b9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.171748  9938 tablet_replica.cc:333] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.172394  9938 raft_consensus.cc:2243] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.172911  9938 raft_consensus.cc:2272] T 91c5c8a45bfd45748045d92c8adc1eb9 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.175496  9938 tablet_replica.cc:333] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.176124  9938 raft_consensus.cc:2243] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.177302  9938 raft_consensus.cc:2272] T 2dfb6742cf47458098a12fb789667176 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.180474  9938 tablet_replica.cc:333] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
W20260709 12:15:36.180570 23001 consensus_peers.cc:597] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 -> Peer aec5293ceaa2446bb92d3815d81e4dd9 (127.9.180.130:40941): Couldn't send request to peer aec5293ceaa2446bb92d3815d81e4dd9. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:40941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.181241  9938 raft_consensus.cc:2243] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.181810  9938 raft_consensus.cc:2272] T 3a852a80db35499983d3b6e09fe4872f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.184136  9938 tablet_replica.cc:333] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.184682  9938 raft_consensus.cc:2243] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.185513  9938 raft_consensus.cc:2272] T 51f3a23b4dbd40dd95afd94b1a0d6553 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.187661  9938 tablet_replica.cc:333] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.188179  9938 raft_consensus.cc:2243] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.188630  9938 raft_consensus.cc:2272] T b95014864b2441b19f8c8e20ed94c3a5 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.190670  9938 tablet_replica.cc:333] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.191159  9938 raft_consensus.cc:2243] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.191558  9938 raft_consensus.cc:2272] T 7edccb175f8140e2acf082dba7c24bb7 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.193684  9938 tablet_replica.cc:333] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.194199  9938 raft_consensus.cc:2243] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.195034  9938 raft_consensus.cc:2272] T 4dbce0ceb89b427f8cc53a68bb604d90 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.197145  9938 tablet_replica.cc:333] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.197667  9938 raft_consensus.cc:2243] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.198096  9938 raft_consensus.cc:2272] T 019ee5547f6b4efcad03cb805fb09424 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.200294  9938 tablet_replica.cc:333] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.200749  9938 raft_consensus.cc:2243] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.201263  9938 raft_consensus.cc:2272] T 2e89d36af7054860b93358b62676a76f P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.203617  9938 tablet_replica.cc:333] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.204098  9938 raft_consensus.cc:2243] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.204541  9938 raft_consensus.cc:2272] T 9381344d09374953a2e8b77f6ab634f3 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.206678  9938 tablet_replica.cc:333] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.207175  9938 raft_consensus.cc:2243] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.207553  9938 raft_consensus.cc:2272] T f761ade5f6484b97994c4cb11460dda6 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.209612  9938 tablet_replica.cc:333] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.210111  9938 raft_consensus.cc:2243] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.210655  9938 raft_consensus.cc:2272] T 54f9ca74f47b44e78b825ac57c0e8b08 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.212769  9938 tablet_replica.cc:333] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.213243  9938 raft_consensus.cc:2243] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.213608  9938 raft_consensus.cc:2272] T c67ff9f87b9d4ab5badad9b2791c64fe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.215675  9938 tablet_replica.cc:333] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.216122  9938 raft_consensus.cc:2243] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.216512  9938 raft_consensus.cc:2272] T e14f9ba3f9844c14bfd74786b95f80f1 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.218564  9938 tablet_replica.cc:333] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.219017  9938 raft_consensus.cc:2243] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.220119  9938 raft_consensus.cc:2272] T 0de15374caea4b6a8e49632ca6cd2abe P 6cc69a97033e429b982e8ddd0ee48cb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.223313  9938 tablet_replica.cc:333] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7: stopping tablet replica
I20260709 12:15:36.224067  9938 raft_consensus.cc:2243] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:36.224668  9938 raft_consensus.cc:2272] T 81cc0c4dc01c4835a4bb06c65ae6c698 P 6cc69a97033e429b982e8ddd0ee48cb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.269028  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:15:36.307720  9938 master.cc:562] Master@127.9.180.190:39865 shutting down...
I20260709 12:15:36.346020  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:36.346694  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:36.346983  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 004e2c69aabd4c9c8689e4ca081d3b55: stopping tablet replica
I20260709 12:15:36.368865  9938 master.cc:584] Master@127.9.180.190:39865 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22505 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:15:36.431617  9938 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.9.180.190:43829
I20260709 12:15:36.432958  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:36.439672 23403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:36.439834 23402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:36.440933 23405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:36.441183  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:36.442418  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:36.443313  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:36.443440  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599336443427 us; error 0 us; skew 500 ppm
I20260709 12:15:36.443945  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:36.446755  9938 webserver.cc:533] Webserver started at http://127.9.180.190:39579/ using document root <none> and password file <none>
I20260709 12:15:36.447372  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:36.447600  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:36.447950  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:36.449301  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/master-0-root/instance:
uuid: "4c05a2809d9d4000866789a65ef49bde"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.454053  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:15:36.457692 23410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.458679  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:36.459008  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/master-0-root
uuid: "4c05a2809d9d4000866789a65ef49bde"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.459271  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:36.470752  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:36.472131  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:36.515829  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.190:43829
I20260709 12:15:36.515976 23461 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.190:43829 every 8 connection(s)
I20260709 12:15:36.520066 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:36.531571 23462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde: Bootstrap starting.
I20260709 12:15:36.536516 23462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:36.541189 23462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde: No bootstrap required, opened a new log
I20260709 12:15:36.543550 23462 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c05a2809d9d4000866789a65ef49bde" member_type: VOTER }
I20260709 12:15:36.543972 23462 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:36.544157 23462 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c05a2809d9d4000866789a65ef49bde, State: Initialized, Role: FOLLOWER
I20260709 12:15:36.544674 23462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c05a2809d9d4000866789a65ef49bde" member_type: VOTER }
I20260709 12:15:36.545219 23462 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:36.545436 23462 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:36.545668 23462 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.550379 23462 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c05a2809d9d4000866789a65ef49bde" member_type: VOTER }
I20260709 12:15:36.550936 23462 leader_election.cc:304] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c05a2809d9d4000866789a65ef49bde; no voters: 
I20260709 12:15:36.552045 23462 leader_election.cc:290] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:36.552604 23465 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.554275 23465 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 1 LEADER]: Becoming Leader. State: Replica: 4c05a2809d9d4000866789a65ef49bde, State: Running, Role: LEADER
I20260709 12:15:36.555197 23462 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:36.555112 23465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c05a2809d9d4000866789a65ef49bde" member_type: VOTER }
I20260709 12:15:36.561434 23466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c05a2809d9d4000866789a65ef49bde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c05a2809d9d4000866789a65ef49bde" member_type: VOTER } }
I20260709 12:15:36.561450 23467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c05a2809d9d4000866789a65ef49bde. Latest consensus state: current_term: 1 leader_uuid: "4c05a2809d9d4000866789a65ef49bde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c05a2809d9d4000866789a65ef49bde" member_type: VOTER } }
I20260709 12:15:36.562196 23466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:36.562521 23467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:36.568187 23473 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:36.573638 23473 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:36.574848  9938 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:36.584368 23473 catalog_manager.cc:1383] Generated new cluster ID: a1feb7215131460585916dadd6ad9481
I20260709 12:15:36.584735 23473 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:36.600795 23473 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:36.602421 23473 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:36.616336 23473 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde: Generated new TSK 0
I20260709 12:15:36.617075 23473 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:36.641933  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:36.649037 23483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:36.650370 23484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:36.653194  9938 server_base.cc:1061] running on GCE node
W20260709 12:15:36.654057 23486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:36.655215  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:36.655409  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:36.655534  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599336655522 us; error 0 us; skew 500 ppm
I20260709 12:15:36.656037  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:36.659243  9938 webserver.cc:533] Webserver started at http://127.9.180.129:45731/ using document root <none> and password file <none>
I20260709 12:15:36.659752  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:36.659910  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:36.660130  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:36.661345  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-0-root/instance:
uuid: "2b3d620dab1b4f09885aa2676375479e"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.666087  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:15:36.670171 23491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.671207  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:15:36.671731  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-0-root
uuid: "2b3d620dab1b4f09885aa2676375479e"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.672113  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:36.702986  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:36.704386  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:36.705938  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:36.708597  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:36.708827  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.709079  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:36.709264  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.755334  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.129:36843
I20260709 12:15:36.755520 23553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.129:36843 every 8 connection(s)
I20260709 12:15:36.760738  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:36.768707 23558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:36.769737 23559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:36.774104 23561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:36.774137  9938 server_base.cc:1061] running on GCE node
I20260709 12:15:36.776005  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:36.776319  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:36.776561  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599336776539 us; error 0 us; skew 500 ppm
I20260709 12:15:36.777137  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:36.780294 23554 heartbeater.cc:344] Connected to a master server at 127.9.180.190:43829
I20260709 12:15:36.780742  9938 webserver.cc:533] Webserver started at http://127.9.180.130:32987/ using document root <none> and password file <none>
I20260709 12:15:36.780764 23554 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:36.781402  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:36.781668  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:36.781800 23554 heartbeater.cc:507] Master 127.9.180.190:43829 requested a full tablet report, sending...
I20260709 12:15:36.781944  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:36.783613  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-1-root/instance:
uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.784308 23427 ts_manager.cc:194] Registered new tserver with Master: 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843)
I20260709 12:15:36.786278 23427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41676
I20260709 12:15:36.788482  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:15:36.792328 23566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.793156  9938 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:15:36.793484  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-1-root
uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.793781  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:36.810141  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:36.811339  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:36.812837  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:36.815068  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:36.815294  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.815538  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:36.815708  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.859059  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.130:41813
I20260709 12:15:36.859251 23628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.130:41813 every 8 connection(s)
I20260709 12:15:36.864166  9938 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:36.872225 23632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:36.873523 23633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:36.876621  9938 server_base.cc:1061] running on GCE node
W20260709 12:15:36.877319 23635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:36.878671  9938 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:36.878976  9938 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:36.879258  9938 hybrid_clock.cc:648] HybridClock initialized: now 1783599336879238 us; error 0 us; skew 500 ppm
I20260709 12:15:36.879614 23629 heartbeater.cc:344] Connected to a master server at 127.9.180.190:43829
I20260709 12:15:36.880038  9938 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:36.880075 23629 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:36.881091 23629 heartbeater.cc:507] Master 127.9.180.190:43829 requested a full tablet report, sending...
I20260709 12:15:36.883371  9938 webserver.cc:533] Webserver started at http://127.9.180.131:35497/ using document root <none> and password file <none>
I20260709 12:15:36.883880 23427 ts_manager.cc:194] Registered new tserver with Master: 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:36.884132  9938 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:36.884473  9938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:36.884819  9938 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:36.886080 23427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41678
I20260709 12:15:36.886724  9938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-2-root/instance:
uuid: "3f942a2ebb664fd08dc63f3629df639d"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.891906  9938 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:36.895792 23640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.896801  9938 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:36.897172  9938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-2-root
uuid: "3f942a2ebb664fd08dc63f3629df639d"
format_stamp: "Formatted at 2026-07-09 12:15:36 on dist-test-slave-lg8f"
I20260709 12:15:36.897501  9938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNnajqF/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895524733-9938-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:36.912937  9938 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:36.914340  9938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:36.916035  9938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:36.918452  9938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:36.918751  9938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.919019  9938 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:36.919203  9938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:36.967058  9938 rpc_server.cc:307] RPC server started. Bound to: 127.9.180.131:34779
I20260709 12:15:36.967172 23702 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.180.131:34779 every 8 connection(s)
I20260709 12:15:36.983892 23703 heartbeater.cc:344] Connected to a master server at 127.9.180.190:43829
I20260709 12:15:36.984413 23703 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:36.985211 23703 heartbeater.cc:507] Master 127.9.180.190:43829 requested a full tablet report, sending...
I20260709 12:15:36.987540 23427 ts_manager.cc:194] Registered new tserver with Master: 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:36.988651  9938 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017578633s
I20260709 12:15:36.988864 23427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41688
I20260709 12:15:37.018330 23427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41704:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:37.021133 23427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:37.112783 23519 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee6003f89e8407dac25b04a22dd30c2 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:37.113694 23517 tablet_service.cc:1511] Processing CreateTablet for tablet 3e80560505d84218ae00206ad6c0d1d1 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:37.114509 23519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee6003f89e8407dac25b04a22dd30c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.115226 23517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e80560505d84218ae00206ad6c0d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.117584 23516 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea017fe3a0643469251c58a43f0a52b (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:37.119055 23516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea017fe3a0643469251c58a43f0a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.119123 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee6003f89e8407dac25b04a22dd30c2 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:37.119910 23518 tablet_service.cc:1511] Processing CreateTablet for tablet 758b8f80153f4c0a9ea7295ee27262eb (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:37.121414 23518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758b8f80153f4c0a9ea7295ee27262eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.122160 23667 tablet_service.cc:1511] Processing CreateTablet for tablet 758b8f80153f4c0a9ea7295ee27262eb (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:37.122670 23662 tablet_service.cc:1511] Processing CreateTablet for tablet be328d929a7643dab6a0dd73d53b8879 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:37.123617 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee6003f89e8407dac25b04a22dd30c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.127323 23665 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea017fe3a0643469251c58a43f0a52b (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:37.124990 23666 tablet_service.cc:1511] Processing CreateTablet for tablet 3e80560505d84218ae00206ad6c0d1d1 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:37.130848 23662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be328d929a7643dab6a0dd73d53b8879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.126096 23515 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6b39e3e7ae4c29a7a4abdba63a0c77 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:37.131645 23665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea017fe3a0643469251c58a43f0a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.132381 23515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6b39e3e7ae4c29a7a4abdba63a0c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.126334 23664 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6b39e3e7ae4c29a7a4abdba63a0c77 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:37.124851 23663 tablet_service.cc:1511] Processing CreateTablet for tablet 3c13afbdf2784b46bba2a3edf2baa9f6 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:37.135426 23664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6b39e3e7ae4c29a7a4abdba63a0c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.136098 23663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c13afbdf2784b46bba2a3edf2baa9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.136729 23666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e80560505d84218ae00206ad6c0d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.141149 23667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758b8f80153f4c0a9ea7295ee27262eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.151962 23514 tablet_service.cc:1511] Processing CreateTablet for tablet 3c13afbdf2784b46bba2a3edf2baa9f6 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:37.153555 23514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c13afbdf2784b46bba2a3edf2baa9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.156359 23513 tablet_service.cc:1511] Processing CreateTablet for tablet be328d929a7643dab6a0dd73d53b8879 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:37.158792 23513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be328d929a7643dab6a0dd73d53b8879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.160655 23593 tablet_service.cc:1511] Processing CreateTablet for tablet 758b8f80153f4c0a9ea7295ee27262eb (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:37.158808 23594 tablet_service.cc:1511] Processing CreateTablet for tablet 5ee6003f89e8407dac25b04a22dd30c2 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:37.162375 23593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758b8f80153f4c0a9ea7295ee27262eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.163317 23594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ee6003f89e8407dac25b04a22dd30c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.172300 23592 tablet_service.cc:1511] Processing CreateTablet for tablet 3e80560505d84218ae00206ad6c0d1d1 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:37.173828 23592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e80560505d84218ae00206ad6c0d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.173246 23661 tablet_service.cc:1511] Processing CreateTablet for tablet d72fe4c4490d4e7598aced2ce4e60336 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:37.175304 23661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72fe4c4490d4e7598aced2ce4e60336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.180895 23512 tablet_service.cc:1511] Processing CreateTablet for tablet d72fe4c4490d4e7598aced2ce4e60336 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:37.182864 23512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72fe4c4490d4e7598aced2ce4e60336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.188355 23591 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea017fe3a0643469251c58a43f0a52b (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:37.189844 23591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea017fe3a0643469251c58a43f0a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.191378 23586 tablet_service.cc:1511] Processing CreateTablet for tablet 4b56fa8b099144f6a46ea5ac3a842d05 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:37.191656 23590 tablet_service.cc:1511] Processing CreateTablet for tablet 8a6b39e3e7ae4c29a7a4abdba63a0c77 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:37.192750 23586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b56fa8b099144f6a46ea5ac3a842d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.193852 23589 tablet_service.cc:1511] Processing CreateTablet for tablet 3c13afbdf2784b46bba2a3edf2baa9f6 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:37.195377 23589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c13afbdf2784b46bba2a3edf2baa9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.195509 23511 tablet_service.cc:1511] Processing CreateTablet for tablet 4b56fa8b099144f6a46ea5ac3a842d05 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:37.197532 23511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b56fa8b099144f6a46ea5ac3a842d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.199775 23588 tablet_service.cc:1511] Processing CreateTablet for tablet be328d929a7643dab6a0dd73d53b8879 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:37.200627 23660 tablet_service.cc:1511] Processing CreateTablet for tablet 4b56fa8b099144f6a46ea5ac3a842d05 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:37.201157 23588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be328d929a7643dab6a0dd73d53b8879. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.202140 23660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b56fa8b099144f6a46ea5ac3a842d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.203670 23587 tablet_service.cc:1511] Processing CreateTablet for tablet d72fe4c4490d4e7598aced2ce4e60336 (DEFAULT_TABLE table=test-workload [id=cc4192d88ac649ac87241f8f81ac50ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:37.210842 23587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72fe4c4490d4e7598aced2ce4e60336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.230667 23590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a6b39e3e7ae4c29a7a4abdba63a0c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.252748 23718 tablet_bootstrap.cc:492] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.270839 23718 tablet_bootstrap.cc:654] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.279425 23719 tablet_bootstrap.cc:492] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.295363 23720 tablet_bootstrap.cc:492] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.313287 23719 tablet_bootstrap.cc:654] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.324209 23718 tablet_bootstrap.cc:492] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.324843 23718 ts_tablet_manager.cc:1403] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.072s	user 0.000s	sys 0.010s
I20260709 12:15:37.325064 23720 tablet_bootstrap.cc:654] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.327898 23718 raft_consensus.cc:359] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.329075 23718 raft_consensus.cc:385] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.329368 23718 raft_consensus.cc:740] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.330219 23718 consensus_queue.cc:260] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.331149 23720 tablet_bootstrap.cc:492] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.331324 23719 tablet_bootstrap.cc:492] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.331789 23720 ts_tablet_manager.cc:1403] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 12:15:37.331987 23719 ts_tablet_manager.cc:1403] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 12:15:37.333109 23554 heartbeater.cc:499] Master 127.9.180.190:43829 was elected leader, sending a full tablet report...
I20260709 12:15:37.335095 23720 raft_consensus.cc:359] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.335912 23720 raft_consensus.cc:385] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.335556 23719 raft_consensus.cc:359] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.336238 23720 raft_consensus.cc:740] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.336405 23719 raft_consensus.cc:385] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.336541 23718 ts_tablet_manager.cc:1434] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:15:37.336817 23719 raft_consensus.cc:740] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.337090 23720 consensus_queue.cc:260] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.338172 23718 tablet_bootstrap.cc:492] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.337877 23719 consensus_queue.cc:260] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.347537 23718 tablet_bootstrap.cc:654] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.352367 23720 ts_tablet_manager.cc:1434] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.020s	user 0.013s	sys 0.007s
I20260709 12:15:37.353309 23629 heartbeater.cc:499] Master 127.9.180.190:43829 was elected leader, sending a full tablet report...
I20260709 12:15:37.353603 23720 tablet_bootstrap.cc:492] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.358137 23703 heartbeater.cc:499] Master 127.9.180.190:43829 was elected leader, sending a full tablet report...
I20260709 12:15:37.362345 23720 tablet_bootstrap.cc:654] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:37.366811 23630 tablet.cc:2406] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:37.368330 23718 tablet_bootstrap.cc:492] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.370110 23718 ts_tablet_manager.cc:1403] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.003s
I20260709 12:15:37.371986 23719 ts_tablet_manager.cc:1434] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.012s
I20260709 12:15:37.373380 23719 tablet_bootstrap.cc:492] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.374249 23718 raft_consensus.cc:359] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.375455 23718 raft_consensus.cc:385] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.375845 23718 raft_consensus.cc:740] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.377471 23718 consensus_queue.cc:260] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.379606 23720 tablet_bootstrap.cc:492] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.379789 23718 ts_tablet_manager.cc:1434] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:15:37.380148 23720 ts_tablet_manager.cc:1403] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 12:15:37.380954 23718 tablet_bootstrap.cc:492] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.381763 23719 tablet_bootstrap.cc:654] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.383419 23720 raft_consensus.cc:359] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.384215 23720 raft_consensus.cc:385] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.384532 23720 raft_consensus.cc:740] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.385366 23720 consensus_queue.cc:260] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.387771 23720 ts_tablet_manager.cc:1434] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:37.388168 23718 tablet_bootstrap.cc:654] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.388808 23720 tablet_bootstrap.cc:492] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.394001 23719 tablet_bootstrap.cc:492] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.394660 23719 ts_tablet_manager.cc:1403] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.014s
I20260709 12:15:37.398116 23720 tablet_bootstrap.cc:654] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.398231 23719 raft_consensus.cc:359] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.399622 23719 raft_consensus.cc:385] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.399941 23719 raft_consensus.cc:740] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.400943 23719 consensus_queue.cc:260] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.403689 23719 ts_tablet_manager.cc:1434] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:15:37.404723 23719 tablet_bootstrap.cc:492] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.411841 23719 tablet_bootstrap.cc:654] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.415630 23726 raft_consensus.cc:493] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.416260 23726 raft_consensus.cc:515] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.420241 23724 raft_consensus.cc:493] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.420887 23724 raft_consensus.cc:515] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.425768 23724 leader_election.cc:290] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.423506 23726 leader_election.cc:290] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:37.432405 23718 tablet_bootstrap.cc:492] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.433058 23718 ts_tablet_manager.cc:1403] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.019s
I20260709 12:15:37.436414 23718 raft_consensus.cc:359] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.437199 23718 raft_consensus.cc:385] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.437553 23718 raft_consensus.cc:740] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.438351 23718 consensus_queue.cc:260] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.446190 23718 ts_tablet_manager.cc:1434] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:15:37.447319 23718 tablet_bootstrap.cc:492] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.454666 23718 tablet_bootstrap.cc:654] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.447327 23720 tablet_bootstrap.cc:492] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.458328 23720 ts_tablet_manager.cc:1403] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.014s
I20260709 12:15:37.461696 23720 raft_consensus.cc:359] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.462455 23720 raft_consensus.cc:385] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.462821 23720 raft_consensus.cc:740] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.463650 23720 consensus_queue.cc:260] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.466064 23720 ts_tablet_manager.cc:1434] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:15:37.467067 23720 tablet_bootstrap.cc:492] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.468000 23719 tablet_bootstrap.cc:492] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.468837 23719 ts_tablet_manager.cc:1403] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.001s
I20260709 12:15:37.475939 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.476913 23720 tablet_bootstrap.cc:654] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:37.478729 23644 leader_election.cc:343] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.491202 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.491880 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea017fe3a0643469251c58a43f0a52b" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.492033 23529 raft_consensus.cc:2468] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:37.492116 23719 raft_consensus.cc:359] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.493280 23719 raft_consensus.cc:385] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.493628 23719 raft_consensus.cc:740] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.494532 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea017fe3a0643469251c58a43f0a52b" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.494524 23719 consensus_queue.cc:260] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.495275 23641 leader_election.cc:304] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:37.495436 23718 tablet_bootstrap.cc:492] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.495803 23604 raft_consensus.cc:2468] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:37.496296 23718 ts_tablet_manager.cc:1403] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.002s
I20260709 12:15:37.498883 23720 tablet_bootstrap.cc:492] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.499498 23720 ts_tablet_manager.cc:1403] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.005s
I20260709 12:15:37.496388 23726 raft_consensus.cc:2804] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.500551 23726 raft_consensus.cc:493] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.501030 23726 raft_consensus.cc:3060] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.502810 23720 raft_consensus.cc:359] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.503641 23720 raft_consensus.cc:385] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.503998 23720 raft_consensus.cc:740] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.504908 23720 consensus_queue.cc:260] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.508194 23719 ts_tablet_manager.cc:1434] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 12:15:37.499733 23718 raft_consensus.cc:359] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.509843 23720 ts_tablet_manager.cc:1434] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:15:37.508824 23726 raft_consensus.cc:515] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.511265 23720 tablet_bootstrap.cc:492] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
W20260709 12:15:37.500965 23495 leader_election.cc:343] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.513381 23719 tablet_bootstrap.cc:492] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.513789 23495 leader_election.cc:304] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:37.508908 23718 raft_consensus.cc:385] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.514828 23718 raft_consensus.cc:740] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.514981 23724 raft_consensus.cc:2804] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.515463 23724 raft_consensus.cc:493] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.515799 23724 raft_consensus.cc:3060] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.517414 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
W20260709 12:15:37.519279 23644 leader_election.cc:343] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.521430 23720 tablet_bootstrap.cc:654] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.515754 23718 consensus_queue.cc:260] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.525287 23724 raft_consensus.cc:515] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.527161 23726 leader_election.cc:290] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:37.530282 23719 tablet_bootstrap.cc:654] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.530575 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea017fe3a0643469251c58a43f0a52b" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:37.530843 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:37.531270 23604 raft_consensus.cc:3060] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.531750 23529 raft_consensus.cc:3060] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.538156 23725 raft_consensus.cc:493] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.538686 23725 raft_consensus.cc:515] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.541244 23529 raft_consensus.cc:2468] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:37.542435 23641 leader_election.cc:304] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:37.543709 23726 raft_consensus.cc:2804] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.544195 23726 raft_consensus.cc:697] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:37.545022 23726 consensus_queue.cc:237] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.545290 23604 raft_consensus.cc:2468] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:37.546793 23725 leader_election.cc:290] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.548660 23495 leader_election.cc:304] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:37.551013 23724 leader_election.cc:290] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.552024 23724 raft_consensus.cc:2804] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.552501 23724 raft_consensus.cc:697] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:37.553385 23724 consensus_queue.cc:237] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.556550 23719 tablet_bootstrap.cc:492] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.559377 23719 ts_tablet_manager.cc:1403] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.011s
I20260709 12:15:37.558681 23718 ts_tablet_manager.cc:1434] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.014s
I20260709 12:15:37.562757 23718 tablet_bootstrap.cc:492] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.568176 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
W20260709 12:15:37.570353 23475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:37.571815 23720 tablet_bootstrap.cc:492] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.575906 23720 ts_tablet_manager.cc:1403] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.016s
I20260709 12:15:37.575525 23426 catalog_manager.cc:5697] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 1 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.577656 23726 raft_consensus.cc:493] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.577975 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea017fe3a0643469251c58a43f0a52b" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:37.578413 23726 raft_consensus.cc:515] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
W20260709 12:15:37.579082 23570 leader_election.cc:343] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.579598 23718 tablet_bootstrap.cc:654] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.581032 23726 leader_election.cc:290] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:37.572893 23719 raft_consensus.cc:359] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
W20260709 12:15:37.582747 23495 leader_election.cc:343] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.583158 23719 raft_consensus.cc:385] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.583545 23719 raft_consensus.cc:740] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.584082 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b56fa8b099144f6a46ea5ac3a842d05" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.584192 23720 raft_consensus.cc:359] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.584411 23719 consensus_queue.cc:260] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.585114 23720 raft_consensus.cc:385] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.585515 23720 raft_consensus.cc:740] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
W20260709 12:15:37.586349 23641 leader_election.cc:343] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.586706 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b56fa8b099144f6a46ea5ac3a842d05" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.587556 23719 ts_tablet_manager.cc:1434] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
I20260709 12:15:37.587499 23604 raft_consensus.cc:2468] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:37.588893 23719 tablet_bootstrap.cc:492] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.589154 23644 leader_election.cc:304] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:37.586352 23720 consensus_queue.cc:260] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.590791 23726 raft_consensus.cc:2804] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.591292 23726 raft_consensus.cc:493] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.591732 23726 raft_consensus.cc:3060] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.602176 23724 raft_consensus.cc:493] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.602401 23719 tablet_bootstrap.cc:654] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.602865 23724 raft_consensus.cc:515] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.603544 23720 ts_tablet_manager.cc:1434] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:15:37.604769 23720 tablet_bootstrap.cc:492] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.606117 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee6003f89e8407dac25b04a22dd30c2" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.606894 23604 raft_consensus.cc:2468] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:37.607151 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.608336 23495 leader_election.cc:304] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:37.608664 23718 tablet_bootstrap.cc:492] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
W20260709 12:15:37.609263 23567 leader_election.cc:343] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.609428 23718 ts_tablet_manager.cc:1403] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.008s
I20260709 12:15:37.609903 23567 leader_election.cc:304] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:37.611353 23725 raft_consensus.cc:2749] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.610014 23745 raft_consensus.cc:2804] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.612295 23745 raft_consensus.cc:493] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.612566 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee6003f89e8407dac25b04a22dd30c2" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.612970 23745 raft_consensus.cc:3060] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.613250 23720 tablet_bootstrap.cc:654] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.613548 23718 raft_consensus.cc:359] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.614275 23724 leader_election.cc:290] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.614609 23718 raft_consensus.cc:385] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.615069 23718 raft_consensus.cc:740] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
W20260709 12:15:37.615201 23495 leader_election.cc:343] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.616075 23718 consensus_queue.cc:260] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.625521 23427 catalog_manager.cc:5697] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.627771 23726 raft_consensus.cc:515] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.629230 23718 ts_tablet_manager.cc:1434] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:15:37.632053 23718 tablet_bootstrap.cc:492] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.633186 23745 raft_consensus.cc:515] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.636169 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b56fa8b099144f6a46ea5ac3a842d05" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:37.637814 23745 leader_election.cc:290] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.638897 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee6003f89e8407dac25b04a22dd30c2" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:37.639415 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ee6003f89e8407dac25b04a22dd30c2" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:37.639648 23604 raft_consensus.cc:3060] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.640879 23719 tablet_bootstrap.cc:492] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
W20260709 12:15:37.640816 23641 leader_election.cc:343] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.641239 23720 tablet_bootstrap.cc:492] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
W20260709 12:15:37.641978 23495 leader_election.cc:343] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.641948 23720 ts_tablet_manager.cc:1403] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.011s
I20260709 12:15:37.641964 23719 ts_tablet_manager.cc:1403] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.003s
I20260709 12:15:37.646422 23726 leader_election.cc:290] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:37.647964 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b56fa8b099144f6a46ea5ac3a842d05" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:37.654458 23604 raft_consensus.cc:2468] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:37.661463 23495 leader_election.cc:304] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:37.648303 23739 raft_consensus.cc:493] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.662197 23720 raft_consensus.cc:359] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.663295 23720 raft_consensus.cc:385] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.663244 23739 raft_consensus.cc:515] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.663486 23745 raft_consensus.cc:2804] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.659212 23603 raft_consensus.cc:3060] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.664620 23745 raft_consensus.cc:697] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:37.665834 23745 consensus_queue.cc:237] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.667106 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be328d929a7643dab6a0dd73d53b8879" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.663877 23720 raft_consensus.cc:740] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
W20260709 12:15:37.669016 23641 leader_election.cc:343] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.642740 23718 tablet_bootstrap.cc:654] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.671875 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be328d929a7643dab6a0dd73d53b8879" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.673593 23739 leader_election.cc:290] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
W20260709 12:15:37.674078 23644 leader_election.cc:343] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.674273 23720 consensus_queue.cc:260] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.675071 23644 leader_election.cc:304] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d; no voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:37.677626 23720 ts_tablet_manager.cc:1434] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:15:37.661995 23719 raft_consensus.cc:359] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.678864 23603 raft_consensus.cc:2468] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:37.678939 23719 raft_consensus.cc:385] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.679471 23719 raft_consensus.cc:740] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.680856 23720 tablet_bootstrap.cc:492] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.681679 23644 leader_election.cc:304] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:37.682663 23718 tablet_bootstrap.cc:492] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.682871 23726 raft_consensus.cc:2749] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.683405 23718 ts_tablet_manager.cc:1403] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.003s
I20260709 12:15:37.683714 23726 raft_consensus.cc:2804] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.684252 23726 raft_consensus.cc:697] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:37.684357 23724 raft_consensus.cc:493] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.684878 23724 raft_consensus.cc:515] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.685166 23726 consensus_queue.cc:237] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.687084 23724 leader_election.cc:290] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.689019 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.684530 23719 consensus_queue.cc:260] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.689684 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.690433 23678 raft_consensus.cc:2468] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
W20260709 12:15:37.691000 23495 leader_election.cc:343] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.691937 23495 leader_election.cc:304] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:37.692878 23724 raft_consensus.cc:2804] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.693400 23724 raft_consensus.cc:493] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.693830 23724 raft_consensus.cc:3060] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.694314 23720 tablet_bootstrap.cc:654] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.689039 23718 raft_consensus.cc:359] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.696878 23718 raft_consensus.cc:385] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.697271 23718 raft_consensus.cc:740] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.698436 23718 consensus_queue.cc:260] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.702334 23719 ts_tablet_manager.cc:1434] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.004s
I20260709 12:15:37.703012 23718 ts_tablet_manager.cc:1434] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.002s
I20260709 12:15:37.703773 23719 tablet_bootstrap.cc:492] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.704777 23718 tablet_bootstrap.cc:492] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.708482 23720 tablet_bootstrap.cc:492] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.709225 23720 ts_tablet_manager.cc:1403] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.005s
I20260709 12:15:37.705533 23724 raft_consensus.cc:515] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.712069 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:37.713030 23720 raft_consensus.cc:359] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
W20260709 12:15:37.713513 23495 leader_election.cc:343] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.714758 23718 tablet_bootstrap.cc:654] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.715509 23724 leader_election.cc:290] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.716270 23720 raft_consensus.cc:385] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.716691 23720 raft_consensus.cc:740] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.717723 23720 consensus_queue.cc:260] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.719779 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:37.720109 23719 tablet_bootstrap.cc:654] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.720377 23678 raft_consensus.cc:3060] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.720916 23720 ts_tablet_manager.cc:1434] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:15:37.722324 23720 tablet_bootstrap.cc:492] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.731882 23720 tablet_bootstrap.cc:654] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.733563 23678 raft_consensus.cc:2468] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:37.736533 23495 leader_election.cc:304] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:37.738304 23724 raft_consensus.cc:2804] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.738976 23724 raft_consensus.cc:697] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:37.740022 23724 consensus_queue.cc:237] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.750900 23718 tablet_bootstrap.cc:492] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.751945 23720 tablet_bootstrap.cc:492] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.752696 23720 ts_tablet_manager.cc:1403] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.010s
I20260709 12:15:37.752429 23426 catalog_manager.cc:5697] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.754122 23719 tablet_bootstrap.cc:492] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.754796 23719 ts_tablet_manager.cc:1403] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.022s
I20260709 12:15:37.755990 23720 raft_consensus.cc:359] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.756788 23720 raft_consensus.cc:385] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.757213 23720 raft_consensus.cc:740] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.757918 23719 raft_consensus.cc:359] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.758842 23719 raft_consensus.cc:385] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.758255 23720 consensus_queue.cc:260] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.759182 23719 raft_consensus.cc:740] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.760004 23719 consensus_queue.cc:260] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.761273 23720 ts_tablet_manager.cc:1434] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:37.762392 23720 tablet_bootstrap.cc:492] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:37.762607 23719 ts_tablet_manager.cc:1434] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:15:37.763705 23719 tablet_bootstrap.cc:492] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.767843 23718 ts_tablet_manager.cc:1403] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.026s
I20260709 12:15:37.769771 23720 tablet_bootstrap.cc:654] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.770556 23719 tablet_bootstrap.cc:654] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.774034 23427 catalog_manager.cc:5697] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 1 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.776146 23725 raft_consensus.cc:493] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.776899 23725 raft_consensus.cc:515] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.780970 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.784333 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.785178 23678 raft_consensus.cc:2468] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
W20260709 12:15:37.785380 23567 leader_election.cc:343] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.786975 23570 leader_election.cc:304] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:37.788657 23725 leader_election.cc:290] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.789477 23725 raft_consensus.cc:2804] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.789925 23725 raft_consensus.cc:493] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.790360 23725 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.798456 23718 raft_consensus.cc:359] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.807847 23725 raft_consensus.cc:515] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.812011 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:37.814123 23424 catalog_manager.cc:5697] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.815853 23720 tablet_bootstrap.cc:492] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:37.816538 23720 ts_tablet_manager.cc:1403] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.032s
I20260709 12:15:37.819691 23720 raft_consensus.cc:359] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.820551 23720 raft_consensus.cc:385] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:37.820490 23567 leader_election.cc:343] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:37.821327 23720 raft_consensus.cc:740] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.822324 23720 consensus_queue.cc:260] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.823031 23718 raft_consensus.cc:385] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.823632 23718 raft_consensus.cc:740] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.825130 23720 ts_tablet_manager.cc:1434] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:37.824827 23718 consensus_queue.cc:260] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.828912 23718 ts_tablet_manager.cc:1434] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.004s
I20260709 12:15:37.830420 23718 tablet_bootstrap.cc:492] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.836908 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:37.837817 23678 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.846617 23725 leader_election.cc:290] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.849251 23678 raft_consensus.cc:2468] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:37.851034 23570 leader_election.cc:304] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:37.852254 23725 raft_consensus.cc:2804] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.852789 23725 raft_consensus.cc:697] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:37.853905 23719 tablet_bootstrap.cc:492] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.853643 23725 consensus_queue.cc:237] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.854615 23719 ts_tablet_manager.cc:1403] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.091s	user 0.033s	sys 0.057s
I20260709 12:15:37.855180 23718 tablet_bootstrap.cc:654] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.857651 23719 raft_consensus.cc:359] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.858566 23719 raft_consensus.cc:385] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.858970 23719 raft_consensus.cc:740] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.859793 23719 consensus_queue.cc:260] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.862613 23719 ts_tablet_manager.cc:1434] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:37.863334 23718 tablet_bootstrap.cc:492] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.863818 23719 tablet_bootstrap.cc:492] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.863876 23718 ts_tablet_manager.cc:1403] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.007s
I20260709 12:15:37.864216 23426 catalog_manager.cc:5697] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.867071 23718 raft_consensus.cc:359] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.867817 23718 raft_consensus.cc:385] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.868211 23718 raft_consensus.cc:740] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.869030 23718 consensus_queue.cc:260] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.872184 23719 tablet_bootstrap.cc:654] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.875519 23718 ts_tablet_manager.cc:1434] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:15:37.876631 23718 tablet_bootstrap.cc:492] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:37.881271 23718 tablet_bootstrap.cc:654] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.887748 23719 tablet_bootstrap.cc:492] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.888228 23719 ts_tablet_manager.cc:1403] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:15:37.889334 23718 tablet_bootstrap.cc:492] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:37.889906 23718 ts_tablet_manager.cc:1403] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 12:15:37.890697 23719 raft_consensus.cc:359] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.891366 23719 raft_consensus.cc:385] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.891601 23719 raft_consensus.cc:740] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.892195 23719 consensus_queue.cc:260] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } } peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } }
I20260709 12:15:37.892524 23718 raft_consensus.cc:359] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.893186 23718 raft_consensus.cc:385] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.893414 23718 raft_consensus.cc:740] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.894089 23718 consensus_queue.cc:260] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.894429 23719 ts_tablet_manager.cc:1434] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:15:37.895707 23719 tablet_bootstrap.cc:492] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:37.896003 23718 ts_tablet_manager.cc:1434] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:15:37.901098 23719 tablet_bootstrap.cc:654] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:37.907023 23719 tablet_bootstrap.cc:492] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:37.907610 23719 ts_tablet_manager.cc:1403] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:15:37.910079 23719 raft_consensus.cc:359] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.910660 23719 raft_consensus.cc:385] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:37.910843 23719 raft_consensus.cc:740] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:37.911329 23719 consensus_queue.cc:260] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.912642 23719 ts_tablet_manager.cc:1434] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:37.923038 23725 raft_consensus.cc:493] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.923719 23725 raft_consensus.cc:515] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.925570 23725 leader_election.cc:290] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.926545 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be328d929a7643dab6a0dd73d53b8879" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.926868 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be328d929a7643dab6a0dd73d53b8879" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.927142 23529 raft_consensus.cc:2468] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:37.927696 23678 raft_consensus.cc:2468] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:37.928259 23567 leader_election.cc:304] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:37.929137 23725 raft_consensus.cc:2804] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.929484 23725 raft_consensus.cc:493] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.929713 23725 raft_consensus.cc:3060] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.934551 23725 raft_consensus.cc:515] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.936157 23725 leader_election.cc:290] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.937021 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be328d929a7643dab6a0dd73d53b8879" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:37.937536 23529 raft_consensus.cc:3060] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.937363 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be328d929a7643dab6a0dd73d53b8879" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:37.938151 23724 raft_consensus.cc:493] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.938174 23678 raft_consensus.cc:3060] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.938920 23724 raft_consensus.cc:515] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.941313 23724 leader_election.cc:290] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.942616 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b56fa8b099144f6a46ea5ac3a842d05" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.942612 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b56fa8b099144f6a46ea5ac3a842d05" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:37.943914 23603 raft_consensus.cc:2393] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b3d620dab1b4f09885aa2676375479e in current term 1: Already voted for candidate 3f942a2ebb664fd08dc63f3629df639d in this term.
I20260709 12:15:37.945031 23529 raft_consensus.cc:2468] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:37.945166 23495 leader_election.cc:304] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e; no voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:37.945371 23725 raft_consensus.cc:493] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.946161 23724 raft_consensus.cc:3060] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.946079 23725 raft_consensus.cc:515] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.946813 23678 raft_consensus.cc:2468] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:37.947070 23567 leader_election.cc:304] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:37.948288 23765 raft_consensus.cc:2804] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.950299 23725 leader_election.cc:290] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.950064 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.951202 23765 raft_consensus.cc:697] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:37.953089 23529 raft_consensus.cc:2393] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ef0bfb6d3a54eea8f15c3910a602340 in current term 1: Already voted for candidate 3f942a2ebb664fd08dc63f3629df639d in this term.
I20260709 12:15:37.951072 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.954133 23724 raft_consensus.cc:2749] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.953680 23765 consensus_queue.cc:237] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.954854 23725 raft_consensus.cc:493] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:37.955075 23570 leader_election.cc:304] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:37.955446 23725 raft_consensus.cc:515] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.956640 23771 raft_consensus.cc:3060] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.958002 23725 leader_election.cc:290] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.959161 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:37.959868 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:37.960191 23529 raft_consensus.cc:2468] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:37.960615 23678 raft_consensus.cc:2468] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:37.962169 23570 leader_election.cc:304] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:37.965606 23771 raft_consensus.cc:2749] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:37.965921 23765 raft_consensus.cc:2804] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:37.966401 23765 raft_consensus.cc:493] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:37.966773 23765 raft_consensus.cc:3060] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.968658 23425 catalog_manager.cc:5697] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.972620 23765 raft_consensus.cc:515] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.975363 23765 leader_election.cc:290] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:37.975862 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:37.976044 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:37.976604 23529 raft_consensus.cc:3060] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.976747 23678 raft_consensus.cc:3060] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:37.984783 23678 raft_consensus.cc:2468] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:37.984783 23529 raft_consensus.cc:2468] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:37.986290 23570 leader_election.cc:304] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:37.987133 23765 raft_consensus.cc:2804] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:37.987635 23765 raft_consensus.cc:697] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:37.988463 23765 consensus_queue.cc:237] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:37.997179 23425 catalog_manager.cc:5697] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.040699 23726 consensus_queue.cc:1048] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.040917 23765 raft_consensus.cc:493] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.041622 23765 raft_consensus.cc:515] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.044507 23765 leader_election.cc:290] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.044874 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:38.044956 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:38.046465 23678 raft_consensus.cc:2393] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ef0bfb6d3a54eea8f15c3910a602340 in current term 1: Already voted for candidate 2b3d620dab1b4f09885aa2676375479e in this term.
I20260709 12:15:38.047535 23570 leader_election.cc:304] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:38.048410 23765 raft_consensus.cc:3060] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.061358 23724 raft_consensus.cc:493] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.060925 23777 consensus_queue.cc:1048] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:15:38.061921 23724 raft_consensus.cc:515] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.064174 23724 leader_election.cc:290] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.066068 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:38.066524 23765 raft_consensus.cc:2749] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:38.066886 23604 raft_consensus.cc:2468] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:38.068557 23495 leader_election.cc:304] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:38.069957 23745 raft_consensus.cc:2804] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:38.070369 23745 raft_consensus.cc:493] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:38.070739 23745 raft_consensus.cc:3060] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.071058 23777 consensus_queue.cc:1048] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.070791 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:38.072834 23678 raft_consensus.cc:2468] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:38.076462 23678 raft_consensus.cc:3060] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.079860 23745 raft_consensus.cc:515] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.083653 23745 leader_election.cc:290] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.084748 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:38.085278 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:38.085929 23677 raft_consensus.cc:3060] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.085460 23604 raft_consensus.cc:3060] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.088117 23745 consensus_queue.cc:1048] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.093416 23604 raft_consensus.cc:2468] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:38.098290 23677 raft_consensus.cc:2468] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:38.098851 23495 leader_election.cc:304] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:38.100489 23777 consensus_queue.cc:1048] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.104559 23724 raft_consensus.cc:2804] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.105091 23741 consensus_queue.cc:1048] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.105120 23724 raft_consensus.cc:697] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:38.107461 23724 consensus_queue.cc:237] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.131763 23678 raft_consensus.cc:3060] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.134800 23424 catalog_manager.cc:5697] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.135474 23724 consensus_queue.cc:1048] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.146380 23724 consensus_queue.cc:1048] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.157089 23745 consensus_queue.cc:1048] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.169481 23786 consensus_queue.cc:1048] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.209009 23677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb"
dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
mode: GRACEFUL
new_leader_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:58102
I20260709 12:15:38.209645 23677 raft_consensus.cc:606] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Received request to transfer leadership to TS 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:38.224434 23602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
mode: GRACEFUL
new_leader_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:37814
I20260709 12:15:38.224960 23602 raft_consensus.cc:606] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Received request to transfer leadership to TS 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:38.234733 23765 consensus_queue.cc:1048] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.247289 23529 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.251247 23528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
mode: GRACEFUL
new_leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:52940
I20260709 12:15:38.252108 23528 raft_consensus.cc:606] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Received request to transfer leadership to TS 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:38.258828 23771 consensus_queue.cc:1048] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.263281 23528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
mode: GRACEFUL
new_leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:52940
I20260709 12:15:38.264101 23528 raft_consensus.cc:606] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Received request to transfer leadership to TS 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:38.267082 23725 raft_consensus.cc:993] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: : Instructing follower 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:38.267853 23771 raft_consensus.cc:1081] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Signalling peer 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:38.269424 23529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:52932
I20260709 12:15:38.269965 23529 raft_consensus.cc:493] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.270386 23529 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.276564 23529 raft_consensus.cc:515] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.279470 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:38.280083 23529 leader_election.cc:290] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.280083 23602 raft_consensus.cc:3055] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:38.280905 23602 raft_consensus.cc:740] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:38.281021 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:38.281857 23677 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.282027 23602 consensus_queue.cc:260] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.283735 23602 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.290851 23677 raft_consensus.cc:2468] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:38.292114 23495 leader_election.cc:304] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 
I20260709 12:15:38.292611 23602 raft_consensus.cc:2468] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:38.292843 23724 raft_consensus.cc:2804] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:38.293481 23724 raft_consensus.cc:697] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:38.294325 23724 consensus_queue.cc:237] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.300554 23424 catalog_manager.cc:5697] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 1 to 2, leader changed from 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130) to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.345458 23771 consensus_queue.cc:1048] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.357019 23725 consensus_queue.cc:1048] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.387413 23725 consensus_queue.cc:1048] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.398952 23725 consensus_queue.cc:1048] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.563380 23724 raft_consensus.cc:993] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: : Instructing follower 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:38.563962 23786 raft_consensus.cc:1081] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Signalling peer 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:38.565724 23602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:37800
I20260709 12:15:38.566252 23602 raft_consensus.cc:493] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.566596 23602 raft_consensus.cc:3060] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.572598 23602 raft_consensus.cc:515] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.574977 23602 leader_election.cc:290] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.575312 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:38.575660 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c13afbdf2784b46bba2a3edf2baa9f6" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:38.576397 23677 raft_consensus.cc:3060] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.576460 23529 raft_consensus.cc:3055] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:38.577016 23529 raft_consensus.cc:740] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:38.580965 23786 consensus_queue.cc:1048] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:38.584177 23529 consensus_queue.cc:260] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.584887 23677 raft_consensus.cc:2468] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:38.585793 23529 raft_consensus.cc:3060] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.586423 23570 leader_election.cc:304] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:38.587472 23725 raft_consensus.cc:2804] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:38.588083 23725 raft_consensus.cc:697] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:38.588860 23786 consensus_queue.cc:1048] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:38.589022 23725 consensus_queue.cc:237] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.595434 23529 raft_consensus.cc:2468] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:38.602218 23724 raft_consensus.cc:993] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: : Instructing follower 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:38.602782 23724 raft_consensus.cc:1081] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Signalling peer 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:38.603588 23424 catalog_manager.cc:5697] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 1 to 2, leader changed from 2b3d620dab1b4f09885aa2676375479e (127.9.180.129) to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.605667 23604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:37800
I20260709 12:15:38.606349 23604 raft_consensus.cc:493] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.606755 23604 raft_consensus.cc:3060] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.613493 23604 raft_consensus.cc:515] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.616725 23604 leader_election.cc:290] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.616916 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:38.617702 23678 raft_consensus.cc:3060] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.618189 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72fe4c4490d4e7598aced2ce4e60336" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:38.618826 23529 raft_consensus.cc:3055] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:38.619146 23529 raft_consensus.cc:740] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:38.621054 23529 consensus_queue.cc:260] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.622432 23529 raft_consensus.cc:3060] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.627585 23678 raft_consensus.cc:2468] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:38.628798 23570 leader_election.cc:304] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:38.629135 23529 raft_consensus.cc:2468] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:38.629745 23771 raft_consensus.cc:2804] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:38.630312 23771 raft_consensus.cc:697] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:38.631258 23771 consensus_queue.cc:237] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.638270 23426 catalog_manager.cc:5697] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 1 to 2, leader changed from 2b3d620dab1b4f09885aa2676375479e (127.9.180.129) to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.643466 23739 raft_consensus.cc:993] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: : Instructing follower 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:38.643985 23777 raft_consensus.cc:1081] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Signalling peer 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:38.645648 23529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:52926
I20260709 12:15:38.646263 23529 raft_consensus.cc:493] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:38.646661 23529 raft_consensus.cc:3060] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.654628 23529 raft_consensus.cc:515] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.656415 23529 leader_election.cc:290] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:38.657351 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:38.657548 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758b8f80153f4c0a9ea7295ee27262eb" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:38.658080 23602 raft_consensus.cc:3060] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.658226 23678 raft_consensus.cc:3055] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:38.658694 23678 raft_consensus.cc:740] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:38.659358 23678 consensus_queue.cc:260] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.660313 23678 raft_consensus.cc:3060] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:38.664511 23602 raft_consensus.cc:2468] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:38.665789 23678 raft_consensus.cc:2468] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:38.665930 23495 leader_election.cc:304] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:38.666863 23724 raft_consensus.cc:2804] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:38.667315 23724 raft_consensus.cc:697] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:38.668066 23724 consensus_queue.cc:237] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:38.674733 23426 catalog_manager.cc:5697] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 1 to 2, leader changed from 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131) to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:38.800275 23602 raft_consensus.cc:1275] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:38.801779 23724 consensus_queue.cc:1048] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:38.812626 23678 raft_consensus.cc:1275] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:38.814407 23724 consensus_queue.cc:1048] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:39.011127 23529 raft_consensus.cc:1275] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.012526 23765 consensus_queue.cc:1048] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:39.020718 23678 raft_consensus.cc:1275] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.022650 23771 consensus_queue.cc:1048] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:39.143703 23678 raft_consensus.cc:1275] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.145431 23724 consensus_queue.cc:1048] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:39.155928 23602 raft_consensus.cc:1275] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.157757 23786 consensus_queue.cc:1048] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:39.190621 23678 raft_consensus.cc:1275] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.191991 23771 consensus_queue.cc:1048] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:39.203187 23529 raft_consensus.cc:1275] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:39.204767 23771 consensus_queue.cc:1048] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.302114 23426 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41716:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:41.304774 23426 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:41.357815 23515 tablet_service.cc:1511] Processing CreateTablet for tablet d48f9aeeac304b869a5cb32ad8a31a48 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:41.359344 23515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f9aeeac304b869a5cb32ad8a31a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.359081 23588 tablet_service.cc:1511] Processing CreateTablet for tablet d48f9aeeac304b869a5cb32ad8a31a48 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:41.360670 23588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f9aeeac304b869a5cb32ad8a31a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.360365 23665 tablet_service.cc:1511] Processing CreateTablet for tablet d48f9aeeac304b869a5cb32ad8a31a48 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:41.361771 23665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f9aeeac304b869a5cb32ad8a31a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.364612 23517 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7a870b4e0c4c338c8228c9dc323e9d (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:41.366050 23517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7a870b4e0c4c338c8228c9dc323e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.368719 23511 tablet_service.cc:1511] Processing CreateTablet for tablet 8c14687e02a64f759189346beedc1725 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:41.370110 23511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c14687e02a64f759189346beedc1725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.373443 23513 tablet_service.cc:1511] Processing CreateTablet for tablet ff569f17fd5d499886b49468f13e3c21 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:41.375598 23512 tablet_service.cc:1511] Processing CreateTablet for tablet 82cb220dcbab4f179724b0860eb16e74 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:41.382932 23519 tablet_service.cc:1511] Processing CreateTablet for tablet abc69b6dc2954bd790ff3d1bf610b822 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:41.385999 23514 tablet_service.cc:1511] Processing CreateTablet for tablet 09a14abf9e6f4b96b1486997aec37026 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:41.391381 23513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff569f17fd5d499886b49468f13e3c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.394939 23512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cb220dcbab4f179724b0860eb16e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.402953 23514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a14abf9e6f4b96b1486997aec37026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.407991 23519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc69b6dc2954bd790ff3d1bf610b822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.410063 23516 tablet_service.cc:1511] Processing CreateTablet for tablet 25cc3b41c00843aca4b4ef139107b449 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:41.412290 23516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25cc3b41c00843aca4b4ef139107b449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.415980 23518 tablet_service.cc:1511] Processing CreateTablet for tablet 840b52347b2a4e85929b6dc352efcea0 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:41.417551 23518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840b52347b2a4e85929b6dc352efcea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.418362 23661 tablet_service.cc:1511] Processing CreateTablet for tablet 8c14687e02a64f759189346beedc1725 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:41.420248 23589 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7a870b4e0c4c338c8228c9dc323e9d (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:41.421006 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7a870b4e0c4c338c8228c9dc323e9d (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:41.421747 23589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7a870b4e0c4c338c8228c9dc323e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.421314 23593 tablet_service.cc:1511] Processing CreateTablet for tablet ff569f17fd5d499886b49468f13e3c21 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:41.422457 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7a870b4e0c4c338c8228c9dc323e9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.427064 23661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c14687e02a64f759189346beedc1725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.426772 23590 tablet_service.cc:1511] Processing CreateTablet for tablet 8c14687e02a64f759189346beedc1725 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:41.430146 23593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff569f17fd5d499886b49468f13e3c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.439013 23667 tablet_service.cc:1511] Processing CreateTablet for tablet ff569f17fd5d499886b49468f13e3c21 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:41.439436 23663 tablet_service.cc:1511] Processing CreateTablet for tablet 82cb220dcbab4f179724b0860eb16e74 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:41.439965 23664 tablet_service.cc:1511] Processing CreateTablet for tablet abc69b6dc2954bd790ff3d1bf610b822 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:41.440538 23667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff569f17fd5d499886b49468f13e3c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.441285 23663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cb220dcbab4f179724b0860eb16e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.442839 23660 tablet_service.cc:1511] Processing CreateTablet for tablet 09a14abf9e6f4b96b1486997aec37026 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:41.444306 23660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a14abf9e6f4b96b1486997aec37026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.446722 23592 tablet_service.cc:1511] Processing CreateTablet for tablet 82cb220dcbab4f179724b0860eb16e74 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:41.447485 23591 tablet_service.cc:1511] Processing CreateTablet for tablet 09a14abf9e6f4b96b1486997aec37026 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:41.448258 23594 tablet_service.cc:1511] Processing CreateTablet for tablet abc69b6dc2954bd790ff3d1bf610b822 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:41.449299 23586 tablet_service.cc:1511] Processing CreateTablet for tablet 840b52347b2a4e85929b6dc352efcea0 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:41.449828 23587 tablet_service.cc:1511] Processing CreateTablet for tablet 25cc3b41c00843aca4b4ef139107b449 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:41.451694 23664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc69b6dc2954bd790ff3d1bf610b822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.455719 23666 tablet_service.cc:1511] Processing CreateTablet for tablet 840b52347b2a4e85929b6dc352efcea0 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:41.457283 23666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840b52347b2a4e85929b6dc352efcea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.455740 23662 tablet_service.cc:1511] Processing CreateTablet for tablet 25cc3b41c00843aca4b4ef139107b449 (DEFAULT_TABLE table=soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:41.460217 23662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25cc3b41c00843aca4b4ef139107b449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.434402 23590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c14687e02a64f759189346beedc1725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.468122 23591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a14abf9e6f4b96b1486997aec37026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.470811 23587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25cc3b41c00843aca4b4ef139107b449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.472952 23594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc69b6dc2954bd790ff3d1bf610b822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.476822 23586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840b52347b2a4e85929b6dc352efcea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.483052 23592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82cb220dcbab4f179724b0860eb16e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:41.536104 23818 tablet_bootstrap.cc:492] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:41.568464 23819 tablet_bootstrap.cc:492] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.584211 23819 tablet_bootstrap.cc:654] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.588634 23818 tablet_bootstrap.cc:654] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.589599 23820 tablet_bootstrap.cc:492] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.603756 23820 tablet_bootstrap.cc:654] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:41.613899 23475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:41.632239 23820 tablet_bootstrap.cc:492] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:41.632474 23818 tablet_bootstrap.cc:492] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:41.632965 23820 ts_tablet_manager.cc:1403] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 12:15:41.639698 23818 ts_tablet_manager.cc:1403] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.104s	user 0.005s	sys 0.015s
I20260709 12:15:41.638473 23819 tablet_bootstrap.cc:492] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:41.643016 23819 ts_tablet_manager.cc:1403] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.006s
I20260709 12:15:41.642733 23820 raft_consensus.cc:359] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.642901 23818 raft_consensus.cc:359] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.643710 23820 raft_consensus.cc:385] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.643751 23818 raft_consensus.cc:385] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.644277 23820 raft_consensus.cc:740] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.644439 23818 raft_consensus.cc:740] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.645138 23820 consensus_queue.cc:260] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.645541 23818 consensus_queue.cc:260] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.646585 23819 raft_consensus.cc:359] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.647435 23819 raft_consensus.cc:385] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.647555 23820 ts_tablet_manager.cc:1434] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:15:41.647804 23819 raft_consensus.cc:740] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.649154 23820 tablet_bootstrap.cc:492] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.648684 23819 consensus_queue.cc:260] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.651166 23818 ts_tablet_manager.cc:1434] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:15:41.652407 23818 tablet_bootstrap.cc:492] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:41.652478 23819 ts_tablet_manager.cc:1434] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:41.653718 23819 tablet_bootstrap.cc:492] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.660746 23818 tablet_bootstrap.cc:654] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.660833 23820 tablet_bootstrap.cc:654] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.660746 23819 tablet_bootstrap.cc:654] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.692376 23777 raft_consensus.cc:493] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.693138 23777 raft_consensus.cc:515] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.702322 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
W20260709 12:15:41.707540 23641 leader_election.cc:343] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.709208 23777 leader_election.cc:290] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:41.713439 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
W20260709 12:15:41.716346 23644 leader_election.cc:343] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.716936 23644 leader_election.cc:304] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d; no voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:41.719298 23777 raft_consensus.cc:2749] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.723062 23828 raft_consensus.cc:493] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.724299 23828 raft_consensus.cc:515] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
W20260709 12:15:41.728729 23567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.129:36843, user_credentials={real_user=slave}} blocked reactor thread for 62518us
I20260709 12:15:41.729211 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:41.730713 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
W20260709 12:15:41.731052 23570 leader_election.cc:343] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.731673 23529 raft_consensus.cc:2468] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:41.733615 23567 leader_election.cc:304] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:41.733711 23828 leader_election.cc:290] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:41.735008 23771 raft_consensus.cc:2804] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.735491 23771 raft_consensus.cc:493] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.734094 23820 tablet_bootstrap.cc:492] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:41.735935 23771 raft_consensus.cc:3060] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.736284 23820 ts_tablet_manager.cc:1403] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.087s	user 0.044s	sys 0.033s
I20260709 12:15:41.737737 23818 tablet_bootstrap.cc:492] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:41.737802 23819 tablet_bootstrap.cc:492] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:41.738516 23818 ts_tablet_manager.cc:1403] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.023s
I20260709 12:15:41.738976 23819 ts_tablet_manager.cc:1403] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.032s
I20260709 12:15:41.743244 23820 raft_consensus.cc:359] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.743477 23819 raft_consensus.cc:359] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.744176 23820 raft_consensus.cc:385] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.744397 23819 raft_consensus.cc:385] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.743923 23818 raft_consensus.cc:359] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.744645 23820 raft_consensus.cc:740] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.744868 23819 raft_consensus.cc:740] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.745234 23818 raft_consensus.cc:385] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.745857 23818 raft_consensus.cc:740] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.745734 23820 consensus_queue.cc:260] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.745931 23819 consensus_queue.cc:260] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.747608 23771 raft_consensus.cc:515] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.748581 23820 ts_tablet_manager.cc:1434] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:15:41.748734 23819 ts_tablet_manager.cc:1434] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:41.747061 23818 consensus_queue.cc:260] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.751087 23819 tablet_bootstrap.cc:492] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.752349 23820 tablet_bootstrap.cc:492] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.756304 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:41.756911 23529 raft_consensus.cc:3060] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.751273 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:41.757048 23818 ts_tablet_manager.cc:1434] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
W20260709 12:15:41.758388 23570 leader_election.cc:343] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.758538 23818 tablet_bootstrap.cc:492] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:41.763113 23820 tablet_bootstrap.cc:654] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.769230 23819 tablet_bootstrap.cc:654] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.771116 23771 leader_election.cc:290] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:41.771414 23820 tablet_bootstrap.cc:492] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:41.772167 23820 ts_tablet_manager.cc:1403] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:15:41.772969 23818 tablet_bootstrap.cc:654] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.775717 23529 raft_consensus.cc:2468] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:41.777187 23567 leader_election.cc:304] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:41.778014 23828 raft_consensus.cc:2804] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:41.778573 23828 raft_consensus.cc:697] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:41.779493 23828 consensus_queue.cc:237] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.788154 23820 raft_consensus.cc:359] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.789047 23820 raft_consensus.cc:385] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.789392 23820 raft_consensus.cc:740] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.790179 23820 consensus_queue.cc:260] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.792881 23820 ts_tablet_manager.cc:1434] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:15:41.794986 23820 tablet_bootstrap.cc:492] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.805040 23820 tablet_bootstrap.cc:654] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.808665 23818 tablet_bootstrap.cc:492] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:41.809659 23818 ts_tablet_manager.cc:1403] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.005s
I20260709 12:15:41.812708 23425 catalog_manager.cc:5697] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:41.822477 23819 tablet_bootstrap.cc:492] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:41.823158 23819 ts_tablet_manager.cc:1403] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.004s
I20260709 12:15:41.819621 23818 raft_consensus.cc:359] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.824822 23818 raft_consensus.cc:385] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.825350 23818 raft_consensus.cc:740] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.826480 23819 raft_consensus.cc:359] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.827466 23819 raft_consensus.cc:385] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.827805 23819 raft_consensus.cc:740] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.826694 23818 consensus_queue.cc:260] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.828589 23819 consensus_queue.cc:260] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.830802 23818 ts_tablet_manager.cc:1434] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.005s
I20260709 12:15:41.832538 23818 tablet_bootstrap.cc:492] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:41.840078 23819 ts_tablet_manager.cc:1434] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:15:41.841239 23819 tablet_bootstrap.cc:492] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.848158 23819 tablet_bootstrap.cc:654] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.854255 23820 tablet_bootstrap.cc:492] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:41.854856 23820 ts_tablet_manager.cc:1403] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.060s	user 0.028s	sys 0.029s
I20260709 12:15:41.855093 23819 tablet_bootstrap.cc:492] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:41.856093 23819 ts_tablet_manager.cc:1403] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 12:15:41.861204 23820 raft_consensus.cc:359] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.861507 23819 raft_consensus.cc:359] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.862161 23820 raft_consensus.cc:385] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.862402 23819 raft_consensus.cc:385] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.862848 23820 raft_consensus.cc:740] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.862952 23819 raft_consensus.cc:740] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.863528 23829 raft_consensus.cc:493] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.863857 23820 consensus_queue.cc:260] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.864095 23829 raft_consensus.cc:515] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.863976 23819 consensus_queue.cc:260] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.866668 23820 ts_tablet_manager.cc:1434] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:15:41.867074 23819 ts_tablet_manager.cc:1434] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:15:41.867847 23820 tablet_bootstrap.cc:492] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.868244 23819 tablet_bootstrap.cc:492] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.868934 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:41.869920 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
W20260709 12:15:41.870644 23641 leader_election.cc:343] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.870705 23602 raft_consensus.cc:2468] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:41.861296 23818 tablet_bootstrap.cc:654] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.875134 23644 leader_election.cc:304] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:41.875650 23819 tablet_bootstrap.cc:654] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.871104 23829 leader_election.cc:290] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:41.876386 23820 tablet_bootstrap.cc:654] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.876644 23829 raft_consensus.cc:2804] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.877051 23829 raft_consensus.cc:493] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.877439 23829 raft_consensus.cc:3060] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.897581 23818 tablet_bootstrap.cc:492] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:41.898173 23818 ts_tablet_manager.cc:1403] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.003s
I20260709 12:15:41.901613 23818 raft_consensus.cc:359] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.902259 23820 tablet_bootstrap.cc:492] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:41.902426 23818 raft_consensus.cc:385] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.903769 23818 raft_consensus.cc:740] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.904860 23819 tablet_bootstrap.cc:492] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:41.904744 23818 consensus_queue.cc:260] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.905531 23819 ts_tablet_manager.cc:1403] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.011s
I20260709 12:15:41.907404 23818 ts_tablet_manager.cc:1434] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 12:15:41.908603 23818 tablet_bootstrap.cc:492] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:41.908898 23819 raft_consensus.cc:359] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.909703 23819 raft_consensus.cc:385] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.910022 23819 raft_consensus.cc:740] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.910849 23819 consensus_queue.cc:260] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.912463 23820 ts_tablet_manager.cc:1403] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.001s
I20260709 12:15:41.913475 23819 ts_tablet_manager.cc:1434] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:15:41.914713 23819 tablet_bootstrap.cc:492] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.916122 23820 raft_consensus.cc:359] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.917008 23820 raft_consensus.cc:385] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.917343 23820 raft_consensus.cc:740] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.918219 23820 consensus_queue.cc:260] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.920858 23820 ts_tablet_manager.cc:1434] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:15:41.922065 23820 tablet_bootstrap.cc:492] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.922650 23819 tablet_bootstrap.cc:654] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.926473 23828 raft_consensus.cc:493] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.927228 23818 tablet_bootstrap.cc:654] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.927282 23828 raft_consensus.cc:515] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.933636 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
W20260709 12:15:41.935802 23570 leader_election.cc:343] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.937407 23820 tablet_bootstrap.cc:654] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.937708 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:41.937877 23828 leader_election.cc:290] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
W20260709 12:15:41.939805 23567 leader_election.cc:343] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.942869 23818 tablet_bootstrap.cc:492] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:41.942854 23567 leader_election.cc:304] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:41.943739 23818 ts_tablet_manager.cc:1403] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.002s
I20260709 12:15:41.944985 23828 raft_consensus.cc:2749] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:41.948098 23818 raft_consensus.cc:359] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.949129 23818 raft_consensus.cc:385] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.905230 23829 raft_consensus.cc:515] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.949501 23818 raft_consensus.cc:740] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.950613 23818 consensus_queue.cc:260] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.951450 23829 leader_election.cc:290] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:41.952486 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
W20260709 12:15:41.955260 23641 leader_election.cc:343] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.952935 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:41.956112 23602 raft_consensus.cc:3060] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.956269 23818 ts_tablet_manager.cc:1434] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:15:41.957918 23818 tablet_bootstrap.cc:492] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:41.964763 23602 raft_consensus.cc:2468] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:41.967056 23818 tablet_bootstrap.cc:654] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.968842 23644 leader_election.cc:304] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:41.970146 23829 raft_consensus.cc:2804] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:41.970854 23741 raft_consensus.cc:493] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.971612 23741 raft_consensus.cc:515] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.972451 23829 raft_consensus.cc:697] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:41.973516 23829 consensus_queue.cc:237] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.975728 23820 tablet_bootstrap.cc:492] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:41.974224 23741 leader_election.cc:290] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:41.976274 23820 ts_tablet_manager.cc:1403] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.018s
I20260709 12:15:41.976125 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c14687e02a64f759189346beedc1725" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:41.976987 23819 tablet_bootstrap.cc:492] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:41.977197 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c14687e02a64f759189346beedc1725" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:41.977645 23819 ts_tablet_manager.cc:1403] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.014s
I20260709 12:15:41.978102 23602 raft_consensus.cc:2468] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:41.979592 23495 leader_election.cc:304] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:41.979938 23820 raft_consensus.cc:359] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.980649 23741 raft_consensus.cc:2804] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:41.980816 23820 raft_consensus.cc:385] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.981178 23741 raft_consensus.cc:493] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:41.981314 23820 raft_consensus.cc:740] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.981927 23741 raft_consensus.cc:3060] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:41.981305 23819 raft_consensus.cc:359] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.982733 23819 raft_consensus.cc:385] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:41.982586 23820 consensus_queue.cc:260] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.983117 23819 raft_consensus.cc:740] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:41.983652 23678 raft_consensus.cc:2468] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:41.984110 23819 consensus_queue.cc:260] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.985129 23777 raft_consensus.cc:493] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.985774 23777 raft_consensus.cc:515] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.987068 23819 ts_tablet_manager.cc:1434] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260709 12:15:41.988227 23819 tablet_bootstrap.cc:492] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:41.985090 23820 ts_tablet_manager.cc:1434] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:41.989660 23820 tablet_bootstrap.cc:492] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:41.990253 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840b52347b2a4e85929b6dc352efcea0" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:41.991775 23828 raft_consensus.cc:493] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:41.992272 23828 raft_consensus.cc:515] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:41.994474 23828 leader_election.cc:290] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
W20260709 12:15:41.995772 23644 leader_election.cc:343] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:41.996299 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840b52347b2a4e85929b6dc352efcea0" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:41.997044 23528 raft_consensus.cc:2468] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:41.997295 23820 tablet_bootstrap.cc:654] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:41.997584 23777 leader_election.cc:290] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:41.998106 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:41.998790 23678 raft_consensus.cc:2468] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:41.999763 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:42.000902 23819 tablet_bootstrap.cc:654] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.001721 23570 leader_election.cc:304] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.002985 23828 raft_consensus.cc:2804] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.003412 23828 raft_consensus.cc:493] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.003854 23828 raft_consensus.cc:3060] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:42.007056 23567 leader_election.cc:343] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.007795 23641 leader_election.cc:304] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.009099 23777 raft_consensus.cc:2804] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.009799 23777 raft_consensus.cc:493] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.010358 23777 raft_consensus.cc:3060] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.013535 23819 tablet_bootstrap.cc:492] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:42.014178 23819 ts_tablet_manager.cc:1403] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 12:15:42.017863 23828 raft_consensus.cc:515] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.018635 23819 raft_consensus.cc:359] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.019744 23819 raft_consensus.cc:385] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.020047 23819 raft_consensus.cc:740] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.021843 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:42.022450 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:42.023335 23678 raft_consensus.cc:3060] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:42.023561 23567 leader_election.cc:343] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.024828 23819 consensus_queue.cc:260] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.028016 23819 ts_tablet_manager.cc:1434] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 12:15:42.029171 23819 tablet_bootstrap.cc:492] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:42.033123 23678 raft_consensus.cc:2468] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:42.034871 23570 leader_election.cc:304] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:42.036043 23771 raft_consensus.cc:2804] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.036263 23819 tablet_bootstrap.cc:654] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.036798 23771 raft_consensus.cc:697] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:42.037956 23771 consensus_queue.cc:237] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.040899 23825 raft_consensus.cc:493] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.041628 23825 raft_consensus.cc:515] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.045147 23825 leader_election.cc:290] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.045387 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25cc3b41c00843aca4b4ef139107b449" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:42.046121 23529 raft_consensus.cc:2468] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 0.
I20260709 12:15:42.046924 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25cc3b41c00843aca4b4ef139107b449" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:42.047503 23567 leader_election.cc:304] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
W20260709 12:15:42.048570 23570 leader_election.cc:343] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.050849 23825 raft_consensus.cc:2804] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.051303 23825 raft_consensus.cc:493] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.051657 23825 raft_consensus.cc:3060] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.053071 23818 tablet_bootstrap.cc:492] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:42.053184 23819 tablet_bootstrap.cc:492] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:42.054214 23819 ts_tablet_manager.cc:1403] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260709 12:15:42.054477 23818 ts_tablet_manager.cc:1403] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.006s
I20260709 12:15:42.057829 23819 raft_consensus.cc:359] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.058676 23819 raft_consensus.cc:385] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.059062 23819 raft_consensus.cc:740] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.059717 23828 leader_election.cc:290] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.059945 23819 consensus_queue.cc:260] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.062479 23819 ts_tablet_manager.cc:1434] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:15:42.063625 23819 tablet_bootstrap.cc:492] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: Bootstrap starting.
I20260709 12:15:42.063424 23426 catalog_manager.cc:5697] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.064616 23818 raft_consensus.cc:359] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.065713 23818 raft_consensus.cc:385] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.066107 23818 raft_consensus.cc:740] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.071357 23819 tablet_bootstrap.cc:654] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.071731 23820 tablet_bootstrap.cc:492] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:42.072729 23820 ts_tablet_manager.cc:1403] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.083s	user 0.035s	sys 0.035s
I20260709 12:15:42.067147 23818 consensus_queue.cc:260] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.076571 23820 raft_consensus.cc:359] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.077502 23820 raft_consensus.cc:385] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.077879 23820 raft_consensus.cc:740] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.078884 23820 consensus_queue.cc:260] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.080999 23741 raft_consensus.cc:515] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.081969 23820 ts_tablet_manager.cc:1434] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:42.083415 23820 tablet_bootstrap.cc:492] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:42.084082 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c14687e02a64f759189346beedc1725" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:42.084815 23602 raft_consensus.cc:3060] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.090749 23818 ts_tablet_manager.cc:1434] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.036s	user 0.015s	sys 0.001s
I20260709 12:15:42.091018 23819 tablet_bootstrap.cc:492] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: No bootstrap required, opened a new log
I20260709 12:15:42.091779 23820 tablet_bootstrap.cc:654] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.091799 23819 ts_tablet_manager.cc:1403] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 12:15:42.092446 23825 raft_consensus.cc:515] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.091938 23818 tablet_bootstrap.cc:492] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:42.107358 23818 tablet_bootstrap.cc:654] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.110754 23820 tablet_bootstrap.cc:492] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:42.111256 23820 ts_tablet_manager.cc:1403] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 12:15:42.114013 23820 raft_consensus.cc:359] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.115003 23820 raft_consensus.cc:385] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.115260 23820 raft_consensus.cc:740] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.115890 23820 consensus_queue.cc:260] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.095678 23819 raft_consensus.cc:359] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.117380 23819 raft_consensus.cc:385] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.117684 23819 raft_consensus.cc:740] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.117820 23820 ts_tablet_manager.cc:1434] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:42.118850 23820 tablet_bootstrap.cc:492] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: Bootstrap starting.
I20260709 12:15:42.124396 23820 tablet_bootstrap.cc:654] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.125418 23427 catalog_manager.cc:5697] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 1 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.127569 23602 raft_consensus.cc:2468] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:42.128387 23741 leader_election.cc:290] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.128587 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c14687e02a64f759189346beedc1725" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:42.129454 23819 consensus_queue.cc:260] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.137786 23678 raft_consensus.cc:3060] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.131301 23777 raft_consensus.cc:515] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.136679 23820 tablet_bootstrap.cc:492] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: No bootstrap required, opened a new log
I20260709 12:15:42.142287 23820 ts_tablet_manager.cc:1403] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 12:15:42.143265 23819 ts_tablet_manager.cc:1434] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:15:42.148315 23820 raft_consensus.cc:359] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.148998 23820 raft_consensus.cc:385] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.149252 23820 raft_consensus.cc:740] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.149904 23820 consensus_queue.cc:260] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.152374 23820 ts_tablet_manager.cc:1434] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:15:42.153707 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25cc3b41c00843aca4b4ef139107b449" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:42.154366 23677 raft_consensus.cc:3060] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.157703 23825 leader_election.cc:290] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.162338 23829 raft_consensus.cc:493] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.162916 23829 raft_consensus.cc:515] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.165230 23829 leader_election.cc:290] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:42.166455 23678 raft_consensus.cc:2468] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:42.166824 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25cc3b41c00843aca4b4ef139107b449" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:42.167359 23529 raft_consensus.cc:3060] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.169234 23777 leader_election.cc:290] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:42.174921 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.175606 23602 raft_consensus.cc:2468] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:42.175791 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840b52347b2a4e85929b6dc352efcea0" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:42.176507 23603 raft_consensus.cc:3060] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.177914 23529 raft_consensus.cc:2468] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:42.179482 23567 leader_election.cc:304] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.180497 23828 raft_consensus.cc:2804] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.181133 23828 raft_consensus.cc:697] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:42.181986 23828 consensus_queue.cc:237] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.183288 23677 raft_consensus.cc:2468] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 1.
I20260709 12:15:42.184278 23644 leader_election.cc:304] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.185079 23818 tablet_bootstrap.cc:492] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:42.185339 23829 raft_consensus.cc:2804] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.185683 23818 ts_tablet_manager.cc:1403] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.018s
I20260709 12:15:42.185863 23829 raft_consensus.cc:493] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.186323 23829 raft_consensus.cc:3060] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.190562 23603 raft_consensus.cc:2468] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
W20260709 12:15:42.191608 23495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.131:34779, user_credentials={real_user=slave}} blocked reactor thread for 45573.8us
I20260709 12:15:42.192045 23644 leader_election.cc:304] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.193147 23777 raft_consensus.cc:2804] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.193367 23818 raft_consensus.cc:359] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.194175 23818 raft_consensus.cc:385] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.194478 23818 raft_consensus.cc:740] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.194769 23777 raft_consensus.cc:697] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:42.195274 23818 consensus_queue.cc:260] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.196048 23777 consensus_queue.cc:237] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.192973 23495 leader_election.cc:304] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.199316 23741 raft_consensus.cc:2804] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.199824 23741 raft_consensus.cc:697] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:42.199714 23829 raft_consensus.cc:515] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.201020 23818 ts_tablet_manager.cc:1434] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:15:42.202240 23818 tablet_bootstrap.cc:492] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:42.202167 23829 leader_election.cc:290] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:42.200917 23741 consensus_queue.cc:237] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.208668 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:42.209370 23603 raft_consensus.cc:3060] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.213383 23818 tablet_bootstrap.cc:654] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.213815 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:42.215585 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840b52347b2a4e85929b6dc352efcea0" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:42.216161 23529 raft_consensus.cc:3060] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.217586 23527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
W20260709 12:15:42.219667 23641 leader_election.cc:343] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:42.225729 23641 leader_election.cc:343] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:42.231175 23603 raft_consensus.cc:2468] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:42.233225 23644 leader_election.cc:304] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:42.230187 23427 catalog_manager.cc:5697] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 1 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.234228 23829 raft_consensus.cc:2804] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.234786 23829 raft_consensus.cc:697] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:42.235764 23829 consensus_queue.cc:237] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.225971 23529 raft_consensus.cc:2468] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:42.239845 23847 raft_consensus.cc:493] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.240469 23847 raft_consensus.cc:515] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.242902 23847 leader_election.cc:290] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.245549 23836 raft_consensus.cc:493] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.246125 23836 raft_consensus.cc:515] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.248486 23836 leader_election.cc:290] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:42.249099 23425 catalog_manager.cc:5697] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.252326 23741 raft_consensus.cc:493] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.252907 23741 raft_consensus.cc:515] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.253799 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.255057 23741 leader_election.cc:290] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.255193 23825 consensus_queue.cc:1048] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.262456 23528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:42.263024 23426 catalog_manager.cc:5697] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 1 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.265211 23641 leader_election.cc:304] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d; no voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.266527 23777 raft_consensus.cc:2749] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.266739 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff569f17fd5d499886b49468f13e3c21" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:42.267423 23677 raft_consensus.cc:2468] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:42.269436 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:42.270231 23677 raft_consensus.cc:2393] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b3d620dab1b4f09885aa2676375479e in current term 1: Already voted for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in this term.
I20260709 12:15:42.270737 23818 tablet_bootstrap.cc:492] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:42.271323 23818 ts_tablet_manager.cc:1403] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.069s	user 0.028s	sys 0.035s
I20260709 12:15:42.272447 23495 leader_election.cc:304] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 
I20260709 12:15:42.275035 23818 raft_consensus.cc:359] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.275825 23818 raft_consensus.cc:385] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.276080 23818 raft_consensus.cc:740] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.277550 23741 raft_consensus.cc:2804] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.277951 23741 raft_consensus.cc:493] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.278261 23741 raft_consensus.cc:3060] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.276750 23818 consensus_queue.cc:260] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.281635 23818 ts_tablet_manager.cc:1434] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 12:15:42.282583 23818 tablet_bootstrap.cc:492] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: Bootstrap starting.
I20260709 12:15:42.287285 23741 raft_consensus.cc:515] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.288305 23818 tablet_bootstrap.cc:654] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:42.290122 23741 leader_election.cc:290] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.292099 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff569f17fd5d499886b49468f13e3c21" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:42.293097 23677 raft_consensus.cc:3060] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.303795 23677 raft_consensus.cc:2468] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:42.305126 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff569f17fd5d499886b49468f13e3c21" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.307533 23678 raft_consensus.cc:3060] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.310460 23602 raft_consensus.cc:2468] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 0.
I20260709 12:15:42.317042 23818 tablet_bootstrap.cc:492] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: No bootstrap required, opened a new log
I20260709 12:15:42.317862 23818 ts_tablet_manager.cc:1403] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.008s
I20260709 12:15:42.313684 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff569f17fd5d499886b49468f13e3c21" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:42.319206 23604 raft_consensus.cc:3060] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.321918 23818 raft_consensus.cc:359] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.322857 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82cb220dcbab4f179724b0860eb16e74" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.323069 23818 raft_consensus.cc:385] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:42.323601 23818 raft_consensus.cc:740] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Initialized, Role: FOLLOWER
I20260709 12:15:42.324262 23741 raft_consensus.cc:493] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.324505 23818 consensus_queue.cc:260] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.324802 23741 raft_consensus.cc:515] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.326671 23741 leader_election.cc:290] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.330159 23818 ts_tablet_manager.cc:1434] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:15:42.331446 23676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:42.336498 23425 catalog_manager.cc:5697] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 1 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.337929 23604 raft_consensus.cc:2468] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 1.
I20260709 12:15:42.339529 23495 leader_election.cc:304] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e; no voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.340554 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.341331 23603 raft_consensus.cc:2393] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b3d620dab1b4f09885aa2676375479e in current term 1: Already voted for candidate 3f942a2ebb664fd08dc63f3629df639d in this term.
I20260709 12:15:42.343113 23847 raft_consensus.cc:3060] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.343894 23828 consensus_queue.cc:1048] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.346144 23495 leader_election.cc:304] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e; no voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.347154 23852 raft_consensus.cc:3060] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.352353 23847 raft_consensus.cc:2749] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.352404 23495 leader_election.cc:304] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.361255 23847 raft_consensus.cc:2804] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.361897 23847 raft_consensus.cc:697] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:42.362877 23847 consensus_queue.cc:237] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.364733 23852 raft_consensus.cc:2749] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.442278 23426 catalog_manager.cc:5697] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 1 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.468734 23828 consensus_queue.cc:1048] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.488080 23828 consensus_queue.cc:1048] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.496505 23829 consensus_queue.cc:1048] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.504021 23852 raft_consensus.cc:493] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.505219 23852 raft_consensus.cc:515] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.508679 23852 leader_election.cc:290] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.509919 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.511210 23603 raft_consensus.cc:2393] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b3d620dab1b4f09885aa2676375479e in current term 1: Already voted for candidate 3f942a2ebb664fd08dc63f3629df639d in this term.
I20260709 12:15:42.516579 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f942a2ebb664fd08dc63f3629df639d" is_pre_election: true
I20260709 12:15:42.518827 23495 leader_election.cc:304] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e; no voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.520403 23852 raft_consensus.cc:3060] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.523218 23829 consensus_queue.cc:1048] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.536424 23852 raft_consensus.cc:2749] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:42.563987 23872 raft_consensus.cc:493] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:42.565027 23872 raft_consensus.cc:515] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.569250 23872 leader_election.cc:290] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:42.570531 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" is_pre_election: true
I20260709 12:15:42.570854 23527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e" is_pre_election: true
I20260709 12:15:42.571952 23603 raft_consensus.cc:2468] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:42.572073 23527 raft_consensus.cc:2468] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 0.
I20260709 12:15:42.574138 23644 leader_election.cc:304] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:42.575083 23872 raft_consensus.cc:2804] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:42.575536 23872 raft_consensus.cc:493] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:42.575842 23872 raft_consensus.cc:3060] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.583657 23872 raft_consensus.cc:515] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.585675 23872 leader_election.cc:290] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:42.586570 23527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:42.587028 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:42.587306 23527 raft_consensus.cc:3060] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.587669 23603 raft_consensus.cc:3060] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:42.597851 23527 raft_consensus.cc:2468] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:42.598269 23603 raft_consensus.cc:2468] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 1.
I20260709 12:15:42.599640 23641 leader_election.cc:304] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 
I20260709 12:15:42.600781 23872 raft_consensus.cc:2804] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:42.601403 23872 raft_consensus.cc:697] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:42.602710 23872 consensus_queue.cc:237] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.612859 23427 catalog_manager.cc:5697] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 1 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.621645 23852 consensus_queue.cc:1048] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:42.623974 23475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:42.643953 23847 consensus_queue.cc:1048] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.651237 23828 consensus_queue.cc:1048] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.664249 23836 consensus_queue.cc:1048] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.672287 23828 consensus_queue.cc:1048] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.687897 23829 consensus_queue.cc:1048] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:42.697698 23829 consensus_queue.cc:1048] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:42.712744 23829 consensus_queue.cc:1048] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:42.715629 23604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
mode: GRACEFUL
new_leader_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:37814
I20260709 12:15:42.716539 23604 raft_consensus.cc:606] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Received request to transfer leadership to TS 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:42.720896 23828 raft_consensus.cc:993] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: : Instructing follower 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:42.721439 23828 raft_consensus.cc:1081] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Signalling peer 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:42.723958 23529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:52932
I20260709 12:15:42.724478 23677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d"
dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
mode: GRACEFUL
new_leader_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:58102
I20260709 12:15:42.724800 23529 raft_consensus.cc:493] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:42.725265 23677 raft_consensus.cc:606] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Received request to transfer leadership to TS 2b3d620dab1b4f09885aa2676375479e
I20260709 12:15:42.725528 23529 raft_consensus.cc:3060] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.745340 23529 raft_consensus.cc:515] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.748070 23529 leader_election.cc:290] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:42.749336 23677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:42.749496 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f9aeeac304b869a5cb32ad8a31a48" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:42.750200 23677 raft_consensus.cc:3060] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.751008 23603 raft_consensus.cc:3055] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:42.751398 23603 raft_consensus.cc:740] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:42.751495 23678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822"
dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
mode: GRACEFUL
new_leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:58102
I20260709 12:15:42.752321 23678 raft_consensus.cc:606] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Received request to transfer leadership to TS 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.752668 23603 consensus_queue.cc:260] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.755084 23603 raft_consensus.cc:3060] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:42.758559 23847 consensus_queue.cc:1048] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:42.761677 23676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026"
dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
mode: GRACEFUL
new_leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:58102
I20260709 12:15:42.762233 23676 raft_consensus.cc:606] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Received request to transfer leadership to TS 4ef0bfb6d3a54eea8f15c3910a602340
I20260709 12:15:42.763635 23677 raft_consensus.cc:2468] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:42.765100 23495 leader_election.cc:304] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 
I20260709 12:15:42.765983 23603 raft_consensus.cc:2468] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:42.766178 23847 raft_consensus.cc:2804] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:42.766714 23847 raft_consensus.cc:697] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:42.767741 23847 consensus_queue.cc:237] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:42.782204 23847 consensus_queue.cc:1048] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:42.793579 23427 catalog_manager.cc:5697] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 1 to 2, leader changed from 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130) to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.082633 23829 consensus_queue.cc:1048] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.093881 23829 consensus_queue.cc:1048] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:43.104229 23829 raft_consensus.cc:993] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: : Instructing follower 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:43.104854 23777 raft_consensus.cc:1081] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Signalling peer 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:43.106529 23603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:37792
I20260709 12:15:43.107309 23603 raft_consensus.cc:493] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:43.107717 23603 raft_consensus.cc:3060] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.115932 23603 raft_consensus.cc:515] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.116938 23872 raft_consensus.cc:993] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: : Instructing follower 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:43.117595 23872 raft_consensus.cc:1081] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Signalling peer 2b3d620dab1b4f09885aa2676375479e to start an election
I20260709 12:15:43.119504 23603 leader_election.cc:290] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:43.119825 23529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:43.120514 23529 raft_consensus.cc:3060] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.123698 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc69b6dc2954bd790ff3d1bf610b822" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:43.124402 23678 raft_consensus.cc:3055] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.124697 23678 raft_consensus.cc:740] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:43.125485 23678 consensus_queue.cc:260] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.126605 23678 raft_consensus.cc:3060] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.130194 23529 raft_consensus.cc:2468] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:43.131390 23527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
 from {username='slave'} at 127.0.0.1:52926
I20260709 12:15:43.131979 23527 raft_consensus.cc:493] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:43.131938 23567 leader_election.cc:304] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:43.132750 23527 raft_consensus.cc:3060] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.133334 23825 raft_consensus.cc:2804] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.133862 23825 raft_consensus.cc:697] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:43.134927 23825 consensus_queue.cc:237] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.136577 23872 raft_consensus.cc:993] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: : Instructing follower 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:43.137122 23777 raft_consensus.cc:1081] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Signalling peer 4ef0bfb6d3a54eea8f15c3910a602340 to start an election
I20260709 12:15:43.140358 23603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
 from {username='slave'} at 127.0.0.1:37792
I20260709 12:15:43.141899 23603 raft_consensus.cc:493] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:43.142328 23603 raft_consensus.cc:3060] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.146683 23678 raft_consensus.cc:2468] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:43.144570 23427 catalog_manager.cc:5697] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 1 to 2, leader changed from 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131) to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.150277 23527 raft_consensus.cc:515] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.151701 23603 raft_consensus.cc:515] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.153447 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:43.154145 23604 raft_consensus.cc:3060] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.156481 23527 leader_election.cc:290] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Requested vote from peers 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:43.157653 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7a870b4e0c4c338c8228c9dc323e9d" candidate_uuid: "2b3d620dab1b4f09885aa2676375479e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:43.158136 23678 raft_consensus.cc:3055] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.158367 23678 raft_consensus.cc:740] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:43.159260 23678 consensus_queue.cc:260] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.160209 23678 raft_consensus.cc:3060] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.164737 23604 raft_consensus.cc:2468] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:43.165721 23678 raft_consensus.cc:2468] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b3d620dab1b4f09885aa2676375479e in term 2.
I20260709 12:15:43.166270 23495 leader_election.cc:304] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:43.167217 23847 raft_consensus.cc:2804] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.167735 23847 raft_consensus.cc:697] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Becoming Leader. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:43.167898 23603 leader_election.cc:290] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131:34779)
I20260709 12:15:43.168726 23847 consensus_queue.cc:237] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.169531 23678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
I20260709 12:15:43.170100 23678 raft_consensus.cc:3055] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:43.170401 23678 raft_consensus.cc:740] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:43.171232 23678 consensus_queue.cc:260] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.171553 23527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a14abf9e6f4b96b1486997aec37026" candidate_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:43.172322 23527 raft_consensus.cc:3060] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.172551 23678 raft_consensus.cc:3060] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:43.178165 23678 raft_consensus.cc:2468] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:43.179488 23570 leader_election.cc:304] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:43.178712 23427 catalog_manager.cc:5697] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e reported cstate change: term changed from 1 to 2, leader changed from 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131) to 2b3d620dab1b4f09885aa2676375479e (127.9.180.129). New cstate: current_term: 2 leader_uuid: "2b3d620dab1b4f09885aa2676375479e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.180471 23825 raft_consensus.cc:2804] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:43.180974 23825 raft_consensus.cc:697] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Becoming Leader. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:43.181963 23527 raft_consensus.cc:2468] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ef0bfb6d3a54eea8f15c3910a602340 in term 2.
I20260709 12:15:43.181952 23825 consensus_queue.cc:237] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:43.192662 23425 catalog_manager.cc:5697] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 reported cstate change: term changed from 1 to 2, leader changed from 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131) to 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130). New cstate: current_term: 2 leader_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:43.359783 23678 raft_consensus.cc:1275] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.361133 23847 consensus_queue.cc:1048] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.369791 23603 raft_consensus.cc:1275] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.371615 23884 consensus_queue.cc:1048] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.593720 23603 raft_consensus.cc:1275] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.595247 23741 consensus_queue.cc:1048] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.604584 23678 raft_consensus.cc:1275] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 2b3d620dab1b4f09885aa2676375479e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.606822 23847 consensus_queue.cc:1048] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.691461 23678 raft_consensus.cc:1275] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.692557 23527 raft_consensus.cc:1275] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.692965 23825 consensus_queue.cc:1048] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.694118 23891 consensus_queue.cc:1048] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:43.716614 23527 raft_consensus.cc:1275] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.720188 23676 raft_consensus.cc:1275] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Refusing update from remote peer 4ef0bfb6d3a54eea8f15c3910a602340: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:43.735118 23892 consensus_queue.cc:1048] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.737078 23894 consensus_queue.cc:1048] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:45.775724 23426 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41716:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:45.798283 23426 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41716:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:45.867321  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:46.014559 23495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41813, user_credentials={real_user=slave}} blocked reactor thread for 109376us
I20260709 12:15:46.017714 23932 tablet.cc:1724] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.133517 23945 tablet.cc:1724] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:46.178977 23495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41813, user_credentials={real_user=slave}} blocked reactor thread for 74225.9us
W20260709 12:15:46.203125 23939 log.cc:927] Time spent T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:15:46.202462 23950 tablet.cc:1724] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:46.208052 23937 log.cc:927] Time spent T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:15:46.251873 23932 tablet.cc:1724] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.229852 23955 tablet.cc:1724] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.299177 23960 tablet.cc:1724] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:46.324225 23495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.9.180.130:41813, user_credentials={real_user=slave}} blocked reactor thread for 115436us
I20260709 12:15:46.316859 23950 tablet.cc:1724] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.356407 23966 tablet.cc:1724] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.357776 23524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1"
dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
mode: GRACEFUL
new_leader_uuid: "3f942a2ebb664fd08dc63f3629df639d"
 from {username='slave'} at 127.0.0.1:46208
I20260709 12:15:46.358517 23524 raft_consensus.cc:606] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Received request to transfer leadership to TS 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:46.355868 23967 tablet.cc:1724] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.363703 23965 tablet.cc:1724] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.338698 23959 tablet.cc:1724] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.320371 23945 tablet.cc:1724] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.403676 23932 tablet.cc:1724] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.406713 23964 tablet.cc:1724] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.421305 23960 tablet.cc:1724] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.426729 23950 tablet.cc:1724] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.428674 23945 tablet.cc:1724] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.442384 23970 tablet.cc:1724] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.412979 23968 tablet.cc:1724] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.466771 23970 tablet.cc:1724] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.468114 23932 tablet.cc:1724] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.475152 23966 tablet.cc:1724] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.476862 23960 tablet.cc:1724] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.477736 23601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77"
dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
mode: GRACEFUL
new_leader_uuid: "3f942a2ebb664fd08dc63f3629df639d"
 from {username='slave'} at 127.0.0.1:54756
I20260709 12:15:46.480875 23601 raft_consensus.cc:606] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Received request to transfer leadership to TS 3f942a2ebb664fd08dc63f3629df639d
I20260709 12:15:46.482788  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:46.483690  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:46.484737 23955 tablet.cc:1724] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.495275 23970 tablet.cc:1724] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.499279 23965 tablet.cc:1724] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.507854 23970 tablet.cc:1724] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:46.517724 23427 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde: soft_deleted_table [id=dd8f85222cb945d7a18ebd4e3a0ec028] alter complete (version 1)
I20260709 12:15:46.631362 23963 raft_consensus.cc:993] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: : Instructing follower 3f942a2ebb664fd08dc63f3629df639d to start an election
I20260709 12:15:46.631865 23963 raft_consensus.cc:1081] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Signalling peer 3f942a2ebb664fd08dc63f3629df639d to start an election
I20260709 12:15:46.633419 23673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1"
dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
 from {username='slave'} at 127.0.0.1:58074
I20260709 12:15:46.633980 23673 raft_consensus.cc:493] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:46.634305 23673 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.640672 23673 raft_consensus.cc:515] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:46.642896 23673 leader_election.cc:290] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 3 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:46.644151 23526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:46.644016 23601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80560505d84218ae00206ad6c0d1d1" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:46.645052 23526 raft_consensus.cc:3055] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:46.645152 23601 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.645411 23526 raft_consensus.cc:740] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b3d620dab1b4f09885aa2676375479e, State: Running, Role: LEADER
I20260709 12:15:46.646572 23526 consensus_queue.cc:260] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:46.647601 23526 raft_consensus.cc:3060] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:46.652729 23601 raft_consensus.cc:2468] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 3.
I20260709 12:15:46.653754 23526 raft_consensus.cc:2468] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 3.
I20260709 12:15:46.654115 23644 leader_election.cc:304] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f942a2ebb664fd08dc63f3629df639d, 4ef0bfb6d3a54eea8f15c3910a602340; no voters: 
I20260709 12:15:46.655105 23777 raft_consensus.cc:2804] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:46.655627 23777 raft_consensus.cc:697] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 3 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:46.656590 23777 consensus_queue.cc:237] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:46.666146 23427 catalog_manager.cc:5697] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 2 to 3, leader changed from 2b3d620dab1b4f09885aa2676375479e (127.9.180.129) to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 3 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:46.899210 23921 raft_consensus.cc:993] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: : Instructing follower 3f942a2ebb664fd08dc63f3629df639d to start an election
I20260709 12:15:46.899923 23962 raft_consensus.cc:1081] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Signalling peer 3f942a2ebb664fd08dc63f3629df639d to start an election
I20260709 12:15:46.901814 23673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77"
dest_uuid: "3f942a2ebb664fd08dc63f3629df639d"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:15:46.902477 23673 raft_consensus.cc:493] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:46.902937 23673 raft_consensus.cc:3060] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.908115 23673 raft_consensus.cc:515] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:46.909626 23673 leader_election.cc:290] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 2 election: Requested vote from peers 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843), 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813)
I20260709 12:15:46.910727 23524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b3d620dab1b4f09885aa2676375479e"
I20260709 12:15:46.910949 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a6b39e3e7ae4c29a7a4abdba63a0c77" candidate_uuid: "3f942a2ebb664fd08dc63f3629df639d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ef0bfb6d3a54eea8f15c3910a602340"
I20260709 12:15:46.911717 23602 raft_consensus.cc:3055] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:46.911717 23524 raft_consensus.cc:3060] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.912299 23602 raft_consensus.cc:740] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ef0bfb6d3a54eea8f15c3910a602340, State: Running, Role: LEADER
I20260709 12:15:46.913314 23602 consensus_queue.cc:260] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:46.914883 23602 raft_consensus.cc:3060] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:46.921175 23524 raft_consensus.cc:2468] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 2.
I20260709 12:15:46.922662 23641 leader_election.cc:304] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b3d620dab1b4f09885aa2676375479e, 3f942a2ebb664fd08dc63f3629df639d; no voters: 
I20260709 12:15:46.923695 23777 raft_consensus.cc:2804] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:46.923763 23602 raft_consensus.cc:2468] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f942a2ebb664fd08dc63f3629df639d in term 2.
I20260709 12:15:46.924360 23777 raft_consensus.cc:697] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 2 LEADER]: Becoming Leader. State: Replica: 3f942a2ebb664fd08dc63f3629df639d, State: Running, Role: LEADER
I20260709 12:15:46.925418 23777 consensus_queue.cc:237] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } }
I20260709 12:15:46.933351 23427 catalog_manager.cc:5697] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d reported cstate change: term changed from 1 to 2, leader changed from 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130) to 3f942a2ebb664fd08dc63f3629df639d (127.9.180.131). New cstate: current_term: 2 leader_uuid: "3f942a2ebb664fd08dc63f3629df639d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f942a2ebb664fd08dc63f3629df639d" member_type: VOTER last_known_addr { host: "127.9.180.131" port: 34779 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:47.160095 23602 raft_consensus.cc:1275] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 3 FOLLOWER]: Refusing update from remote peer 3f942a2ebb664fd08dc63f3629df639d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:47.161487 23777 consensus_queue.cc:1048] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:47.172859 23524 raft_consensus.cc:1275] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 3 FOLLOWER]: Refusing update from remote peer 3f942a2ebb664fd08dc63f3629df639d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:47.174721 23777 consensus_queue.cc:1048] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:47.314092 23602 raft_consensus.cc:1275] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Refusing update from remote peer 3f942a2ebb664fd08dc63f3629df639d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:47.315580 23777 consensus_queue.cc:1048] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef0bfb6d3a54eea8f15c3910a602340" member_type: VOTER last_known_addr { host: "127.9.180.130" port: 41813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:47.325450 23524 raft_consensus.cc:1275] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Refusing update from remote peer 3f942a2ebb664fd08dc63f3629df639d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:47.327062 23777 consensus_queue.cc:1048] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b3d620dab1b4f09885aa2676375479e" member_type: VOTER last_known_addr { host: "127.9.180.129" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:47.484722  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:47.490116  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:47.490595  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:48.491688  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:48.498133  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:48.498754  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:49.499836  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:49.505976  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:49.506712  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:50.508255  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:50.516553  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:50.517181  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:51.518450  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:51.524504  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:51.525054  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:52.527289  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:52.538633  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:52.539175  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:53.540395  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:53.545640  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:53.546211  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:54.547408  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:54.554720  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:54.555349  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:55.556459  9938 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:55.561451  9938 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:55.561887  9938 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:56.626950  9938 tablet_server.cc:179] TabletServer@127.9.180.129:0 shutting down...
I20260709 12:15:56.681947  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:56.683276  9938 tablet_replica.cc:333] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.685308  9938 raft_consensus.cc:2243] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.686700  9938 raft_consensus.cc:2272] T 82cb220dcbab4f179724b0860eb16e74 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.690574  9938 tablet_replica.cc:333] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.691407  9938 raft_consensus.cc:2243] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.692452  9938 raft_consensus.cc:2272] T ff569f17fd5d499886b49468f13e3c21 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:56.696247 23641 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 12:15:56.696426  9938 tablet_replica.cc:333] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.697366  9938 raft_consensus.cc:2243] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.698308  9938 raft_consensus.cc:2272] T 840b52347b2a4e85929b6dc352efcea0 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:56.700268 23641 consensus_peers.cc:597] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:56.701967  9938 tablet_replica.cc:333] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.702874  9938 raft_consensus.cc:2243] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.704221  9938 raft_consensus.cc:2272] T 2c7a870b4e0c4c338c8228c9dc323e9d P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.707356  9938 tablet_replica.cc:333] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.708029  9938 raft_consensus.cc:2243] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.709080  9938 raft_consensus.cc:2272] T d48f9aeeac304b869a5cb32ad8a31a48 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.712230  9938 tablet_replica.cc:333] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.712921  9938 raft_consensus.cc:2243] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.713541  9938 raft_consensus.cc:2272] T 3e80560505d84218ae00206ad6c0d1d1 P 2b3d620dab1b4f09885aa2676375479e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.716692  9938 tablet_replica.cc:333] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.717396  9938 raft_consensus.cc:2243] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.717996  9938 raft_consensus.cc:2272] T 09a14abf9e6f4b96b1486997aec37026 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.720738  9938 tablet_replica.cc:333] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.721340  9938 raft_consensus.cc:2243] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.721998  9938 raft_consensus.cc:2272] T 25cc3b41c00843aca4b4ef139107b449 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.724754  9938 tablet_replica.cc:333] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.725380  9938 raft_consensus.cc:2243] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.726110  9938 raft_consensus.cc:2272] T 4b56fa8b099144f6a46ea5ac3a842d05 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.729928  9938 tablet_replica.cc:333] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.730551  9938 raft_consensus.cc:2243] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.731515  9938 raft_consensus.cc:2272] T 758b8f80153f4c0a9ea7295ee27262eb P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.734177  9938 tablet_replica.cc:333] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.734836  9938 raft_consensus.cc:2243] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.735791  9938 raft_consensus.cc:2272] T 8c14687e02a64f759189346beedc1725 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.738384  9938 tablet_replica.cc:333] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.739261  9938 raft_consensus.cc:2243] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.739831  9938 raft_consensus.cc:2272] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.742818  9938 tablet_replica.cc:333] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.743430  9938 raft_consensus.cc:2243] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.743992  9938 raft_consensus.cc:2272] T d72fe4c4490d4e7598aced2ce4e60336 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.746909  9938 tablet_replica.cc:333] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.747539  9938 raft_consensus.cc:2243] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.748092  9938 raft_consensus.cc:2272] T be328d929a7643dab6a0dd73d53b8879 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.750983  9938 tablet_replica.cc:333] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.751763  9938 raft_consensus.cc:2243] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.752318  9938 raft_consensus.cc:2272] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.755187  9938 tablet_replica.cc:333] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.755797  9938 raft_consensus.cc:2243] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.756937  9938 raft_consensus.cc:2272] T 5ee6003f89e8407dac25b04a22dd30c2 P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.760133  9938 tablet_replica.cc:333] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.760696  9938 raft_consensus.cc:2243] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.761397  9938 raft_consensus.cc:2272] T abc69b6dc2954bd790ff3d1bf610b822 P 2b3d620dab1b4f09885aa2676375479e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.764299  9938 tablet_replica.cc:333] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e: stopping tablet replica
I20260709 12:15:56.764854  9938 raft_consensus.cc:2243] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.765911  9938 raft_consensus.cc:2272] T 6ea017fe3a0643469251c58a43f0a52b P 2b3d620dab1b4f09885aa2676375479e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:56.794716 23641 consensus_peers.cc:597] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:56.796384 23567 consensus_peers.cc:597] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:56.824149  9938 tablet_server.cc:196] TabletServer@127.9.180.129:0 shutdown complete.
I20260709 12:15:56.873907  9938 tablet_server.cc:179] TabletServer@127.9.180.130:0 shutting down...
W20260709 12:15:56.884479 23567 consensus_peers.cc:597] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:36843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:56.923099 23567 consensus_peers.cc:597] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:36843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:56.927479  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:56.928442  9938 tablet_replica.cc:333] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.929389  9938 raft_consensus.cc:2243] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.930143  9938 raft_consensus.cc:2272] T 840b52347b2a4e85929b6dc352efcea0 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.932691  9938 tablet_replica.cc:333] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.933370  9938 raft_consensus.cc:2243] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.933907  9938 raft_consensus.cc:2272] T ff569f17fd5d499886b49468f13e3c21 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.936115  9938 tablet_replica.cc:333] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.936721  9938 raft_consensus.cc:2243] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.937237  9938 raft_consensus.cc:2272] T 2c7a870b4e0c4c338c8228c9dc323e9d P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.939826  9938 tablet_replica.cc:333] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.940501  9938 raft_consensus.cc:2243] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.941150  9938 raft_consensus.cc:2272] T d48f9aeeac304b869a5cb32ad8a31a48 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.943759  9938 tablet_replica.cc:333] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.944367  9938 raft_consensus.cc:2243] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.945266  9938 raft_consensus.cc:2272] T d72fe4c4490d4e7598aced2ce4e60336 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.947541  9938 tablet_replica.cc:333] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.948113  9938 raft_consensus.cc:2243] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.948971  9938 raft_consensus.cc:2272] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.951267  9938 tablet_replica.cc:333] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.951886  9938 raft_consensus.cc:2243] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.952342  9938 raft_consensus.cc:2272] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.954453  9938 tablet_replica.cc:333] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.955026  9938 raft_consensus.cc:2243] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.955850  9938 raft_consensus.cc:2272] T be328d929a7643dab6a0dd73d53b8879 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.958048  9938 tablet_replica.cc:333] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.958639  9938 raft_consensus.cc:2243] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.959146  9938 raft_consensus.cc:2272] T 8c14687e02a64f759189346beedc1725 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.961463  9938 tablet_replica.cc:333] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.962339  9938 raft_consensus.cc:2243] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.963033  9938 raft_consensus.cc:2272] T 758b8f80153f4c0a9ea7295ee27262eb P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.965394  9938 tablet_replica.cc:333] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.966027  9938 raft_consensus.cc:2243] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.966532  9938 raft_consensus.cc:2272] T 5ee6003f89e8407dac25b04a22dd30c2 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.968736  9938 tablet_replica.cc:333] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.969285  9938 raft_consensus.cc:2243] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.969802  9938 raft_consensus.cc:2272] T 3e80560505d84218ae00206ad6c0d1d1 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.972070  9938 tablet_replica.cc:333] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.972589  9938 raft_consensus.cc:2243] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.973642  9938 raft_consensus.cc:2272] T 82cb220dcbab4f179724b0860eb16e74 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.976012  9938 tablet_replica.cc:333] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.976577  9938 raft_consensus.cc:2243] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.977661  9938 raft_consensus.cc:2272] T abc69b6dc2954bd790ff3d1bf610b822 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.980517  9938 tablet_replica.cc:333] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.981133  9938 raft_consensus.cc:2243] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.981719  9938 raft_consensus.cc:2272] T 6ea017fe3a0643469251c58a43f0a52b P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.984000  9938 tablet_replica.cc:333] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.984618  9938 raft_consensus.cc:2243] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:56.985843  9938 raft_consensus.cc:2272] T 09a14abf9e6f4b96b1486997aec37026 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.989681  9938 tablet_replica.cc:333] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.990455  9938 raft_consensus.cc:2243] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:15:56.991573 23641 consensus_peers.cc:597] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:36843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:56.991761  9938 raft_consensus.cc:2272] T 25cc3b41c00843aca4b4ef139107b449 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:56.994201  9938 tablet_replica.cc:333] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340: stopping tablet replica
I20260709 12:15:56.994782  9938 raft_consensus.cc:2243] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:56.995242  9938 raft_consensus.cc:2272] T 4b56fa8b099144f6a46ea5ac3a842d05 P 4ef0bfb6d3a54eea8f15c3910a602340 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:57.010805 23644 consensus_peers.cc:597] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d -> Peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Couldn't send request to peer 4ef0bfb6d3a54eea8f15c3910a602340. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:57.044241  9938 tablet_server.cc:196] TabletServer@127.9.180.130:0 shutdown complete.
W20260709 12:15:57.071329 23644 consensus_peers.cc:597] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d -> Peer 4ef0bfb6d3a54eea8f15c3910a602340 (127.9.180.130:41813): Couldn't send request to peer 4ef0bfb6d3a54eea8f15c3910a602340. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.130:41813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:57.086035  9938 tablet_server.cc:179] TabletServer@127.9.180.131:0 shutting down...
W20260709 12:15:57.130973 23641 consensus_peers.cc:597] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d -> Peer 2b3d620dab1b4f09885aa2676375479e (127.9.180.129:36843): Couldn't send request to peer 2b3d620dab1b4f09885aa2676375479e. Status: Network error: Client connection negotiation failed: client connection to 127.9.180.129:36843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:57.131675  9938 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:57.132477  9938 tablet_replica.cc:333] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.133329  9938 raft_consensus.cc:2243] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.133956  9938 raft_consensus.cc:2272] T ff569f17fd5d499886b49468f13e3c21 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.136759  9938 tablet_replica.cc:333] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.137429  9938 raft_consensus.cc:2243] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:57.138384  9938 raft_consensus.cc:2272] T 840b52347b2a4e85929b6dc352efcea0 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.140851  9938 tablet_replica.cc:333] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.141513  9938 raft_consensus.cc:2243] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.142004  9938 raft_consensus.cc:2272] T 3c13afbdf2784b46bba2a3edf2baa9f6 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.144469  9938 tablet_replica.cc:333] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.145076  9938 raft_consensus.cc:2243] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.145576  9938 raft_consensus.cc:2272] T d72fe4c4490d4e7598aced2ce4e60336 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.147979  9938 tablet_replica.cc:333] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.148557  9938 raft_consensus.cc:2243] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.149117  9938 raft_consensus.cc:2272] T d48f9aeeac304b869a5cb32ad8a31a48 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.151455  9938 tablet_replica.cc:333] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.152067  9938 raft_consensus.cc:2243] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.152614  9938 raft_consensus.cc:2272] T 2c7a870b4e0c4c338c8228c9dc323e9d P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.155103  9938 tablet_replica.cc:333] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.155712  9938 raft_consensus.cc:2243] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.156189  9938 raft_consensus.cc:2272] T 5ee6003f89e8407dac25b04a22dd30c2 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.158581  9938 tablet_replica.cc:333] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.159178  9938 raft_consensus.cc:2243] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.159734  9938 raft_consensus.cc:2272] T 82cb220dcbab4f179724b0860eb16e74 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.162118  9938 tablet_replica.cc:333] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.162765  9938 raft_consensus.cc:2243] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.163318  9938 raft_consensus.cc:2272] T abc69b6dc2954bd790ff3d1bf610b822 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.165602  9938 tablet_replica.cc:333] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.166211  9938 raft_consensus.cc:2243] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.166719  9938 raft_consensus.cc:2272] T 6ea017fe3a0643469251c58a43f0a52b P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.169062  9938 tablet_replica.cc:333] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.169634  9938 raft_consensus.cc:2243] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:57.170661  9938 raft_consensus.cc:2272] T 3e80560505d84218ae00206ad6c0d1d1 P 3f942a2ebb664fd08dc63f3629df639d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.172978  9938 tablet_replica.cc:333] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.173628  9938 raft_consensus.cc:2243] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.174114  9938 raft_consensus.cc:2272] T be328d929a7643dab6a0dd73d53b8879 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.176388  9938 tablet_replica.cc:333] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.176921  9938 raft_consensus.cc:2243] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:57.177951  9938 raft_consensus.cc:2272] T 8a6b39e3e7ae4c29a7a4abdba63a0c77 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.180394  9938 tablet_replica.cc:333] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.180974  9938 raft_consensus.cc:2243] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.181514  9938 raft_consensus.cc:2272] T 25cc3b41c00843aca4b4ef139107b449 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.183969  9938 tablet_replica.cc:333] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.184544  9938 raft_consensus.cc:2243] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.185076  9938 raft_consensus.cc:2272] T 09a14abf9e6f4b96b1486997aec37026 P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.187435  9938 tablet_replica.cc:333] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.187990  9938 raft_consensus.cc:2243] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:57.188939  9938 raft_consensus.cc:2272] T 4b56fa8b099144f6a46ea5ac3a842d05 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.191453  9938 tablet_replica.cc:333] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.191982  9938 raft_consensus.cc:2243] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.192490  9938 raft_consensus.cc:2272] T 8c14687e02a64f759189346beedc1725 P 3f942a2ebb664fd08dc63f3629df639d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.194864  9938 tablet_replica.cc:333] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d: stopping tablet replica
I20260709 12:15:57.195402  9938 raft_consensus.cc:2243] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:57.195892  9938 raft_consensus.cc:2272] T 758b8f80153f4c0a9ea7295ee27262eb P 3f942a2ebb664fd08dc63f3629df639d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.241518  9938 tablet_server.cc:196] TabletServer@127.9.180.131:0 shutdown complete.
I20260709 12:15:57.287127  9938 master.cc:562] Master@127.9.180.190:43829 shutting down...
I20260709 12:15:57.316432  9938 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:57.317111  9938 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:57.317411  9938 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4c05a2809d9d4000866789a65ef49bde: stopping tablet replica
I20260709 12:15:57.339941  9938 master.cc:584] Master@127.9.180.190:43829 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20969 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43475 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (461712 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:15:57.403429  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2239 messages since previous log ~32 seconds ago
I20260709 12:15:57.403677  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2239 messages since previous log ~32 seconds ago
I20260709 12:15:57.403846  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2236 messages since previous log ~32 seconds ago
I20260709 12:15:57.404071  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:15:57.404290  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:15:57.404539  9938 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 4 messages since previous log ~292 seconds ago
I20260709 12:15:57.404704  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~292 seconds ago
I20260709 12:15:57.404922  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~200 seconds ago
I20260709 12:15:57.405210  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 12:15:57.405507  9938 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
